PDF.

We show that large language models can be used to perform at-scale deanonymization. With full Internet access, our agent can re-identify Hacker News users and Anthropic Interviewer participants at high precision, given pseudonymous online profiles and conversations alone, matching what would take hours for a dedicated human investigator. We then design attacks for the closed-world setting. Given two databases of pseudonymous individuals, each containing unstructured text written by or about that individual, we implement a scalable attack pipeline that uses LLMs to: (1) extract identity-relevant features, (2) search for candidate matches via semantic embeddings, and (3) reason over top candidates to verify matches and reduce false positives. Compared to prior deanonymization work (e.g., on the Netflix prize) that required structured data or manual feature engineering, our approach works directly on raw user content across arbitrary platforms. We construct three datasets with known ground-truth data to evaluate our attacks. The first links Hacker News to LinkedIn profiles, using cross-platform references that appear in the profiles. Our second dataset matches users across Reddit movie discussion communities; and the third splits a single user's Reddit history in time to create two pseudonymous profiles to be matched. In each setting, LLM-based methods substantially outperform classical baselines, achieving up to 68% recall at 90% precision compared to near 0% for the best non-LLM method. Our results show that the practical obscurity protecting pseudonymous users online no longer holds and that threat models for online privacy need to be reconsidered.

you are viewing a single comment's thread
view the rest of the comments
[+] 2 points 8 months ago (6 children)
  • [–] 1 point 8 months ago (5 children)

    The internet can mostly die as far as I'm concerned. Just roll it back to file servers again, or something like gemspace. But being able to talk with people across cultures, borders freely is really important. It's a tragedy that all these people will be hurt by the dystopification of the web. The new web needs to have a safe way to converse socially that is safe and easy enough to use for lay people. I have so much more to say on this, but real life is calling so I'll leave it at this.

    I don't really get your point about markets though. I'm genuinely trying to understand, so bear with me. This is what I got from your post:

    Our market has coexisted with an extremely fast global communication network for decades now. Given that the market feels like a quite organic thing, on what authority is the market not meant to coexists with the internet?

    I think that internet access is restricted because of technological constraints, a technological lag in rolling out higher speed infrastructure, and a the lack of demand for that access which is driven by technological and practical constraint. Some complex function of those factors haha. Still, I don't really know what you are trying to get across.

  • source
  • parent
  • hideshow 5 child comments
  • [+] 2 points 8 months ago (4 children)
  • [–] 2 points 8 months ago (3 children)

    Thanks for explaining your thoughts. So to paraphrase you: you are saying that the market and by proxy, nations too, Are still adapting to the concept of the internet. One way to cope with the effects is to restricted access?

  • source
  • parent
  • hideshow 3 child comments
  • [+] 1 point 8 months ago* (2 children)
  • [–] 2 points 8 months ago (1 child)

    You have a lot say on this. Its good that someone thinks about these thing. I'm sorry that I can't really provide you with a good discussion. I don't know enough about markets etc and I don't want to spend too long online.

    I agree that can't really stamp out openness and anonymity online (which is beautiful in a way) but I think that will mostly be reserved to technically capable users in the cracks and niches of the web who can navigate the restrictions. This is a massive tragedy.

    This brings us to the current state of the web with age restrictions popping up everywhere, deanonimization etc. I think that we are in agreement regarding where it is going. Where you think we should be heading. I'm sure you have opinios on that

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)