bleh.au
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
FactChecker@lemmy.world to science@lemmy.worldEnglish · 3 months ago

Large-scale online deanonymization with LLMs

arxiv.org

external-link
message-square
10
link
fedilink
  • cross-posted to:
  • privacy@lemmy.ml
  • technology@lemmy.world
1
external-link

Large-scale online deanonymization with LLMs

arxiv.org

FactChecker@lemmy.world to science@lemmy.worldEnglish · 3 months ago
message-square
10
link
fedilink
  • cross-posted to:
  • privacy@lemmy.ml
  • technology@lemmy.world
We show that large language models can be used to perform at-scale deanonymization. With full Internet access, our agent can re-identify Hacker News users and Anthropic Interviewer participants at high precision, given pseudonymous online profiles and conversations alone, matching what would take hours for a dedicated human investigator. We then design attacks for the closed-world setting. Given two databases of pseudonymous individuals, each containing unstructured text written by or about that individual, we implement a scalable attack pipeline that uses LLMs to: (1) extract identity-relevant features, (2) search for candidate matches via semantic embeddings, and (3) reason over top candidates to verify matches and reduce false positives. Compared to classical deanonymization work (e.g., on the Netflix prize) that required structured data, our approach works directly on raw user content across arbitrary platforms. We construct three datasets with known ground-truth data to evaluate our attacks. The first links Hacker News to LinkedIn profiles, using cross-platform references that appear in the profiles. Our second dataset matches users across Reddit movie discussion communities; and the third splits a single user's Reddit history in time to create two pseudonymous profiles to be matched. In each setting, LLM-based methods substantially outperform classical baselines, achieving up to 68% recall at 90% precision compared to near 0% for the best non-LLM method. Our results show that the practical obscurity protecting pseudonymous users online no longer holds and that threat models for online privacy need to be reconsidered.
  • WesternInfidels@feddit.online
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    3 months ago

    “ChatGPT, please rewrite this inflammatory post full of libelous accusations using the rhetorical style of my worst enemy.”

    • [deleted]@piefed.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      spits out the text with no changes

science@lemmy.world

science@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !science@lemmy.world

A community to post scientific articles, news, and civil discussion.

dart board;; science bs

rule #1: be kind

lemmy.world rules

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 5 users / day
  • 219 users / week
  • 924 users / month
  • 2.02K users / 6 months
  • 0 local subscribers
  • 27.2K subscribers
  • 648 Posts
  • 4.7K Comments
  • Modlog
  • mods:
  • laverabe@lemmy.world
  • m3t00🌎🇺🇦@lemmy.world
  • Joleee@lemmy.world
  • DeadPand@midwest.social
  • laverabe@lemmy.zip
  • BE: 0.19.15
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org