Scammers Use AI Personas on TikTok, Deceiving Users While Platform Fails to Act
Translated from Swedish, summarized and contextualized by DistantNews.
At a glance
News
Named sources
Under investigation
- Scammers are using AI-generated personas on TikTok to sell fake handmade products.
- These fake creators target vulnerable groups like people with Down syndrome or war veterans.
- TikTok is failing to enforce its own rules, allowing hundreds of deceptive videos to remain online.
A disturbing trend has emerged on TikTok where scammers are exploiting artificial intelligence to create fake personas, preying on user sympathy to sell non-existent handmade goods. These deceptive campaigns often feature fabricated individuals, including those with Down syndrome, injured war veterans, and bullied teenagers, depicted in tearful videos.
The scam involves presenting these AI-generated characters as creators of handmade clothing and bags. Viewers are encouraged to purchase these items, with the implication that they are supporting individuals in need. However, investigations reveal that the people in the videos do not exist, and the products are likely mass-produced, possibly originating from China.
They are young people with Down syndrome, injured war veterans, and bullied girls. They want you to buy their handmade clothes and bags, which they show in tearful clips on TikTok. But it's all AI-generated. The people don't exist. The products are mass-produced, probably from China.
Despite clear violations of TikTok's platform rules against deceptive practices and impersonation, hundreds of these misleading videos continue to receive approval. Dagens Nyheter has uncovered that the platform's content moderation is failing to identify and remove these fraudulent clips, allowing the scam to flourish. This failure raises serious questions about TikTok's commitment to user safety and its effectiveness in combating AI-driven disinformation and fraud.
A clear violation of TikTok's rules – but DN can now reveal that hundreds of clips are given the green light even though the platform reviews them.
DistantNews Editorial
Originally published by Dagens Nyheter in Swedish. Translated, summarized, and contextualized by our editorial team with added local perspective. Read our editorial standards.
More Stories
From Our Blog
What Gets Lost (and Found) When News Is Translated
The Critical Role of Diaspora Media in Global News
What Travellers Should Know About Countries with Restricted Press
A Digital Nomad's Guide to Following Local News
How the Same Story Looks Different in Different Countries
