DistantNews
Support us
๐Ÿ‡ฐ๐Ÿ‡ท South Korea /Crime & Justice

YouTuber arrested for spreading AI-generated fake news

From Hankyoreh · () Korean

Translated from Korean, summarized and contextualized by DistantNews.

At a glance

News Named sources Under investigation
  • A YouTuber in Busan, South Korea, has been referred to prosecutors for allegedly using generative AI to create and spread fabricated videos on social media.
  • The videos falsely claimed sensitive events, such as oil reserves being sent to North Korea and a private military company landing in Yeouido.
  • The suspect continued to post fake videos even while under police investigation, aiming to profit from them.

Busan police have referred a YouTuber in his 40s to prosecutors on charges of violating the Electronic Communications Basic Act for repeatedly creating and distributing fake videos using generative artificial intelligence. The suspect, identified by the initial 'A', is accused of posting fabricated content on his YouTube channel, aiming to mislead the public on socially sensitive issues.

Among the false claims spread by 'A' were that 900,000 barrels of oil reserves had been transferred to North Korea, that a U.S. private military company had landed in Seoul's Yeouido district, and that an arrest operation was underway for former Ministry of the Interior and Safety officials and specific political figures related to election fraud. These videos were created using generative AI programs, which the suspect allegedly prompted repeatedly to elicit desired false information.

The suspect used generative AI to repeatedly ask questions to induce a specific conclusion, and based on that, received the desired false information and created the video.

โ€” Police officialExplaining how the YouTuber allegedly manipulated AI to create fabricated content.

Even while under police investigation for these actions, 'A' continued to produce and upload fabricated videos. These later posts included false claims about Chinese masked police engaging in violence in Jamsil and an attempted arson attack beneath the Jamsil handball stadium. The suspect reportedly admitted to posting the videos but claimed the content was merely what the AI provided.

Police confirmed that 'A' used generative AI to create videos that steered towards specific conclusions, suggesting a deliberate manipulation of the technology. Investigators believe the suspect disseminated these false narratives for profit, potentially earning around 10 million won (approximately $7,200 USD) from YouTube revenue. Police have requested the pre-prosecution seizure of these earnings and vowed strict action against such criminal activities that cause social chaos.

Because the act of creating and spreading clear falsehoods using AI for profit is causing social chaos, we will respond strictly to related crimes.

โ€” Police officialStating the police's commitment to combating the spread of AI-generated disinformation.
DistantNews Editorial

Originally published by Hankyoreh in Korean. Translated, summarized, and contextualized by our editorial team with added local perspective. Read our editorial standards.