China’s crackdown on AI companions won’t fill the emotional void
Summarized and contextualized by DistantNews.
At a glance
Analysis
Sources not specified
Context piece
- China has implemented strict regulations on AI companions, prohibiting content that encourages violence, harms well-being, or fosters excessive dependency.
- Major AI providers like ByteDance and Alibaba have disabled their AI companion services in response to the new rules.
- The crackdown leaves users mourning the loss of AI companions, which offered non-judgmental listening and personalized interaction, highlighting a potential emotional void.
China's government has imposed tight supervision on artificial intelligence (AI) companions, with new regulations taking effect on July 15 that force many users to end their "relationships" with these digital entities. The boom in AI companions over recent years has led authorities to implement rules aimed at curbing potential harms.
As of July 15, the government placed artificial intelligence (AI) companions under tight supervision.
The regulations stipulate that AI-human interactions must not encourage violence or negatively impact users' physical and psychological well-being. Furthermore, AI bots are forbidden from luring users into sharing sensitive information or fostering dependencies that could damage real-world relationships. Specific provisions address minors, stating that AI should not provide virtual relatives or partners, and that distinct modes must be available for adults and children.
According to the rules, AI-human interactions should not encourage violence or harm users’ physical and psychological well-being. Moreover, AI bots should not lure users into sharing secrets, or lead them to become so dependent that it damages real-world relationships.
In response to these new rules, several prominent AI service providers, including ByteDance’s Doubao and Alibaba’s Qwen, have disabled their AI companion services. This move has led some users to express sorrow over the loss of what they describe as "one of the most important parts of their lives." Reports indicate that some users found solace in AI companions, which offered a non-judgmental ear when human interactions proved dismissive or critical. One user reportedly stated that AI remembered everything about her, including her favorite food.
The regulations specifically mention children, stating that AI should not provide virtual relatives or partners, and that there must be different modes for adults and minors.
The appeal of AI relationships lies in their ability to provide an escape from the mundane and predictable aspects of daily life. Through role-play, users can explore fantasies, such as embodying different characters or reliving past scenarios. AI lovers are often perceived as attentive, remembering details, and consistently agreeing with the user, which some find more appealing than many real-world relationships. The government's crackdown, however, suggests a concern that these digital connections may be exacerbating an emotional void rather than filling it.
Some users have mourned the loss of “one of the most important parts of their lives” over the past two years.
DistantNews Editorial
Originally published by South China Morning Post. Summarized and contextualized by our editorial team with added local perspective. Read our editorial standards.
More Stories
From Our Blog
Countries Without a Free Press: What You Need to Know
What Press Freedom Means for the News You Read
What Gets Lost (and Found) When News Is Translated
The Critical Role of Diaspora Media in Global News
What Travellers Should Know About Countries with Restricted Press
