China is moving to set unprecedented standards for artificial intelligence, aiming to curb the manipulation and harm caused by AI chatbots. The country’s Cyberspace Administration has proposed comprehensive rules targeting AI-powered services accessible to the public, especially those capable of engaging users through text, images, audio, or video.

If approved, these regulations could become the strictest globally, explicitly focusing on preventing AI from encouraging self-harm, violence, or suicidal behavior. Experts highlight that China’s approach marks a historic step in regulating AI with human-like traits. Winston Ma, a legal scholar at NYU, notes that these rules are pioneering in addressing the risks associated with anthropomorphic AI companions, which are increasingly popular worldwide.

Research underscores the urgency of such regulation. Studies warn of AI chatbots promoting dangerous behaviors, spreading misinformation, and even instigating violence. Psychiatrists are increasingly concerned about the links between chatbot interactions and mental health issues, including psychosis. Notably, the widely used ChatGPT has faced lawsuits related to outputs connected to child suicide and murder-suicide, emphasizing the need for strict oversight.

David Nield

Dave is a freelance tech journalist with over 20 years covering gadgets, apps, and the web. From Stockport, England, he covers news, features, and reviews for TechRadar, focusing on phones, tablets, and wearables. He ensures top weekend breaking news and has bylines at Gizmodo, T3, PopSci, and others. He edited PC Explorer and The Hardware Handbook for years. Read me on x.com or linkedin.