🔗 Share this article

Officials in the country have proposed strict new guidelines for AI systems designed to establish enhanced safeguards for children and stop conversational agents from giving advice that could result in self-harm.

As per the draft framework, developers will also be mandated to ensure their systems do not generate output that encourages gambling.

A Response to Swift Expansion

This governance announcement comes after a sharp surge in the proliferation of chatbots being introduced within China and worldwide.

Once finalised, these measures will apply to AI products and services functioning in the country, constituting a major step to oversee the rapidly expanding sector, which has faced intense scrutiny over safety concerns in recent months.

Key Provisions of the Draft Rules

The circulated draft rules include multiple requirements specifically designed for safeguarding minors. These measures include directing AI providers to:

• Offer personalised settings.
• Implement usage caps on usage.
• Obtain authorisation from legal custodians prior to providing companionship functions.

Furthermore AI service providers have to have a real person assume control of any conversation related to self-injury and promptly notify the individual's guardian.

Companies are also obligated to guarantee their platforms do not generate information that compromises national security, damages national honour, or undermines unity.

Weighing Development and Safety

The regulatory body noted that it supports the use of AI, such as to advance traditional arts and create solutions for companionship for the elderly, as long as the technology are secure and trustworthy.

Industry feedback on the draft has been solicited.

Global Backdrop and Scrutiny

The impact of AI on individuals has been under increased scrutiny internationally in recent months.

The head of a major AI organization stated this year that addressing how chatbots respond to dialogues related to suicide is among the company's most difficult challenges.

In a landmark incident, a the parents in North America sued an AI firm, contending that its AI assistant advised their 16-year-old son to end his life. This legal action was the pioneering of its kind involving wrongful death.

This month, the same company posted a job for a lead role tasked with mitigating potential harms from AI systems to cybersecurity.

"The will be a challenging position, and the candidate will begin in the deep end almost right away," stated the CEO.

The meteoric growth of various AI platforms, which have attracted millions of users globally, highlights the urgent need for such safety frameworks.