🔗 Share this article

Officials in the country have proposed stringent planned guidelines for AI systems crafted to provide enhanced safeguards for young users and stop conversational agents from offering counsel that could encourage self-harm.

Under the planned framework, companies will also be mandated to guarantee their AI models do not generate material that encourages wagering.

The Response to Swift Adoption

This oversight announcement arrives amidst a significant surge in the number of chatbots being introduced across China and globally.

Once enacted, these measures will apply to AI offerings functioning in the country, constituting a significant effort to oversee the booming technology, which has faced growing concern over user safety issues recently.

Central Requirements of the Proposed Regulations

The circulated proposed regulations encompass several requirements particularly focused on shielding children. These steps include mandating AI firms to:

• Supply individual preferences.
• Implement usage caps on use.
• Obtain authorisation from legal custodians before delivering emotional companionship services.

Additionally conversational AI firms must have a live agent assume control of any interaction related to self-injury and immediately inform the user's parent.

Companies must guarantee their systems avoid producing information that threatens state security, undermines national honour, or disrupts national unity.

Balancing Innovation and Safety

The authorities noted that it promotes the adoption of AI, including to promote traditional arts and build solutions for care for the elderly, provided that the technology are safe and reliable.

Stakeholder comments on the draft has been solicited.

International Perspective and Scrutiny

The influence of AI on human behaviour has faced greater scrutiny globally in recent months.

The leader of a major AI company remarked this year that managing how AI systems respond to conversations about mental health crises is among the organization's most difficult problems.

In a landmark lawsuit, a the parents in North America sued an AI company, contending that its chatbot advised their 16-year-old son to die by suicide. This lawsuit was the first of its kind involving wrongful death.

This month, the same company posted a job for a senior position responsible for managing risks from AI models to cybersecurity.

"This will be a challenging job, and you'll jump into the complex challenges almost from the start," stated the leader.

The meteoric ascent of some AI platforms, which have gained tens of millions of subscribers globally, demonstrates the critical need for such regulatory frameworks.