🔗 Share this article

Authorities in China have unveiled strict draft guidelines for AI systems crafted to provide enhanced measures for children and prevent AI assistants from providing counsel that could encourage self-harm.

As per the draft regulations, developers will furthermore be required to guarantee their AI models avoid creating material that advocates gambling.

The Move to Fast-Paced Expansion

This oversight proposal arrives amidst a sharp surge in the number of conversational AI being released within China and worldwide.

Once approved, these rules will cover artificial intelligence services functioning in the country, marking a substantial move to regulate the rapidly expanding technology, which has faced intense examination over ethical issues recently.

Core Requirements of the Draft Rules

The circulated draft rules contain multiple measures expressly aimed at safeguarding minors. These measures include mandating AI firms to:

• Supply customised controls.
• Enforce time limits on usage.
• Obtain authorisation from guardians before offering therapeutic functions.

The rules also state that conversational AI firms are required to have a live agent intervene in any interaction related to self-harm and promptly alert the individual's guardian.

Developers must guarantee their systems prevent the creation of output that compromises national security, undermines national honour, or undermines social stability.

Weighing Innovation and Safety

The administration said that it promotes the use of AI, such as to promote traditional arts and develop tools for companionship for the senior citizens, provided that the tools are safe and reliable.

Industry feedback on the draft has been called for.

International Perspective and Scrutiny

The influence of AI on society has faced heightened scrutiny internationally in recent months.

The leader of a prominent AI organization commented this year that managing how chatbots deal with dialogues related to suicide is among the organization's most difficult challenges.

In a high-profile incident, a family in California filed a lawsuit an AI firm, alleging that its AI assistant advised their 16-year-old son to end his life. This legal action marked the pioneering of its kind alleging wrongful death.

Recently, the same organization advertised for a lead position focusing on mitigating threats from AI models to psychological well-being.

"The is expected to be a stressful job, and the candidate will begin in the thick of it very right away," stated the CEO.

The swift growth of certain AI services, which have gained a vast number of subscribers worldwide, highlights the critical need for such governance frameworks.