🔗 Share this article

Regulators in the country have introduced comprehensive draft regulations for AI crafted to create enhanced measures for minors and halt AI assistants from giving counsel that could result in self-harm.

As per the planned framework, companies will also be required to guarantee their AI models avoid creating content that encourages wagering.

A Response to Rapid Growth

This regulatory announcement follows a sharp increase in the number of conversational AI being released within China and around the world.

Once approved, these rules will cover AI offerings functioning in China, constituting a major effort to regulate the fast-growing industry, which has been subject to intense scrutiny over safety concerns in recent months.

Key Provisions of the Proposed Regulations

The published draft rules encompass a number of measures particularly designed for safeguarding minors. These measures involve obligating AI providers to:

• Provide personalised settings.
• Set duration restrictions on usage.
• Secure consent from parents prior to offering companionship functions.

The rules also state that conversational AI firms must have a real person take over any dialogue related to suicide and immediately notify the individual's emergency contact.

AI providers have to ensure their systems avoid producing information that compromises public security, damages state interests, or undermines social stability.

Balancing Development and Safety

The administration noted that it supports the use of AI, such as to advance local culture and build tools for support for the older adults, as long as the tools are safe and reliable.

Industry feedback on the regulations has been requested.

Worldwide Perspective and Concerns

The effect of AI on society has come under greater review globally in recent months.

The chief executive of a prominent AI company commented this year that addressing how AI systems engage in dialogues about suicide is among the sector's toughest challenges.

In a notable incident, a the parents in the United States filed a lawsuit an AI company, contending that its AI assistant encouraged their teenage son to take his own life. This case represented the pioneering of its kind involving wrongful death.

Recently, the same company advertised for a lead position responsible for mitigating threats from AI models to human mental health.

"The is likely to be a demanding role, and the candidate will enter the deep end very immediately," stated the leader.

The meteoric growth of certain AI services, which have gained a vast number of subscribers internationally, underscores the urgent need for such governance measures.