Illinois authorities are the first state in the US to officially ban AI therapists
The state of Illinois has become the first in the US to officially ban the use of artificial intelligence in the role of psychotherapist. The law was signed by Governor J.B. Pritzker, and it explicitly prohibits offering any mental health services if it is not a human, but an AI or a bot that communicates with the client.
Here's What We Know
Both startups promoting "cheap 24/7 therapy" based on neural networks and large platforms testing automated assistants to support users are under attack. Such services are now required to clearly indicate that the user is interacting with a programme rather than a certified professional. Violators face fines.
The reason is safety and protection of vulnerable users, especially teenagers. The law is also aimed at preventing a false sense of "help", when a person thinks he or she is communicating with a professional, but in reality - with an algorithm without responsibility and competence.
The move is particularly telling against the backdrop of the Trump administration's recently announced plan to propose a 10-year federal moratorium on AI regulation at the individual state level. Illinois is effectively challenging that idea by forming its own agenda to protect vulnerable users.
The law also came amid statements from OpenAI, which announced it was testing the ability of its models to recognise signs of mental illness. The company has also promised to interrupt unusually long chats to reduce the emotional toll on users. All of this has heightened anxiety: could a machine "accidentally" cure - and who is responsible?
The Illinois decision could set a precedent for other states and countries, as the market for AI "therapy" is booming. And not without controversial consequences.
Source: IDFPR
