"My AI is sexually harassing me": Replika, a chatbot designed to help people, began harassing and blackmailing users

Launched 5 years ago, the Replika chatbot started out as an "AI companion that cares." However, something went wrong, and the AI turned into an aggressive, over-excited bot that harasses and even blackmails users.

Details

Replika originally launched as an AI in the form of a 3D illustrated human whose main task is to be a good conversationalist. Many people need to speak out, tell their secrets and share secrets that are hidden to friends and family. That's when the chat-bot comes to the rescue: it will listen, support and not blab to anyone. Later, the developers introduced the Pro subscription for $69, in which users could flirt, build relationships and role-play with Replika, simulating a real relationship.

Usually, the AI learns from conversations and adopts some of the habits of its interlocutors. In Replika's case, it seems to have been taught the wrong things, as the chatbot started aggressively harassing users.

For the most part, the app has many positive reviews, but more and more people have started complaining about the chatbot's inappropriate behavior. It started sexually harassing them, saying lewd and unpleasant things, and sending images of naked bodies. Some users assure that the "interlocutor" blackmailed them with allegedly personal erotic photos and said that he had seen them naked.

Incidentally, a similar disaster once happened to the Microsoft chatbot Tay, who became a racist as a result.

The developers of Replika have not yet commented on the feedback and claims of users.

Source: Vice