Live conversation instead of selecting lines: Ubisoft has unveiled the first details of its experimental Neo NPC technology based on generative artificial intelligence

At the Game Developers Conference (GDC) Ubisoft presented the first details of the experimental Neo NPC technology, which in the future will allow gamers to communicate with characters not with the help of prepared lines, but in the format of a live conversation.

Here's What We Know

Neo NPC is based on generative artificial intelligence, which analyses the player's queries and phrases and composes reasonable and natural answers.

Gamer will be able to build relationships with characters, for each of which AI separately prescribes the character, behavioural model, interaction with the player and variants of reactions to the user's actions. Moreover, the AI will be able to distinguish between negative attitudes towards the character and realistically respond to provocations from the player.

Neo NPC is created in cooperation with Inworld AI and using Nvidia technologies.

The AI engages the following programmes:

• A speech analyser that turns speech into text;
• Inworld AI's Character engine, which determines how the NPC will act and react;
• a text-to-speech programme that generates a verbal response;
• Nvidia's Audio2Face technology, a real-time facial animation system that makes the NPC's lips and facial expressions match the words being spoken.

Ubisoft CEO Yves Guillemot praises the prospects and possibilities of generative artificial intelligence and notes that his company will continue to explore and develop this area.

Source: Ubisoft