Artificial intelligence chatbots can create software in 7 minutes for less than $1 - study

By: Bohdan Kaminskyi | 13.09.2023, 20:32

AI bots work in a hypothetical ChatDev company. Provided by researcher Chen Qian.

According to a new study, chatbots like ChatGPT can effectively run a company and develop software with minimal human involvement.

Here's What We Know

A team of researchers from Brown University and Chinese universities conducted an experiment with the ChatGPT 3.5 model. They simulated the work of a hypothetical ChatDev company without prior training of bots.

They divided the software development process into four phases:

  • Design
  • Coding
  • Testing
  • Documentation

The researchers assigned specific roles to the bots and assigned each of them to a specific stage. The agents communicated with each other with minimal human involvement.

The experiment showed that ChatDev could fully develop software in less than 7 minutes at a cost of less than $1. At the same time, the bots found and fixed vulnerabilities using "memory" and "self-reflection."

According to the study, about 86% of the software created worked flawlessly. However, bugs were identified due to flaws in language models.

Nevertheless, the authors believe that the results can help novice developers.

Source: arXiv