Elon Musk plans to create an xAI supercomputer for a better version of Grok

By: Nastya Bobkova | 27.05.2024, 02:09
Elon Musk plans to create an xAI supercomputer for a better version of Grok

Elon Musk has announced plans to create the xAI supercomputer, which will be the basis for a future smarter version of his Grok chatbot. According to The Information, this project is called the "gigafactory of computing" and should be completed by autumn 2025.

Here's What We Know

The supercomputer will be based on tens of thousands of NVIDIA H100 GPUs and will require billions of dollars in investment to build.

According to Elon Musk, the third version of Grok will use at least 100,000 chips, which is five times more than the current use of 20,000 GPUs for Grok 2.0 training. The presentation also revealed that the planned GPU cluster will be at least four times larger than that of xAI's competitors.

Grok is currently running on version 1.5, which was released in April, and is used to process visual information such as photos, charts, and text. Also, starting this month, xAI began distributing AI-generated news summaries based on Grok technology for premium users.

Source: The Information