Amazon announced Trainium 2 and Graviton 4 chips for training and running AI models

By: Bohdan Kaminskyi | 29.11.2023, 13:11
Amazon announced Trainium 2 and Graviton 4 chips for training and running AI models
Amazon

AWS, Amazon's cloud computing division, has unveiled updated versions of its AI chips designed to train machine learning algorithms and then deploy finished models.

Here's What We Know

The Trainium 2 chip shows a four-fold increase in performance and a two-fold increase in power efficiency compared to the first version. This will enable faster and cheaper training of neural networks. Anthropic has already announced the use of Trainium 2.

The Graviton 4 processor is focused on running off-the-shelf AI models. It promises a 30% performance boost over its peers with lower power consumption. This should reduce cloud computing costs for AWS customers when running AI.

Amazon announced Trainium 2 and Graviton 4 chips for training and running AI models-2
AWS Graviton 4 and AWS Trainium 2 prototypes

The new chips will become available in the AWS cloud in the coming months. In parallel, Amazon will continue its co-operation with NVIDIA.

Source: Amazon