Meta will release compact Llama 3 models before the release of the big version - media outlet

Meta plans to launch several smaller versions of its Llama 3 language model as early as this month, before releasing flagship models in summer 2024.

Here's What We Know

According to media reports, Meta intends to release two smaller versions of Llama 3 in the coming weeks. The company already has a smaller version of the Llama 2 7B, which it unveiled in 2023.

Apart from this, Meta's Llama 3 may be "freer" in answering controversial questions compared to the previous version.

Other big players like Google with Gemma models and France's Mistral with Mistral 7B have also recently released their compact AI models.

Typically, the scaled-down versions do not have all the features of the full-fledged models. However, they are faster, more flexible and, most importantly, cheaper to operate.

Despite their limitations, compact models remain powerful AI systems capable of performing tasks like summarizing text documents, conducting dialogues, and even writing code. They appeal to users who don't need all the functionality of larger language models, such as for use on devices with limited computing resources.

Source: The Verge