Microsoft has released the Phi-2 compact language model, which outperforms Llama 2 and Mistral 7B

Microsoft

Microsoft has released Phi-2, a compact language model that outperforms counterparts from Meta and other tech giants. It contains 2.7 billion parameters and can even run on a laptop.

Here's What We Know

According to the developers, Phi-2's performance is comparable to much larger models like Meta's Llama 2 or Mistral-7B, which contain 7 billion parameters each. Phi-2 is also ahead of Google's recently announced Gemini Nano 2, which has half a billion fewer parameters.

Performance comparison between Phi-2 and other jazikoi models.

Microsoft's new development also shows less toxicity and response bias compared to Llama 2. In the demo, Phi-2, like Google's Gemini Ultra, was able to answer a student's question correctly.

An example of the Phi-2 model answering a question.

For now, Phi-2 is only licensed for research purposes and not for commercial use.

Source: Microsoft