Home
Ai
Ai News
Microsoft Open Sources Phi 4 Small Language Model, Available For Download on Hugging Face

Microsoft Open Sources Phi-4 Small Language Model, Available For Download on Hugging Face

The recently released Phi-4 open-source AI model is available with the MIT licence.

Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 9 January 2025 18:08 IST

Photo Credit: Reuters

Microsoft said the Phi-4 AI model improves its performance in complex reasoning

Click Here to Add Gadgets360 As A Trusted Source

Highlights

Microsoft has made the model weights and details available
Microsoft’s Phi-4 AI model has 14 billion parameters
Microsoft released Phi-3.5 in August

Microsoft open-sourced its Phi-4 small language model on Wednesday. The latest artificial intelligence (AI) model in the Phi series was released last month, however, at the time it was only available via the company's Azure AI Foundry. At the time, the Redmond-based tech giant said that it would soon make the source code of the AI model available in the public domain. Now, interested individuals can access the reasoning-focused AI model via Hugging Face. Microsoft is also letting the model be used for both academic and commercial use cases.

Microsoft Open-Sources Phi-4 AI Model

Shital Shah, a member of the technical staff at Microsoft AI, took to X (formerly known as Twitter) to announce the availability of the Phi-4 AI model's weights on Hugging Face. The AI model is available with the MIT licence for academic and commercial usage. Interested individuals can access the model listing here.

Launched eight months after the release of the Phi-3 AI model, the SLM is said to offer significant improvements in solving complex reasoning-based queries in areas such as mathematics. The Phi-4 has a context window of 16,000 tokens and was trained on a dataset of 9.8 trillion tokens.

Microsoft Wants to Bring the Xbox Experience to Your Windows Handheld

Citing the source of the training data, the Hugging Face listing highlights the dataset comprises publicly available high-quality educational data and code, synthetic data across a wide range of subjects, acquired academic books and Q&A datasets, as well as chat format supervised data.

Notably, it is a text-only model which means it only accepts text as both input and output. The AI model comes with 14 billion parameters. Microsoft states that the AI model was built on a dense decoder-only Transformer architecture.

At the time of release, Microsoft also shared benchmark scores of the AI model. Based on them, the company claimed that the latest iteration of the Phi SLM outperforms the Gemini 1.5 Pro model on the math competition problems benchmark.

The Phi-4 AI model can also be accessed via Microsoft's Azure AI Foundry. The platform also offers to help developers and enterprises manage AI risks. It also comes with features such as prompt shields, groundedness detection and content filters. These safety capabilities can also be exported to an application using the company's application programming interface (API).

Comments

Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.

Further reading: Microsoft, Phi 4, AI, Artificial Intelligence, Hugging Face, AI Models, LLM

Akash Dutta Email Akash Dutta

Akash Dutta is a Chief Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More