MediaTek Announces Optimisation of Microsoft’s Phi-3.5 AI Models on Dimensity Chipsets

The models are now optimised for the MediaTek Dimensity 9400, 9300, and 8300 chipsets.

Advertisement
Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 24 December 2024 13:40 IST
Highlights
  • Microsoft released the Phi-3.5 small language models in August
  • Phi-3.5 is also optimised for MediaTek's NeuroPilot SDK toolkit
  • MediaTek said its mobile platforms will support on-device AI inference
MediaTek Announces Optimisation of Microsoft’s Phi-3.5 AI Models on Dimensity Chipsets

The Phi-3.5 Mixture of Experts (MoE) supports 1,28,000 tokens context length

Photo Credit: MediaTek

MediaTek announced on Monday that it has now optimised several of its mobile platforms for Microsoft's Phi-3.5 artificial intelligence (AI) models. The Phi-3.5 series of small language models (SLMs), comprising Phi-3.5 Mixture of Experts (MoE), Phi-3.5 Mini, and Phi-3.5 Vision, was released in August. The open-source AI models were made available on Hugging Face. Instead of being typical conversational models, these were instruct models that require users to input specific instructions to get the desired output.

MediaTek Optimises Dimensity Chipsets for Phi-3.5 SLMs

In a blog post, MediaTek announced that its Dimenisty 9400, Dimensity 9300, and Dimensity 8300 chipsets are now optimised for the Phi-3.5 AI models. With this, these mobile platforms can efficiently process and run inference for on-device generative AI tasks using MediaTek's neural processing units (NPUs).

Optimising a chipset for a specific AI model involves tailoring the hardware design, architecture, and operation of the chipset to efficiently support the processing power, memory access patterns, and data flow of that particular model. After optimising, the AI model will show reduced latency and power consumption, and increased throughput.

MediaTek highlighted that its processors are not only optimised for Microsoft's Phi-3.5 MoE but also for Phi-3.5 Mini which offers multi-lingual support and Phi-3.5 Vision which comes with multi-frame image understanding and reasoning.

Advertisement

Notably, the Phi-3.5 MoE has 16x3.8 billion parameters. However, only 6.6 billion of them are active parameters when using two experts (typical use case). On the other hand, Phi-3.5 features 4.2 billion parameters and an image encoder, and the Phi-3.5 Mini has 3.8 billion parameters.

Coming to performance, Microsoft claimed that the Phi-3.5 MoE outperformed both Gemini 1.5 Flash and GPT-4o mini AI models on the SQuALITY benchmark which tests readability and accuracy when summarising a block of text.

Advertisement

While developers can leverage Microsoft Phi-3.5 directly via Hugging Face or the Azure AI Model Catalogue, MediaTek's NeuroPilot SDK toolkit also offers access to these SLMs. The chip maker stated that the latter will enable developers to build optimised on-device applications capable of generative AI inference using the AI models across the above mentioned mobile platforms.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. Sneaky Links: Dating After Dark Now Streaming on Netflix: What You Need to Know
  2. OTT Releases of the Week: Truth or Trouble, Motorheads, and More
  3. Tecno Pova Curve 5G India Launch Date Announced
  4. Apple Adds iPhone 7 Plus, iPhone 8 to Vintage and Obsolete Products List
  5. Computex 2025: Five Takeaways From Asia's Biggest AI Tech Show
  6. Motorola Razr 60 Will Launch in India on This Date
  1. SpaceX Successfully Launches 23 Starlink Satellites on Brand-New Falcon 9 Rocket
  2. Polaris Wasn’t Always the North Star: How Earth’s Wobble Shifts the Celestial Pole
  3. Scientists Warn of Inadequate Solar Storm Forecasting: What You Need to Know
  4. NASA’s Perseverance Explores Mars' Oldest Rocks in Krokodillen Region
  5. New Study Uses AI to Reveal Dry Origins of Mars’ Mysterious Slope Streaks
  6. Ancient 14,000-Year-Old Solar Storm Revealed as Strongest Ever Recorded in Earth’s History
  7. New Study Confirms TeV Halos Are Common in Middle-Aged Pulsars
  8. Capuchin Monkeys Abduct Baby Howler Monkeys on Panama’s Jicarón Island, New Study Reveals
  9. Sneaky Links: Dating After Dark Now Streaming on Netflix: What You Need to Know
  10. Devika & Danny OTT Release Date Revealed: When and Where to Watch It Online?
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.