Search

Google Releases Gemma 3n Open-Source AI Model That Can Run Locally on 2GB RAM

Google says Gemma 3n natively supports image, audio, video, and text inputs as well as text outputs.

Advertisement
Highlights
  • Gemma 3n was released as an early preview in May
  • The AI model is available in two variants — E2B and E4B
  • It is built on the MatFormer architecture
Google Releases Gemma 3n Open-Source AI Model That Can Run Locally on 2GB RAM

The open-source Gemma 3n AI model is available to download on Hugging Face and Kaggle

Photo Credit: Google

Google released the full version of Gemma 3n, its latest open-source model in the Gemma 3 family of artificial intelligence (AI) models, on Thursday. First announced in May, the new model is designed and optimised for on-device use cases and features several new architecture-based improvements. Interestingly, the large language model (LLM) can be run locally on just 2GB of RAM. This means the model can be deployed and operated even on a smartphone, provided it comes with AI-enabled processing power.

Gemma 3n Is a Multimodal AI Model

In a blog post, the Mountain View-based tech giant announced the release of the full version of Gemma 3n. The model follows the launch of the Gemma 3 and GemmaSign models and joins the Gemmaverse. Since it is an open-source model, the company has provided its model weights as well as the cookbook to the community. The model itself is available to use under a permissive Gemma license, which allows both academic and commercial usages.

Gemma 3n is a multimodal AI model. It natively supports image, audio, video, and text inputs. However, it can only generate text outputs. It is also a multilingual model and supports 140 languages for text, and 35 languages when the input is multimodal.

Google says that Gemma 3n has a “mobile-first architecture,” which is built on Matryoshka Transformer or MatFormer architecture. It is a nested transformer, named after the Russian nesting dolls, where one fits inside another. This architecture offers a unique way of training AI models with different parameter sizes.

Gemma 3n comes in two sizes — E2B and E4B — short for effective parameters. This means, despite being five billion and eight billion parameters in size, the active parameters are just two and four billion.

This is achieved using a technique called Per-Layer Embeddings (PLE), where only the most essential parameters are required to be loaded into the fast memory (VRAM). The rest remains in the extra layer embeddings and can be handled by the CPU.

So, with the MatFormer system, the E4B variant nests the E2B model, and when the larger model is being trained, it simultaneously trains the smaller model. This gives users the convenience of either using E4B for more advanced operations or E2B for faster outputs without finding any noticeable differences in the quality of the processing or output.

Google is also letting users create custom-sized models by tweaking certain internal parts. For this, the company is releasing the MatFormer Lab tool that will let developers test different combinations to help them find the custom model sizes.

Currently, Gemma 3n is available to download via Google's Hugging Face listing and Kaggle listing. Users can also visit Google AI Studio to try Gemma 3n. Notably, Gemma models can also be deployed directly to Cloud Run from AI Studio.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

 
Show Full Article
Please wait...
Advertisement

Related Stories

Popular Mobile Brands
  1. OnePlus Nord 5, OnePlus Nord CE 5 Launched in India at These Prices
  2. AI+ Pulse, AI+ Nova 5G With 50-Megapixel Rear Cameras Launched in India
  3. AI+ Nova 5G, Pulse Phones India Launch Today: How to Watch Live Event
  4. OnePlus Nord 5 Review
  5. OnePlus Nord 5, Nord CE 5 Launch Today: Everything You Need to Know
  6. Apple Releases iOS 26 Beta 3 Update for iPhone With These New Features
  7. Google Pixel 10 Series Colour and Storage Options Leaked
  8. Samsung Smart Monitor M9 Launched in India Alongside Updated M8, M7 Models
  9. OnePlus 13 to Get a Price Cut During Amazon Prime Day 2025 Sale
  10. OnePlus Buds 4 With Up to 45 Hours of Total Battery Life Launched in India
  1. Oppo Reno 14 Launched in New Finish With Temperature-Sensitive Colour Changing Rear Panel
  2. Microsoft Edge Can Now Load Websites Faster After Migration to WebUI 2.0, Says Company
  3. Samsung Galaxy S25 FE to Sport a 6.7-Inch Flexible OLED Display: Report
  4. ChatGPT Could Soon Get a Study Together Feature That Helps Users Learn New Topics
  5. OnePlus Buds 4 Launched in India With Adaptive ANC, Up to 45 Hours of Total Battery Life: Price, Features
  6. Amazon Prime Day 2025 Sale: OnePlus 13 Offer Price Revealed
  7. Ai+ Wearbuds Smartwatch With Built-In TWS Earbuds, Blood Pressure Monitoring Launched in India
  8. Apple Loses Top AI Models Executive to Meta’s Hiring Spree
  9. OnePlus Nord 5, Nord CE 5 Launched in India With 50-Megapixel Rear Camera, OnePlus AI Features
  10. Honor X70 Confirmed to Launch on July 15; Battery, Charging Details Revealed
Gadgets 360 is available in
Download Our Apps
App Store App Store
Available in Hindi
App Store
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.
Trending Products »
Latest Tech News »