Search

Google Releases Gemma 3n Open-Source AI Model That Can Run Locally on 2GB RAM

Google says Gemma 3n natively supports image, audio, video, and text inputs as well as text outputs.

Advertisement
Highlights
  • Gemma 3n was released as an early preview in May
  • The AI model is available in two variants — E2B and E4B
  • It is built on the MatFormer architecture
Google Releases Gemma 3n Open-Source AI Model That Can Run Locally on 2GB RAM

The open-source Gemma 3n AI model is available to download on Hugging Face and Kaggle

Photo Credit: Google

Google released the full version of Gemma 3n, its latest open-source model in the Gemma 3 family of artificial intelligence (AI) models, on Thursday. First announced in May, the new model is designed and optimised for on-device use cases and features several new architecture-based improvements. Interestingly, the large language model (LLM) can be run locally on just 2GB of RAM. This means the model can be deployed and operated even on a smartphone, provided it comes with AI-enabled processing power.

Gemma 3n Is a Multimodal AI Model

In a blog post, the Mountain View-based tech giant announced the release of the full version of Gemma 3n. The model follows the launch of the Gemma 3 and GemmaSign models and joins the Gemmaverse. Since it is an open-source model, the company has provided its model weights as well as the cookbook to the community. The model itself is available to use under a permissive Gemma license, which allows both academic and commercial usages.

Gemma 3n is a multimodal AI model. It natively supports image, audio, video, and text inputs. However, it can only generate text outputs. It is also a multilingual model and supports 140 languages for text, and 35 languages when the input is multimodal.

Google says that Gemma 3n has a “mobile-first architecture,” which is built on Matryoshka Transformer or MatFormer architecture. It is a nested transformer, named after the Russian nesting dolls, where one fits inside another. This architecture offers a unique way of training AI models with different parameter sizes.

Gemma 3n comes in two sizes — E2B and E4B — short for effective parameters. This means, despite being five billion and eight billion parameters in size, the active parameters are just two and four billion.

This is achieved using a technique called Per-Layer Embeddings (PLE), where only the most essential parameters are required to be loaded into the fast memory (VRAM). The rest remains in the extra layer embeddings and can be handled by the CPU.

So, with the MatFormer system, the E4B variant nests the E2B model, and when the larger model is being trained, it simultaneously trains the smaller model. This gives users the convenience of either using E4B for more advanced operations or E2B for faster outputs without finding any noticeable differences in the quality of the processing or output.

Google is also letting users create custom-sized models by tweaking certain internal parts. For this, the company is releasing the MatFormer Lab tool that will let developers test different combinations to help them find the custom model sizes.

Currently, Gemma 3n is available to download via Google's Hugging Face listing and Kaggle listing. Users can also visit Google AI Studio to try Gemma 3n. Notably, Gemma models can also be deployed directly to Cloud Run from AI Studio.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

 
Show Full Article
Please wait...
Advertisement

Related Stories

Popular Mobile Brands
  1. Amazon Prime Day Sale: Samsung Galaxy S24 Ultra Discount Revealed
  2. AI+ Nova 5G, Pulse Phones India Launch Today: How to Watch Live Event
  3. Apple Releases iOS 26 Beta 3 Update for iPhone With These New Features
  4. OnePlus Nord 5, Nord CE 5 Launch Today: Everything You Need to Know
  5. Samsung Smart Monitor M9 Launched in India Alongside Updated M8, M7 Models
  6. Amazon Prime Day 2025 Sale: iPhone 15 Discounted Price Revealed
  7. Xiaomi Compact Power Bank 20,000mAh Launched in India: Price, Features
  8. Realme 15 Series Will Let You Edit Photos Using Voice Commands
  9. Realme 15 5G, 15 Pro 5G to Launch in India on This Day
  10. Amazon's Rufus AI Assistant Coming to Desktop Users
  1. Realme 15 Series India Launch Date Set for July 24; Design, Colour Options Revealed
  2. Boat to Partner With Safari for Launch of Smart Luggage in India During Amazon Prime Day 2025
  3. iOS 26 Beta 3 Update for iPhone Released With New Stock Wallpapers, Darker Liquid Glass Appearance
  4. AI+ Nova 5G, Pulse India Launch Today: Know Price, Specifications and More
  5. OnePlus Nord 5, Nord CE 5 Launch Today: Know Price, Expected Features and Specifications
  6. Realme 15 Pro 5G Leaked Render Shows Design Ahead of India Launch
  7. Samsung Smart Monitor M9 With QD-OLED Display Launched in India Alongside Refreshed M8, M7 Models
  8. Samsung Galaxy S26 Ultra Said to Get 16GB RAM, Improved Telephoto Lens, More
  9. Xiaomi Compact Power Bank 20,000mAh Launched in India With Built-In Cable: Price, Features
  10. Forza Motorsport Team 'No More', Romero Games 'Completely Closed' Following Microsoft Cuts
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.
Trending Products »
Latest Tech News »