Search

Hugging Face Introduces Compact Versions of SmolVLM Vision Language Model That Can Run on Consumer Laptops

Hugging Face claimed that the SmolVLM-256M is the world’s smallest vision language model.

Advertisement
Highlights
  • The new SmolVLM models are available in 256M and 500M parameter sizes
  • SmolVLM can analyse images and process visual information at high speeds
  • The open-source models are available with an Apache 2.0 licence
Hugging Face Introduces Compact Versions of SmolVLM Vision Language Model That Can Run on Consumer Laptops

Hugging Face introduced the SmolVLM 2B model in December 2024

Photo Credit: Hugging Face

Hugging Face introduced two new variants to its SmolVLM vision language models last week. The new artificial intelligence (AI) models are available in 256 million and 500 million parameter sizes, with the former being claimed as the world's smallest vision model by the company. The new variants focus on retaining the efficiency of the older two-billion parameter model while reducing the size significantly. The company highlighted that the new models can be locally run on constrained devices, consumer laptops, or even potentially browser-based inference.

Hugging Face Introduces Smaller SmolVLM AI Models

In a blog post, the company announced the SmolVLM-256M and SmolVLM-500M vision language models, in addition to the existing 2 billion parameter model. The release brings two base models and two instruction fine-tuned models in the abovementioned parameter sizes.

Hugging Face said that these models can be loaded directly to transformers, Machine Learning Exchange (MLX), and Open Neural Network Exchange (ONNX) platforms and developers can build on top of the base models. Notably, these are open-source models available with an Apache 2.0 licence for both personal and commercial usage.

With the new AI models, Hugging Face aims to bring multimodal models focused on computer vision to portable devices. The 256 million parameter model, for instance, can be run on less than one GB of GPU memory and 15GB of RAM to process 16 images per second (with a batch size of 64).

Andrés Marafioti, a machine learning research engineer at Hugging Face told VentureBeat, “For a mid-sized company processing 1 million images monthly, this translates to substantial annual savings in compute costs.”

To reduce the size of the AI models, the researchers switched the vision encoder from the previous SigLIP 400M to a 93M-parameter SigLIP base patch. Additionally, the tokenisation was also optimised. The new vision models encode images at a rate of 4096 pixels per token, compared to 1820 pixels per token in the 2B model.

Notably, the smaller models are also marginally behind the 2B model in terms of performance, but the company said this trade-off has been kept at a minimum. As per Hugging Face, the 256M variant can be used for captioning images or short videos, answering questions about documents, and basic visual reasoning tasks.

Developers can use transformers and MLX for inference and fine-tuning the AI model as they work with the old SmolVLM code out-of-the-box. These models are also listed on Hugging Face.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

 
Show Full Article
Please wait...
Advertisement

Related Stories

Popular Mobile Brands
  1. Realme 15 Pro 5G to Launch in India With Snapdragon 7 Gen 4 Chipset
  2. OnePlus Pad Lite With 11-Inch Display, 9,340mAh Battery Launched
  3. Moto G96 5G Launched in India With 50-Megapixel Sony Lytia 700C Camera
  4. Samsung Galaxy Buds 3 Pro's Amazon Prime Day 2025 Offer Revealed
  5. OnePlus Nord CE 5 Review
  6. Google Pixel Phones Receiving Monthly Software Update for July 2025
  7. iQOO 13, iQOO Neo 10R and More Get Discounts During Prime Day 2025 Sale
  8. Apple's New Chief Operating Officer Is Indian-Origin Sabih Khan: Details
  9. Swiggy Instamart And Jio Collaborate for Instant Delivery of Jio Phones
  10. Nothing Phone 3 Review: Enters the Big League With a Big Price
  1. Dreame F10 Robot Vacuum Cleaner Launched in India With 300 Minutes of Run Time: Price, Specifications
  2. Apple Appoints Indian-Origin Sabih Khan as New COO; Jeff Williams Shifts Focus to Apple Watch
  3. Meta Invests $3.5 Billion in Ray-Ban Maker EssilorLuxottica in AI Glasses Push
  4. The Last of Us Part 2 Remastered Gets New Free Update That Allows Players to Experience Story Chronologically
  5. Gemini AI Upgraded to Support Google Home’s Broadcast Messages Feature
  6. Samsung W26 Foldable Phone Allegedly Spotted on China's 3C Site; Charging Speed Tipped
  7. Redmi 15C Leaked Renders Show Design, Colour Options; Reportedly Spotted on NBTC Site Alongside Poco C85
  8. Axiom 4 Mission Crew Settles Down at ISS, Begins Conducting Biomedical Research
  9. Microsoft Fixes One Zero-Day Vulnerability, 136 Other Flaws With July 2025 Windows Security Update
  10. Tata Motors Brings Dolby Atmos to Harrier.ev Powered by Harman JBL Black Audio System
Gadgets 360 is available in
Download Our Apps
App Store App Store
Available in Hindi
App Store
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.
Trending Products »
Latest Tech News »