Adobe Develops SlimLM That Can Process Documents Locally on Devices Without Internet Connectivity

Adobe researchers developed the SlimLM and have published its achievements in a paper.

Advertisement
Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 22 November 2024 17:41 IST
Highlights
  • The smallest SlimLM model can process up to 800 words
  • Adobe researchers said SlimLM is pre-trained on SlimPajama-627B
  • The AI model was fine-tuned on a specialised software dubbed DocAssist
Adobe Develops SlimLM That Can Process Documents Locally on Devices Without Internet Connectivity

The smallest SlimLM model capable of document processing contains 125 million parameters

Photo Credit: Reuters

Adobe researchers have published a paper that details a new artificial intelligence (AI) model capable of processing documents locally on a device. Published last week, the paper highlights that researchers experimented with existing large language models (LLMs) and small language models (SLMs) to find how to reduce the size of the AI model while keeping its processing capability and inference speed high. The researchers, as a result of the experimentations, were able to develop an AI model dubbed SlimLM that can function entirely within a smartphone and process documents.

Adobe Researchers Develop SlimLM

AI-powered document processing, which allows a chatbot to answer user queries about its content, is an important use case of generative AI. Many companies, including Adobe, have tapped into this application and have released tools that offer this functionality. However, there is one issue with all such tools — the AI processing takes place on the cloud. On-server processing of data raises concerns about data privacy and makes processing documents containing sensitive information a risk-ridden process.

The risk mainly emerges from fears that the company offering the solution might train the AI on it, or a data breach incident could cause the sensitive information to be leaked. As a solution, Adobe researchers published a paper in the online journal arXiv, detailing a new AI model that can carry out document processing entirely on the device.

Dubbed SlimLM, the AI model's smallest variant contains just 125 million parameters which makes it feasible to be integrated within a smartphone's operating system. The researchers claim that it can operate locally, without needing Internet connectivity. As a result, users can process even the most sensitive documents without any fear as the data never leaves the device.

Advertisement

In the paper, the researchers highlighted that they conducted several experiments on a Samsung Galaxy S24 to find the balance between parameter size, inference speed, and processing speed. After optimising it, the team pre-tained the model on SlimPajama-627B foundation model and fine-tuned it using DocAssist, a specialised software for document processing.

Notably, arXiv is a pre-print journal where publishing does not require peer reviews. As such, the validity of the claims made in the research paper cannot be ascertained. However, if true, the AI model could be shipped with Adobe's platforms in the future.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. Scientists Discover Clicking Sounds in Rig Sharks for the First Time
  1. NASA-ISRO Launch Joint Space Biology Experiments on Axiom Mission 4
  2. Scientists Discover Clicking Sounds in Rig Sharks for the First Time
  3. WWDC 2025: How to Watch the Apple Keynote Live and What to Expect
  4. Scientists Discover Heaviest Proton-Emitting Nucleus After Nearly 30 Years
  5. Hubble Unveils Galactic ‘Cotton Candy’ in the Large Magellanic Cloud
  6. James Webb Telescope Maps Fiery Atmosphere of Turbulent Exoplanet WASP-121b
  7. SpaceX Launches 27 Starlink Satellites from California Using Veteran Falcon 9 Booster
  8. Chaurya Paatam, A Crime-Comedy Film with a Twist, Now Streaming on Lionsgate Play
  9. Get Away (2024), A British Comedy-Horror Film, Now Streaming on JioHotstar
  10. Single Now Streaming on Amazon Prime Video: What You Need to Know About Telugu Romantic Comedy
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.