Search

MLCommons Releases New AI Benchmark to Test Speed of Responses to User Queries

MLCommons officials also added a second text-to-image generator to its MLPerf benchmarking suite based on Stability AI's Stable Diffusion XL model.

Advertisement
Highlights
  • MLCommons has released new benchmark tests to measure AI performance
  • Servers powered by Nvidia's H100 chips handily won both new benchmarks
  • Intel has also submitted a design based on its Gaudi2 accelerator chips
MLCommons Releases New AI Benchmark to Test Speed of Responses to User Queries

Servers powered by Nvidia's H100 chips handily won both new benchmarks on raw performance

Photo Credit: Reuters

Artificial intelligence benchmarking group MLCommons on Wednesday released a fresh set of tests and results that rate the speed at which top-of-the-line hardware can run AI applications and respond to users.

The two new benchmarks added by MLCommons measure the speed at which the AI chips and systems can generate responses from the powerful AI models packed with data. The results roughly demonstrate to how quickly an AI application such as ChatGPT can deliver a response to a user query.

One of the new benchmarks added the capability to measure the speediness of a question-and-answer scenario for large language models. Called Llama 2, it includes 70 billion parameters and was developed by Meta Platforms.

MLCommons officials also added a second text-to-image generator to the suite of benchmarking tools, called MLPerf, based on Stability AI's Stable Diffusion XL model.

Servers powered by Nvidia's H100 chips built by the likes of Alphabet's Google, Supermicro and Nvidia itself handily won both new benchmarks on raw performance. Several server builders submitted designs based on the company's less powerful L40S chip.

Server builder Krai submitted a design for the image generation benchmark with a Qualcomm AI chip that draws significant less power than Nvidia's cutting edge processors.

Intel also submitted a design based on its Gaudi2 accelerator chips. The company described the results as "solid."

Raw performance is not the only measure that is critical when deploying AI applications. Advanced AI chips suck up enormous amounts of energy and one of the most significant challenges for AI companies is deploying chip that deliver an optimal amount of performance for a minimal amount of energy.

MLCommons has a separate benchmark category for measuring power consumption.

© Thomson Reuters 2024


Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

(This story has not been edited by NDTV staff and is auto-generated from a syndicated feed.)

Affiliate links may be automatically generated - see our ethics statement for details.

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

 
Show Full Article
Please wait...
Advertisement

Related Stories

Popular Mobile Brands
  1. Amazon Prime Day Sale: Samsung Galaxy S24 Ultra Discount Revealed
  2. How to Upgrade to BSNL 4G/ 5G SIM Card Online: A Step-by-Step Guide
  3. Samsung Smart Monitor M9 Launched in India Alongside Updated M8, M7 Models
  4. OnePlus Nord 5, Nord CE 5 Launch Today: Everything You Need to Know
  5. AI+ Nova 5G, Pulse Phones India Launch Today: How to Watch Live Event
  6. Amazon Prime Day 2025 Sale: iPhone 15 Discounted Price Revealed
  7. Realme 15 Pro 5G Leaked Render Shows Design Ahead of India Launch
  8. Samsung Galaxy Watch 8 Series, Ultra 2 Specifications Leak Ahead of Debut
  9. Samsung Galaxy S26 Ultra Leak Suggests 16GB RAM, Camera Upgrades, More
  10. Honor X9c 5G With 6,600mAh Battery Launched in India: Price, Features
  1. AI+ Nova 5G, Pulse India Launch Today: Know Price, Specifications and More
  2. OnePlus Nord 5, Nord CE 5 Launch Today: Know Price, Expected Features and Specifications
  3. Realme 15 Pro 5G Leaked Render Shows Design Ahead of India Launch
  4. Samsung Smart Monitor M9 With QD-OLED Display Launched in India Alongside Refreshed M8, M7 Models
  5. Samsung Galaxy S26 Ultra Said to Get 16GB RAM, Improved Telephoto Lens, More
  6. Xiaomi Compact Power Bank 20,000mAh Launched in India With Built-In Cable: Price, Features
  7. Forza Motorsport Team 'No More', Romero Games 'Completely Closed' Following Microsoft Cuts
  8. Honor X70 Tipped to Launch With an 8,300mAh Battery, Snapdragon 6 Gen 4 SoC
  9. iPhone 15 to Get a Discount During Amazon Prime Day 2025 Sale: Price Revealed
  10. Realme 15 Series to Feature AI Edit Genie, a Voice-Enabled Photo Editing Tool
Gadgets 360 is available in
Download Our Apps
App Store App Store
Available in Hindi
App Store
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.
Trending Products »
Latest Tech News »