OpenAI's o3 Model Claims Human-Level Intelligence on Benchmark, But It Might Not Be That Smart

OpenAI’s o3 AI model scored 85 percent on the ARC-AGI benchmark, matching the average human score.

Advertisement
Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 3 January 2025 18:33 IST
Highlights
  • The previous best score by an AI model was 55 percent
  • OpenAI has not shared details about the model architecture
  • The ARC-AGI test includes a series of pattern-based IQ questions
OpenAI's o3 Model Claims Human-Level Intelligence on Benchmark, But It Might Not Be That Smart

The o3 AI model is currently available in early access to external testers

OpenAI unveiled the reasoning-focused o3 series of artificial intelligence (AI) models last month. During a live stream, the company shared the benchmark scores of the model based on internal testing. While all of the shared scores were impressive and highlighted the improved capabilities of the successor to o1, one benchmark score stood out. On the ARC-AGI benchmark, the large language model (LLM) scored 85 percent, beating the previous best score by a 30 percent margin. Interestingly, this score is also on par with what an average human scored on the test.

OpenAI Scores 85 Percent on ARC-AGI Benchmark

However, just because o3 scored such a high score on the test, does it mean its intelligence is equal to that of an average human? This would be easier to answer if the AI model was released in the public domain and we could test it out. Since OpenAI has not disclosed anything about the model's architecture, training techniques, or datasets, it is difficult to conclusively claim anything.

There are certain things that we do know about the AI firm's reasoning-focused models which can help us understand just what to expect from OpenAI's upcoming LLM. Firstly, so far, the o-series models do not have a major overhaul in their architecture or framework but are fine-tuned to showcase enhanced capabilities.

For instance, developers used a technique with the o1 series of AI models called test-time compute. With this, the AI models were given additional processing time to spend on a question and a workspace to test the theories and correct any mistakes. Similarly, the GPT-4o model was just a fine-tuned version of the GPT-4.

It is unlikely that the company would have made major changes to the architecture with the o3 model, given that it is also rumoured to be working on the GPT-5 AI model, which could be launched later this year.

Advertisement

Coming to the ARC-AGI (Abstract Reasoning Corpus - Artificial General Intelligence) benchmark, it features a series of grid-based pattern recognition questions that require reasoning and spatial understanding capabilities to solve. This could be done with a large dataset of high-quality data focusing on reasoning and aptitude-based logic.

However, if this were that simple, older AI models would have scored high on the test as well. Notably, the previous highest score was 55 percent as opposed to o3's 85 percent score. This highlights that the developers have added new refinement techniques and algorithms to enhance the reasoning capabilities of the model. The full extent of it cannot be stated unless OpenAI officially reveals the technical details.

Advertisement

That being said, it is unlikely that the o3 AI model would have reached AGI or human-level intelligence. Firstly, if that were the case, it would mark the end of the company's partnership with Microsoft, which is slated to end once OpenAI models hit the AGI status. Second, many AI experts, including Geoffrey Hinton, the godfather of AI, have repeatedly highlighted that we are multiple years away from reaching AGI.

Finally, AGI is such a big accomplishment that if OpenAI did reach that milestone, it would explicitly let people know instead of sharing subtle hints about it. What is far more likely here is that the o3 AI model has found a way to improve the pattern-based reasoning capabilities of the model (either by adding enough sampling data or by tweaking the training methods), as also highlighted in a PTI report.

Advertisement

However, this improvement is likely very isolated and does not mean an increase in the overall intelligence level of the model.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. Our Fault OTT Release Date: When and Where to Watch Final Chapter of Culpables Online?
  2. OnePlus Pad 3 With 12,140mAh Battery Launched in India: Check Features
  3. Realme GT 7 and GT 7T Review
  4. OnePlus 13s Review
  5. Bazooka OTT Release Reportedly Revealed Online: What You Need to Know
  6. OnePlus 13s Launched in India: Know Price, Specifications and More
  7. Oppo Reno 14F 5G Listed on NBTC Site, Hints at Key Specifications
  8. Xiaomi 16 Battery and Display Size Leaked Ahead of Debut in China
  9. Redmi Pad 2 With 9,000mAh Battery Launched in Global Markets: See Price
  10. Tecno Pova Curve 5G First Sale Starts Today in India: See Offers
  1. Samsung Galaxy Z Flip FE Price, Storage Options Leaked Again; Here's How Much It Could Cost
  2. WWDC 2025: watchOS 26 to Reportedly Get Support for Third-Party Control Centre Widgets
  3. Snapchat Launches Apple Watch App With Scribble, Dictation Support; Lens Studio Now on iOS
  4. Hugging Face Releases SmolVLA Open Source AI Model For Robotics Workflows
  5. Redmi Pad 2 With 9,000mAh Battery, MediaTek Helio G100 Ultra Chip Launched: Price, Specifications
  6. Alphabet CEO Expects to Keep Hiring Engineers as AI Advances
  7. Amazon Said to Be Preparing to Test Humanoid Robots for Deliveries
  8. Google Doubles Gemini 2.5 Pro Rate Limit for Google AI Pro Subscribers
  9. Apple Said to Have Given iPhone Repair Business to Tata India as Partnership Expands
  10. Huawei Pura 80 Pro, Pura 80 Pro+ Design Teased; Pre-Reservation Begin
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.