The upgraded Gemini 2.5 Pro model gets an Elo score jump of 24 points compared to the previous version.
Gemini 2.5 Pro is currently available as a preview, with stable version expected in two weeks
Photo Credit: Google
Google introduced an upgraded version of the Gemini 2.5 Pro artificial intelligence (AI) model on Thursday. Available in preview, the new model's technical name is “Gemini 2.5 Pro preview 06-05 Thinking” and it offers improved coding capabilities compared to the previous version that was released ahead of the Google I/O 2025. The Mountain View-based tech giant said this version also brings improvements in the style and structure of its responses. Notably, this is the second update the company has added to the model.
In a blog post, Google announced the new version of the large language model, highlighting that it will be generally available in a couple of weeks. Notably, Gemini 2.5 Pro was originally released in March, which was then upgraded in May. The May upgrade was focused on the model's coding performance.
The 06-05 version has also performed better on the LMArena, an AI model ranking platform where users rate models based on their experience of it. Google said the upgraded Gemini 2.5 Pro gets a 24-point Elo score jump compared to the previous version with a score of 1,470. It also increases its Elo score by 35 points on the WebDevArena and reaches 1,443.
Google also highlighted the model's coding proficiency by mentioning that it is currently leading on the Aider Polyglot benchmark, considered to be a difficult coding-based test. The Gemini 2.5 Pro also keeps a similar score on the GPQA and Humanity's Last Exam (HLE) benchmarks, the company claimed.
Apart from core capability boost, the tech giant is also said to have improved the style and structure of the model's responses. However, it is difficult to assess the improvements due to lack of any independent testers.
While the stable version is still two weeks away, the upgraded preview version is now available in the Gemini app. Additionally, it can also be accessed with the Gemini application programming interface (API) via Google AI Studio and Vertex AI. Google said it has added thinking budgets to let developers have more control over the cost and latency.
Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.