Meta Releases AI Coding Model Code Llama 70B; Calls It ‘Largest’ and ‘Best-Performing’ in Llama Family

Code Llama 70B scored 53 percent in accuracy on the HumanEval benchmark and 62.4 percent on the MBPP benchmark, beating GPT 3.5 in both metrics.

Advertisement
Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 31 January 2024 12:46 IST
Highlights
  • Code Llama 70B is free for research and commercial use
  • Meta’s Code Llama 70B is built on Llama 2 foundational model
  • It was trained on 1 trillion tokens of code and code-related data
Meta Releases AI Coding Model Code Llama 70B; Calls It ‘Largest’ and ‘Best-Performing’ in Llama Family

Code Llama 70B is available in the foundational model version, as well as Python and Instruct versions

Photo Credit: Meta

Meta has recently released Code Llama 70B, the latest update to the company's open-source artificial intelligence (AI) coding model. Announcing the release, the California-based tech conglomerate called it “the largest and best-performing model in the Code Llama family.” As per the company's report, Code Llama 70B scored 53 percent in accuracy on the HumanEval benchmark, highlighting capabilities nearing OpenAI's GPT 4 that scored 67 percent. The latest AI assistant joins the company's existing coding models Code Llama 7B, Code Llama 13B, and Code Llama 34B.

Meta CEO Mark Zuckerberg announced Code Llama 70B via a Facebook post and said, “We're open sourcing a new and improved Code Llama, including a larger 70B parameter model. Writing and editing code has emerged as one of the most important uses of AI models today. [..] I'm proud of the progress here, and looking forward to including these advances in Llama 3 and future models as well.”

Code Llama 70B is available in three versions — the foundational model, the Code LLama - Python, and Code Llama - Instruct, as per Meta's blog post. Python is for the specific programming language and Instruct has natural language processing (LNP) capabilities, which means you can use this even if you do not know how to code.

The Meta AI coding assistant is capable of generating both codes and natural language responses, the latter being important for explaining codes and answering queries related to them. The 70B model has been trained on 1 trillion tokens (roughly 750 million words) of coding and code-related data. Like all LLama AI models, Code Llama 70B is also free for research and commercial purposes. It is hosted on Hugging Face, a coding repository.

Coming to benchmarks, the company has posted its scores in accuracy and compared them against all rival coding-focussed AI models. On the HumanEval benchmark, 70B scored 53 percent and on the Mostly Basic Python Programming (MBPP) benchmark, it received 62.4 percent. In both benchmarks, it has outscored OpenAI's GPT 3.5 which received 48.1 percent and 52.2 percent, respectively. GPT 4 posted only its HumanEval accuracy scores online and netted 67 percent, edging the Llama Code 70B parameter by a fairly healthy margin.

Advertisement

In August 2023, Meta released Code Llama, which was based on the Llama 2 foundational model and trained specifically on its coding-based datasets. It accepts both codes and natural language for prompts and can generate responses in both, as well. Code Llama can generate, edit, analyse, and debug codes. Its Instruct version can also help users understand the codes in natural language.


Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.
Affiliate links may be automatically generated - see our ethics statement for details.
 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Meta, Artificial intelligence, AI
Advertisement

Related Stories

Popular Mobile Brands
  1. Vivo X200 FE Reportedly Listed on BIS, IMDA Websites Ahead of Launch
  2. Realme GT 7 Series: Launch Date, Expected Price in India and More
  3. Xiaomi Surpasses Apple to Lead Wearables Market in Q1 2025: Canalys
  1. X Restores Access After Thousands of Users Report X Website and App Not Working
  2. Made in India iPhones Will Still Be Cheaper in the US, Even With Donald Trump's 25 Percent Tariff: GTRI Report
  3. Xiaomi Surpasses Apple to Lead Wearables Market in Q1 2025 With 19 Percent Market Share: Canalys
  4. Vivo X200 FE Reportedly Listed on BIS, IMDA Certification Websites Ahead of Anticipated Launch in India
  5. Oracle Said to Buy $40 Billion of Nvidia Chips for OpenAI's US Data Center
  6. Trump Threatens 25 Percent Tariffs on Apple If iPhones Not Made in US
  7. iPhone 16 Pro Max, iPhone 15, MacBook Air (M4) and More Get Discounts During Vijay Sales Apple Days Sale
  8. Anthropic CEO Dario Amodei Says AI Models Hallucinate Less Than Humans: Report
  9. UK Government Updates Crypto Reporting Guidelines, Mandates Collection of Crypto Transaction Data
  10. Acer Swift Neo WIth Intel Core Ultra 5, Up to 32GB RAM Launched in India: Price, Specifications
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.