The Meta chief executive said Llama 3.1 405B will be open source
Meta CEO Mark Zuckerberg arrives to testify before a Senate Judiciary Committee on Capitol Hill in Washington, D.C. on January 31, 2024.
Photo: Susan Walsh, File (AP)
Meta is taking on its artificial intelligence rivals with the latest version of its Llama model, saying open-source AI is “good for the world.”
The open-source Llama 3.1 models released Tuesday, which Meta calls its “most capable” to date, include its largest model, Llama 3.1 405B, which stands for 405 billion parameters, or the variables a model learns from training data that guide its behavior. Llama 3.1 405B rivals its closed-source competitors from OpenAI and Google in “state-of-the-art capabilities,” including general knowledge, math, and translating languages, Meta said. The release also includes upgraded versions of its 8B and 70B models which were introduced in April.
Llama 3.1 405B was evaluated on over 150 benchmark datasets and by humans against other leading foundation models, including OpenAI’s GPT-4 and GPT-4o, and Anthropic’s Claude 3.5 Sonnet, which are closed-source models. While Llama 3.1 405B was outperformed on some benchmarks, the “experimental evaluation suggests that our flagship model is competitive” with the other leading models, Meta said.
The model was trained with over 16,000 of Nvidia’s H100 GPUs, or graphics processing units, according to Meta. The chipmaker also announced a new Nvidia AI Foundry service for enterprises and nation states to build “supermodels” with Llama 3.1 405B.
The Llama models are used to power Meta’s AI chatbot, Meta AI, which is available on Facebook, Instagram, and other platforms. Meta expanded access to Meta AI in Latin America and other countries on Tuesday, and announced it is offering the chatbot in seven new languages, including German and Hindi. Users have the option to use the Llama 3.1 405B-powered Meta AI on WhatsApp and meta.ai.
Meta chief executive Mark Zuckerberg said the company expects “future Llama models to become the most advanced in the industry,” and that Llama 3.1 405B is a step toward making open-source models the industry standard.
“AI has more potential than any other modern technology to increase human productivity, creativity, and quality of life — and to accelerate economic growth while unlocking progress in medical and scientific research,” Zuckerberg said in a statement released Tuesday. “Open source will ensure that more people around the world have access to the benefits and opportunities of AI, that power isn’t concentrated in the hands of a small number of companies, and that the technology can be deployed more evenly and safely across society.”
Zuckerberg, who told Bloomberg the company is working on Llama 4, said he believes “open-source AI will be safer than the alternatives,” and that the company’s new model “will be an inflection point in the industry where most developers begin to primarily use open source.”
News
Game of Thrones Made the Right Call Cutting the Books’ Biggest Targaryen Twist – And This Major Spinoff Trend Proves It!
Game of Thrones cut A Song of Ice and Fire‘s biggest Targaryen twist (so far) when it didn’t include Young Griff, aka Aegon Targaryen, but it was the right…
Jon Snow’s iconic sword and Jaime Lannister’s golden hand are up for grabs – Don’t miss your chance to own a piece of ‘Game of Thrones’ history!
Heritage Auctions has united with HBO to offer more than 2,000 pieces from the hit series based on George R.R. Martin’s novels. They include the dreaded shame…
‘House of the Dragon’ Season 3 Might Blow Past Game of Thrones’ Biggest Cameo – If They Can Land This One Celebrity Who Would Be Perfect for the Role!
One celebrity is so perfect that their potential cameo in House of the Dragon can leave behind Game of Thrones’ most memorable cameo. The Game of Thrones prequel, House…
House of the Dragon Season 2: A slow-burning yet captivating ‘dance’ you won’t want to miss!
The long night has officially begun, and two bleak winters will now pass before we are gifted season three of this magnificent show. Season one of House of…
House of the Dragon’s Fabien Frankel set to reunite with co-stars Matt Smith & Tom Glynn-Carney at NYCC 2024 – What could this epic reunion reveal?
Raise your banners – green and black are coming head-to-head at New York Comic Con 2024. House of the Dragon’s Ser Criston Cole – aka actor Fabien…
10 Strangest Details You Probably Missed in House of the Dragon!
The first two seasons of House of the Dragon had many great moments and clever plotlines setting up a horrific war, known as the Dance of the Dragons,…
End of content
No more pages to load