The Meta chief executive said Llama 3.1 405B will be open source
Meta CEO Mark Zuckerberg arrives to testify before a Senate Judiciary Committee on Capitol Hill in Washington, D.C. on January 31, 2024.
Photo: Susan Walsh, File (AP)
Meta is taking on its artificial intelligence rivals with the latest version of its Llama model, saying open-source AI is “good for the world.”
The open-source Llama 3.1 models released Tuesday, which Meta calls its “most capable” to date, include its largest model, Llama 3.1 405B, which stands for 405 billion parameters, or the variables a model learns from training data that guide its behavior. Llama 3.1 405B rivals its closed-source competitors from OpenAI and Google in “state-of-the-art capabilities,” including general knowledge, math, and translating languages, Meta said. The release also includes upgraded versions of its 8B and 70B models which were introduced in April.
Llama 3.1 405B was evaluated on over 150 benchmark datasets and by humans against other leading foundation models, including OpenAI’s GPT-4 and GPT-4o, and Anthropic’s Claude 3.5 Sonnet, which are closed-source models. While Llama 3.1 405B was outperformed on some benchmarks, the “experimental evaluation suggests that our flagship model is competitive” with the other leading models, Meta said.
The model was trained with over 16,000 of Nvidia’s H100 GPUs, or graphics processing units, according to Meta. The chipmaker also announced a new Nvidia AI Foundry service for enterprises and nation states to build “supermodels” with Llama 3.1 405B.
The Llama models are used to power Meta’s AI chatbot, Meta AI, which is available on Facebook, Instagram, and other platforms. Meta expanded access to Meta AI in Latin America and other countries on Tuesday, and announced it is offering the chatbot in seven new languages, including German and Hindi. Users have the option to use the Llama 3.1 405B-powered Meta AI on WhatsApp and meta.ai.
Meta chief executive Mark Zuckerberg said the company expects “future Llama models to become the most advanced in the industry,” and that Llama 3.1 405B is a step toward making open-source models the industry standard.
“AI has more potential than any other modern technology to increase human productivity, creativity, and quality of life — and to accelerate economic growth while unlocking progress in medical and scientific research,” Zuckerberg said in a statement released Tuesday. “Open source will ensure that more people around the world have access to the benefits and opportunities of AI, that power isn’t concentrated in the hands of a small number of companies, and that the technology can be deployed more evenly and safely across society.”
Zuckerberg, who told Bloomberg the company is working on Llama 4, said he believes “open-source AI will be safer than the alternatives,” and that the company’s new model “will be an inflection point in the industry where most developers begin to primarily use open source.”
News
Is ‘The Watchers’ Inspired by Real-Life Folklore? Discover the Truth Behind the Scary Story!
Folktales have led to some of the most terrifying horror movies in recent years, presenting audiences with monstrous creatures and strange human behavior. These stories come from…
Director’s Daughter Turns Horror Flop into a Surprise #1 Hit on Max
Growing up on sets around the world, Ishana Night Shyamalan watched her father, two-time Academy Award nominee M. Night Shyamalan, helm some of the biggest thrillers and…
‘The Watchers’: Dakota Fanning, Ishana Shyamalan, and Georgina Campbell Share How ‘Love Island’ Surprisingly Influenced Their Chilling Horror Film!
©Warner Bros/Courtesy Everett Collection “Try not to die!” When Dakota Fanning’s Mina prepares for a night out with a bird on loan from the pet shop, she gives…
Here’s Why ‘The Watchers’ Should Be Your Next Must-Watch Series!
The feature debut of 24-year-old Ishana Night Shyamalan has divided critics, but there’s more going on beneath the surface than it seems. Dakota Fanning in ‘The Watchers.’ Jonathan…
Could HBO’s Big Bet on ‘Industry’ Cement Its Status as the Next Hit Series?
Nick Strasburg/HBO It’s a tale as old as time in the television industry: There’s no better way to make a TV show a success than to move…
Industry Season 3 Returns with 8 Thrilling Episodes Packed with High-Stakes Drama and Scandalous Debauchery!
The HBO series levels up in its third season—and you won’t want to miss a second of it. HBO Our product picks are editor-tested, expert-approved. We may…
End of content
No more pages to load