\u201cThe Llama models that we\u2019re building are some of the most advanced in the world.\u201d Meta is already working on Llama 4, Zuckerberg added.<\/p>\n
Meta executives say that the model, which is primarily used to power chatbots both within Meta and by outside developers, has a wide range of new capabilities, including improved reasoning to help\u00a0solve complex math problems or instantly synthesize an entire book of text.<\/p>\n
It also has generative AI features that can create images on demand through text prompts. A feature called \u201cImagine Yourself\u201d lets users upload an image of their face, which can then be used to create depictions of them in different scenes and scenarios.<\/p>\n
Meta uses its Llama models to power its AI chatbot, called Meta AI, which operates inside its apps, including Instagram and WhatsApp,\u00a0and also as a separate web product.<\/p>\n
Zuckerberg said that Meta has \u201chundreds of millions\u201d of users for its chatbot, and expects it will be the most widely used chatbot in the world by the end of the year.<\/p>\n
He expects that others outside of Meta will use Llama to train their own AI models.<\/p>\n
\u201cIt\u2019s just gonna be this teacher that allows so many different organizations to create their own models rather than having to rely on the kind of off-the-shelf ones that the other guys are selling,\u201d he said.<\/p>\n
Meta\u2019s investments in AI have been steep. Zuckerberg said that Meta\u2019s Llama 3 models cost \u201chundreds of millions of dollars\u201d in computing power to train, but that he expects future models will cost even more.<\/p>\n
![\"\"](\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2024\/04\/Meta-AI-tool-in-WhatsApp.jpg\")
Meta’s AI tool on WhatsApp<\/p><\/div>\n
\u201cGoing forward it\u2019s going to be billions\u00a0\u00a0<\/strong>and many billions of dollars of compute\u201d\u00a0power, he said.\u00a0\u00a0<\/strong><\/p>\n Meta in 2023 tried to reign in some of its spending on futuristic technologies and management layers,\u00a0cutting thousands of jobs in what Zuckerberg dubbed the \u201cyear of efficiency.\u201d But Zuckerberg is still willing to spend on the AI arms race.<\/p>\n \u201cI think that there\u2019s a meaningful chance that a lot of the companies are over-building now, and that you\u2019ll look back and you\u2019re like,\u00a0\u2018oh, we maybe all spent some number of billions of dollars more than we had to,\u2019\u201d Zuckerberg said.<\/p>\n \u201cOn the flip side, I actually think all the companies that are investing are making a rational decision, because the downside of being behind is that you\u2019re out of position for like the most important technology for the next 10 to 15 years.\u201d<\/p>\n After all the investment, Meta makes\u00a0the technology behind Llama available for the public to use for free, so long as they adhere to the company\u2019s \u201cacceptable use policy.\u201d<\/p>\n Zuckerberg hopes the open-access strategy will help make the company\u2019s work the foundation of other successful startups and products, giving Meta\u00a0greater sway in how the industry moves forward.<\/p>\n \u201cIf AI is going to be as important in the future as mobile platforms are, then I just don\u2019t want to be in the position where we\u2019re accessing AI through\u201d a competitor, said Zuckerberg, who has long been frustrated with Meta\u2019s reliance on distributing its social media apps on phones and operating systems from Google and Apple.<\/p>\n \u201cWe\u2019re a technology company and we need to be able to kind of build stuff not just at the app layer but all the way down. And it\u2019s worth it to us to make these massive investments to do that.\u201d<\/p>\n Despite the pledge to make Llama open, Zuckerberg and other top company executives are keeping the data sets used for training Llama 3.1 a secret.<\/p>\n \u201cEven though it\u2019s open we are designing this also for ourselves,\u201d he explained. Meta is using publicly available user posts from Facebook and Instagram, as well as other \u201cproprietary\u201d data sets that the company has licensed from others, Zuckerberg said, without sharing specifics.<\/p>\n He also dismissed the idea that training Llama on data from Facebook and Instagram posts is a key advantage. \u201cA lot of the public data on those services we allow to be indexed in search engines, so I think Google and others actually have the ability to use a lot of that data, too,\u201d he said.<\/p>\n Meta told investors in April that it was\u00a0planning to spend billions of dollars more than initially expected\u00a0this year, with investments in AI being a core reason why. The company is expected to have some 350,000 Nvidia Corp. H100 GPUs by the end of the year, according to a company blog post.<\/p>\n Nvidia’s H100 processor<\/p><\/div>\n The H100 chips have become the foundational technology used to train large language models like Llama and OpenAI\u2019s ChatGPT, and can cost upwards of tens of thousands of dollars\u00a0apiece.<\/p>\n Critics of Meta\u2019s open source approach to AI point to the potential for abuse \u2014\u00a0or the fear that tech companies from geopolitical rivals like China will piggyback off Meta\u2019s technology to keep pace with their American counterparts.<\/p>\n Zuckerberg is more concerned that closing off the tech from other parts of the world would ultimately be a detriment.<\/p>\n \u201cThere\u2019s one string of thought which is like, \u2018Ok well we need to lock it all down,\u2019\u201d he said. \u201cI just happen to think that that\u2019s really wrong because the US thrives on open and decentralized innovation.<\/p>\n I mean that\u2019s the way our economy works, that\u2019s how we build awesome stuff. So I think that locking everything down would hamstring us and make us more likely to not be the leaders.\u201d<\/p>\n It’s also unrealistic to think that the US will ever be years ahead of China when it comes to AI advancements, he added, but pointed out that even a small, multi-month lead can \u201ccompound\u201d over time to give the US a clear advantage.<\/p>\n","protected":false},"excerpt":{"rendered":" Meta Platforms debuted a new and powerful AI model that chief executive officer Mark Zuckerberg called \u201cstate of the art\u201d and said will rival similar offerings from competitors like OpenAI and Alphabet Google.<\/p>\n","protected":false},"author":341034,"featured_media":519827,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[92837],"tags":[35793,83065,167,84559,96295,40812,85017,45266],"class_list":["post-545689","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","tag-artificial-intelligence-ai","tag-chatgpt","tag-google","tag-llama","tag-mark-zuckerburg","tag-meta","tag-nvidia-h100","tag-openai"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/545689"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/341034"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=545689"}],"version-history":[{"count":1,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/545689\/revisions"}],"predecessor-version":[{"id":545701,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/545689\/revisions\/545701"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/519827"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=545689"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=545689"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=545689"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"\"](\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/03\/Nvidia-H100-new-.jpg\")