{"id":539373,"date":"2024-06-03T08:53:06","date_gmt":"2024-06-03T06:53:06","guid":{"rendered":"https:\/\/mybroadband.co.za\/news\/?p=539373"},"modified":"2024-06-03T08:55:51","modified_gmt":"2024-06-03T06:55:51","slug":"nvidia-unveils-ai-accelerator-chip-models","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/hardware\/539373-nvidia-unveils-ai-accelerator-chip-models.html","title":{"rendered":"Nvidia unveils AI accelerator chip models"},"content":{"rendered":"<p>Nvidia chief executive officer Jensen Huang said the company plans to upgrade its AI accelerators every year, announcing a Blackwell Ultra chip for 2025 and a next-generation platform in development called Rubin for 2026.<\/p>\n<p>The company \u2014 now best known for its artificial intelligence data centre systems \u2014 also introduced new tools and software models on the eve of the Computex trade show in Taiwan.<\/p>\n<p>Nvidia sees the rise of generative AI as a new industrial revolution and expects to play a major role as the technology shifts to personal computers, the CEO said in a keynote address at National Taiwan University.<\/p>\n<p>Nvidia has been the\u00a0main beneficiary\u00a0of a massive flood of AI spending, helping turn the company into the world\u2019s most valuable chipmaker.<\/p>\n<p>But it now looks to broaden its customer base beyond the handful of cloud-computing giants that generate much of its sales.<\/p>\n<p>As part of the expansion, Huang expects a larger swath of companies and government agencies to embrace AI \u2014 everyone from shipbuilders to drug developers.<\/p>\n<p>He returned to themes he set out a year ago at the same venue, including the idea that those without AI capabilities will be\u00a0left behind.<\/p>\n<p>\u201cWe are seeing computation inflation,\u201d Huang said on Sunday.<\/p>\n<p>As the amount of data that needs to be processed grows exponentially, traditional computing methods cannot keep up and it\u2019s only through Nvidia\u2019s style of accelerated computing that we can cut back the costs, Huang said.<\/p>\n<p>He touted 98% cost savings and 97% less energy required with Nvidia\u2019s technology, saying that constituted \u201cCEO math, which is not accurate, but it is correct.\u201d<\/p>\n<p>Shares of Taiwan Semiconductor Manufacturing and other suppliers rose after the announcement. TSMC\u2019s stock climbed as much as 3.9%, while Wistron gained 4%.<\/p>\n<p>Huang said the upcoming Rubin AI platform will use HBM4, the next iteration of the essential high-bandwidth memory that\u2019s grown into a bottleneck for AI accelerator production, with leader SK Hynix largely sold out through 2025.<\/p>\n<p>He otherwise did not offer detailed specifications for the upcoming products, which will follow Blackwell.<\/p>\n<p>\u201cI think teasing out Rubin and Rubin Ultra was extremely clever and is indicative of its commitment to a year-over-year refresh cycle,\u201d said Dan Newman, CEO and chief analyst at Futurum Group.<\/p>\n<p>\u201cWhat I feel he hammered home most clearly is the cadence of innovation, and the company\u2019s relentless pursuit of maximizing the limit of technology including software, process, packaging and partnerships to protect and expand its moat and market position.\u201d<\/p>\n<p>Nvidia got its start selling gaming cards for desktop PCs, and that background is coming into play as computer makers push to add more AI functions to their machines.<\/p>\n<p>Microsoft Corp. and its hardware partners are using Computex to show off new laptops with AI enhancements under the branding of Copilot+.<\/p>\n<p>The majority of those devices coming to market are based on a new type of processor that will enable them to go longer on one battery charge, provided by Nvidia rival Qualcomm Inc.<\/p>\n<p>While those devices are good for simple AI functionality, adding an Nvidia graphics card will massively increase their performance and bring new features to popular software like games, Nvidia said.<\/p>\n<p>PC makers such as Asustek Computer are offering such computers, the company said.<\/p>\n<p>To help software makers bring more new capabilities to the PC, Nvidia is offering tools and pretrained AI models.<\/p>\n<p>They will handle complex tasks, such as deciding whether to crunch data on the machine itself or send it out to a data center over the internet.<\/p>\n<p>Separately, Nvidia is releasing a new design for server computers built on its chips.<\/p>\n<p>The MGX program is used by companies such as Hewlett Packard Enterprise Co. and Dell Technologies to allow them to get to market faster with products that are used by corporations and government agencies.<\/p>\n<p>Even rivals Advanced Micro Devices and Intel are taking advantage of the design with servers that put their processors alongside Nvidia chips.<\/p>\n<p>AMD CEO Lisa Su took the stage at Computex the day after Huang\u2019s comments, sketching out her company\u2019s progress in AI chips.<\/p>\n<p>AMD is speeding up the introduction of its AI processors as it seeks to close the gap with Nvidia in the fast-growing field.<\/p>\n<p>Nvidia\u2019s earlier-announced products, such as Spectrum X for networking and Nvidia Inference Microservices \u2014 or NIM, which Huang called \u201cAI in a box\u201d \u2014 are now generally available and being widely adopted, the company said.<\/p>\n<p>It\u2019s also going to offer free access to the NIM products.<\/p>\n<p>The microservices are a set of intermediate software and models that help companies roll out AI services more quickly, without having to worry about the underlying technology.<\/p>\n<p>Companies that deploy them then have to pay Nvidia a usage fee.<\/p>\n<p>Huang also promoted the use of digital twins in a virtual world that Nvidia calls the Omniverse.<\/p>\n<p>To show the scale possible, he showed a digital twin of planet Earth, called Earth 2, and how it can help conduct more sophisticated weather pattern modelling and other complex tasks.<\/p>\n<p>He noted that Taiwan-based contract manufacturers such as Hon Hai Precision Industry Co., also known as Foxconn, are using the tools to make plans and operate their factories more efficiently.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The company \u2014 now best known for its artificial intelligence data centre systems \u2014 also introduced new tools and software models on the eve of the Computex trade show in Taiwan.<\/p>\n","protected":false},"author":341034,"featured_media":505290,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_sma_x_autopost_status":"idle","_sma_x_autopost_error":"","_sma_x_post_id":"","_sma_x_attempts":0,"footnotes":""},"categories":[92837,15],"tags":[95113,95111,86677,3838,93057,95109],"class_list":["post-539373","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-hardware","tag-blackwell-ultra","tag-dan-newman","tag-jen-hsun-jensen-huang","tag-nvidia","tag-nvidia-blackwell","tag-nvidia-rubin"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/539373"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/341034"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=539373"}],"version-history":[{"count":2,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/539373\/revisions"}],"predecessor-version":[{"id":539379,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/539373\/revisions\/539379"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/505290"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=539373"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=539373"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=539373"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}