Riding the surge of hype around ChatGPT and other artificial intelligence products, Nvidia Corp. introduced new chips, supercomputing services and a raft of high-profile partnerships Tuesday intended to showcase how its technology will fuel the next wave of AI breakthroughs.<\/p>\n
At the chipmaker\u2019s annual developer conference on Tuesday, chief executive officer Jensen Huang positioned Nvidia as the engine behind \u201cthe iPhone moment of AI,\u201d as he\u2019s taken to calling this inflexion point in computing.<\/p>\n
Spurred by a boom in consumer and enterprise applications, such as advanced chatbots and eye-popping graphics generators, \u201cgenerative AI will reinvent nearly every industry,\u201d Huang said.<\/p>\n
The idea is to build infrastructure that can make AI apps faster and more accessible to customers.<\/p>\n
Nvidia\u2019s graphics processing units have become the brains behind ChatGPT and its ilk, helping them digest and process ever-greater sums of training data.<\/p>\n
Microsoft Corp. revealed last week it had to string together tens of thousands of Nvidia\u2019s A100 GPUs in data centers in order to handle the computational workload in the cloud for OpenAI, ChatGPT\u2019s developer.<\/p>\n
Other tech giants are following suit with similarly colossal cloud infrastructures geared for AI.<\/p>\n
Oracle Corp. announced that its platform will feature 16,000 Nvidia H100 GPUs, the A100\u2019s successor, for high-performance compute applications, and Nvidia said a forthcoming system from Amazon Web Services will be able to scale up to 20,000 interconnected H100s.<\/p>\n
Microsoft has likewise started adding the H100 to its server racks.<\/p>\n
These kinds of chip superclusters are part of a push by Nvidia to rent out supercomputing services through a new program called DGX Cloud, hosted by Oracle and soon Microsoft Azure and Google Cloud.<\/p>\n
Nvidia said the goal is to make accessing an AI supercomputer as easy as opening a webpage, enabling companies to train their models without the need for on-premise infrastructure that\u2019s costly to install and manage.<\/p>\n
\u201cProvide your job, point to your data set, and you hit go \u2014 and all of the orchestration and everything underneath is taken care of,\u201d said Manuvir Das, Nvidia\u2019s vice president of enterprise computing.<\/p>\n
The DGX Cloud service will start at $36,999 per instance per month, with each \u201cinstance\u201d\u2014 essentially the amount of computing horsepower being rented \u2014 equating to eight H100 GPUs.<\/p>\n
Nvidia also launched two new chips, one focused on enhancing AI video performance and the other an upgrade to the H100.<\/p>\n
The latter GPU is designed specifically to improve the deployment of large language models like those used by ChatGPT.<\/p>\n
Called the H100 NVL, it can perform 12 times faster when handling inferences \u2014 that is, how AI responds to real-life queries \u2014 compared with the prior generation of A100s at scale in data centers.<\/p>\n
Ian Buck, vice president of hyperscale and high-performance computing at Nvidia, said it will help \u201cdemocratise ChatGPT use cases and bring that capability to every server and every cloud.\u201d<\/p>\n
At the chipmaker\u2019s annual developer conference on Tuesday, chief executive officer Jensen Huang positioned Nvidia as the engine behind \u201cthe iPhone moment of AI,\u201d as he\u2019s taken to calling this inflexion point in computing.<\/p>\n","protected":false},"author":341034,"featured_media":484739,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_sma_x_autopost_status":"idle","_sma_x_autopost_error":"","_sma_x_post_id":"","_sma_facebook_post_id":"","_sma_instagram_post_id":"","_sma_threads_post_id":"","_sma_x_attempts":0,"footnotes":""},"categories":[25],"tags":[27543,35793,35258,33897,76672,24957,3838,85017],"class_list":["post-484737","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cloud-hosting","tag-amazon-web-services-aws","tag-artificial-intelligence-ai","tag-cloud-services","tag-google-cloud","tag-jensen-huang","tag-microsoft-azure","tag-nvidia","tag-nvidia-h100"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/484737"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/341034"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=484737"}],"version-history":[{"count":1,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/484737\/revisions"}],"predecessor-version":[{"id":484741,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/484737\/revisions\/484741"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/484739"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=484737"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=484737"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=484737"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}