{"id":641668,"date":"2023-04-26T10:05:52","date_gmt":"2023-04-26T15:05:52","guid":{"rendered":"https:\/\/news.sellorbuyhomefast.com\/index.php\/2023\/04\/26\/the-power-of-infrastructure-purpose-built-for-ai\/"},"modified":"2023-04-26T10:05:52","modified_gmt":"2023-04-26T15:05:52","slug":"the-power-of-infrastructure-purpose-built-for-ai","status":"publish","type":"post","link":"https:\/\/newsycanuse.com\/index.php\/2023\/04\/26\/the-power-of-infrastructure-purpose-built-for-ai\/","title":{"rendered":"The power of infrastructure purpose-built for AI"},"content":{"rendered":"
\n
\n

\n

<\/p>\n

\n

Image Credit: Adobe Stock<\/em><\/p>\n<\/div><\/div>\n<\/p><\/div>\n

\n
\n
\n

This article is part of a VB Lab Insights series on AI sponsored by Microsoft and Nvidia.<\/em><\/p>\n

Don\u2019t miss additional articles in this series providing new industry insights, trends and analysis on how AI is transforming organizations. Find them all here<\/a>. \u00a0<\/em><\/p>\n

\n

Advances in powerful computing and the cloud are at the heart of the AI revolution. With faster, more efficient processing of vast amounts of data, companies can break through the boundaries that previously limited model sizes, leading to innovation that will change the world. It\u2019s a revolution open to organizations of every size, given the affordability and versatility of the cloud.<\/p>\n

At NVIDIA\u2019s 2023 GTC, held March 20 \u2013 23, leaders from Microsoft showcased the ways AI infrastructure is crucial to AI innovation, from the keynote to demos and many other panels. Customers and partners dug deep into how they\u2019re using AI to transform and disrupt their industries, while Microsoft shared exclusive company announcements and showcased the recently released Azure OpenAI Service, NVIDIA H100 GPU-powered VM series for Generative AI, the new NVIDIA Omniverse Cloud on Azure and integration Microsoft 365 and more.<\/p>\n

Bringing AI into the physical world with autonomous driving<\/strong><\/h2>\n

The Microsoft Session, \u201cAccelerate AI Innovation with Unmatched Cloud Scale and Performance<\/a>,\u201d featured conversations with Alex Kendall from Wayve, Nidhi Chappell from Microsoft and NVIDIA\u2019s Manuvir Das, focusing on the ways AI infrastructure is crucial for advancing AI innovation, the leaps forward in Azure AI infrastructure powered by NVIDIA and more.<\/p>\n

First up was Alex Kendall, CEO of Wayve, a leader in bringing autonomous driving to market.<\/p>\n

It\u2019s widely accepted that autonomous driving will fundamentally change the way people and goods move around cities. \u201cBut in order to realize the promise of autonomous driving,\u201d Kendall explained, \u201cwe need to have an AI system which has the intelligence to make safe and robust decisions in the complex urban environments we drive in.\u201d<\/p>\n

Wayve is building an artificial intelligence system that can learn how to drive based on what it sees, with onboard intelligence needed to make decisions in real-time without requiring a set of rules or maps, bringing AI into the physical world. That requires the latest advances in machine learning, and a large-scale foundational neural network, trained with self-supervised learning to address very diverse sets of data.<\/p>\n

The scale of video data makes it an especially complicated task. Vehicles collect terabytes of data per minute from each of the car\u2019s cameras and radar, which is then sent to Wayve\u2019s training infrastructure on Azure that allows them to train billion-parameter neural networks.<\/p>\n

\u201cThis is a scale that autonomous driving hasn\u2019t seen yet \u2014 and we want to push the boundaries here,\u201d Kendall said. \u201cThat\u2019s where our partnership with Microsoft has been fantastic because we\u2019ve been working on supercomputing technologies that really make this possible both from a software infrastructure perspective as well as creating the right data and compute nodes to be able to train at this level of scale.\u201d<\/p>\n

Current successful results will only compound as the scale of data and compute increases, he added.<\/p>\n

\u201cWe see more and more of our fleet partners\u2019 vehicles contribute experience to our learning as we use new generative AI methods to be able to generate, re-simulate or create experiences that we can train from, or by scaling our simulation platform,\u201d Kendall said. \u201cIt operates in a really adaptable way in Azure as well that lets us both create synthetic training data, while new experiences train multi-agent reinforcement learning systems, and validate that our system achieves the performance that we expect before we deploy it on public roads.\u201d<\/p>\n

Azure infrastructure levels up again<\/strong><\/h2>\n

Nidhi Chappell, General Manager, HPC, AI, SAP and Confidential Computing, Microsoft brought news about the Microsoft AI initiatives addressing the growing compute demand for AI training and the equally urgent need for performance at scale. This high-end training is also very sensitive to performance at large scale with a single job synchronously running across thousands of GPUs.<\/p>\n

\u201cMicrosoft AI initiatives are part of that revolution,\u201d Chappell said. \u201cWe have a vision to embed AI in all of our products and we want to leverage the best infrastructure for these AI workloads.\u201d<\/p>\n

But building a full AI-optimized solution stack on premises can be impractical and costly for most companies. Azure AI infrastructure powered by NVIDIA accelerated computing and networking technologies combined with Microsoft\u2019s overall AI solution, was architected to address these challenges for customers of all sizes.<\/p>\n

\u201cOur design philosophy is to provide the optimal AI infrastructure configuration of the next-generation CPU, compute GPU and storage,\u201d she explained. NVIDIA solutions are utilized and interconnected with the NVIDIA Quantum InfiniBand, she added, \u201cto allow unprecedented scale in cloud surrounded by first-in-class AI platform services.\u201d<\/p>\n

Chappell also explained that Microsoft is currently the only provider to offer a pay-as-you go infrastructure stack \u2014 so that customers only pay for what they need, giving organizations the best performance at the scale of their choosing.<\/p>\n

The variety of Azure VM series and SKUs configurations are designed for middle-tier to small-scale AI workloads, even allowing the use of virtual machines for GPU workloads. These VMs offer hardware-based security enhancements to protect AI models and data in use.<\/p>\n

NVIDIA and Azure bring AI to companies of all sizes<\/strong><\/h2>\n

Manuvir Das, Vice President of Enterprise Compute at NVIDIA spoke about the ways their partnership with Microsoft is crucial to the evolution of Azure.<\/p>\n

\u201cAt its core, NVIDIA is the company of accelerated computing,\u201d said Manuvir Das, Vice President of Enterprise Compute, NVIDIA, \u201cwhether that\u2019s AI, data science or data processing.\u201d<\/p>\n

Das continued: \u201cMore and more customers have gravitated to Azure for their cloud computing platform. So the [Microsoft] partnership has been all about how do we take this new accelerated computing model and place it into Azure, the cloud where all these companies are choosing to do their work.\u201d<\/p>\n

Deep integration of NVIDIA AI software and hardware into Azure has put speed into the hands of an increasing number of companies, no matter where they are on the AI timeline. It\u2019s a particularly powerful tool for enterprises that aren\u2019t doing grand-scale projects, meaning they don\u2019t have large engineering teams or need the most powerful platform. But to operationalize AI, they need more power than simple turnkey solutions offer. NVIDIA AI Enterprise packages AI software for a broad array of use cases and integrates these seamlessly into Azure.<\/p>\n

For more details on these conversations, watch the full NVIDIA GTC session, \u201cAccelerate AI Innovation,\u201d on demand<\/a>, featuring Alex Kendall from Wayve, Nidhi Chappell, Microsoft, and Manuvir Das, NVIDIA.<\/p>\n

Introducing a new family of powerful, scalable VMs<\/strong><\/h2>\n

A new powerful and scalable VM is in town. Microsoft introduced the ND v5 H100 series<\/a>, powered by \u00a0NVIDIA H100 Tensor Core GPUs. It allows companies to scale models from eight to thousands of NVIDIA H100 GPUs interconnected on a single fabric, backed by NVIDIA Quantum-2 InfiniBand Networking.<\/p>\n

\u201cCustomers will see significant performance improvement on their OAI models over our last generation of ND series that was based on NVIDIA A100 GPUs,\u201d said Chappell. \u201cWith the introduction of these VMs there is going to be groundbreaking research for generative AI applications both for training as well as for inference.\u201d<\/p>\n

Microsoft worked closely with NVIDIA to update the entire architecture to absorb these new GPUs, offering a diverse portfolio that makes them fully available to the entire developer community.<\/p>\n

\u201cIt\u2019s the same programming model to access all of this stuff whether they\u2019re doing training or inference, and so it opens up all kinds of use cases,\u201d Das explained.<\/p>\n

For an in-depth look at the latest updates for Azure\u2019s ND series based on NVIDIA H100 GPUs, watch the NVIDIA GTC session: Azure\u2019s Purpose-Built AI Infrastructure using the Latest NVIDIA GPU Accelerators<\/a> featuring Matt Vegas, Principal Product Manager at Microsoft.<\/p>\n

NVIDIA and Microsoft announce <\/strong>industrial metaverse and AI supercomputing service collabs<\/strong><\/h2>\n

Elsewhere in the conference, Microsoft and NVIDIA demonstrated a new collaboration in action<\/a>: NVIDIA Omniverse Cloud.<\/p>\n

Microsoft Azure will host two new cloud offerings from NVIDIA<\/a>: NVIDIA Omniverse Cloud, a platform-as-a-service giving instant access to a full-stack environment to design, develop, deploy and manage industrial metaverse applications; and NVIDIA DGX Cloud, an AI supercomputing service that gives enterprises immediate access to the infrastructure and software needed to train advanced models for generative AI and other groundbreaking applications.<\/p>\n

Connecting Omniverse to Azure Digital Twins\u00a0and\u00a0Internet of Things allows companies to link real-time data from sensors in the physical world to digital replicas that automatically respond to changes in their physical environments. Azure provides the cloud infrastructure and capabilities needed to deploy enterprise services at scale, including security, identity and storage.<\/p>\n

Omniverse will also be integrated into the Microsoft productivity suite, starting with Microsoft Teams, SharePoint and OneDrive. Omniverse will be powered by Microsoft Azure, giving Microsoft 365 and Azure users their own Omniverse.<\/p>\n

Omniverse Cloud, powered by\u00a0NVIDIA OVX computing systems, will be available on Azure in the second half of the year, while DGX Cloud will be available running in Azure beginning next quarter, providing enterprises with dedicated clusters of NVIDIA DGX AI supercomputing and software, rented on a monthly basis.<\/p>\n

And for more information on the ways companies can build, operationalize and deploy AI-enabled products and services, plus industry insights trends and analysis to help business and IT decision-makers capture the revolutionary power of AI, head to <\/em>Microsoft and NVIDIA\u2019s Make AI Your Reality hub at VB Lab<\/em><\/a>.<\/em><\/p>\n

\n

VB Lab Insights content is created in collaboration with a company that is either paying for the post or has a business relationship with VentureBeat, and they\u2019re always clearly marked. For more information, contact sa***<\/span>@*********<\/span>at.com<\/span>.<\/em>\n\t\t\t\t<\/p>\n<\/div><\/div>\n

Read More<\/a>
\n VB Staff<\/p>\n","protected":false},"excerpt":{"rendered":"

April 26, 2023 6:20 AM Image Credit: Adobe Stock This article is part of a VB Lab Insights series on AI sponsored by Microsoft and Nvidia. Don\u2019t miss additional articles in this series providing new industry insights, trends and analysis on how AI is transforming organizations. Find them all here. \u00a0 Advances in powerful computing<\/p>\n","protected":false},"author":1,"featured_media":641669,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[27827,414,46],"tags":[],"class_list":{"0":"post-641668","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-infrastructure","8":"category-power","9":"category-technology"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/641668","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=641668"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/641668\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/641669"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=641668"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=641668"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=641668"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}