Microsoft unveils an AI virtual machine powered by Azure and NVIDIA

Microsoft has recently announced details of their latest virtual machine destined for AI workloads, as the company continues to develop and release AI products following a substantial investment in OpenAI, The company that is behind ChatGPT.

In a recent blog post the company stressed the importance of the role its GPU-accelerated VM’s play in providing the foundation for many generative AI advancements , they are both in-house and from other companies including its own Azure OpenAI Service which puts AI writers like GPT-3.5, Codex, and DALL-E 2 into the hands of its customers.

With its new ND H100 v5 virtual machine, Microsoft promises “significantly faster performance” compared with the previous-generation ND A100 v4 virtual machines.

The updated VM makes use of eight NVIDIA H100 Tensor Core GPUs with the option to scale this up to a figure in the thousands. It’s also home to 4th Gen Intel Xeon Scalable processors and 16 channels of 4800 MHz DDR5 DIMMs.

With this move, Microsoft aims to deliver some of the latest, highest-performance technology at a more affordable rate to startups working in the AI field, many of which will be comparing their own stories to OpenAI’s recent success. That company’s co-founder, Greg Brockman, said:

“Co-designing supercomputers with Azure has been crucial for scaling our demanding AI training needs, making our research and alignment work on systems like ChatGPT possible.”

Moving forward, the ND H100 v5 VMs will need to be able to handle large amounts of training for significant periods of time as the world seeks to make artificial intelligence as reliable and accurate as possible.

The new H100-powered VMs are now available for preview as the tech giant looks to make them part of its standard offering in the Azure portfolio. 

For the latest industry news, click here: 

For the latest industry news, click here: