Generative AI in the Cloud: Inside Microsoft AI innovation

Join Mark Russinovich, Azure CTO and Technical Fellow, and get an under-the-hood look at Microsoft’s AI architecture, including the large-scale supercomputers that train foundational models and the infrastructure that efficiently serves small and large pretrained and finetuned models. He’ll cover everything from how we design servers, to the AI-aware resource management service that schedules training and inference, to the AI-specific techniques we’ve developed for maximizing GPU usage. You’ll also get a look at advancements and opportunities in trending AI research and confidential AI.