Mark Russinovich | Generative AI in the Cloud: Inside Microsoft AI Innovation

Abstract:

In this seminar, Mark Russinovich, Azure CTO and Technical Fellow, gave an under-the-hood look at Microsoft’s AI architecture, including the large-scale supercomputers that train foundational models and the infrastructure that efficiently serves small and large pretrained and fine-tuned models. He covered everything from how the company designs servers, to the AI-aware resource management service that schedules training and inference, to the AI-specific techniques it’s developed for maximizing GPU usage. He also gave insight into advancements and opportunities in trending AI research and confidential AI.