Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.
Sign Up For Latest News
This seminar pairs a case study of AI diffusion with an organizational approach to technological changes in the workplace.
This seminar pairs a case study of AI diffusion with an organizational approach to technological changes in the workplace.
Sessions run Wednesdays from 4:30–5:30 PM in CoDa E160. Each session features a different Stanford speaker; talk titles are announced by the organizers.
Sessions run Wednesdays from 4:30–5:30 PM in CoDa E160. Each session features a different Stanford speaker; talk titles are announced by the organizers.
Abstract: As foundation models grow in scale and complexity, the need for reproducible, modular, and high-performance research frameworks has become critical. NVIDIA NeMo is an open, extensible framework built on PyTorch and tightly integrated with Megatron-Core and Transformer Engine for optimized distributed training on NVIDIA GPUs, providing a unified stack for developing end-to-end generative AI models. This talk will introduce key components of the NeMo ecosystem, including data curation, model customization through techniques like parameter-efficient fine-tuning (PEFT) and model alignment algorithms, model safety through guardrails, as well as 4D parallelism for efficient large-model training. Drawing on examples from robotics research, the presentation will highlight how NeMo can be used to build and adapt foundation models for multimodal and domain-specific reasoning, illustrating how NeMo’s modular design enables scalable, domain-specific generative AI for complex systems.
Speaker: Sugandha Sharma is a senior generative AI architect and scientist at NVIDIA, specializing in generative models for robotics and embodied AI. Prior to joining NVIDIA, she was a research scientist at Microsoft Research, where she worked on GPT-based gaming AI agents and their alignment with humans. She holds a PhD in theoretical neuroscience from MIT, where she developed generative AI agents for 3D spatial planning, a memory model without catastrophic forgetting, and the first neural circuit model linking memory and spatial navigation, significantly advancing the theoretical understanding of brain circuits.
We are excited to announce a series of NVIDIA-led workshops designed to enhance your expertise in GPU computing. Whether you're a beginner or looking to deepen your skills, these sessions offer valuable insights and hands-on learning opportunities. Workshops are expected to be held on a monthly basis.
