John Schulman and Barret Zoph | ChatGPT and the Art of Post Training
HAI Seminar with John Schulman & Barret Zoph
Abstract:
At this seminar, we’ll talk about the history and development process of ChatGPT, tracing its journey from initial prototypes to becoming a large-scale product and research effort. We’ll delve into the technical and operational challenges involved in post-training, including fine-tuning for conversational behavior, addressing alignment issues, and optimizing for large-scale deployment. Additionally, we’ll highlight some of the innovative solutions developed to tackle these challenges. To conclude, we’ll explore a set of open problems in the field, including ethical considerations, maintaining factual accuracy, and advancing the contextual understanding of conversational AI.
Related Events
Sanmi Koyejo | Beyond Benchmarks: Building a Science of AI Measurement
The widepread deployment of AI systems in critical domains demands more rigorous approaches to evaluating their capabilities and safety.
The widepread deployment of AI systems in critical domains demands more rigorous approaches to evaluating their capabilities and safety.
Robotics in a Human-Centered World: Innovations and Implications
2025 Spring Conference
Lowry Pressly | Privacy and the Power of Unknowing
In an era when information is treated as a form of power and self-knowledge an unqualified good, the value of what remains unknown is often overlooked.
In an era when information is treated as a form of power and self-knowledge an unqualified good, the value of what remains unknown is often overlooked.