John Schulman and Barret Zoph | ChatGPT and the Art of Post Training
HAI Seminar with John Schulman & Barret Zoph
Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.
Sign Up For Latest News
HAI Seminar with John Schulman & Barret Zoph
What does digital inclusion look like in the age of AI? Over 6,000 of the world’s 7,000-plus living languages remain digitally disadvantaged.

What does digital inclusion look like in the age of AI? Over 6,000 of the world’s 7,000-plus living languages remain digitally disadvantaged.
AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery. Experts will separate hype from reality, spotlighting where AI is already enabling genuine breakthroughs and where its limits and risks remain.

AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery. Experts will separate hype from reality, spotlighting where AI is already enabling genuine breakthroughs and where its limits and risks remain.
While Large Language Models (LLMs) show promise in many domains, relying on them for direct policy generation in games often results in illegal moves and poor strategic play.

While Large Language Models (LLMs) show promise in many domains, relying on them for direct policy generation in games often results in illegal moves and poor strategic play.
Abstract:
At this seminar, we’ll talk about the history and development process of ChatGPT, tracing its journey from initial prototypes to becoming a large-scale product and research effort. We’ll delve into the technical and operational challenges involved in post-training, including fine-tuning for conversational behavior, addressing alignment issues, and optimizing for large-scale deployment. Additionally, we’ll highlight some of the innovative solutions developed to tackle these challenges. To conclude, we’ll explore a set of open problems in the field, including ethical considerations, maintaining factual accuracy, and advancing the contextual understanding of conversational AI.

