John Schulman and Barret Zoph | ChatGPT and the Art of Post Training
HAI Seminar with John Schulman & Barret Zoph
Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.
Sign Up For Latest News
HAI Seminar with John Schulman & Barret Zoph
A eureka moment is a two-step process: discovering something new and surprising, and establishing that it is correct. Drawing on her work at Axiom, Carina will discuss the transition from solving mathematical benchmarks to contributing to research, and from proving individual theorems to formalizing mathematical theories in Lean.

A eureka moment is a two-step process: discovering something new and surprising, and establishing that it is correct. Drawing on her work at Axiom, Carina will discuss the transition from solving mathematical benchmarks to contributing to research, and from proving individual theorems to formalizing mathematical theories in Lean.
A Center for Neural Data Science Seminar Series

A Center for Neural Data Science Seminar Series
Abstract:
At this seminar, we’ll talk about the history and development process of ChatGPT, tracing its journey from initial prototypes to becoming a large-scale product and research effort. We’ll delve into the technical and operational challenges involved in post-training, including fine-tuning for conversational behavior, addressing alignment issues, and optimizing for large-scale deployment. Additionally, we’ll highlight some of the innovative solutions developed to tackle these challenges. To conclude, we’ll explore a set of open problems in the field, including ethical considerations, maintaining factual accuracy, and advancing the contextual understanding of conversational AI.

