John Schulman and Barret Zoph | ChatGPT and the Art of Post Training
HAI Seminar with John Schulman & Barret Zoph
Abstract:
At this seminar, we’ll talk about the history and development process of ChatGPT, tracing its journey from initial prototypes to becoming a large-scale product and research effort. We’ll delve into the technical and operational challenges involved in post-training, including fine-tuning for conversational behavior, addressing alignment issues, and optimizing for large-scale deployment. Additionally, we’ll highlight some of the innovative solutions developed to tackle these challenges. To conclude, we’ll explore a set of open problems in the field, including ethical considerations, maintaining factual accuracy, and advancing the contextual understanding of conversational AI.
Related Events
AI+Science: Accelerating Discovery
AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery.
AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery.
Kristina McElheran | The Rise of Industrial AI in America: Microfoundations of the Productivity J-curve(s)
We examine the prevalence and productivity dynamics of artificial intelligence (AI) in American manufacturing. Working with the Census Bureau to collect detailed large-scale data for 2017 and 2021, we focus on AI-related technologies with industrial applications.
.png&w=1920&q=100)
We examine the prevalence and productivity dynamics of artificial intelligence (AI) in American manufacturing. Working with the Census Bureau to collect detailed large-scale data for 2017 and 2021, we focus on AI-related technologies with industrial applications.
Wolfgang Lehrach | Code World Models for General Game Playing
While Large Language Models (LLMs) show promise in many domains, relying on them for direct policy generation in games often results in illegal moves and poor strategic play.
While Large Language Models (LLMs) show promise in many domains, relying on them for direct policy generation in games often results in illegal moves and poor strategic play.