eventSeminar
Khaoula Chehbouni | Best Practices for the Use of LLMs as Judges
SeminarNov 13, 20261:00 PM - 2:15 PM
November
13
2026
An AI Measurement Science (AIMS) Seminar Series
Event
An AI Measurement Science (AIMS) Seminar Series
Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.
Sign Up For Latest News
An AI Measurement Science (AIMS) Seminar Series
An AI Measurement Science (AIMS) Seminar Series
Phil Lewis from the National Center for O*NET Development will talk about data infrastructure the US Department of Labor provides, and how AI is used to update it. A panel with Diyi Yang from the Stanford Computer Science Department and DEL’s Erik Brynjolfsson will discuss the opportunities of a new partnership between Stanford and the National Center for O*NET Development.
Phil Lewis from the National Center for O*NET Development will talk about data infrastructure the US Department of Labor provides, and how AI is used to update it. A panel with Diyi Yang from the Stanford Computer Science Department and DEL’s Erik Brynjolfsson will discuss the opportunities of a new partnership between Stanford and the National Center for O*NET Development.
In the last year, AI models have rapidly improved on public benchmarks measuring their ability to carry out research tasks autonomously. Such performance suggests that models may be capable of automating parts of the AI R&D process itself, thereby accelerating the pace of AI progress.
In the last year, AI models have rapidly improved on public benchmarks measuring their ability to carry out research tasks autonomously. Such performance suggests that models may be capable of automating parts of the AI R&D process itself, thereby accelerating the pace of AI progress.
Over the past few years, a series of crises and scandals have resulted in pushback against some of the biggest tech companies from employees within their ranks and from a broader public. This pushback has highlighted a deep concern with the ethical implications of data-driven technologies that have been implicated in anti-democratic practices, automated warfare, the spread of mis- and disinformation, and the perpetuation of racial and gender disparities. In the wake of this pushback, Silicon Valley tech companies have recently begun to invest resources in hiring personnel to design, develop, and manage a portfolio of practices that can adequately address these areas of ethical concern. In this talk we will discuss our recent research, in which we interviewed dozens of these "ethics owners" to understand how they understand their emerging job roles, the conceptual and organizational challenges that stand in their way, and the tensions that emerge from developing ethics practices inside and across their companies.
