Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
Advancing AI Audit - Project Showcase and Lessons Learned | Stanford HAI
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Research Programs
    • Grants
    • Marlowe (opens in new tab)
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

Navigate
  • About
  • Events
  • AI Glossary
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us
eventLecture

Advancing AI Audit - Project Showcase and Lessons Learned

Status
Past
Date
Tuesday, June 27, 2023 9:00 AM - 11:15 AM PST/PDT
Location
Virtual 

How can we effectively design and develop practical tools to assess the presence of bias and potential discrimination in AI systems?

Share
Link copied to clipboard!
Event Contact
Daniel Zhang
dzhang105@stanford.edu

Related Events

Khaoula Chehbouni | Best Practices for the Use of LLMs as Judges
SeminarNov 13, 20261:00 PM - 2:15 PM
November
13
2026

An AI Measurement Science (AIMS) Seminar Series

Event

Khaoula Chehbouni | Best Practices for the Use of LLMs as Judges

Nov 13, 20261:00 PM - 2:15 PM

An AI Measurement Science (AIMS) Seminar Series

Special Seminar and Fireside Chat: Understanding Work Using AI
Nov 13, 20262:00 PM - 4:00 PM
November
13
2026

Phil Lewis from the National Center for O*NET Development will talk about data infrastructure the US Department of Labor provides, and how AI is used to update it. A panel with Diyi Yang from the Stanford Computer Science Department and DEL’s Erik Brynjolfsson will discuss the opportunities of a new partnership between Stanford and the National Center for O*NET Development.

Event

Special Seminar and Fireside Chat: Understanding Work Using AI

Nov 13, 20262:00 PM - 4:00 PM

Phil Lewis from the National Center for O*NET Development will talk about data infrastructure the US Department of Labor provides, and how AI is used to update it. A panel with Diyi Yang from the Stanford Computer Science Department and DEL’s Erik Brynjolfsson will discuss the opportunities of a new partnership between Stanford and the National Center for O*NET Development.

Christopher Ong | Research Acceleration: The View Inside OpenAI
Nov 16, 202612:00 PM - 1:00 PM
November
16
2026

In the last year, AI models have rapidly improved on public benchmarks measuring their ability to carry out research tasks autonomously. Such performance suggests that models may be capable of automating parts of the AI R&D process itself, thereby accelerating the pace of AI progress.

Event

Christopher Ong | Research Acceleration: The View Inside OpenAI

Nov 16, 202612:00 PM - 1:00 PM

In the last year, AI models have rapidly improved on public benchmarks measuring their ability to carry out research tasks autonomously. Such performance suggests that models may be capable of automating parts of the AI R&D process itself, thereby accelerating the pace of AI progress.

Last August, HAI and Cyber Policy Center launched the AI Audit Challenge, an initiative that invited teams from around the world to submit their models, solutions, and tools with the goal of improving our ability to evaluate AI systems. This event spotlights the four award-winning entries, featuring insightful discussions from participants and AI experts on effective practices and valuable lessons learned from the Challenge. 

Agenda

9:00a.m. - 9:05a.m. PDT

Opening Remarks 

Speakers

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Section 1: Project Showcase and Discussion

9:05a.m. - 9:15a.m. PDT

Award for the Greatest Potential

Auditbot

Speakers

Neal Lathia

Monzo Bank, UK

9:15a.m. - 9:25a.m. PDT

Award for Most Promising for Auditing LLMs

Ceteris Paribus

Speakers

Edward Chen

Stanford University

9:25a.m. - 9:35a.m. PDT

Award for Most Innovative and Empowering to the Public

End-User Audits

Speakers

Michelle S. Lam

Stanford University

9:35a.m. - 9:45a.m. PDT

Award for Best Holistic Evaluation and Benchmarking

HateCheck

Speakers

Paul Röttger

University of Oxford

Hannah Rose Kirk

University of Oxford

Bertie Vidgen

University of Oxford

9:45a.m. - 10:15a.m. PDT

Panel Discussion

Moderated panel discussion

Moderators

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Section 2: Best Practices and Lessons Learned

10:15a.m. - 11:15a.m. PDT

Panel Discussion

Moderated panel discussion

Speakers

Abhishek Gupta

Founder and Principal Researcher, Montreal AI Ethics Institute

Gillian Hadfield

Schwartz Reisman Chair in Technology and Society, Professor of Law and Professor of Strategic Management. CIFAR AI Chair. Director, Schwartz Reisman Institute for Technology and Society

William Issac

Staff Research Scientist, DeepMind's Ethics and Society Team

Danaë Metaxa

Raj & Neera Singh Assistant Professor, Computer & Information Science, University of Pennsylvania

Moderators

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Event Organizers
Rumman Chowdhury
Director of ML EThics, Transparency, and Accountability, Twitter
Marietje Schaake
International Policy Fellow, Stanford HAI
Daniel Zhang
Chief of Staff at Stanford HAI

Watch Event Recording