Advancing AI Audit - Project Showcase and Lessons Learned | Stanford HAI
Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Fellowship Programs
    • Grants
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs
Navigate
  • About
  • Events
  • AI Glossary
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

eventLecture

Advancing AI Audit - Project Showcase and Lessons Learned

Status
Past
Date
Tuesday, June 27, 2023 9:00 AM - 11:15 AM PST/PDT
Location
Virtual 

How can we effectively design and develop practical tools to assess the presence of bias and potential discrimination in AI systems?

Share
Link copied to clipboard!
Event Contact
Daniel Zhang
dzhang105@stanford.edu

Related Events

AI+Science: Accelerating Discovery
ConferenceMay 05, 20268:30 AM - 6:45 PM
May
05
2026

AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery.

Conference

AI+Science: Accelerating Discovery

May 05, 20268:30 AM - 6:45 PM

AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery.

Wolfgang Lehrach | Code World Models for General Game Playing
SeminarMay 13, 202612:00 PM - 1:15 PM
May
13
2026

While Large Language Models (LLMs) show promise in many domains, relying on them for direct policy generation in games often results in illegal moves and poor strategic play.

Seminar

Wolfgang Lehrach | Code World Models for General Game Playing

May 13, 202612:00 PM - 1:15 PM

While Large Language Models (LLMs) show promise in many domains, relying on them for direct policy generation in games often results in illegal moves and poor strategic play.

Inside the 2026 AI Index Report | Stanford HAI
SeminarMay 20, 202612:00 PM - 1:15 PM
May
20
2026

The AI Index, currently in its ninth year, tracks, collates, distills, and visualizes data relating to artificial intelligence.

Seminar

Inside the 2026 AI Index Report | Stanford HAI

May 20, 202612:00 PM - 1:15 PM

The AI Index, currently in its ninth year, tracks, collates, distills, and visualizes data relating to artificial intelligence.

Last August, HAI and Cyber Policy Center launched the AI Audit Challenge, an initiative that invited teams from around the world to submit their models, solutions, and tools with the goal of improving our ability to evaluate AI systems. This event spotlights the four award-winning entries, featuring insightful discussions from participants and AI experts on effective practices and valuable lessons learned from the Challenge. 

Agenda

9:00a.m. - 9:05a.m. PDT

Opening Remarks 

Speakers

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Section 1: Project Showcase and Discussion

9:05a.m. - 9:15a.m. PDT

Award for the Greatest Potential

Auditbot

Speakers

Neal Lathia

Monzo Bank, UK

9:15a.m. - 9:25a.m. PDT

Award for Most Promising for Auditing LLMs

Ceteris Paribus

Speakers

Edward Chen

Stanford University

9:25a.m. - 9:35a.m. PDT

Award for Most Innovative and Empowering to the Public

End-User Audits

Speakers

Michelle S. Lam

Stanford University

9:35a.m. - 9:45a.m. PDT

Award for Best Holistic Evaluation and Benchmarking

HateCheck

Speakers

Paul Röttger

University of Oxford

Hannah Rose Kirk

University of Oxford

Bertie Vidgen

University of Oxford

9:45a.m. - 10:15a.m. PDT

Panel Discussion

Moderated panel discussion

Moderators

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Section 2: Best Practices and Lessons Learned

10:15a.m. - 11:15a.m. PDT

Panel Discussion

Moderated panel discussion

Speakers

Abhishek Gupta

Founder and Principal Researcher, Montreal AI Ethics Institute

Gillian Hadfield

Schwartz Reisman Chair in Technology and Society, Professor of Law and Professor of Strategic Management. CIFAR AI Chair. Director, Schwartz Reisman Institute for Technology and Society

William Issac

Staff Research Scientist, DeepMind's Ethics and Society Team

Danaë Metaxa

Raj & Neera Singh Assistant Professor, Computer & Information Science, University of Pennsylvania

Moderators

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Event Organizers
Rumman Chowdhury
Director of ML EThics, Transparency, and Accountability, Twitter
Marietje Schaake
International Policy Fellow, Stanford HAI
Daniel Zhang
Chief of Staff

Watch Event Recording