Advancing AI Audit - Project Showcase and Lessons Learned | Stanford HAI
Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Fellowship Programs
    • Grants
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs
Navigate
  • About
  • Events
  • AI Glossary
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

eventLecture

Advancing AI Audit - Project Showcase and Lessons Learned

Status
Past
Date
Tuesday, June 27, 2023 9:00 AM - 11:15 AM PST/PDT
Location
Virtual 

How can we effectively design and develop practical tools to assess the presence of bias and potential discrimination in AI systems?

Share
Link copied to clipboard!
Event Contact
Daniel Zhang
dzhang105@stanford.edu

Related Events

Arvind Narayanan | Adapting to the Transformation of Knowledge Work
May 18, 202612:00 PM - 1:00 PM
May
18
2026

The possibility that AI will automate most cognitive labor is worth taking seriously. How should we adapt to this transformation? I start from the perspective, articulated in the essay “AI as normal technology”, that the true bottlenecks lie downstream of capabilities and that AI’s impacts will unfold gradually over decades. If this is true, there are major gaps in our current evidence infrastructure, because it over-emphasizes the capability layer.

Event

Arvind Narayanan | Adapting to the Transformation of Knowledge Work

May 18, 202612:00 PM - 1:00 PM

The possibility that AI will automate most cognitive labor is worth taking seriously. How should we adapt to this transformation? I start from the perspective, articulated in the essay “AI as normal technology”, that the true bottlenecks lie downstream of capabilities and that AI’s impacts will unfold gradually over decades. If this is true, there are major gaps in our current evidence infrastructure, because it over-emphasizes the capability layer.

Inside the 2026 AI Index Report | Stanford HAI
SeminarMay 20, 202612:00 PM - 1:15 PM
May
20
2026

The AI Index, currently in its ninth year, tracks, collates, distills, and visualizes data relating to artificial intelligence.

Seminar

Inside the 2026 AI Index Report | Stanford HAI

May 20, 202612:00 PM - 1:15 PM

The AI Index, currently in its ninth year, tracks, collates, distills, and visualizes data relating to artificial intelligence.

Eyck Freymann | AI and Strategic Stability: A Framework for U.S.–China Technology Competition
SeminarMay 27, 202612:00 PM - 1:15 PM
May
27
2026

Strategic stability exists when neither side thinks it can improve its strategic outcome by striking first.

Seminar

Eyck Freymann | AI and Strategic Stability: A Framework for U.S.–China Technology Competition

May 27, 202612:00 PM - 1:15 PM

Strategic stability exists when neither side thinks it can improve its strategic outcome by striking first.

Last August, HAI and Cyber Policy Center launched the AI Audit Challenge, an initiative that invited teams from around the world to submit their models, solutions, and tools with the goal of improving our ability to evaluate AI systems. This event spotlights the four award-winning entries, featuring insightful discussions from participants and AI experts on effective practices and valuable lessons learned from the Challenge. 

Agenda

9:00a.m. - 9:05a.m. PDT

Opening Remarks 

Speakers

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Section 1: Project Showcase and Discussion

9:05a.m. - 9:15a.m. PDT

Award for the Greatest Potential

Auditbot

Speakers

Neal Lathia

Monzo Bank, UK

9:15a.m. - 9:25a.m. PDT

Award for Most Promising for Auditing LLMs

Ceteris Paribus

Speakers

Edward Chen

Stanford University

9:25a.m. - 9:35a.m. PDT

Award for Most Innovative and Empowering to the Public

End-User Audits

Speakers

Michelle S. Lam

Stanford University

9:35a.m. - 9:45a.m. PDT

Award for Best Holistic Evaluation and Benchmarking

HateCheck

Speakers

Paul Röttger

University of Oxford

Hannah Rose Kirk

University of Oxford

Bertie Vidgen

University of Oxford

9:45a.m. - 10:15a.m. PDT

Panel Discussion

Moderated panel discussion

Moderators

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Section 2: Best Practices and Lessons Learned

10:15a.m. - 11:15a.m. PDT

Panel Discussion

Moderated panel discussion

Speakers

Abhishek Gupta

Founder and Principal Researcher, Montreal AI Ethics Institute

Gillian Hadfield

Schwartz Reisman Chair in Technology and Society, Professor of Law and Professor of Strategic Management. CIFAR AI Chair. Director, Schwartz Reisman Institute for Technology and Society

William Issac

Staff Research Scientist, DeepMind's Ethics and Society Team

Danaë Metaxa

Raj & Neera Singh Assistant Professor, Computer & Information Science, University of Pennsylvania

Moderators

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Event Organizers
Rumman Chowdhury
Director of ML EThics, Transparency, and Accountability, Twitter
Marietje Schaake
International Policy Fellow, Stanford HAI
Daniel Zhang
Chief of Staff

Watch Event Recording