Advancing AI Audit - Project Showcase and Lessons Learned | Stanford HAI
Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Fellowship Programs
    • Grants
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs
Navigate
  • About
  • Events
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

eventLecture

Advancing AI Audit - Project Showcase and Lessons Learned

Status
Past
Date
Tuesday, June 27, 2023 9:00 AM - 11:15 AM PST/PDT
Location
Virtual 

How can we effectively design and develop practical tools to assess the presence of bias and potential discrimination in AI systems?

Share
Link copied to clipboard!
Event Contact
Daniel Zhang
dzhang105@stanford.edu

Related Events

Suproteem Sarkar | AI Agents and Higher-Order Work
Apr 06, 202612:00 PM - 1:00 PM
April
06
2026

How do AI agents influence knowledge work? This paper finds that agents shift worker effort from implementation to supervision, which especially benefits verifiable work and expert workers. I use data from the coding platform Cursor to study agents in software production.

Event

Suproteem Sarkar | AI Agents and Higher-Order Work

Apr 06, 202612:00 PM - 1:00 PM

How do AI agents influence knowledge work? This paper finds that agents shift worker effort from implementation to supervision, which especially benefits verifiable work and expert workers. I use data from the coding platform Cursor to study agents in software production.

Caroline Meinhardt, Thomas Mullaney, Juan N. Pava, and Diyi Yang | How Can AI Support Language Digitization and Digital Inclusion?
SeminarApr 15, 202612:00 PM - 1:15 PM
April
15
2026

What does digital inclusion look like in the age of AI? Over 6,000 of the world’s 7,000-plus living languages remain digitally disadvantaged.

Seminar

Caroline Meinhardt, Thomas Mullaney, Juan N. Pava, and Diyi Yang | How Can AI Support Language Digitization and Digital Inclusion?

Apr 15, 202612:00 PM - 1:15 PM

What does digital inclusion look like in the age of AI? Over 6,000 of the world’s 7,000-plus living languages remain digitally disadvantaged.

AI+Science: Accelerating Discovery
ConferenceMay 05, 20268:30 AM - 5:00 PM
May
05
2026

AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery.

Conference

AI+Science: Accelerating Discovery

May 05, 20268:30 AM - 5:00 PM

AI+Science: Accelerating Discovery is an interdisciplinary conference bringing together researchers across physics, mathematics, chemistry, biology, neuroscience, and more to examine how AI is reshaping scientific discovery.

Last August, HAI and Cyber Policy Center launched the AI Audit Challenge, an initiative that invited teams from around the world to submit their models, solutions, and tools with the goal of improving our ability to evaluate AI systems. This event spotlights the four award-winning entries, featuring insightful discussions from participants and AI experts on effective practices and valuable lessons learned from the Challenge. 

Agenda

9:00a.m. - 9:05a.m. PDT

Opening Remarks 

Speakers

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Section 1: Project Showcase and Discussion

9:05a.m. - 9:15a.m. PDT

Award for the Greatest Potential

Auditbot

Speakers

Neal Lathia

Monzo Bank, UK

9:15a.m. - 9:25a.m. PDT

Award for Most Promising for Auditing LLMs

Ceteris Paribus

Speakers

Edward Chen

Stanford University

9:25a.m. - 9:35a.m. PDT

Award for Most Innovative and Empowering to the Public

End-User Audits

Speakers

Michelle S. Lam

Stanford University

9:35a.m. - 9:45a.m. PDT

Award for Best Holistic Evaluation and Benchmarking

HateCheck

Speakers

Paul Röttger

University of Oxford

Hannah Rose Kirk

University of Oxford

Bertie Vidgen

University of Oxford

9:45a.m. - 10:15a.m. PDT

Panel Discussion

Moderated panel discussion

Moderators

Marietje Schaake

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Section 2: Best Practices and Lessons Learned

10:15a.m. - 11:15a.m. PDT

Panel Discussion

Moderated panel discussion

Speakers

Abhishek Gupta

Founder and Principal Researcher, Montreal AI Ethics Institute

Gillian Hadfield

Schwartz Reisman Chair in Technology and Society, Professor of Law and Professor of Strategic Management. CIFAR AI Chair. Director, Schwartz Reisman Institute for Technology and Society

William Issac

Staff Research Scientist, DeepMind's Ethics and Society Team

Danaë Metaxa

Raj & Neera Singh Assistant Professor, Computer & Information Science, University of Pennsylvania

Moderators

Rumman Chowdhury

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Event Organizers
Rumman Chowdhury
Director of ML EThics, Transparency, and Accountability, Twitter
Marietje Schaake
International Policy Fellow, Stanford HAI
Daniel Zhang
Chief of Staff

Watch Event Recording