Skip to main content Skip to secondary navigation
Page Content

Advancing AI Audit: Project Showcase and Lessons Learned

Event Details

Tuesday, June 27, 2023
9:00 a.m. - 11:15 a.m. PDT

Event Type

Location

Virtual 

Contact

Daniel Zhang

Overview

How can we effectively design and develop practical tools to assess the presence of bias and potential discrimination in AI systems? Last August, HAI and Cyber Policy Center launched the AI Audit Challenge, an initiative that invited teams from around the world to submit their models, solutions, and tools with the goal of improving our ability to evaluate AI systems. This event spotlights the four award-winning entries, featuring insightful discussions from participants and AI experts on effective practices and valuable lessons learned from the Challenge. 

See the Challenge’s 2023 awards and finalists here

Watch the Recording

Event Organizers

Rumman Chowdhury

Rumman Chowdhury

Responsible AI Fellow, Harvard Berkman Klein Center for Internet & Society

Marietje headshot photo

Marietje Schaake

International Policy Fellow, Stanford HAI; International Policy Director, Stanford Cyber Policy Center

Agenda

9:00a.m. - 9:05a.m. PDT

Opening Remarks

 

 

Speakers

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University
Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University

Section 1: Project Showcase and Discussion

9:05a.m. - 9:15a.m. PDT

Award for the Greatest Potential

Auditbot

Speakers

Neal Lathia
Monzo Bank, UK
9:15a.m. - 9:25a.m. PDT

Award for Most Promising for Auditing LLMs

Ceteris Paribus

Speakers

Edward Chen
Stanford University
9:25a.m. - 9:35a.m. PDT

Award for Most Innovative and Empowering to the Public

End-User Audits

Speakers

Michelle S. Lam
Stanford University
9:35a.m. - 9:45a.m. PDT

Award for Best Holistic Evaluation and Benchmarking

HateCheck

Speakers

Paul Röttger
University of Oxford
Hannah Rose Kirk
University of Oxford
Bertie Vidgen
University of Oxford
9:45a.m. - 10:15a.m. PDT

Panel Discussion

Moderated panel discussion

Moderators

HAI International Policy Fellow; International Policy Director, Cyber Policy Center, Stanford University

Section 2: Best Practices and Lessons Learned

10:15a.m. - 11:15a.m. PDT

Panel Discussion

Moderated panel discussion

Speakers

Founder and Principal Researcher, Montreal AI Ethics Institute
Schwartz Reisman Chair in Technology and Society, Professor of Law and Professor of Strategic Management. CIFAR AI Chair. Director, Schwartz Reisman Institute for Technology and Society
Staff Research Scientist, DeepMind's Ethics and Society Team
Raj & Neera Singh Assistant Professor, Computer & Information Science, University of Pennsylvania

Moderators

Responsible AI Fellow, Berkman Klein Center for Internet & Society, Harvard University