Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
Sanmi Koyejo | Beyond Benchmarks: Building a Science of AI Measurement | Stanford HAI
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Research Programs
    • Grants
    • Marlowe (opens in new tab)
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs
Navigate
  • About
  • Events
  • AI Glossary
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

Your browser does not support the video tag.
eventSeminar

Sanmi Koyejo | Beyond Benchmarks: Building a Science of AI Measurement

Status
Past
Date
Wednesday, March 19, 2025 12:00 PM - 1:15 PM PST/PDT
Location
Gates Computer Science Building Room 119
Topics
Sciences (Social, Health, Biological, Physical)
Attend Virtually

The widepread deployment of AI systems in critical domains demands more rigorous approaches to evaluating their capabilities and safety.

Share
Link copied to clipboard!
Event Contact
Annie Benisch
abenisch@stanford.edu

Related Events

AI100 | AI Goes Mainstream: The Scaling Era and the Rise of Generative AI
SeminarNov 18, 202612:00 PM - 1:15 PM
November
18
2026

This talk will cover key insights from the third AI100 report, AI Goes Mainstream: The Scaling Era and the Rise of Generative AI, set for release in November 2026. The report was commissioned by the AI100 standing committee and led by study panel chair Michael Wooldridge.

Seminar

AI100 | AI Goes Mainstream: The Scaling Era and the Rise of Generative AI

Nov 18, 202612:00 PM - 1:15 PM

This talk will cover key insights from the third AI100 report, AI Goes Mainstream: The Scaling Era and the Rise of Generative AI, set for release in November 2026. The report was commissioned by the AI100 standing committee and led by study panel chair Michael Wooldridge.

Marlowe | AI + Data for Science with Andreas Tolias
SeminarNov 18, 20264:30 PM - 5:30 PM
November
18
2026

Sessions run Wednesdays from 4:30–5:30 PM in CoDa E160. Each session features a different Stanford speaker; talk titles are announced by the organizers.

Event

Marlowe | AI + Data for Science with Andreas Tolias

Nov 18, 20264:30 PM - 5:30 PM

Sessions run Wednesdays from 4:30–5:30 PM in CoDa E160. Each session features a different Stanford speaker; talk titles are announced by the organizers.

NVIDIA & Marlowe | Accelerating Biological Discovery with AI — Youssef Nashed
Dec 02, 2026
December
02
2026

This talk will explore the latest advances in computational protein design and structure prediction, highlighting NVIDIA technologies such as cuEquivariance and the Proteína family of models, including the latest RFdiffusion4 (RFD4)–Proteína developments. We will discuss how accelerated geometric deep learning and generative AI are enabling scalable, high-performance protein modeling and the design of novel proteins with tailored structures and functions.

Bio:
Youssef Nashed is a Senior Solutions Architect on NVIDIA's Healthcare and Life Sciences team. He joined NVIDIA from Bristol Myers Squibb (BMS), where he was a Senior Principal Scientist focused on machine learning and computational protein design. At BMS, Youssef led a team developing and deploying AI models for antibody discovery and development. He previously served as an Assistant Professor at Northwestern University and conducted research in structural biology at SLAC National Accelerator Laboratory at Stanford. Youssef began his career in high-performance and large-scale GPU computing at Argonne National Laboratory. His background spans computer science, mathematics, structural biology, and AI-driven protein engineering.

Location: CoDa W401

Event

NVIDIA & Marlowe | Accelerating Biological Discovery with AI — Youssef Nashed

Dec 02, 2026

This talk will explore the latest advances in computational protein design and structure prediction, highlighting NVIDIA technologies such as cuEquivariance and the Proteína family of models, including the latest RFdiffusion4 (RFD4)–Proteína developments. We will discuss how accelerated geometric deep learning and generative AI are enabling scalable, high-performance protein modeling and the design of novel proteins with tailored structures and functions.

Bio:
Youssef Nashed is a Senior Solutions Architect on NVIDIA's Healthcare and Life Sciences team. He joined NVIDIA from Bristol Myers Squibb (BMS), where he was a Senior Principal Scientist focused on machine learning and computational protein design. At BMS, Youssef led a team developing and deploying AI models for antibody discovery and development. He previously served as an Assistant Professor at Northwestern University and conducted research in structural biology at SLAC National Accelerator Laboratory at Stanford. Youssef began his career in high-performance and large-scale GPU computing at Argonne National Laboratory. His background spans computer science, mathematics, structural biology, and AI-driven protein engineering.

Location: CoDa W401

While current evaluation practices rely on static benchmarks, these methods face fundamental efficiency, reliability, and real-world relevance challenges. This talk presents a path toward a measurement framework that bridges established psychometric principles with modern AI evaluation needs. We demonstrate how techniques from Item Response Theory, amortized computation, and predictability analysis can substantially improve the rigor and efficiency of AI evaluation. Through case studies in safety assessment and capability measurement, we show how this approach can enable more reliable, scalable, and meaningful evaluation of AI systems. This work points toward a broader vision: evolving AI evaluation from a collection of benchmarks into a rigorous measurement science that can effectively guide research, deployment, and policy decisions.

Speaker
Sanmi Koyejo
Associate Professor of Computer Science, Stanford University; Faculty Affiliate, Stanford HAI

Watch the Event Recording