Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.
Sign Up For Latest News

This brief assesses data broker compliance with California privacy laws and calls for more stringent consumer protections.
This brief assesses data broker compliance with California privacy laws and calls for more stringent consumer protections.

HAI Policy Fellow Riana Pfefferkorn comments on recent federal appeals court asking the Supreme Court to reconsider laws around AI generated CSAM.
HAI Policy Fellow Riana Pfefferkorn comments on recent federal appeals court asking the Supreme Court to reconsider laws around AI generated CSAM.

This brief highlights the emergence of world models and outlines a first-of-its-kind governance and policy agenda for the technology.
This brief highlights the emergence of world models and outlines a first-of-its-kind governance and policy agenda for the technology.


Building an AI pipeline to comb through millions of local statutes, researchers at Stanford Law School turn a spotlight on unsavory laws still on the books in communities across the country.
Building an AI pipeline to comb through millions of local statutes, researchers at Stanford Law School turn a spotlight on unsavory laws still on the books in communities across the country.

Artificial intelligence (AI) tools for radiology are commonly unmonitored once deployed. The lack of real-time case-by-case assessments of AI prediction confidence requires users to independently distinguish between trustworthy and unreliable AI predictions, which increases cognitive burden, reduces productivity, and potentially leads to misdiagnoses. To address these challenges, we introduce Ensembled Monitoring Model (EMM), a framework inspired by clinical consensus practices using multiple expert reviews. Designed specifically for black-box commercial AI products, EMM operates independently without requiring access to internal AI components or intermediate outputs, while still providing robust confidence measurements. Using intracranial hemorrhage detection as our test case on a large, diverse dataset of 2919 studies, we demonstrate that EMM can successfully categorize confidence in the AI-generated prediction, suggest appropriate actions, and help physicians recognize low confidence scenarios, ultimately reducing cognitive burden. Importantly, we provide key technical considerations and best practices for successfully translating EMM into clinical settings.
Artificial intelligence (AI) tools for radiology are commonly unmonitored once deployed. The lack of real-time case-by-case assessments of AI prediction confidence requires users to independently distinguish between trustworthy and unreliable AI predictions, which increases cognitive burden, reduces productivity, and potentially leads to misdiagnoses. To address these challenges, we introduce Ensembled Monitoring Model (EMM), a framework inspired by clinical consensus practices using multiple expert reviews. Designed specifically for black-box commercial AI products, EMM operates independently without requiring access to internal AI components or intermediate outputs, while still providing robust confidence measurements. Using intracranial hemorrhage detection as our test case on a large, diverse dataset of 2919 studies, we demonstrate that EMM can successfully categorize confidence in the AI-generated prediction, suggest appropriate actions, and help physicians recognize low confidence scenarios, ultimately reducing cognitive burden. Importantly, we provide key technical considerations and best practices for successfully translating EMM into clinical settings.