Stanford researchers investigate why models often fail in edge-case scenarios.
Stanford researchers investigate why models often fail in edge-case scenarios.
AGQA: A Benchmark for Compositional Spatio-Temporal Reasoning
AGQA: A Benchmark for Compositional Spatio-Temporal Reasoning
Extending the WILDS Benchmark for Unsupervised Adaptation
Extending the WILDS Benchmark for Unsupervised Adaptation
Sanmi Koyejo | Beyond Benchmarks: Building a Science of AI Measurement
The widepread deployment of AI systems in critical domains demands more rigorous approaches to evaluating their capabilities and safety.
Sanmi Koyejo | Beyond Benchmarks: Building a Science of AI Measurement
The widepread deployment of AI systems in critical domains demands more rigorous approaches to evaluating their capabilities and safety.
LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning
LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning
Researchers are establishing standards to validate the efficacy of AI agents in clinical settings.
Researchers are establishing standards to validate the efficacy of AI agents in clinical settings.
Reading Today’s Headlines Through AI: A Real-Time Audit of Six Commercial Chatbots
In a new study, scholars measured how accurately popular AI chatbots answered questions about the emerging news and found substantial regional disparity, dependence on distinct information ecosystems, and acute fragility under imperfect prompts.
In a new study, scholars measured how accurately popular AI chatbots answered questions about the emerging news and found substantial regional disparity, dependence on distinct information ecosystems, and acute fragility under imperfect prompts.
