Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
Common Crawl Foundation | Preserving Humanity's Knowledge and Making it Accessible: Addressing Challenges of Public Web Data | Stanford HAI

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Research Programs
    • Grants
    • Marlowe (opens in new tab)
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs
Navigate
  • About
  • Events
  • AI Glossary
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us
Your browser does not support the video tag.
eventSeminar

Common Crawl Foundation | Preserving Humanity's Knowledge and Making it Accessible: Addressing Challenges of Public Web Data

Status
Past
Date
Wednesday, October 22, 2025 12:00 PM - 1:15 PM PST/PDT
Location
353 Jane Stanford Way, Stanford, CA, 94305 | Room 119
Topics
Privacy, Safety, Security
Attend Virtually
Overview
Watch Event Recording

Learn about Common Crawl's insights from a recent data product and informed solutions for the future of public web data.

Overview
Watch Event Recording
Share
Link copied to clipboard!
Event Contact
Stanford HAI
stanford-hai@stanford.edu

Related Events

Tim de Silva | AI Financial Advice: Supply, Demand, and Life Cycle Implications
SeminarOct 07, 202612:00 PM - 1:15 PM
October
07
2026
Seminar

Tim de Silva | AI Financial Advice: Supply, Demand, and Life Cycle Implications

Oct 07, 202612:00 PM - 1:15 PM
NVIDIA & Marlowe | GPU Computing Foundations - Amanda Butler
Oct 07, 2026
October
07
2026

This session covers the foundational knowledge of GPUs, including their architecture, functionality, and applications in computing. It provides an introduction to GPU computing through the lens of the Marlowe SuperPod and prepares learners for advanced topics such as GPU-accelerated data science and machine learning.

Location: CoDa W401

Event

NVIDIA & Marlowe | GPU Computing Foundations - Amanda Butler

Oct 07, 2026

This session covers the foundational knowledge of GPUs, including their architecture, functionality, and applications in computing. It provides an introduction to GPU computing through the lens of the Marlowe SuperPod and prepares learners for advanced topics such as GPU-accelerated data science and machine learning.

Location: CoDa W401

Marlowe | AI + Data for Science with Olivier Gevaert
SeminarOct 07, 2026
October
07
2026

For 9/23 and 10/7 only, sessions are at the David Packard Electrical Engineering Building, Room 101. Each session features a different Stanford speaker; talk titles are announced by the organizers.

Event

Marlowe | AI + Data for Science with Olivier Gevaert

Oct 07, 2026

For 9/23 and 10/7 only, sessions are at the David Packard Electrical Engineering Building, Room 101. Each session features a different Stanford speaker; talk titles are announced by the organizers.

The Common Crawl Foundation is dedicated to preserving humanity's knowledge and making it accessible through its free public web dataset, a vital resource since 2008. As AI development accelerates, concerns have emerged regarding the accessibility and transparency of public web data, impacting open datasets in three key ways: robots.txt exclusions, legal demands, and "bot defenses." Two of these are not visible in public and are not very well understood. In this seminar, Common Crawl will present insights from a new data product that utilizes Common Crawl's crawl metadata to visually explore these three problems, advocating for greater transparency and informed solutions for the future of public web data.