Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
What is Multimodal AI? | Stanford HAI
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Fellowship Programs
    • Grants
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs

What is Multimodal AI?

Multimodal AI refers to artificial intelligence systems that can process, understand, and generate multiple types of data modalities simultaneously—such as text, images, audio, and video. Unlike traditional AI models that work with only one type of input, multimodal systems can combine information from different sources to gain richer understanding and produce more comprehensive outputs.

Navigate
  • About
  • Events
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News


Multimodal AI mentioned at Stanford HAI

Explore Similar Terms:

Computer Vision | Natural Language Processing (NLP) | Transformer

See Full List of Terms & Definitions

Stanford’s Multimodal AI Model Advances Personalized Cancer Care
Vignesh Ramachandran
Jan 27
news

The MUSK model combines clinical notes and images to predict prognosis and immunotherapy response.

Stanford’s Multimodal AI Model Advances Personalized Cancer Care

Vignesh Ramachandran
Jan 27

The MUSK model combines clinical notes and images to predict prognosis and immunotherapy response.

Healthcare
news
Stanford HAI Funds Groundbreaking AI Research Projects
Nikki Goth Itoi
Quick ReadJan 30
news
collage

Thirty-two interdisciplinary teams will receive $2.37 million in Seed Research Grants to work toward initial results on ambitious proposals.

Stanford HAI Funds Groundbreaking AI Research Projects

Nikki Goth Itoi
Quick ReadJan 30

Thirty-two interdisciplinary teams will receive $2.37 million in Seed Research Grants to work toward initial results on ambitious proposals.

Education, Skills
Machine Learning
collage
news
Stanford Research Teams Receive New Hoffman-Yee Grant Funding for 2025
Nikki Goth Itoi
Dec 09
news

Five teams will use the funding to advance their work in biology, generative AI and creativity, policing, and more.

Stanford Research Teams Receive New Hoffman-Yee Grant Funding for 2025

Nikki Goth Itoi
Dec 09

Five teams will use the funding to advance their work in biology, generative AI and creativity, policing, and more.

Arts, Humanities
Ethics, Equity, Inclusion
Foundation Models
Generative AI
Healthcare
Sciences (Social, Health, Biological, Physical)
news
Predictions for AI in 2025: Collaborative Agents, AI Skepticism, and New Risks
Shana Lynch
Dec 23
news

Leading Stanford faculty offer their expectations for artificial intelligence in the new year.

Predictions for AI in 2025: Collaborative Agents, AI Skepticism, and New Risks

Shana Lynch
Dec 23

Leading Stanford faculty offer their expectations for artificial intelligence in the new year.

news
AI Index: Five Trends in Frontier AI Research
Nestor Maslej
Apr 15
news

The new AI Index spots major advances in multimodal models, robotics, generative AI, and more.

AI Index: Five Trends in Frontier AI Research

Nestor Maslej
Apr 15

The new AI Index spots major advances in multimodal models, robotics, generative AI, and more.

Economy, Markets
Natural Language Processing
Machine Learning
news
Stanford Develops Real-World Benchmarks for Healthcare AI Agents
Scott Hadly
Sep 15
news

Researchers are establishing standards to validate the efficacy of AI agents in clinical settings.

Stanford Develops Real-World Benchmarks for Healthcare AI Agents

Scott Hadly
Sep 15

Researchers are establishing standards to validate the efficacy of AI agents in clinical settings.

Healthcare
news

Enroll in a Human-Centered AI Course

This AI program covers technical fundamentals, business implications, and societal considerations.