Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
What is Attention Mechanism? | Stanford HAI
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Fellowship Programs
    • Grants
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs

What is Attention Mechanism?

An Attention Mechanism is a method in neural networks that helps a model focus on the most relevant parts of the input when producing an output. For example, when translating a sentence, it “pays attention” to the words that matter most for the next translated word, which improves accuracy and handling of long sequences.

Navigate
  • About
  • Events
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

Attention Mechanism mentioned at Stanford HAI

Explore Similar Terms

Transformer | Vision Transformer (ViT) | Embeddings

See Full List of Terms & Definitions

Spotting Visual Signs of Gentrification at Scale
Katharine Miller
Mar 04
news

An AI model trained with images from Google Street View can recognize visual indicators of gentrification early.

Spotting Visual Signs of Gentrification at Scale

Katharine Miller
Mar 04

An AI model trained with images from Google Street View can recognize visual indicators of gentrification early.

Economy, Markets
news
Earthquake-Monitoring AI Could Help Anticipate, Understand Major Quakes
Josie Garthwaite
Oct 22
news

Tiny movements in Earth’s outermost layer tell us a lot about big quakes. New algorithms that work a little like human vision are now detecting these long-hidden microquakes.

Earthquake-Monitoring AI Could Help Anticipate, Understand Major Quakes

Josie Garthwaite
Oct 22

Tiny movements in Earth’s outermost layer tell us a lot about big quakes. New algorithms that work a little like human vision are now detecting these long-hidden microquakes.

news

Enroll in a Human-Centered AI Course

This HAI program covers technical fundamentals, business implications, and societal considerations.