What is a Generative Pre-Trained Transformer (GPT)? | Stanford HAI
Stanford
University
  • Stanford Home
  • Maps & Directions
  • Search Stanford
  • Emergency Info
  • Terms of Use
  • Privacy
  • Copyright
  • Trademarks
  • Non-Discrimination
  • Accessibility
© Stanford University.  Stanford, California 94305.
Skip to content
  • About

    • About
    • People
    • Get Involved with HAI
    • Support HAI
    • Subscribe to Email
  • Research

    • Research
    • Fellowship Programs
    • Grants
    • Student Affinity Groups
    • Centers & Labs
    • Research Publications
    • Research Partners
  • Education

    • Education
    • Executive and Professional Education
    • Government and Policymakers
    • K-12
    • Stanford Students
  • Policy

    • Policy
    • Policy Publications
    • Policymaker Education
    • Student Opportunities
  • AI Index

    • AI Index
    • AI Index Report
    • Global Vibrancy Tool
    • People
  • News
  • Events
  • Industry
  • Centers & Labs

What is a Generative Pre-Trained Transformer (GPT)?

Generative Pre-Trained Transformer (GPT) is a family of large language models developed that uses the transformer architecture to generate human-like text based on input prompts. The "pre-trained" aspect means the model is first trained on massive amounts of text from the internet to learn language patterns, grammar, facts, and reasoning, then can be fine-tuned or used directly for specific tasks like conversation, writing, translation, or code generation without task-specific training.

Navigate
  • About
  • Events
  • Careers
  • Search
Participate
  • Get Involved
  • Support HAI
  • Contact Us

Stay Up To Date

Get the latest news, advances in research, policy work, and education program updates from HAI in your inbox weekly.

Sign Up For Latest News

GPT's mentioned at Stanford HAI

Explore Similar Terms:

Transformer | Large Language Model (LLM) | Foundation Model

See Full List of Terms & Definitions

Enroll in a Human-Centered AI Course

This AI program covers technical fundamentals, business implications, and societal considerations.
How AI Like ChatGPT Could Change the Future of Work, Education and Our Minds
Chase Difeliciantonio
Mar 30
media mention

Stanford HAI Associate Director Rob Reich details how the use of AI could play out for society, and what it means for generations who will grow up with it.

How AI Like ChatGPT Could Change the Future of Work, Education and Our Minds

Chase Difeliciantonio
Mar 30

Stanford HAI Associate Director Rob Reich details how the use of AI could play out for society, and what it means for generations who will grow up with it.

media mention
How Trustworthy Are Large Language Models Like GPT?
Prabha Kannan
Aug 23
news

More people feel comfortable outsourcing important projects to AI; new research shows why we shouldn’t.

How Trustworthy Are Large Language Models Like GPT?

Prabha Kannan
Aug 23

More people feel comfortable outsourcing important projects to AI; new research shows why we shouldn’t.

Machine Learning
news
The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues
Anaïs Tack, Christopher Piech
Sep 09
Research
Your browser does not support the video tag.

The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues

The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues

Anaïs Tack, Christopher Piech
Sep 09

The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues

Your browser does not support the video tag.
Research
Stanford CRFM Introduces PubMedGPT 2.7B
Michihiro Yasunaga, Tony Lee, Percy Liang
Elliot Bolton, David Hall, Chris Manning
Dec 15
news

The new 2.7B parameter language model trained on biomedical literature delivers an improved state of the art for medical question answering. 

Stanford CRFM Introduces PubMedGPT 2.7B

Michihiro Yasunaga, Tony Lee, Percy Liang
Elliot Bolton, David Hall, Chris Manning
Dec 15

The new 2.7B parameter language model trained on biomedical literature delivers an improved state of the art for medical question answering. 

Healthcare
news
ChatGPT Is About to Revolutionize the Economy. We Need to Decide What That Looks Like.
David Rotman
Mar 25
media mention

Will ChatGPT make the already troubling income and wealth inequality in the U.S. and many other countries even worse? Digital Economy Lab Director Erik Brynjolfsson and other experts share their views.

ChatGPT Is About to Revolutionize the Economy. We Need to Decide What That Looks Like.

David Rotman
Mar 25

Will ChatGPT make the already troubling income and wealth inequality in the U.S. and many other countries even worse? Digital Economy Lab Director Erik Brynjolfsson and other experts share their views.

media mention
Why Large Language Models Like ChatGPT Treat Black- and White-Sounding Names Differently
Julian Nyarko
Monica Schreiber
Mar 25
news

A new study shows systemic issues in some of the most popular models.

Why Large Language Models Like ChatGPT Treat Black- and White-Sounding Names Differently

Julian Nyarko
Monica Schreiber
Mar 25

A new study shows systemic issues in some of the most popular models.

news