Curriculum/Beginner/Lesson 3 of 5

Beginner · lesson 3 of 5 · 10 min

How generative AI works

Learn why chatbots and image tools can create genuinely useful material, and why they can confidently invent details.

What you will be able to do

  • Explain prediction in plain terms
  • Name the three most common failure modes
  • Decide when a draft is good enough to use

Learn · part 1 of 3

Prediction, one piece at a time

A large language model is trained on an enormous amount of text and learns which pieces of language tend to follow which. When you send a prompt, it produces the next piece, then the next, each time conditioned on everything written so far. Nothing in that loop checks a fact against the world. The loop optimizes for plausible continuation.

In plain language
Hallucination

Output that is fluent and well-formed but factually fabricated, produced because the system optimizes for plausible language rather than verified truth.

Example

Ask a model for five sources on a niche topic and you may get five perfectly formatted citations, two of which do not exist. The formatting is right because formatting is a pattern. The existence of the paper is not a pattern.

Learn · part 2 of 3

Why it invents things

Because the goal is plausibility, a gap in the model's knowledge is filled with the most plausible-looking material rather than an admission of ignorance. This is usually called hallucination or confabulation. It shows up most often in specifics: names, dates, page numbers, case citations, statistics, product features, and quotations. These are exactly the details people copy without checking.

Learn · part 3 of 3

Where it is genuinely strong

Generative AI is strong at transformation and at volume: rewriting for a different audience, summarizing material you supply, drafting a first version you will edit, generating alternatives, explaining a concept several ways, and translating between formats. Those uses put the model to work on content you already have, where you can see whether it got it right.

Practice · try it yourself

Find the seam

Ask an AI tool a question inside your own area of expertise, then mark every specific claim you can personally verify as true, false, or unverifiable.

Your own expertise is the safest test surface, because you can grade the answer without trusting another AI to grade it.

Ask a question you already know the answer to
Highlight every specific fact, number, or name
Mark each one true, false, or unverifiable
Note where the wrong ones cluster

0 of 4 practice steps checked. Saved on this device.

Knowledge check · 2 questions

Check your understanding

Answer both to mark the lesson complete. You can try again. This is practice, not a graded exam.

1. Why can a generative model state something false with total confidence?

2. Which task is the safest use of a general-purpose chatbot?

Recap · take it with you

Three things to remember

  1. Generation predicts plausible continuations; it does not look up truth.
  2. Fabrication concentrates in specifics: names, numbers, citations, quotations.
  3. Use it where you can see the source and grade the output.
Cover of AI for Everyone: No One Is Left Behind

Go deeper

AI for Everyone: No One Is Left Behind

Every idea in this path is expanded with more examples in the book.

View on Amazon ↗

Sources

  1. NIST, Generative AI Profile, AI 600-1 (2024)
  2. Mata v. Avianca, Inc., sanctions opinion on fabricated case citations (S.D.N.Y. 2023)
  3. Google, Machine Learning Crash Course

Examples are composites written for teaching unless a source is cited. Figures come from the sources listed where given.