Look Inside a Language Model
Follow one sentence through a simplified language-model pipeline.
Code & AI › Lesson 2 of 2
During training, the model learned numerical language patterns. Training is finished for this demonstration. We are now watching the trained model use those patterns to choose what comes next.
Earlier
Learn patterns during training.
Now
Use the patterns to generate text.
Quick recap of Lesson 1
How AI builds a response
READ
The cat sat on the…
Look at the text so far
COMPARE
matfloorchair
Think about what could come next
ADD
The cat sat on the mat
Choose and add one text piece
REPEAT
The cat sat on the mat…
Use the new text and go again
↻ Repeat from the top
Language AI reads, compares, adds one text piece, and repeats.