AILT1001 / Lecture 3Runs on This Mac

Inside the Model

How Does AI Read Text?

Loading model details…

Available Models

The Model’s Input Pieces

Guess Before You Reveal

How many pieces will the model see? A word is not always one token.

Notice

The model works with tokens: whole words, word fragments, punctuation, or pieces of a character.