Tokens and Embeddings
A token is a chunk of text; an embedding turns it into a point in space where nearness means similarity. Together they explain why models miscount letters, fumble arithmetic, and still find the right paragraph.
One essay per issue. Honest about uncertainty, generous with examples, and free of ceremony.
The easiest way to understand AI without being a total nerd. Five short essays, no equations, no jargon.
All three follow the slope downhill; they differ only in what they remember. SGD remembers nothing, momentum remembers direction, Adam remembers direction and scale — and one of them has a bug you should know about.
Continue →Overfitting is memorising the training data; underfitting is never learning it. Both fail on new data, the fixes are exact opposites, and one ten-second check tells you which one you are looking at.
Continue →