A class in Dar es Salaam builds a small character-level transformer and trains it on Swahili proverbs: embedding, positions, blocks of normalisation, causal attention and SwiGLU, and a tied output head. Watch the loss fall and the samples improve. Then remove the causal mask, forget to shift the targets, or set the learning rate ten times too high. This lesson needs JavaScript.