Writing
2 posts · 1 series
Long-form notes on systems, languages, and the things I build. Multi-part series live under their own page.
Text goes in, integers come out. Building BPE from scratch and understanding why vocabulary size is a real tradeoff.
The slow, obvious version first — then the batched one, and a look at what actually changed.