LLM Inference, from scratch — eleven levels on why generating one token means moving every weight in the model.
Places I've been, in no particular order. Mostly cities, occasionally mountains. Click any photo to see it full size.