NOTES / PART 1 · FOUNDATIONS
How language models work and what they can and can't do.
THIS SECTION COVERS
Tokens and tokenisation, transformers and attention, pre-training vs post-training, sampling and temperature, reasoning models, capabilities and failure modes.
Related: Prompting and context engineering · Inference and serving