inference_lab
writingcoursesfield guideabout

Courses · in production

Courses are coming.

Built like the posts: measured, runnable, no hand-waving. Each course ships with working code, real benchmarks, and exercises against actual inference stacks — not slideware.

  • 01 · entry course

    KV Cache: The Complete Mental Model

    Everything the KV cache touches — memory math, paging, prefix reuse, eviction, and what it all costs — until you can reason about any serving stack from first principles.

  • 02 · flagship

    LLM Inference Performance Engineering

    The deep end: vLLM internals, writing and profiling GPU kernels, quantization trade-offs, and the discipline of measuring serving systems honestly.

Be first in line

Course-opening announcements, early-bird pricing, and a vote on what gets built next. Nothing else.

Double opt-in. Unsubscribe anytime. No spam, ever.

The lab notebook, in your inbox

One deep post at a time — measured, runnable, benchmarks included. Plus early access when courses open.

Double opt-in. Unsubscribe anytime. No spam, ever.

writingcoursesfield guideaboutrssgithub

© 2026 Inference Lab · every number on this site comes with a receipt · no cookies, no trackers