Jul 6, 2026 · 11 min read
LLM Inference KPIs Every SRE Should Know
LLM inference metrics for SREs: TTFT, TPOT, KV cache, HBM bandwidth, and how they connect to real production behavior.
Tag
inference
2 posts tagged “inference”
Jun 26, 2026 · 10 min read
Kubernetes Gateway API Inference Extension
Kubernetes Gateway API Inference Extension: What It Is and Why It Matters