sre

LLM inference metrics for SREs: TTFT, TPOT, KV cache, HBM bandwidth, and how they connect to real production behavior.