Jul 6, 2026 · 11 min read
LLM Inference KPIs Every SRE Should Know
LLM inference metrics for SREs: TTFT, TPOT, KV cache, HBM bandwidth, and how they connect to real production behavior.
Tag
4 posts tagged “observability”
Jul 6, 2026 · 11 min read
LLM inference metrics for SREs: TTFT, TPOT, KV cache, HBM bandwidth, and how they connect to real production behavior.
Jul 22, 2025 · 9 min read
A practical guide to scaling Prometheus with Thanos for long-term storage, global querying, and multi-cluster observability.
Apr 7, 2025 · 9 min read
How I migrated 100TB+ of observability data from InfluxDB to Grafana Mimir with custom tooling, dashboard rewrites, and zero downtime.
Jul 4, 2024 · 7 min read
An introduction to Prometheus, PromQL, and practical monitoring concepts for modern infrastructure and Kubernetes environments.