Jul 6, 2026 · 11 min read
LLM Inference KPIs Every SRE Should Know
LLM inference metrics for SREs: TTFT, TPOT, KV cache, HBM bandwidth, and how they connect to real production behavior.
Tag
5 posts tagged “kubernetes”
Jul 6, 2026 · 11 min read
LLM inference metrics for SREs: TTFT, TPOT, KV cache, HBM bandwidth, and how they connect to real production behavior.
Jun 26, 2026 · 10 min read
Kubernetes Gateway API Inference Extension: What It Is and Why It Matters
Apr 7, 2026 · 4 min read
How the ndots option works in Kubernetes DNS resolution, including resolv.conf behavior, search domains, and why DNS queries can multiply inside pods.
May 24, 2024 · 9 min read
A practical introduction to KubeRay, Ray clusters on Kubernetes, and how cloud-native infrastructure supports scalable AI and ML workloads.
May 7, 2024 · 8 min read
How Talos simplifies Kubernetes operations on bare metal with an immutable, API-driven operating system built for reliability and security.