Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM

Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes. It includes declarative routing policies, KV-cache-aware load balancing, and per-tenant metrics, and reportedly cut median TTFT by 95% in Buoyant’s own benchmark.