Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM
benchmarksMarkTechPostNov 7, 2026
Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes. It adds declarative routing policies, KV-cache-aware load balancing and per-tenant metrics, and cut median TTFT 95% in Buoyant’s own benchmark. The post Buoyant R...
Impact: LowConfidence: LowNovelty: Incremental
benchmarksmarktechpostopen-source