Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM

benchmarksMarkTechPostNov 7, 2026

Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes. It adds declarative routing policies, KV-cache-aware load balancing and per-tenant metrics, and cut median TTFT 95% in Buoyant’s own benchmark. The post Buoyant R...

Impact: LowConfidence: LowNovelty: Incremental
benchmarksmarktechpostopen-source

See the whole story

Read the original on MarkTechPost

Sens.ai aggregates and assesses published reporting. The assessment above is machine generated; the original source is authoritative.