Buoyant Releases Open Source Kinference Inference Control Plane for Kubernetes and vLLM

Buoyant released Kinference, an Apache 2.0 open source inference control plane for vLLM on Kubernetes, adding declarative routing policies, KV-cache-aware load balancing and per-tenant metrics.

Read the full story at MarkTechPost ↗

Timeline · 1 report

2026-11-07 08:16 · MarkTechPost
Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM

More stories

Election backlash against data centers rattles AI stocks and expansion plans — TechCrunch AI
Anthropic strikes $3.4bn deal for gas-fired generators to power AI data centres — Financial Times AI
OpenAI to keep expanding AI data centers despite election results favoring restrictions — DigiTimes Asia
Tencent AI chief warns AI will soon master biology, raising new safety risks — SCMP China Tech
Hydra-PSIE expands 'Coeziune OM–IA' DOI registry to 39 published works — DEV Community — AI
Developer's 48-Hour Field Notes Detail Free-Tier LLM Batch Job Failures — DEV Community — AI
Apple's John Ternus reportedly pushing for faster AI progress beyond Siri upgrades — Techmeme
US AI Safety Center Staff Now Report to White House, Raising Independence Concerns — AP News

Get the daily brief of stories like this at 6:30 every morning →