vLLM 0.28.0 · Runner V2, tiered KV offload, bitsandbytes out-of-tree — from issue No. 018nofeed.dev
Issue No. 018 · 27 August 2026
Breaking

vLLM 0.28.0 · Runner V2, tiered KV offload, bitsandbytes out-of-tree

Major engine cut (26 Aug): Runner V2, tiered KV with disk offload, Rust/gRPC multimodal path, new models (Muse Glimmer, Ling 3.0 Flash, Dots3 NOTE).1 Batch token default doubles to 16384. bitsandbytes is a plugin; pin Transformers ≥5.15.0.1

MATTERS TO · anyone running vLLM servers or pinning CUDA/ROCm serving images
WHAT THE VERDICT MEANS
Will break existing code: deprecation or API change.

Also in this issue

read the whole thing →
Use itCodex 0.150.0 · @task mentions, Interrupt hooks, /copy picker

Get it by email.

One issue every weekday. The whole thing, not a teaser.

Or RSS, if you would rather we never had your address.