vLLM v0.32.0: /v1/systemone Structured Decisions, NVFP4 KV Cache Everywhere, Model Runner V2, and Multi-API Worker Scaling
Explore vLLM v0.32.0: native /v1/systemone fast-path decision serving, NVFP4 and FP8 KV caches across NVIDIA and ROCm, Model Runner V2 with GPU n-gram speculation, and multi-API worker throughput scaling.
Read Post →

