vLLM on NVIDIA Vera Rubin: 7.8x Throughput, HBM4 Memory Hierarchy, and the NVL72 Inference Leap
Inside vLLM's day-0 support for NVIDIA Vera Rubin NVL72: 19.16 TB/s HBM4 bandwidth, 50 PFLOPS NVFP4 Tensor Cores, CUDA 13.4 locality domains, and 7.8x throughput scaling over GB200.
Read Post →

