← Back to live feed1 story
vLLM v0.32.0 was released with 814 commits from 363 contributors, including 121 new ones. The release introduces a new POST /v1/systemone endpoint for structured state queries and generic parsers that read checkpoint response templates, eliminating the need for model-specific parsers. It also adds low-precision KV cache support across various hardware platforms, including NVFP4 on SM8x, SM12x, and SM90, FP8 on SM100, and 4-bit ultraquant_4bit on ROCm.
Sign in to suggest
Key sources
- SOURCEgithub.com