vLLM

This update resolves a numerical stability issue causing NaN outputs in the Mamba2 chunk scan kernel. The fix specifically targets hardware utilizing the sm90 architecture, such as NVIDIA H100 GPUs.

This release resolves a critical numerical stability issue causing NaN outputs in the Mamba2 chunk scan kernel. The fix specifically targets hardware architectures utilizing the sm90 compute capability.

The vLLM v0.32.0rc2 release pins the DeepSeek-V4.1-Flash-NVFP4 evaluation to a specific FP8-Engram revision. This update ensures deterministic testing environments for high-precision FP8 model execution.

The vllm-proto package has been updated to version 0.6.0. This release formalizes the protocol definitions associated with the vLLM inference engine ecosystem.

<p>Signed-off-by: jinzhen.ljz <a href="mailto:[email protected]">[email protected]</a><br> Co-authored-by: Codex <a href="mailto:[email protected]">[email protected]</a><br> Co-authored-by: Misha Goin <a href...

<p>Signed-off-by: Matthew Bonanni <a href="mailto:[email protected]">[email protected]</a><br> Co-authored-by: Claude Opus 5.5 <a href="mailto:[email protected]">[email protected]</a></p>...

<p>Release vllm-proto 0.5.0</p>...

<p>Signed-off-by: Cam Quilici <a href="mailto:[email protected]">[email protected]</a><br> Signed-off-by: Cam Quilici <a href="mailto:[email protected]">[email protected]</a><br> Co-authored-by: Cam Qui...

vLLM v0.31.0 introduces specialized performance optimizations for DeepSeek-V4.1, including FlashMLA with NVFP4 compressed KV cache and DeepGEMM sparse MQA integration. It also implements kernel fusion for MXFP8 quantization and sequence-parallel operations on SM100/SM103 architectures.

The vLLM v0.31.0rc5 release introduces a strict upper bound constraint on the Hugging Face Transformers library dependency. This change prevents the installation of incompatible future versions of the Transformers package that could break vLLM's internal model loading logic.

vLLM version 0.31.0 introduces a strict upper bound constraint on the Hugging Face Transformers library dependency. This change prevents the installation of incompatible future versions of Transformers that could break vLLM's internal model loading logic.

This release addresses a critical bug in the HiSparse integration. It specifically resolves an MTP (Multi-Token Prediction) acceptance collapse occurring under FULL graph configurations.

<p>Signed-off-by: Robert Shaw <a href="mailto:[email protected]">[email protected]</a><br> Co-authored-by: Robert Shaw <a href="mailto:[email protected]">[email protected]</a><br> Co-authored-by: Claude Opus 5.5 <a h...

The vLLM project has released version 0.4.0 of its proto package. This update marks a specific version increment for the protocol-related components within the vLLM ecosystem.

<p>[Bugfix][Mamba] Keep the prompt-end prefill checkpoint under sparse r…</p>...

The vLLM build process now explicitly skips the snapshot runtime component when targeting CUDA 12.x container images. This change modifies the CI/CD pipeline configuration to optimize build behavior for specific NVIDIA CUDA versions.

vLLM has introduced support for MI355 dense NVFP4 and MoRI kernel mirrors within the ROCm CI pipeline. This update enables specific hardware-accelerated precision formats for AMD Instinct MI355 accelerators.

The v0.30.0 release updates the build process for CPU-based images. It specifically hardens the fetch mechanism for the triton-cpu sleef submodule.

This update resolves build failures specifically affecting DeepGEMM integration within the vLLM framework when using CUDA 12.9. It ensures compatibility for users deploying vLLM on the latest NVIDIA CUDA toolkit version.

This release introduces a bugfix for the NIXL component to prevent unnecessary receive reports. It specifically targets notification-only requests to optimize network traffic and processing overhead.

This release introduces an isolation mechanism for FlashInfer BF16 autotuning processes. It specifically addresses potential conflicts in supplemental tuning configurations during the vLLM execution pipeline.

The vllm-proto package has been updated to version 0.3.0. This release marks a specific iteration of the protocol-related components within the vLLM ecosystem.

The vllm-proto package has been updated to version 0.2.0. This release is formally validated by pull request #56538 and commit fa2a26f.

vLLM v0.29.1rc0 introduces dual-key Gumbel-max watermarking support specifically for speculative decoding workflows. This implementation enables cryptographically verifiable provenance for model outputs generated through speculative execution pipelines.

The vLLM project has released vllm-proto version 0.1.0. This release introduces the initial implementation of the proto package within the vLLM ecosystem.

Model Runner V2 (MRV2) is now the default execution engine for all models in vLLM. This release introduces CUDA graph memory profiling for KV cache auto-sizing and batch-sharded sampling to reduce per-step logits memory usage.

vLLM v0.29.0rc6 introduces a default dense prefix cache configuration for hybrid model architectures. This update addresses issue #55 to ensure consistent memory management across mixed-model deployments.

<p>[Core] Default prefix_cache_retention_interval to dense for Mamba + E…</p>...

<p>Generated-by: Codex <a href="mailto:[email protected]">[email protected]</a></p> <p>Signed-off-by: Codex <a href="mailto:[email protected]">[email protected]</a></p>...