Back to Featured
vLLM Official BlogRaphaël Rialland (Mistral AI), Simon Veitner (Red Hat), and Tomas Ruiz (Red Hat)2026-09-24 08:00September 24

vLLM adds lossless text watermarking based on Gumbel-max

Watermarking in vLLM

AI Briefing

vLLM announced support for lossless watermarking based on the Gumbel-max algorithm, integrating it into the sampling pipeline of Model Runner v2. PRs #54053, #56122, and #56233 implement a fused GPU kernel, a dual-key scheme, and context deduplication to support speculative decoding while preserving output diversity.

Source: vLLM official blog · vllm.ai

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.