Back to Featured
vLLM Official BlogInferact and the vLLM Team2026-10-23 08:0025 days ago

Serving DeepSeek-V4.1-Flash at scale on GB300 NVL72, with decoding throughput within 6% of DeepInfer

Serving DeepSeek-V4.1-Flash at Scale: vLLM Matches DeepInfer and Scales to GB300 NVL72

AI Briefing

vLLM serves DeepSeek-V4.1-Flash on a single NVIDIA GB300 NVL72 using P/D disaggregation and Wide-EP, reaching 954K tokens/s per GPU and 196 tokens/s for single-user P90 on SemiAnalysis AgentX—7.9× the early single-node result.

Source: vLLM official blog · vllm.ai

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.