vLLM releases Day 0 support for Mistral Large 4
Day 0 support for Mistral Large 4 on vLLM
AI BriefingThe vLLM team announced Day 0 support for Mistral’s new flagship model, Mistral Large 4. It is a natively multimodal MoE model with 1T parameters and 49B active parameters per token. It incorporates architectural innovations including MLA sparse attention with a DSA top-k indexer, cross-layer KV sharing, NoPE, SSMax, and LeRoPE, along with a built-in DSpark speculative decoding drafter and Pixtral vision encoder.
Source: vLLM official blog · vllm.ai
Event follow-up3
View all event coverage- vLLM releases Day 0 support for Mistral Large 4vLLM Official Blog · 18 days ago
- Unsloth releases a 1-bit GGUF quantized version of Mistral Le Chonk, enabling local use of the 1T-parameter modelUnsloth · 18 days ago
- Mistral Large 4 (Le Chonk) arrives on Hugging Face: an open-weight, multimodal MoE model with 1T parametersHugging Face Official Team Blog · 18 days ago