Mistral Releases Open-Source Model Mixtral 8x22B Under the Apache 2.0 License
Research Cheaper, Better, Faster, Stronger April 17, 2024 By Mistral team
AI BriefingMistral releases the open-source sparse mixture-of-experts model Mixtral 8x22B, with 141B total parameters and only 39B activated, a 64K-token context window, and the Apache 2.0 license. The model supports English, French, Italian, German, and Spanish, has native function-calling capabilities, and its instruction version scores 90.8% on GSM8K maj@8 and 44.6% on Math maj@4. It is now available on la Plateforme.
Source: Mistral AI: News · mistral.ai
Event follow-up1
View all event coverage- Mistral Releases Open-Source Model Mixtral 8x22B Under the Apache 2.0 LicenseMistral AI: News · April 17