Zyphra Releases the 7B Hybrid-Architecture Foundation Model Zamba
ZAMBA
AI BriefingZyphra Releases the 7B Foundation Model Zamba, Using a Hybrid Architecture with Mamba Blocks Plus Global Attention Layers with Shared Weights Every 6 Layers.
Source: Zyphra Research · zyphra.com
Event follow-up1
View all event coverage- Zyphra Releases the 7B Hybrid-Architecture Foundation Model ZambaZyphra Research · April 16