Learn about this first
Zyphra released ZAYA1-8B, an MoE model with fewer than 1 billion active parameters. It is the first model to complete pretraining, mid-training, and supervised fine-tuning entirely on an AMD Instinct MI300 cluster with 1,024 nodes, built in partnership with IBM.
Latest developments
Zyphra releases ZAYA1-8B: an MoE model trained on an all-AMD cluster
Event progress1
Zyphra releases ZAYA1-8B: the first MoE model to complete pretraining, mid-training, and SFT entirely on the AMD MI300 full stack; it also launched on Zyphra Cloud serverless endpoints the same day with Apache-2.0 open weights
Zyphra Research: Zyphra releases ZAYA1-8B: an MoE model trained on an all-AMD cluster