Trending
Hot topicsCalmed down

Zyphra releases ZAYA1-8B: the first MoE model to complete pretraining, mid-training, and SFT entirely on the AMD MI300 full stack; it also launched on Zyphra Cloud serverless endpoints the same day with Apache-2.0 open weights

1 Articles1 Reporting sourcesUpdated May 6

Learn about this first

Zyphra released ZAYA1-8B, an MoE model with fewer than 1 billion active parameters. It is the first model to complete pretraining, mid-training, and supervised fine-tuning entirely on an AMD Instinct MI300 cluster with 1,024 nodes, built in partnership with IBM.

Latest developments

Zyphra releases ZAYA1-8B: an MoE model trained on an all-AMD cluster

Event progress1

  1. Zyphra releases ZAYA1-8B: the first MoE model to complete pretraining, mid-training, and SFT entirely on the AMD MI300 full stack; it also launched on Zyphra Cloud serverless endpoints the same day with Apache-2.0 open weights

    Zyphra Research: Zyphra releases ZAYA1-8B: an MoE model trained on an all-AMD cluster

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.