Learn about this first
Z.ai has released GLM-5, an open-weight model under the MIT license designed for long-horizon agents and systems engineering. Modal has partnered with Z.ai to launch a free trial endpoint, available through the end of April and limited to 1 concurrent request. At FP8 precision, the model is approximately 700 GB and requires deployment across multiple GPUs. Modal runs it with SGLang on a single node with 8 B200 GPUs, achieving 30-75 tokens/second per user in internal testing.
Latest developments
Modal launches a free endpoint for Z.ai GLM-5 and provides code for self-hosting
Event progress1
Z.ai releases GLM-5, an open-weight foundation language model (MIT license, designed for long-horizon agents and systems engineering), with Modal collaborating on early testing
Modal Official Engineering Blog: Modal launches a free endpoint for Z.ai GLM-5 and provides code for self-hosting