StepFun demonstrates the inference performance of Step 5 Preview on NVIDIA GB300
StepFun says Step 5 Preview delivers excellent inference performance on NVIDIA GB300 and looks forward to seeing the applications developers build with it. The NVIDIA post it shared describes the model as StepFun's largest open-weight release, featuring a 600B MoE architecture capable of handling agent tasks lasting up to 24 hours. It achieves nearly 8K tokens/sec/GPU on GB300 using NVFP4, offers an NVFP4 checkpoint (https://huggingface.co/stepfun-ai/Step-5-Preview-NVFP4), and supports SGLang, vLLM, post-training with NeMo Automodel, and one-click deployment with NVIDIA NIM.
Why it's recommended:The original article adds details on Step 5 Preview's inference performance on NVIDIA GB300 and a link to its NVFP4 weights, helping developers evaluate deployment options.