StepFun releases Step 5 Preview open weights: 600B MoE, 27B active, 1M context
StepFun has published Step 5 Preview as an open-weight model, with FP8 and BF16 checkpoints on Hugging Face and ModelScope. The sparse mixture-of-experts model is built for long agentic tasks, with 600 billion parameters in total, 27 billion active per token and a context of up to one million tokens.