StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context

MarkTechPostPublished 9 days ago

StepFun has open-sourced the Step 5 Preview model, a sparse Mixture-of-Experts AI with 600 billion parameters, 27 billion active per token, and support for up to 1 million tokens of context, aimed at long-horizon agentic tasks.

#hugging-face #modelscope #step-5-preview #stepfun

StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context

More in Machine Learning

Samsung aims to cut chip material development time using AI

PyTorch Conference 2026: Google and Meta Open-Source TorchTPU for Native PyTorch on TPUs

Tsinghua AI Open-Sources AKV, a Cache Engineering Server for LLM Agents on SGLang