StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context

MarkTechPost
Read the full article
StepFun has open-sourced the Step 5 Preview model, a sparse Mixture-of-Experts AI with 600 billion parameters, 27 billion active per token, and support for up to 1 million tokens of context, aimed at long-horizon agentic tasks.

More in Machine Learning

Machine Learning27 min read

[AINews] High Taste Testers Ep. 1

Latent.Space
Machine Learning3 min read

Nvidia’s new Nemotron 3.5 Super VL is another step forward for US open-weight AI

Covered by 7 sources
Machine Learning4 min read

Amazon Acquires DuckLabs and Integrates DuckDB in Amazon Aurora PostgreSQL

InfoQ (AI, ML & Data)