Machine Learning5 min reading time

Moonshot AI Open-Sources MoonEP: A Perfectly Balanced Expert Parallelism Library for MoE Training

MarkTechPost
Read full post
Moonshot AI released MoonEP, an open-source Expert Parallelism library designed to optimize communication in distributed Mixture-of-Experts training. MoonEP ensures perfectly balanced token distribution across experts by dynamically planning redundant experts, improving scaling efficiency for large MoE models like Kimi K3.

More in Machine Learning

Machine Learning3 min read

Anthropic caught scientists using Claude to further biological weapon research

Covered by 2 sources
Machine Learning4 min read

DeepSeek launches V4.1-Flash and retires V4-Pro, its flagship model

Covered by 2 sources
Machine Learning4 min read

Mistral wants open-weight AI to compete at the frontier. It just raised $3.5 billion to do it.

The New Stack (AI)