Moonshot AI Open-Sources MoonEP: A Perfectly Balanced Expert Parallelism Library for MoE Training

Moonshot AI released MoonEP, an open-source Expert Parallelism library designed to optimize communication in distributed Mixture-of-Experts training. MoonEP ensures perfectly balanced token distribution across experts by dynamically planning redundant experts, improving scaling efficiency for large MoE models like Kimi K3.