Nvidia is building a trillion-parameter open model, and it would still be smaller than China’s

Nvidia launched Nemotron 3.5 Lightning, a 30B parameter mixture-of-experts model with a 1M token context window, available under a permissive license with training data. It offers faster inference speeds and is complemented by NeMo Switchyard, an open-source routing library to optimize model use and reduce costs.