Updates on Distributed Training

Every AI story we track on Distributed Training: 9 stories so far, each summarized in our own words and linked to the publisher that reported it.

Pulled from 125 sources

This month

Machine Learning4 min read

Ai2 releases Olmo-core 3 to make developing large mixture-of-experts LLMs more efficient

Covered by 3 sources24d ago

Machine Learning15 min read

Fault tolerant distributed training on Amazon EKS using NVRx

AWS BlogSep 16

Robotics37 min read

Build a Physical AI model factory with NVIDIA Cosmos 3 on SageMaker HyperPod

AWS BlogSep 4

Machine Learning5 min read

Fireworks AI Makes Training API Generally Available

Unite.AIAug 31

Machine Learning5 min read

Cursor Open-Sources Mixture-of-Kittens (MoK): A Deterministic MoE Training Megakernel for GB300 NVL72 Racks

MarkTechPostAug 4

Machine Learning5 min read

Moonshot AI Open-Sources MoonEP: A Perfectly Balanced Expert Parallelism Library for MoE Training

MarkTechPostJul 30

Machine Learning10 min read

Fine-tune video and image models at scale with NVIDIA NeMo Automodel and 🤗 Diffusers

Hugging FaceJul 17

Machine Learning

Scaling seismic foundation models on AWS: Distributed training with Amazon SageMaker HyperPod and expanding context windows

AWS BlogApr 2

LLM & Text Generation

ImportAI 449: LLMs training other LLMs; 72B distributed training run; computer vision is harder than generative text

Import AIMar 16

That's everything we have on Distributed Training right now