Meta details Prometheus, the Ohio supercluster heading for 1 million GPUs

The Next Web
Read the full article
Meta's Prometheus supercluster in Ohio currently operates hundreds of thousands of Nvidia GPUs and aims to scale up to about 1 million GPUs. The cluster supports training of Meta's Muse models and has achieved significant reliability improvements despite early challenges with hardware faults and power management.

More in Chips & Compute

Chips & Compute3 min read

DeepSeek Dials Up the Pressure on OpenAI and Anthropic With Open-Source Inference Tool

Covered by 4 sources
Chips & Compute5 min read

Amazon is buying billions in Nvidia AI systems it can't yet turn on

Business Insider
Chips & Compute14 min read

Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch

AWS Blog