Inside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster

Meta has completed the first phase of its Prometheus gigawatt-scale supercluster in New Albany, Ohio, which powered the training of its Muse foundational models. The supercluster uses advanced cooling and networking to achieve high efficiency and reliability, and Meta plans to scale it to around one million GPUs for future AI models.