Running Kimi K3 on MI355X at Better Performance per Dollar Than B300

Hacker News
Read the full article
AMD's MI355X GPU runs the large 2.8 trillion parameter Kimi K3 model at 952 tokens per second per node, outperforming NVIDIA's B200 nodes in throughput per dollar despite some performance trade-offs. This demonstrates AMD's cost-effective hardware viability for serving frontier open-source AI models, overcoming previous software support challenges.

More in Chips & Compute

Blackstone Bet on Chips Drove a Debt Boom That’s Upending Credit

Covered by 2 sources
Chips & Compute4 min read

On the ground at Nvidia's AI showpiece: Jensen-mania, robot ducks and neocloud distress

CNBC
Chips & Compute6 min read

Google turns the infrastructure behind Gemini’s agents into a cloud service

Covered by 2 sources