Running Kimi K3 on MI355X at Better Performance per Dollar Than B300

Hacker News
Read full post
AMD's MI355X GPU runs the large 2.8 trillion parameter Kimi K3 model at 952 tokens per second per node, outperforming NVIDIA's B200 nodes in throughput per dollar despite some performance trade-offs. This demonstrates AMD's cost-effective hardware viability for serving frontier open-source AI models, overcoming previous software support challenges.

More in Chips & Compute

Chips & Compute4 min read

Jensen Huang explains why Nvidia will grow an astounding 70% next year

TechCrunch

Microsoft AI Focused Data Center Plan to Add 26 Gigawatts of Compute

Bloomberg

Tencent-Backed Chipmaker Enflame Jumps 188% in Shanghai Debut

Bloomberg