Running Kimi K3 on MI355X at Better Performance per Dollar Than B300

Hacker News
Read the full article
AMD's MI355X GPU runs the large 2.8 trillion parameter Kimi K3 model at 952 tokens per second per node, outperforming NVIDIA's B200 nodes in throughput per dollar despite some performance trade-offs. This demonstrates AMD's cost-effective hardware viability for serving frontier open-source AI models, overcoming previous software support challenges.

More in Chips & Compute

Musk Claims $40 Billion Chips Debt Closed, Yet Talks Ongoing

Covered by 2 sources
Chips & Compute3 min read

SpaceX locks in $40B GPU financing deal with Apollo

Covered by 2 sources

Broadcom Arranges $63 Billion Deal to Finance Anthropic’s Chips

Covered by 2 sources