Machine Learning28 min reading time

Run Kimi K3 using 29 GB of RAM at 0.50 tok/s

Hacker News
Read the full article
The WASTE inference engine runs the 2.78 trillion parameter Kimi K3 model on a 64 GB consumer laptop by streaming model experts from disk, using only about 29 GB RAM at 0.5 tokens per second. This approach enables handling extremely large models without requiring server-grade hardware, though inference speed remains slow.

More in Machine Learning

Machine Learning2 min read

Samsung aims to cut chip material development time using AI

Yonhap News Agency
Machine Learning5 min read

PyTorch Conference 2026: Google and Meta Open-Source TorchTPU for Native PyTorch on TPUs

InfoQ (AI, ML & Data)
Machine Learning5 min read

Scientists overcome a hidden obstacle to more powerful quantum computers

Science Daily