Machine Learning6 min reading time

Smaller, faster, safer: running Kimi and GLM at scale

Hacker News
Read the full article
Cloudflare's Workers AI enhances serving of large models like Moonshot's Kimi K-series and Z.ai's GLM by quantizing KV cache to 8-bit floats, compressing model weights, and protecting shared caches, doubling context capacity and improving efficiency without accuracy loss.

More in Machine Learning

Machine Learning5 min read

PyTorch Conference 2026: Google and Meta Open-Source TorchTPU for Native PyTorch on TPUs

InfoQ (AI, ML & Data)
Machine Learning5 min read

Hugging Face Releases Carbon-X, a 14B Open DNA Language Model that Brings DNA and Natural Language Together for the First Time

MarkTechPost
Machine Learning3 min read

Google ML Drift Accelerates On-Device AI Inference Across Diverse GPUs

InfoQ (AI, ML & Data)