Machine Learning6 min reading time

Smaller, faster, safer: running Kimi and GLM at scale

Hacker News
Read full post
Cloudflare's Workers AI enhances serving of large models like Moonshot's Kimi K-series and Z.ai's GLM by quantizing KV cache to 8-bit floats, compressing model weights, and protecting shared caches, doubling context capacity and improving efficiency without accuracy loss.

More in Machine Learning

Machine Learning3 min read

Anthropic caught scientists using Claude to further biological weapon research

Covered by 2 sources
Machine Learning3 min read

China's star AI labs routed user requests to Claude at least 35 million times in the summer: Anthropic

Business Insider
Machine Learning4 min read

DeepSeek launches V4.1-Flash and retires V4-Pro, its flagship model

Covered by 2 sources