Google ML Drift Accelerates On-Device AI Inference Across Diverse GPUs

InfoQ (AI, ML & Data)
Read the full article
Google has open-sourced ML Drift, a cross-platform GPU compute engine that simplifies on-device AI inference across diverse GPUs by abstracting hardware and API differences. It supports multiple APIs and hardware optimizations, improving performance and reducing memory overhead, and is already used in apps like Chrome and YouTube Shorts.

More in Machine Learning

Machine Learning5 min read

PyTorch Conference 2026: Google and Meta Open-Source TorchTPU for Native PyTorch on TPUs

InfoQ (AI, ML & Data)
Machine Learning5 min read

Hugging Face Releases Carbon-X, a 14B Open DNA Language Model that Brings DNA and Natural Language Together for the First Time

MarkTechPost
Machine Learning5 min read

Researchers from Stanford and UC Berkeley Introduce TokenGate: Token-Gated Attention Makes Long-Context Prefill Up to 11.3x Faster

MarkTechPost