Industry & Manufacturing6 min read
AI’s hidden storage bill: What inference leaves behind
MIT Technology Review
Updates on AI Inference
Every AI story we track on AI Inference: 17 stories so far, each summarized in our own words and linked to the publisher that reported it.
Pulled from 125 sources
This week
This month
Chips & Compute5 min read
SCX.ai Partners With DDN to Scale Australia’s Sovereign AI Inference Cloud
Unite.AI
Chips & Compute4 min read
Is the future of data centers portable? Runware builds a pod to find out
Covered by 2 sources
Chips & Compute3 min read
A startup says the AI bottleneck isn’t compute. It’s memory, and it ditched the GPU to prove it.
The Next Web
Chips & Compute3 min read
Startup swaps costly AI GPUs for Arm cores and up to 128TB of 'cheap' LPDDR6 RAM instead of expensive HBM to smash through the memory wall
TechRadar
Business & Enterprise7 min read
Why compute might get 10x+ more expensive in coming years
Dwarkesh Podcast
Chips & Compute3 min read
Nvidia teams up with chip rival d-Matrix instead of fighting it
The Next Web
TensorX raises €8M to build sovereign AI inference for Europe on Nvidia Blackwell
The Next Web
AI inference startup Baseten reportedly raising $1.5B months after its last mega round
TechCrunch
Baseten is raising $1.5bn at up to $13bn, betting AI’s profits lie in cheap inference
The Next Web
Nebius paid $643 million for 20 people because inference is where the money is
The Next Web
Google is building a four-partner chip supply chain to challenge Nvidia in AI inference
The Next Web
Startup Gimlet Labs is solving the AI inference bottleneck in a surprisingly elegant way
TechCrunch
AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say
TechCrunch
That's everything we have on AI Inference right now