Agentic AI has made CPUs the new performance bottleneck

Amazon Web Services is facing increased CPU demand due to the rise of agentic AI systems that spawn numerous sub-agents requiring CPU-intensive tasks. While GPUs handle AI model inference, CPUs are essential for managing tool use and API calls within these AI workflows. Industry experts from Moor Insights, Intel, and AMD highlight that most stages of agentic AI pipelines rely heavily on CPUs, marking a shift in cloud infrastructure needs.