Machine Learning·21 min readAmazon SageMaker AI adds KV cache-aware routing to speed real-time endpointsAUCovered by 2 sourcesNov 17