Introducing Disaggregated Inference on AWS powered by llm-d

AWS has launched Disaggregated Inference powered by llm-d, a new service that separates large language model inference workloads into modular components to optimize performance and cost. This approach enables more efficient deployment of LLMs on AWS infrastructure.