Disaggregated prefill and decode for LLM inference on SageMaker HyperPod

Amazon SageMaker HyperPod now supports Disaggregated Prefill and Decode (DPD) for large language model inference using vLLM, separating prefill and decode phases across GPU pools to reduce latency and improve concurrency for long-context workloads.