Reduce inference cold starts on Amazon SageMaker HyperPod with model caching

Amazon SageMaker HyperPod now supports model caching, which preloads large language model weights and container images onto cluster nodes. This reduces pod cold start times from tens of minutes to seconds by avoiding repeated network downloads during autoscaling.