SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints

Amazon SageMaker Inference now supports NVIDIA Multi-Instance GPU (MIG) technology, allowing a single GPU to be partitioned into multiple isolated instances. This enables deploying more models per GPU and choosing GPU fractions that better fit model needs, improving utilization and cost efficiency.