SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints

Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU. This feature divides one GPU into hardware-isolated partitions to run a different model in each or use a right-sized fraction of a newer accelerator.