Comprehensive observability for Amazon SageMaker AI LLM inference: From GPU utilization to LLM quality

Amazon SageMaker has introduced comprehensive observability features for AI large language model (LLM) inference, enabling monitoring from GPU utilization to model quality metrics. This enhancement aims to provide deeper insights into LLM performance and resource usage during deployment.