IBM-backed llm-d framework adds controls for running AI models in-house

IBM and partners have released version 1.0 of the open-source llm-d framework, enhancing operational controls for enterprises to run large AI models on their own Kubernetes infrastructure with improved workload management and hardware efficiency.