Red Hat and AMD Strengthen Collaboration for AI Workloads and Virtualised Infrastructure
Red Hat and AMD are working closely together to enhance support for AI workloads and modernise virtualised infrastructure to cater to the increasing data demands of organisations. The collaboration aims to provide more options for businesses running a mix of applications on both on-premise and cloud systems.
Enhancing Support for AI Workloads
With the rising use of AI, the need for data centres capable of supporting it is also increasing. However, many data centres are still primarily focused on traditional IT workloads, which leaves limited capacity for AI operations. To address this challenge, Red Hat is integrating its open source software with AMD’s processors and GPUs to create a more balanced and efficient foundation for AI and virtual machines.
Improving Infrastructure Efficiency
Red Hat and AMD are actively involved in the vLLM community to enhance AI inference capabilities. By contributing updates such as kernel optimisations and communication enhancements, the collaboration aims to make multi-GPU workloads more efficient. This includes better support for quantised and dense AI models running on AMD hardware.
By leveraging AMD Instinct GPUs and EPYC CPUs, Red Hat and AMD are not only enhancing AI capabilities but also revolutionising how businesses manage virtual machines. The partnership enables organisations to simplify legacy infrastructure, reduce costs, and prepare for future workloads like AI, ultimately helping them maximise the use of existing systems.
For more information on how Red Hat and AMD are boosting enterprise AI capabilities across the hybrid cloud, be sure to check out the latest news on Red Hat AI.
Photo by Unsplash
For additional insights on cybersecurity and cloud technology from industry experts, don’t miss the upcoming Cyber Security & Cloud Expo events in Amsterdam, California, and London. Explore a range of enterprise technology events and webinars powered by TechForge here.