AWS Introduces Custom Liquid Cooling System for Servers

Amazon Web Services (AWS) recently announced the deployment of In-Row Heat Exchangers (IRHX), a liquid cooling system specifically designed for servers equipped with Nvidia’s powerful Blackwell GPUs. These GPUs are known for their high performance but also for generating significant heat during AI training and inference processes.

Key Components of the IRHX System

The IRHX unit consists of three main components: a water-distribution cabinet, an integrated pumping unit, and in-row fan-coil modules. The system utilizes direct-to-chip liquid cooling similar to Equinox servers, where cold plates attached to the chips efficiently draw heat away and cool them using liquid circulation. The heated coolant then passes through heat exchangers with high-speed fans blowing on the pipes to facilitate cooling, resembling a car radiator.

Modular Design for Scalability

While direct-to-chip liquid cooling solutions are not new to the market, AWS has innovatively separated the pumping unit from the fan-coil modules. This design allows a single pumping system to support multiple fan units, enabling scalability and flexibility in adjusting cooling requirements as needed. The modular fans can be easily added or removed based on evolving demands, providing AWS with the adaptability to customize the system per row and site.

Market Impact and Future Outlook

There have been speculations about Amazon disrupting the liquid cooling market with this technology. However, according to a Dell’Oro Group analyst, AWS primarily develops custom solutions for internal use and does not typically enter into direct competition with other data center infrastructure companies. While AWS’ liquid cooling system showcases innovation in server cooling technology, its primary focus remains on enhancing its own operations rather than challenging existing market players.