LiquidStack Launches High-Capacity CDU for Next-Gen AI Systems

The Digital Artisan -

LiquidStack's Solution to AI System Cooling Needs

The rising power consumption of GPUs and AI accelerators, often exceeding one kilowatt, necessitates efficient cooling methods. Systems builders are increasingly relying on liquid cooling to manage the heat, employing complex networks of plumbing, manifolds, and coolant distribution units (CDUs). LiquidStack, recognized for its immersion cooling tech, has introduced a high-capacity CDU boasting over a megawatt of cooling capacity, designed to integrate seamlessly with platforms using direct-to-chip liquid cooling.

The Role of CDUs

CDUs play a crucial role in managing system heat, circulating the coolant to and from connected systems and racks. The exchanged heat is then expelled via a liquid-to-air, or, as in this case, liquid-to-liquid heat exchanger. Although a megawatt of capacity might seem excessive, it only just satisfies the cooling requirements of modern AI systems. For instance, next-gen AI systems like Nvidia can pack up 5.4kW to 5.7kW of compute within a single RU server and over 120kW in just one rack.

CDU's Detailed Feature

Despite its massive cooling capacity, LiquidStack's CDU manages to provide for the cooling needs of an Nvidia DGX GB200 Superpod, equipped with 288 2,700W Grace-Blackwell Superchips, and still, have some capacity to spare. Despite the immense cooling capacity, outfits like CoreWeave and Lambda will still require numerous CDUs to reap the benefits of Nvidia's dense compute configurations.

Mitigating Risks

High-capacity CDUs like LiquidStack's can pose risks in case of failure. To minimize such risks, LiquidStack claims their CDU has redundancy safeguards such as hot-swappable pumps, and also optional redundant temperature, pressure, and flow monitors, as well as expansion tanks.

LiquidStack's move into the CDU market comes amid rampant demand as datacenter operators strive to leverage AI's popularity. Supply shortages of crucial components like rear-door heat exchangers and CDUs are contributing to this demand, with companies like LiquidStack seeking a piece of that market share.