Summary
AI GPU maker Nvidia just announced a “hotter than a hot tub” liquid cooling system that it says will cut water and electricity use. According to the company, this new solution will run coolant — composed of 75% water and 25% propylene glycol — at 113 degrees F (45 deg C). By comparison, the water in hot tubs hovers at 100 to 104 degrees F (38 to 40 deg C). This feels counterintuitive, but the company says that the “cool” water is enough to handle the heat generated by Nvidia’s Rubin chips and exit the system at 131 degrees F (55 deg C).
Traditional water-cooling methods, especially those that use chillers, often account for nearly 40% of a data center’s power consumption. Aside from that, these systems must often deal with water loss through evaporation. On the other hand, air-cooled facilities also use a considerable amount of electricity, plus they also generate noise pollution. On the other hand, Nvidia says that this new solution uses a lot fewer resources because of its higher base temperature.
Since 113 degrees F is often higher than ambient temperature, data centers can simply rely on outdoor dry coolers to expel the heat to the environment. This is also a closed-loop system; Nvidia claims an up to 100% reduction in water consumption — it’s “filled once and runs closed for the life of the facility.” This solution is most effective in regions with cooler climates, but it should still be effective in warmer areas as long as the ambient temperature is below 113 degrees F.
[...]
This solution addresses several of the issues that many local governments raised that led to the delay of more than 75 data centers earlier this year. However, it will likely take time for this cooling system to roll out to new and existing projects, so we expect the delays and resistance to continue until Nvidia’s liquid cooling system gains wider adoption. Furthermore, this only addresses the water use of the data center itself — the GPU servers themselves still require massive amounts of electricity.