Nvidia's Water-Saving Data Center Solution: A Drop in the Ocean?

Nvidia has announced a new warm-water cooling system that it claims can eliminate "pretty much all water usage" inside a data center. However, this solution only addresses a fraction of the total water footprint of AI data centers, which is largely driven by the water used in electricity generation and chip manufacturing.

The Problem with Measuring Water Use

Nvidia measures data center water use by drawing a line around the facility. Anything inside the data center is counted, while anything outside is ignored. This approach ignores the significant water usage associated with electricity generation and chip manufacturing, which can double or triple the total water footprint of a facility.

According to Nvidia's blog post, the company's new system delivers on its facility-level promise by running coolant in a closed loop, filled once and recirculated for the life of the facility. This means no new water is consumed to cool the chips. In favorable climates, Nvidia says this can lead to a 100% reduction in on-site water use.

However, as long as AI data centers run on fossil fuels, the savings stop at the data center's walls. Fossil fuel power plants are among the largest water users in the U.S., consuming 2.7 billion gallons per day for evaporative cooling. Natural gas power plants use 1.17 liters of water for every kilowatt-hour of electricity they generate, while coal plants use 2.2 liters per kilowatt-hour.

The Reality of Renewable Energy

Wind and solar power, on the other hand, use vanishingly small amounts of water - about 0.01 liters and 0.03 liters per kilowatt-hour, respectively. However, natural gas and coal are expected to provide more than 40% of new electricity needed to meet data center demand through 2030, according to the IEA. Without major changes to this trajectory, data centers will continue to consume large amounts of water, regardless of what Nvidia does inside its walls.

• Nvidia's solution addresses about a quarter to a third of AI data centers' total water consumption.
• Fossil fuel power plants consume 2.7 billion gallons of water per day for evaporative cooling.
• Natural gas power plants use 1.17 liters of water for every kilowatt-hour of electricity generated.
• Coal plants use 2.2 liters of water per kilowatt-hour of electricity generated.
• Wind and solar power use 0.01 liters and 0.03 liters of water per kilowatt-hour, respectively.