October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run ScanOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk5 min

How Liquid Cooling Works in AI Data Centers

AI data-center liquid cooling moves processor heat through cold plates or dielectric-fluid immersion to a facility heat-rejection system. The design determines what remains for air cooling and whether energy or water use changes.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Liquid cooling carries heat away from high-power processors through engineered coolant loops to a facility heat-rejection system. In direct-to-chip systems, coolant flows through cold plates attached to selected components; in immersion systems, equipment sits in nonconductive dielectric fluid. Neither design automatically removes the need for air cooling or guarantees lower energy or water use.

How liquid cooling moves heat

A liquid absorbs heat at or near a hot component and carries it to a heat exchanger, where that heat is transferred to another loop or rejected by the facility. Water and engineered fluids conduct heat more effectively than air, making liquid useful for extracting heat from processors under demanding workloads. The liquid does not simply disappear after warming: pumps and a connected heat-rejection system keep the circuit operating.

As an Amazon Associate I earn from qualifying purchases.

The direct-to-chip path

  1. Capture heat: A cold plate replaces or supplements a conventional heatsink on a CPU, GPU, or another selected component. Coolant enters the plate, absorbs heat, and exits warmer.
  2. Collect it at the server and rack: Tubes or hoses connect server components to supply and return manifolds, which distribute coolant to servers and gather warmed coolant.
  3. Transfer it through the cooling loops: The technology cooling system (TCS) carries heat from IT equipment to a coolant distribution unit (CDU). The CDU transfers heat to the facility water loop or another heat-rejection system.
  4. Reject heat: The facility system ultimately releases the heat outside or makes it available for another use, depending on the site’s design.

A typical CDU circulates, conditions, monitors, and controls coolant. It may include pumps, valves, sensors, controls, and alarms; the wider installation also depends on piping, manifolds, server connections, and a facility-side heat-rejection path. ASHRAE’s Handbook—HVAC Applications discusses these system elements in its data-center chapter.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Direct-to-chip, immersion, and close-coupled cooling

“Liquid cooling” can describe different ways of getting heat from IT equipment into liquid. Direct-to-chip and immersion put liquid at the component or equipment level. Rear-door and in-row heat exchangers are close-coupled approaches: server heat first enters air, then a nearby exchanger removes it.

Approach Where the liquid goes How heat reaches it Key design questions
Direct-to-chip cold plate Through plates attached to selected processors or components Heat passes from the component into the plate and coolant, then through the TCS and CDU to the facility system Which components are cooled; what heat remains for air cooling; coolant temperatures; serviceability and hardware compatibility
Immersion Into a tank or chassis containing dielectric, nonconductive fluid around the equipment Fluid circulates or moves by natural convection to a heat exchanger and facility loop Single- or two-phase operation; equipment and fluid compatibility; maintenance and fluid handling
Rear-door or in-row heat exchanger Into an exchanger near the server or rack Server heat first transfers to air, which then passes through the exchanger Room airflow, rack heat load, and the capacity of the close-coupled exchanger

Direct-to-chip and immersion systems can each be single-phase or two-phase. In a single-phase design, coolant stays liquid. In a two-phase design, it boils as it absorbs heat and is then condensed back into liquid. The two approaches are not interchangeable: immersion surrounds equipment with dielectric fluid, while cold plates contact selected heat-producing components. ASHRAE Journal’s episode 44 podcast explains these distinctions and the close-coupled category.

Why liquid cooling usually does not eliminate air cooling

Cold plates cool only the components connected to them. Memory, power supplies, storage, networking, and other parts can still release heat into the server room. ASHRAE describes most non-immersion deployments as hybrid air-and-liquid systems. Uptime Institute estimates that cold-plate designs may leave 5% to 30% of heat for air cooling, and in some cases as much as 50%; those figures are indicative and vary by system, not guarantees for a particular product or site.

Immersion places more of the equipment in contact with liquid, but that does not by itself establish that a particular facility can do without room-air systems. The actual arrangement depends on what equipment is immersed, how heat is transferred to the facility, and the rest of the site design.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What the facility installation needs

A server loop must connect reliably to a facility capable of receiving its heat. That involves more than adding cold plates or tanks: piping, manifolds, hoses, valves, quick disconnects, sensors, controls, and heat exchangers all have operational roles. Quick disconnects support equipment removal and reconnection; isolation and redundancy help operators maintain service during maintenance or a component failure.

Coolant, temperature, and condensation

Coolant is not necessarily plain water. Depending on the design, options include chilled water, deionized or reverse-osmosis water, glycol mixtures, refrigerants, dielectric fluids, and oils. The fluid must suit the system materials and equipment. Controls also need to keep coolant above the surrounding air’s dew point where necessary; otherwise, condensation can form on cooled surfaces.

Compatibility and performance checks

Before comparing two cooling designs, check their specified coolant and operating mode, server and facility supply and return temperatures, hardware compatibility, and maintenance procedures. Also establish what share of IT heat is captured by liquid and what remains for air systems. For facility outcomes, compare measured energy, water use, heat reuse, and local-climate performance rather than assuming the cooling method alone determines savings. ASHRAE’s AI data-center energy framework recommends tracking PUE, WUE, WUI, and CUE with other lifecycle metrics and using monitoring and commissioning to confirm how a design performs.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Potential benefits—and what they do not guarantee

Moving heat from a chip into liquid can reduce the number of heat-transfer steps between the processor and the environment. Depending on coolant temperatures, heat-exchanger design, outdoor conditions, and the facility as a whole, liquid systems can also make economizer operation or cooling without mechanical refrigeration more feasible. These are design-dependent opportunities, not universal promises of lower electricity use, less water, or the elimination of chillers.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For context, ASHRAE’s framework introduction reports that U.S. data-center electricity consumption tripled between 2014 and 2023 and amounted to about 4.4% of U.S. electricity consumption in 2023. That is an estimate of the sector’s electricity context, not a measurement of liquid cooling’s effect.

Why AI data centers are considering it

AI and high-performance computing combine powerful processors with dense server arrangements, increasing the demands on thermal management. Uptime Institute Intelligence reported that current-generation systems could surpass 40 kW per rack and that some 2025-generation implementations could exceed 100 kW per rack. These figures describe reported capacity context, not every AI rack or facility.

Adoption is not universal. In its Cooling Systems Survey 2024 summary, published May 30, 2024, Uptime Institute reported that 22% of respondents said their organizations used some direct liquid cooling, while 61% said they did not use it but would consider it. Nearly half of respondents whose organizations used it said less than 10% of their organization’s IT racks had direct liquid cooling. These are survey responses, not a census of data centers.

Water-class terminology

ASHRAE’s AI data-center framework lists liquid-cooling water classes W17, W27, W32, W40, W45, and W+. The number identifies the class’s upper temperature limit; W+ denotes a temperature beyond 45°C. These labels are guidance context and should be checked against the equipment requirements and applicable current standards documentation.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.