Direct Liquid Cooling for Data Center Racks: How to Specify
Direct liquid cooling (DLC) for data center racks removes heat directly from server components using coolant, rather than relying solely on air. This guide explains how to specify a DLC system that matches your hardware, cooling needs, and facility constraints, covering everything from initial assessment to implementation.
What You’ll Need
- Server inventory with thermal design power (TDP) and cooling architecture (air-cooled vs. liquid-ready)
- Facility floor plan and existing cooling infrastructure details (chilled water, CRAC/CRAH, power)
- Coolant specifications (type, flow rate, temperature range)
- Rack layout and power distribution information
- Budget and vendor comparison criteria
Step-by-Step
- Assess your hardware and cooling needs. Identify which servers are candidates for DLC—typically high-density (TDP > 20 kW per rack) or those with liquid-ready connectors. Note the TDP of each component (CPU, GPU, memory) and the total rack heat load. Determine if your servers support cold plate or immersion cooling; most DLC retrofits use cold plates.
- Determine the cooling architecture. Choose between direct-to-chip (cold plate) cooling, where coolant flows through plates attached to CPUs/GPUs, or full immersion, where servers are submerged in dielectric fluid. For most rack-level retrofits, direct-to-chip is the practical choice.
- Calculate the thermal load per rack. Sum the TDP of all components in each rack. For example, if a rack has 10 servers each with 500W CPUs and 300W GPUs, the total is 8 kW. Add a safety margin of 20-30% for future upgrades and non-IT heat sources.
- Define coolant specifications. Choose the coolant type (typically propylene glycol-water mixture for freeze protection, or pure water with corrosion inhibitors). Specify the required flow rate (liters per minute) and inlet temperature (usually 15-25°C for cold plates). Ensure the coolant is compatible with your server materials.
- Design the distribution system. Plan the piping from the facility cooling source (e.g., chiller or cooling tower) to the racks. Decide on a manifold system (row-level or rack-level) that delivers coolant to each server. Specify the number of supply and return lines, pipe diameters, and insulation requirements.
- Select the cooling plant. Determine if you can use existing chilled water or need a dedicated DLC loop. For DLC, the coolant temperature is higher than traditional chilled water (e.g., 20°C vs. 7°C), which improves chiller efficiency. If you have a cooling tower, you might use free cooling for most of the year.
- Specify the rack and server integration. Ensure racks have sufficient space for coolant manifolds and hoses. Specify quick-disconnect couplings for tool-less server installation. Confirm that server mounts and cable management accommodate the coolant lines without kinking.
- Plan for monitoring and control. Include sensors for coolant temperature, flow rate, and pressure at the rack and facility level. Specify a control system that adjusts flow based on server load and alerts on leaks or temperature excursions.
- Develop a leak prevention and containment strategy. Use double-walled piping, drip trays, and leak detection cables. Specify the use of dielectric coolant to minimize electrical damage in case of a leak. Plan for regular maintenance and pressure testing.
- Create a detailed specification document. Include all the above parameters, plus vendor requirements for installation, commissioning, and testing. Specify performance metrics such as PUE (Power Usage Effectiveness) improvement targets and acceptable pressure drops.
Common Mistakes
- Underestimating the thermal load by not accounting for all heat sources (e.g., power supplies, memory).
- Assuming all servers are liquid-ready; many require retrofits or specific models.
- Ignoring the need for a separate coolant loop; mixing DLC with air conditioning can cause condensation issues.
- Choosing too low a coolant temperature, which wastes energy and risks condensation.
- Not planning for future scalability—adding more racks later may require a larger manifold or pump.
Tips
- Start with a pilot rack to validate performance and leak safety before scaling.
- Use a coolant temperature of 20-25°C to maximize chiller efficiency and allow longer periods of free cooling.
- Consider using a dry cooler or cooling tower to reject heat without a chiller in many climates.
- Work with your server vendor to ensure warranty coverage for liquid cooling modifications.
- Specify redundant pumps and N+1 cooling capacity to maintain uptime.
Troubleshooting
- Coolant temperature too high: Check flow rate and chiller setpoint. Increase pump speed or lower the chiller temperature, but watch for condensation.
- Flow rate low in one rack: Inspect for kinked hoses, clogged filters, or air locks. Bleed air from the system and replace filters if needed.
- Leak detected: Isolate the affected section, shut off the pump, and use the leak detection system to locate the source. Dry the area and replace faulty components.
- Condensation on cold plates: Raise the coolant inlet temperature above the dew point or improve insulation on the plates and lines.
- Server overheating despite cooling: Verify that the cold plates are properly seated and that thermal paste is applied. Check that the server’s internal fans are still operating for non-cooled components.
Frequently Asked Questions
- Can I retrofit existing air-cooled servers with DLC? Yes, if the server has liquid-ready cold plates or if you can install aftermarket kits. However, warranty may be voided, so check with the vendor.
- What coolant should I use? Typically a mixture of deionized water and propylene glycol (20-30% glycol) for freeze protection and corrosion inhibition. Some systems use pure water with additives.
- How much energy can DLC save? DLC can reduce cooling energy by up to 40-50% compared to air cooling, because it eliminates the need for fans and allows higher chilled water temperatures.
- Is DLC safe for servers? Yes, when properly installed with leak detection and dielectric coolant. The risk of electrical damage is low, but regular maintenance is essential.
- What is the typical cost of DLC per rack? Costs vary widely, but expect $1,500-$5,000 per rack for retrofits, plus facility costs for piping and cooling plant. Savings in energy and space often offset the investment.
- Do I need a separate cooling loop for DLC? Yes, because the coolant temperature and flow requirements differ from air conditioning. A separate loop allows higher temperatures and better efficiency.
Related
Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.