October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PCOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk5 min

AI Data Centers: Why the Whole Facility Must Be Designed Around the Workload

AI data centers must be designed around the whole workload—not just accelerators. Learn how power, cooling, networking and storage shape retrofit decisions and purpose-built facilities.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI data centers are different because accelerator chips are only one part of the system. Large training and inference workloads can also demand much more power, heat removal, data movement and storage throughput than a conventional facility was designed to deliver. The right answer is not always a new building: an existing site may support selected AI workloads if its electrical, cooling and network capacity—and its room to expand—match the job.

Why can’t a data center just add AI accelerators?

Accelerators do the computation, but they cannot perform well in isolation. They need dependable power, a way to remove the resulting heat, fast connections to other accelerators and a steady supply of data. If any of those supporting systems becomes a bottleneck, adding more compute does not solve the underlying constraint.

As an Amazon Associate I earn from qualifying purchases.

This is why AI infrastructure is a systems-design problem. The compute choice affects power demand and heat; the cooling approach affects facility design; the workload’s communication pattern affects networking and storage; and all of those choices shape how easily the site can grow. A facility with spare floor space but insufficient utility power or heat-rejection capacity may be a worse fit than a smaller site with more suitable infrastructure.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How do training and inference change the design?

Training: keep accelerators exchanging data

Large training workloads distribute computation across many accelerators. Those devices must exchange data, so the network connecting them—the east-west traffic within the facility—can be as important as the computing hardware. Network bandwidth and latency, plus the throughput of the storage feeding the job, help determine whether accelerators can stay productively supplied with data.

#1 Best Overall
Tecmojo 12U Open Frame Network Rack for IT & AV Gear, AV Rack Floor Standing or Wall Mounted,with 2 PCS 1U Rack Shelves & Mounting Hardware,Network Rack for 19" Networking,Audio and Video Device
  • 【Powerful Load-bearing】12U Network Rack Open Frame is constructed from durable cold rolled steel; Rack shelf supports enhance stability, wall-mounted capacity of 130lbs, the ground-mounted up to 260lbs
  • 【Considerate Designs】Open-frame layout, including a top panel adding space, anti-slip shelf stops fixing devices and compatible racks for stack and expansion to meet requirements of home server rack
  • 【Complete Accessories】A 12U open frame server rack, two ventilated shelves, four shelf stops, four velcro straps and a set of equipment mounting screws
  • 【Versatile Application】Ideal for space-efficient multi-device setups in warehouses, retail, classrooms, offices and more; Excellent choices as AV Rack/IT Rack
  • 【Effortless Setup】 Network Rack includes hardware, a comprehensive manual, mounting hole drilling template and an online assembly video to simplify setup

Inference: consider response time and user location

Inference runs a trained model to produce an output. Depending on the service, the priority may be delivering a response quickly and placing capacity close to the people or systems making requests. That can make latency and site location especially important. A design optimized for a large, tightly connected training cluster is not automatically the best design for a geographically distributed inference service.

Why do AI data centers need different power and cooling?

Dense accelerator deployments concentrate electrical demand and heat in racks. McKinsey & Company reported in an October 2024 analysis that average data-center rack power density had more than doubled over the preceding two years, from 8 kW to 17 kW, and projected it could reach 30 kW by 2027 as AI workloads increased. Those figures describe the analysis and its projection, not a current measurement of every data center.

Rank #2
VEVOR 6U Wall Mount Network Server Cabinet, 14.8'' Deep, Server Rack Cabinet Enclosure, 200 lbs Max. Ground-Mounted Load Capacity, with Locking Glass Door Side Panels, for IT Equipment, A/V Devices
  • Space Saving: Maximum depth: 14.8". Use the wall mount network cabinet to maximize available space for retail locations, classrooms, back offices, network cabinets, and other locations where space is limited.
  • Fast Heat Dissipation: The server cabinet is designed with vents to optimize airflow and avoid critical IT equipment overheating. Heat sink holes in the top, bottom, and rear panels are more conducive to heat dissipation.
  • Sturdy Construction: Robust welded frame construction for durability and long service life. With 100 lbs wall-mounted load capacity and 200 lbs ground-mounted load capacity, you can place multiple devices in the server rack cabinet as needed.
  • High Security: The locked glass door ensures the security of data and equipment. Wall mount rack enclosure server cabinet is ideal for use in public places such as offices, effectively protecting the security of your devices.
  • Hassle-free Installation: Fully adjustable square-hole mounting rails of the wall mount server cabinet facilitate device installation. Wiring holes on the top, bottom, and rear panels provide you with easy cable routing.

Power delivery and heat removal have to be planned together. A cooling system’s capacity is relevant only if the facility can deliver the required power and reject the heat it removes; likewise, available electrical capacity is not useful for a dense deployment if the cooling system cannot handle its thermal load. McKinsey describes several cooling approaches and the rack-density ranges associated with them in its 2024 analysis:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Cooling approach Density discussed by McKinsey What to keep in mind
Rear-door heat exchangers 40–60 kW per rack McKinsey’s stated range; capability depends on implementation.
Direct-to-chip cooling 60–120 kW per rack Described as commonly deployed in McKinsey’s account; actual capability depends on implementation.
Immersion cooling Around 100 kW per rack; above 150 kW for dual-phase use Ranges described by McKinsey; actual capability depends on implementation.

These are not universal limits or guarantees for a particular installation. The workable choice depends on the equipment, facility design and deployment conditions. Liquid cooling is therefore not a single solution that every AI site must adopt; it is a family of approaches to evaluate against the heat load and the rest of the facility.

Rank #3
VEVOR 12U Open Frame Server Rack, 23-40 in Adjustable Depth, Free Standing or Wall Mount Network Server Rack, 4 Post AV Rack with Casters, Holds All Your Networking IT Equipment AV Gear Router Modem
  • Adjustable Depth: 23-40'' adjustable depth is used for servers and network equipment, ensuring enough space for AV equipment, components, and cabling, while allowing you to access ports and equipment from multiple sides.
  • Strong Load Capacity: Ground-Mounted Load Capacity: 500 lbs, Wall-Mounted Load Capacity: 150 lbs. The av rack is made of carbon steel for better weldability performance and can help save space while meeting your need to place multiple devices.
  • User-friendly Design: Ergonomic design makes the open frame av rack easier to use. The additional top panel is able to place other items with more available space. Roller design moves anywhere and anytime, is convenient, and is more energy-saving.
  • Complete Accessories: We provide the accessories you need, including 2 x Pallets, 145 x M5*10 Cross Head Screws, 4 x Casters, 4 x M10*50 Expansion Screws,10 x M6*12 Cage Nuts, 1 x Grounding Wire, 1 x User Manual.
  • Wide Application: The server rack wall mount maximizes the use of available space, suitable for retail venues, classrooms, offices, and other places where space is limited.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Can a traditional data center be retrofitted for AI?

Sometimes. A retrofit can make sense for a selective workload when the building has enough power, cooling, network and storage headroom, or when those systems can be upgraded on a practical schedule. Floor space alone does not establish suitability. The important question is whether the facility can support the expected workload at the required density and continue to do so as it expands.

Peter Panfil, Vertiv distinguished engineer and vice president of technical business development, told Mouser Electronics in a July 24, 2026 article that “many existing facilities can be upgraded to support selective AI workloads, but purpose-built designs are usually better suited.” This is an attributed industry perspective, not a universal engineering standard; the facility and workload determine the answer.

Rank #4
AC Infinity CLOUDPLATE T2, Rack Mount Fan 1U, Top Exhaust Airflow
  • An intelligent fan system designed for cooling audio video, DJ, server, network, and IT equipment racks.
  • Protects rack-mount equipment from overheating, performance issues, and shortened lifespans.
  • Programmable thermostat controller with automated speed control, alarm warnings, and backup memory.
  • Premium anodized aluminum construction with CNC-machined detailing for a professional appearance.
  • Size: 1U Rack Space | Design: Top Exhaust | Airflow: 60 to 300 CFM | Noise: 12 to 38 dBA | Bearings: Dual Ball

Use the workload and site together to assess fit

Decision area Questions to answer
Workload Is the site intended for training, inference or both? What communication and response-time requirements follow from that choice?
Rack density What power density will the planned equipment require, and can the cooling design support it?
Power Can utility service and backup power support the deployment and its planned growth?
Heat rejection Can the facility remove the heat at the intended density using a cooling method suited to the site?
Networking and storage Can the network provide the bandwidth and latency the workload needs, and can storage deliver data quickly enough?
Schedule and expansion Can required upgrades be completed in time, and is there a credible path to add capacity later?

If one or more critical systems cannot meet the workload’s needs, the choice is not simply “retrofit” or “new build.” The operator may be able to change the scale or type of workload, upgrade the constrained system, or choose a site designed for the target capacity. The trade-off is between making use of existing infrastructure and the coordination, time and cost of bringing every necessary system into alignment.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What could 800 VDC power mean for future AI facilities?

NVIDIA’s May 20, 2025 developer blog describes a proposed 800 VDC power architecture aimed at future megawatt-scale racks. NVIDIA says the design could transmit 85% more power through the same conductor size, reduce copper requirements by 45% compared with 415 VAC distribution, and improve end-to-end efficiency by up to 5%. These are vendor-stated benefits for a proposed architecture, not independently validated results or evidence of broad deployment.

NVIDIA said full-scale production was expected to coincide with its Kyber rack-scale systems in 2027. As of October 2026, that is a future roadmap milestone. The company’s account also identifies safety, standards and workforce challenges. A higher-voltage architecture is not simply a drop-in upgrade: facilities would need to address those practical requirements as part of any deployment decision.

What makes a data center AI-ready?

AI readiness is not a label that follows from installing accelerators. It means that the facility’s compute, electrical supply, cooling, network, storage and operational plans can support a defined workload at its intended scale. Some existing sites may satisfy that test for selected deployments; denser or larger clusters may make purpose-built infrastructure a better fit.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.