DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
Skip to content
World desk9 min

Why AI Data Centers Face Power, Cooling, and Networking Bottlenecks

AI growth is exposing linked limits in electricity delivery, rack density, cooling capacity and network infrastructure. Here is what the evidence shows—and what remains site-specific.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI data centers are being built faster than the infrastructure that supplies and operates them. Training and serving larger models requires dense clusters of accelerators, which raise electricity demand and rack-level power density. Utilities, transformers and interconnection queues often expand on much longer schedules than a data-center project. The same concentrated hardware produces intense heat, while high-speed switches and links add another substantial equipment and energy load.

These constraints are connected but not identical. Power delivery and cooling energy are directly documented as major limits. Networking is essential and growing, yet current evidence does not show that network throughput is a universal bottleneck for every AI deployment. The severity depends on the facility’s location, design, efficiency, workload and access to shared infrastructure.

As an Amazon Associate I earn from qualifying purchases.

The basic mismatch: AI projects move faster than infrastructure

A data-center operator can procure buildings, servers and electrical equipment on a project schedule. The surrounding power system cannot always move at the same speed. New transmission, substations, transformers and generation require planning, permitting, manufacturing capacity and construction that can take years. When several large facilities seek interconnection in the same area, a project can be physically ready while its grid connection remains delayed.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The International Energy Agency (IEA) reported that global data-center electricity demand grew 17% in 2025, while electricity use by AI-focused data centers grew 50%. Its central projection puts total data-center electricity use at 485 TWh in 2025 and about 950 TWh in 2030. AI-focused data-center use is projected to triple over that period. Those 2030 figures are a scenario, not a measured result, so they should be used to understand the scale of the challenge rather than as a guaranteed outcome.

#1 Best Overall
Sale
TP-Link CPE510, Long Range Outdoor CPE for PtP, PtMP Transmission, 5GHz N300
  • 𝗢𝗻𝗲 𝗦𝘄𝗶𝘁𝗰𝗵 𝗠𝗮𝗱𝗲 𝘁𝗼 𝗘𝘅𝗽𝗮𝗻𝗱 𝗡𝗲𝘁𝘄𝗼𝗿𝗸: 5× 10/100/1000Mbps RJ45 Ports supporting Auto Negotiation and Auto MDI/MDIX.
  • 𝗚𝗶𝗴𝗮𝗯𝗶𝘁 𝘁𝗵𝗮𝘁 𝗦𝗮𝘃𝗲𝘀 𝗘𝗻𝗲𝗿𝗴𝘆: Latest innovative energy-efficient technology greatly expands your network capacity with much less power consumption and helps save money.
  • 𝗥𝗲𝗹𝗶𝗮𝗯𝗹𝗲 𝗮𝗻𝗱 𝗤𝘂𝗶𝗲𝘁: IEEE 802.3X flow control provides reliable data transfer and Fanless design ensures quiet operation.
  • 𝗣𝗹𝘂𝗴 𝗮𝗻𝗱 𝗣𝗹𝗮𝘆: Easy setup with no software installation or configuration needed.
  • 𝗔𝗱𝘃𝗮𝗻𝗰𝗲𝗱 𝗦𝗼𝗳𝘁𝘄𝗮𝗿𝗲 𝗙𝗲𝗮𝘁𝘂𝗿𝗲𝘀: Prioritize your traffic and guarantee high quality of video or voice data transmission with Port-based 802.1p/DSCP QoS and IGMP Snooping.

At the global level, data centers used an estimated 415 TWh, about 1.5% of worldwide electricity, in 2024. That percentage can make the impact appear modest. In practice, facilities cluster in particular regions, so a local substation or transmission corridor can face a severe constraint even when global electricity supply is adequate.

How AI raises the power bottleneck

More accelerators mean more electricity at the rack

AI workloads use large numbers of GPUs or other accelerators working in parallel. Adding accelerators increases the number of servers and the energy consumed by computation, memory and power-conversion equipment. It also concentrates that demand into fewer racks than many conventional enterprise workloads.

The IEA says AI-server power density increased elevenfold between 2020 and 2025 and is set to rise another fourfold by 2027. It estimates that an advanced data-center server rack could have peak power demand equivalent to 65 households by 2027. This is a forecast for an advanced rack, not a description of every rack in operation. Older, mixed-use or less-dense facilities can have very different loads.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Interconnection queues and electrical equipment

High rack density changes the facility’s electrical design. Operators need larger service capacity, more switchgear, substations, power-distribution units and backup systems. The IEA identifies slow grid connections and constrained supply chains for transformers and other energy technologies as obstacles. A site may have enough building space for an AI cluster but still lack an approved interconnection or the equipment needed to energize it.

Rank #2
Sale
NETGEAR 5-Port Gigabit Ethernet Unmanaged Network Switch (GS305) | Home Network Hub, Office Ethernet Splitter, Plug-and-Play, Silent Operation, Desktop or Wall Mount, Essentials Model
  • GIGABIT ETHERNET PORTS: Features 5 x 1.0Gbps Ethernet ports for high-speed connectivity. Auto-negotiating ports detect the optimal speed for connected devices and work with existing Cat5e or Cat6 Ethernet cables.
  • PLUG-AND-PLAY UNMANAGED NETWORK SWITCH: Simple plug-and-play setup with no software to install or configuration required.
  • FLEXIBLE MOUNTING OPTIONS: Compact metal design supports desktop or wall-mount placement for versatile installation.
  • SILENT & ENERGY-EFFICIENT OPERATION: Fanless design ensures silent performance, while IEEE 802.3az Energy Efficient Ethernet reduces power consumption without compromising high-speed network performance.
  • REGIONAL COMPATIBILITY: Made for use in U.S. & CA only

Most data centers prefer a grid connection. The IEA cautions that onsite generation does not remove the need to address grid constraints: generators, batteries or other local resources may support a project, but they do not automatically provide the dependable, long-term capacity or transmission access that a large facility requires. They can also introduce fuel, emissions, permitting, maintenance and noise issues.

Global and U.S. electricity figures are not interchangeable

Measure Figure Scope and status
Global data-center electricity use 415 TWh; about 1.5% of global electricity 2024 estimate from the IEA (2025)
Global data-center demand growth 17% in 2025 IEA (2026); reported growth
AI-focused data-center demand growth 50% in 2025 IEA (2026); reported growth
Global data-center electricity projection 485 TWh in 2025 to about 950 TWh in 2030 IEA (2026) central projection; not a measured outcome
U.S. data-center electricity use 192 TWh; 4.7% of U.S. electricity 2024 estimate in Berkeley Lab’s 2026 update
U.S. 2030 Reference Case 649 TWh; 11.8% of forecast U.S. electricity Berkeley Lab’s 2026 update; scenario estimate
Earlier U.S. estimate 176 TWh; 4.4% of U.S. electricity 2023 estimate, with a 2028 forecast range of 325–580 TWh, from Berkeley Lab’s 2024 report; superseded by the later update

The IEA numbers describe worldwide demand, while Berkeley Lab’s numbers describe the United States. Their years, methods and scopes differ, so they should not be added together or treated as competing measurements of the same quantity.

Why cooling becomes a second bottleneck

Electricity becomes heat

Nearly all electricity consumed by servers eventually appears as heat that must be removed to keep components within operating limits. AI racks make that task harder because more heat is produced in a smaller volume. Cooling equipment must move heat from chips to a heat-rejection system, maintain acceptable temperatures and continue operating during changes in workload.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The IEA reports a wide range in cooling’s share of data-center electricity: about 7% in efficient hyperscale facilities and more than 30% in less-efficient enterprise facilities. The range reflects building design, climate, utilization, cooling architecture and operating practices. A percentage from an efficient hyperscale site is not a valid assumption for an older enterprise room.

Rank #3
Sale
NETGEAR 8-Port Gigabit Ethernet Unmanaged Network Switch (GS308) | Home Network Hub, Office Ethernet Splitter, Plug-and-Play, Silent Operation, Desktop or Wall Mount, Essentials Model
  • GIGABIT ETHERNET PORTS: Features 8 x 1.0Gbps Ethernet ports for high-speed connectivity. Auto-negotiating ports detect the optimal speed for connected devices and work with existing Cat5e or Cat6 Ethernet cables.
  • PLUG-AND-PLAY UNMANAGED NETWORK SWITCH: Simple plug-and-play setup with no software to install or configuration required.
  • FLEXIBLE MOUNTING OPTIONS: Compact metal design supports desktop or wall-mount placement for versatile installation.
  • SILENT & ENERGY-EFFICIENT OPERATION: Fanless design ensures silent performance, while IEEE 802.3az Energy Efficient Ethernet reduces power consumption without compromising high-speed network performance.
  • REGIONAL COMPATIBILITY: Made for use in U.S. & CA only

Air and liquid systems are design choices, not universal answers

Traditional air cooling can be practical for lower-density equipment, but moving enough air through very dense racks requires fans, ducting and heat exchangers. Liquid-cooled designs can transfer heat more effectively at the chip or rack, yet they require compatible servers, distribution hardware, leak-management procedures and facilities capable of rejecting the captured heat. The choice affects capital cost, maintenance, retrofit difficulty and operating efficiency.

Berkeley Lab’s U.S. analysis reports that national average power usage effectiveness (PUE) improved from 1.55 in 2018 to 1.45 in 2024, partly reflecting the shift toward facilities deploying liquid-cooled AI servers. PUE is total facility energy divided by IT energy; a lower value indicates less overhead for cooling, power conversion and other support systems. This national trend does not establish that liquid cooling is preferable for every site or workload.

Water needs local analysis

Cooling choices can affect water demand, but water use depends on the cooling system, climate, operating mode and local utilities. The available evidence does not provide a current, comparable water-use figure by cooling technology and location. A project assessment therefore needs site-specific water accounting rather than a single industry-wide number. Where water availability is constrained, designers may trade water consumption against electricity use, equipment cost and thermal performance.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Where networking fits—and where the evidence is weaker

Networking is part of the facility’s power budget

AI clusters depend on switches, routers, optical links and load balancers to move training data, model parameters and user requests. These components consume electricity, require rack space and add heat that the cooling system must remove. The IEA estimates networking equipment can account for up to 5% of data-center electricity use. Berkeley Lab’s 2026 U.S. update estimates networking at 4.5% of data-center electricity in 2024 and says AI networking needs are driving growth roughly in line with server demand.

Rank #4
Sale
TP-Link TL-SG116, 16 Port Gigabit Unmanaged Ethernet Switch | Desktop/Wall Mount, Fanless, Sturdy Metal w/Shielded Ports, Traffic Optimization
  • One Switch Made to Expand Network-16× 10/100/1000Mbps RJ45 Ports supporting Auto Negotiation and Auto MDI/MDIX
  • Gigabit that Saves Energy-Latest innovative energy-efficient technology greatly expands your network capacity with much less power consumption and helps save money
  • Reliable and Quiet-IEEE 802.3X flow control provides reliable data transfer and Fanless design ensures quiet operation
  • Plug and Play-Easy setup with no software installation or configuration needed
  • Advanced Software Features-Prioritize your traffic and guarantee high quality of video or voice data transmission with Port-based 802.1p/DSCP QoS and IGMP Snooping

That share is large enough to matter in electrical and thermal planning. A facility that increases server capacity without reserving space, power and cooling for switches and optical equipment can create an internal bottleneck even when its utility connection is adequate.

Throughput is not proven to be a universal deployment constraint

The reviewed evidence does not establish that bandwidth, latency or switch availability is a general deployment bottleneck on the same footing as electricity interconnection. Networking requirements vary with model size, parallel-training method, storage layout, inference traffic and the distance between facilities. Some installations may face shortages of specialized switches, optical components or engineering capacity; others may have ample network performance and be limited primarily by power or cooling.

It is more accurate to describe networking as an essential and growing infrastructure requirement than to claim that every AI data center is blocked by insufficient network throughput.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How the constraints reinforce one another

Power, heat and network equipment form a coupled design problem

Adding accelerators raises IT electricity demand. That electricity becomes heat, increasing cooling capacity and often cooling electricity. Larger clusters also need more network equipment and optical interconnects, which add their own load and heat. The resulting facility must size utility service, backup power, distribution equipment, cooling loops, heat rejection and network pathways together.

Best Value
TP-Link 8 Port Gigabit Ethernet Network Switch - Ethernet Splitter | Plug & Play | Fanless | Sturdy Metal w/ Shielded Traffic Optimization | Unmanaged | Lifetime Protection (TL-SG108)
  • 8 GIGABIT PORTS: Features 8 RJ45 ports supporting 10/100/1000 Mbps speeds, providing high-speed wired network connectivity for computers, printers, gaming consoles, and other Ethernet-enabled devices
  • PLUG AND PLAY SETUP: No configuration required; simply connect the switch to your network devices and it is ready to use immediately, making network expansion quick and hassle-free
  • FANLESS QUIET DESIGN: The fanless design ensures silent operation, making this switch suitable for noise-sensitive environments such as home offices, bedrooms, or conference rooms
  • STURDY METAL CONSTRUCTION: Built with a durable metal housing and shielded ports that provide reliable performance, better heat dissipation, and protection against electromagnetic interference
  • TRAFFIC OPTIMIZATION: Supports IEEE 802.3x flow control and advanced traffic optimization technology to reduce data bottlenecks and ensure smooth, efficient data transfer across your network

A limit in one subsystem can strand capacity in another. For example, a building may have floor space for more servers but insufficient transformer capacity. A site may have electrical capacity but not enough heat-rejection equipment for dense racks. A cluster may have compute and cooling but lack the network topology needed to keep accelerators busy. These are engineering failure modes, not a single universal “AI bottleneck.”

Location changes the severity

Grid congestion, climate, water availability, permitting rules, equipment lead times and the existing data-center base differ by region. A project near available transmission and industrial cooling infrastructure can face a different schedule from an otherwise identical project in a constrained load pocket. National or global averages cannot predict the interconnection date, cooling cost or network design for a particular facility.

What operators should check before expanding an AI facility

  1. Confirm firm electrical capacity. Obtain the utility’s written interconnection status, available service level, expected energization date and assumptions about future load. Treat an application or queue position as different from an operating connection.
  2. Map rack-level loads. Separate average, peak and transient demand for accelerators, storage, networking and cooling. Use the actual server and switch specifications rather than an average rack value; the IEA’s 65-household figure is a 2027 forecast for an advanced rack.
  3. Audit transformer and switchgear availability. Check procurement lead times, voltage requirements, redundancy and replacement plans. A building schedule is not realistic if critical electrical equipment cannot arrive in time.
  4. Model heat rejection at full cluster load. Include outdoor design conditions, fan and pump energy, redundancy and the effect of simultaneous training or inference peaks. Compare the result with the facility’s cooling capacity, not just its nameplate IT capacity.
  5. Evaluate cooling options against the site. Compare air and liquid approaches for density, retrofit requirements, maintenance, water exposure, energy overhead and heat-rejection capability. Do not select a technology solely because it is associated with AI.
  6. Reserve network capacity early. Specify switch ports, link speeds, optical paths, oversubscription, latency targets and fault domains. Confirm that network equipment has electrical and thermal capacity in the same deployment phases as servers.
  7. Test alternatives without assuming they solve the grid issue. Onsite generation, storage, demand management or phased commissioning may help a project operate within local limits, but they do not automatically replace a durable grid connection.
  8. Recheck the plan as hardware changes. Accelerator generations, server configurations and model-serving patterns can change rack density and traffic assumptions. A design approved for one platform may not fit the next platform’s power or cooling envelope.

How to read long-range forecasts responsibly

Forecasts are useful for planning transmission, generation, cooling factories and equipment supply chains, but they are not promises. The IEA’s near-term growth figures and its 2030 projection describe different kinds of evidence: 17% and 50% are reported 2025 growth rates, while the rise from 485 TWh to about 950 TWh is a central projection. Berkeley Lab’s 649 TWh U.S. figure is a 2030 Reference Case, not a guaranteed national total.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Actual demand can differ if model efficiency improves, workloads move to smaller systems, utilization changes, new facilities are delayed or electricity prices alter deployment locations. It can also exceed a scenario if AI adoption and training demand grow faster than assumed. Planning should therefore use multiple load cases and state the year, geography and scenario behind every number.

The practical answer

AI data centers face bottlenecks because computation is scaling faster than the shared systems that deliver electricity, remove heat and connect machines. Power delivery is usually the first-order constraint where interconnection queues, transformers or generation are limited. Cooling becomes critical as rack density rises and can consume anywhere from about 7% to more than 30% of facility electricity depending on design and efficiency. Networking is indispensable and accounts for a measurable share of energy, but the evidence supports a site- and workload-specific requirement rather than a universal throughput crisis.

The right response is integrated, local planning: secure a realistic grid connection, size electrical and cooling systems for actual rack peaks, include network equipment from the first design iteration, and treat forecasts as scenarios. No single workaround removes all three constraints.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.