DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix Now×
Skip to content
World desk4 min

AI Is Getting Cheaper Fast. So Why Could Compute Demand Keep Rising?

AI can become cheaper per task while data-centre electricity demand rises. The difference lies in total use, task complexity, and what the figures actually measure.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI can get cheaper per task while total compute demand rises because lower costs make it practical to use AI more often and for more kinds of work. The key distinction is between the resources used by one task and the resources used by all tasks combined: efficiency lowers the first, but wider adoption and more demanding workloads can raise the second.

What “cheaper AI” measures—and what it does not

“Compute demand” can mean several things: processor operations, accelerator-hours, inference tokens, installed computing capacity, or electricity. A claim that one AI task has become cheaper or more efficient is a unit measure; it does not by itself say whether total computing or electricity use is falling.

As an Amazon Associate I earn from qualifying purchases.

For a specific benchmark, Stanford HAI’s 2025 AI Index found that the inference cost of a system performing at GPT-3.5 level fell more than 280-fold between November 2022 and October 2024. That is a striking reduction for a defined performance level and period—not a universal price change for every model, provider, workload, or user’s bill.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The IEA’s 2026 executive summary says energy use per AI task fell by at least an order of magnitude annually in recent years. That is the IEA’s summary of recent trends, not a measured rate that applies to every kind of AI task. Unit efficiency can improve even as the total number and complexity of tasks grow.

#1 Best Overall
ASRock Radeon AI PRO R9700 Creator 32GB Professional Graphics Card, 2920 MHz Boost Clock, GDDR6, AMD RDNA 4, AI-Accelerators, DisplayPort 2.1a, PCIe 5.0, Blower Cooler
  • Professional AI & Creator Workstation: AMD Radeon AI PRO R9700 GPU with 32GB GDDR6 is engineered for AI development, professional content creation, and compute-intensive workloads.
  • Massive 32GB Memory Capacity: 32GB of GDDR6 memory on a 256-bit bus provides ample bandwidth for large AI models, 8K video editing, and complex 3D rendering.
  • Advanced RDNA 4 with AI Accelerators: 64 Compute Units with 3rd Gen Ray Tracing and dedicated 2nd Gen AI Accelerators for groundbreaking AI performance and visual computing.
  • Professional Blower Cooling: Efficient single blower design exhausts heat directly out of the chassis, ideal for multi-GPU workstation and server configurations.
  • Enterprise-Grade Thermal Solution: Vapor chamber heatsink with industrial Honeywell PTM7950 thermal interface material ensures reliable cooling under sustained professional loads.

Why lower costs can lead to more total use

More uses become worth building

When a query becomes less expensive, companies may find it practical to add AI features to more products or make existing features available to more people. Users may also turn to AI more frequently when the service is faster, cheaper, or built into tools they already use. This is a plausible economic mechanism, not a quantified explanation of how much of data-centre growth came from lower prices.

The number of tasks can outweigh savings per task

A simple way to think about the relationship is: total resource use depends on both the resources required per task and the number and kind of tasks performed. If unit use falls but volume rises sufficiently, the aggregate can still increase. There is no comprehensive global count of how often and how deeply people use AI, so the IEA does not establish a precise worldwide query-growth rate.

Rank #2
Sale
HPE NVIDIA Tesla V100 32GB HBM2 PCIe 3.0 x16 Passive GPU Computational Accelerator for AI Machine Learning HPC Deep Learning 699-2G500-0216-400 (Renewed)
  • NVIDIA Volta GV100 Architecture — 4,608 CUDA Cores, 640 1st-Gen Tensor Cores delivering 14 TFLOPS FP32 and 112 TFLOPS deep learning performance for AI training, inference, HPC, and scientific computing workloads
  • 32GB HBM2 ECC Memory — 900 GB/s Bandwidth — High-bandwidth memory on a 4096-bit bus with ECC error correction provides the memory capacity and throughput required for the largest AI models, simulations, and datasets
  • PCIe 3.0 x16 Interface — 250W TDP — Standard PCIe Gen3 connectivity with passive cooling designed for enterprise rack server deployment in HPE ProLiant, Dell PowerEdge, and Supermicro platforms with adequate chassis airflow
  • NVLink — Scale to 96GB Unified Memory — Connect two V100 GPUs via NVLink at 300 GB/s bi-directional bandwidth to scale GPU memory from 32GB to 96GB for larger AI training and HPC workloads
  • Multi-Precision Computing — Supports FP64 (7 TFLOPS), FP32 (14 TFLOPS), FP16 (112 TFLOPS) and INT8 precision modes for flexible deployment across training, inference, and scientific simulation workloads

New workloads may be heavier than the tasks they replace

Not every AI request is comparable. The IEA identifies video generation, reasoning, and agentic tasks as applications that can use hundreds or thousands of times more energy per query than simple text generation. An increase in these workloads can raise total electricity use even while basic text tasks become more efficient.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

So, if each AI query takes less compute, why are data centres still using more power? Because “each query” is not one fixed workload, and the total includes all queries and other data-centre services. More users, more frequent use, and a shift toward more resource-intensive tasks can outweigh lower energy use for a basic request.

Rank #3
ASUS ProArt GeForce RTX 5080 16GB GDDR7 OC Edition Graphics Card
  • AI Performance: 1858 AI TOPS. OC mode: 2730 MHz (OC mode)/ 2700 MHz (Default mode)
  • OC mode: 2730 MHz (OC mode)/ 2700 MHz (Default mode)
  • Powered by the NVIDIA Blackwell architecture and DLSS 4
  • 2.5-slot size with boosted thermal design aims for a perfect balance between compatibility and performance
  • An integrated USB Type-C port enables enhanced versatility for content creation workflows

What the data-centre electricity figures show

Electricity figures give one concrete measure of the aggregate trend, but they cover data centres—not AI alone. Data centres support many digital services, and the IEA identifies AI as their most important growth driver alongside other services.

Measure Figure How to read it
Global data-centre electricity use in 2024 Estimated 415 TWh, about 1.5% of global electricity Historical estimate for all data-centre workloads, not an AI-only total. The IEA estimated data-centre electricity use had grown about 12% per year since 2017.
Global data-centre electricity use in 2030 Around 945 TWh The IEA’s 2025 base-case projection: more than double the 2024 estimate, not a measured outcome. AI was identified as the leading growth driver alongside other digital services.
Change in data-centre electricity demand in 2025 17% growth The IEA’s 2026 update reports this as a change in electricity demand, not a direct measure of all AI compute.
Change in electricity use by AI-focused data centres in 2025 50% growth The IEA’s 2026 update reports this for AI-focused data centres; it is not the same as a global total for all AI-related computing.

The 2024 estimate and 2030 projection come from the IEA’s 2025 analysis of energy demand from AI. The 2025 growth figures are from the IEA’s 2026 update. They use different report vintages and describe distinct time periods; the 2030 number remains a forecast.

Rank #4
PNY NVIDIA GeForce RTX™ 5080 OC Triple-Fan Graphics Card
  • Axial-Fan Tech Built to Endure - Triple 100mm axial fans feature refined blades for 15% more airflow, counter-rotation to cut turbulence, and durable dual-ball bearings. Stealth Mode stops fans at low temps for silent operation, boosting card longevity and performance.
  • Masterfully Crafted Cooling - Advanced vapor chamber and ultra-dense heatsink rapidly pull heat from the GPU, while an open aluminum backplate boosts airflow and ventilation, resulting in lower temperatures for stronger performance and stability in demanding workloads.
  • VelocityX Software - Gain full control over your PNY graphics card to maximize its performance. Fine-tune core and memory clocks, dial in custom fan curves, and monitor real-time temperatures and speeds, all from one intuitive interface. Save up to five profiles for instant recall.
  • Your Creative AI-dvantage - Experience RTX accelerations in top creative apps, world-class NVIDIA Studio drivers engineered and continually updated to provide maximum stability, and a suite of exclusive tools that harness the power of RTX for AI-assisted creative workflows.
  • NVIDIA Blackwell Architecture - The Ultimate Platform for Gamers and Creators. Do it all with 5th-Gen Tensor cores for Max AI performance, new streaming multiprocessors that are optimized for neural shaders, and 4th-Gen Ray Tracing cores built for Mega Geometry.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Training and inference are different kinds of demand

Training is the computing used to build or update a model. Inference is the computing used when a trained model responds to users or performs a task. A reduction in the cost of inference does not erase the resources involved in training, and training-cost estimates should not be mistaken for current per-query prices.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Stanford HAI’s 2024 AI Index estimated compute costs of $78 million to train GPT-4 and $191 million to train Gemini Ultra. These are dated estimates for those models’ training, not current quotes for training a model or running inference.

Best Value
TotalServerShield A2 16GB GDDR6 AI Accelerator Data Center Server GPU Card Compatible with Nvidia Ampere PG179 900-2G179-2720-001
  • ECC Support: Yes.
  • CUDA Cores: 1280.
  • Tensor Cores: 40 (third-generation).
  • RT Cores: 10 (second-generation).
  • GPU Memory: 16 GB GDDR6.

Does efficiency guarantee a rebound in demand?

No. Lower costs can encourage greater use, and more capable applications can require more resources, but those mechanisms do not prove that efficiency gains will always be outweighed. The IEA says comprehensive global statistics on AI usage frequency and depth are not available, limiting certainty about how use is changing and how much of the aggregate increase is attributable to it.

It is therefore more accurate to say that efficiency and rising demand can coexist—and that expanding use and heavier workloads help explain how—than to claim that every efficiency improvement automatically causes total consumption to rise. Global electricity totals also do not reveal where new data centres are built or how their power demand affects a particular local grid.

Quick Recap

How to read claims about AI’s resource use

  • Check whether a figure describes cost or energy per task, or total compute, capacity, or electricity use.
  • Look for the workload: simple text, video, reasoning, and agentic tasks can have very different energy needs.
  • Separate model training from inference, which serves requests after a model is built.
  • Distinguish measured or estimated historical figures from forecasts, and check the year and scope.
  • Do not treat all data-centre electricity as AI electricity; data centres run other digital services too.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.