Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix Now×
Skip to content
World desk5 min

Do AI Coding Tools Make Developers Faster? What the Evidence Shows

AI coding tools can speed up some tasks, but the measured results vary by setting. Here is how to interpret controlled experiments, developer surveys, and the latest METR findings.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Sometimes—but the effect depends on the task, the developer, and how speed is measured. Controlled studies have found both faster and slower completion with AI assistance, while survey estimates describe what developers feel they save rather than independently measured time. The evidence supports no single productivity figure for all software work.

What the studies measured

Study Setting and measure Finding
GitHub Copilot experiment, reported September 2022 and updated May 2024 Randomized experiment with 95 professional developers implementing a JavaScript HTTP server. The Copilot group averaged 1 hour 11 minutes to complete the task, versus 2 hours 41 minutes without Copilot. GitHub reported a 55% faster completion time (95% confidence interval for the speed gain: 21% to 89%; P=.0017). Completion rates were 78% and 70%, respectively. Source: GitHub Blog, Eirini Kalliamvakou.
Microsoft Research summary, February 2023 Summary of the same controlled GitHub Copilot experiment, not a separate replication. Reported a 55.8% faster completion time for the Copilot group and noted that effects varied among participants. Source: Microsoft Research.
UK public-sector coding-assistant trial, November 2024–February 2025 Survey analysis of 424 respondents across 31 departments, following distribution of 2,500 licenses to more than 50 organisations. Respondents estimated an average of 56 minutes saved per working day, including 24 minutes on code creation or analysis. These are self-reported estimates, not results from a randomized comparison of actual work time. Source: Government Digital Service, GOV.UK.
METR trial, reported July 2025 Randomized trial involving 16 experienced open-source developers and 246 issues in mature repositories they had worked in for years. Tasks included bug fixes, features, and refactors; participants primarily used Cursor Pro with Claude 3.5 or 3.7 Sonnet, alongside other tools they chose. Tasks took 19% longer when AI was allowed. Before the trial, participants expected to finish 24% faster with AI; afterward, they estimated that it had made them 20% faster. Source: METR, with the paper’s version 2 posted July 25, 2025.
METR follow-up update, February 24, 2026 Follow-up data from a study begun in August 2025; METR reported problems with participant selection and measuring time when developers used multiple agents while doing other work. Raw estimates suggested an 18% speedup for returning participants and a 4% speedup for new participants, but both confidence intervals included no effect. METR said the data were unreliable and a poor proxy for the real productivity impact.

Why the results point in different directions

The studies did not ask developers to do the same work under the same conditions. The Copilot experiment timed a defined JavaScript task. METR’s trial asked experienced contributors to work on real issues in repositories they knew well; those repositories averaged more than 22,000 stars and one million lines of code. Familiarity with a large codebase, task complexity, quality expectations, and the particular tools available can all change whether AI assistance saves time or adds work.

As an Amazon Associate I earn from qualifying purchases.

The figures also represent different kinds of evidence. A timed task measures elapsed time in that experiment. A survey captures respondents’ estimates or impressions. Code accepted by an editor measures interaction with suggestions, not whether the resulting work was correct, valuable, or faster overall. Treating these outcomes as interchangeable would make the evidence look more consistent than it is.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Speed is only one part of developer productivity

Finishing an individual task quickly does not automatically mean a team has delivered more useful software. A fuller view can include whether work was completed, whether it passed tests and review, how much rework it caused, and whether developers could stay focused and satisfied. GitHub describes this broader approach through the SPACE framework: satisfaction and well-being, performance, activity, communication and collaboration, and efficiency and flow.

#1 Best Overall
AI VoiceWriter – Smart Dictation & AI Writing Assistant for Windows & Mac | USB Dongle & Mobile App for Voice Input, Proofreading, Rewriting & Multilingual Support
  • 🎙️ Hands-Free Voice Typing for Windows & Mac – Powered by iOS & Android dictation technology, AI VoiceWriter allows fast, accurate speech-to-text directly on your desktop. Simply speak, and your words appear in real time. Compatible with Windows 10 & above, macOS 13 & above.
  • ✍️ AI Writing Assistant for Effortless Editing – Boost productivity with AI proofreading, rephrasing, and formatting. Perfect for emails, reports, creative writing, and professional content.
  • 💻 Works Seamlessly in Any Desktop App – Type with your voice in Microsoft Word, Google Docs, PowerPoint, Teams, emails, and more. Just place your cursor in any text field and start speaking!
  • 📱 Mobile App for Enhanced Voice Input – The AI VoiceWriter mobile app enhances voice recognition by using your phone’s microphone as an input device for clearer, more accurate dictation—while typing on your desktop. Supports iOS 15 & above, Android 9.0 & above.
  • 🌎 Multilingual Voice Typing & AI Assistance – Supports 33 languages for dictation, plus AI-powered features in Chinese, English, Japanese, Korean, French, German, Spanish, Italian and, Swedish.

The UK trial illustrates why adoption metrics need careful interpretation. GitHub Copilot telemetry showed an average code-line acceptance rate of 15.8%, while 39% of users said they had committed AI-suggested code. Neither figure establishes a productivity gain: acceptance is not the same as a correct change, and committing a suggestion does not show how much time the whole task took.

What the survey figures can—and cannot—tell you

In the UK trial, 65% of survey respondents said they completed tasks faster, 67% reported spending less time searching for examples or information, and 56% said problem solving was more efficient. Separately, GitHub’s survey of more than 2,000 technical-preview users found that 73% reported staying in flow and 87% said Copilot helped preserve mental effort during repetitive tasks. These results describe participants’ reported experiences, not controlled measurements of work completed per hour.

The Government Digital Service noted that estimates across tasks could overlap and that optimism may have inflated reported savings. The trial also had a missing month of telemetry, inconsistent rollout and uptake, and limits on what it could establish over the long term. Such responses can still reveal where people perceive assistance, but they should not be presented as measured hours recovered.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How to assess a productivity claim for your own work

Before applying a study’s result to a team or project, check whether its conditions resemble yours. A useful comparison specifies:

  • Task: Is the work a short, well-defined implementation, or a complex change involving debugging, design, refactoring, and review?
  • Codebase: Are developers working in a new project or navigating a large repository they already know?
  • People: How experienced were the participants, and do their skills and familiarity resemble the developers affected by the decision?
  • Tools and timing: Which assistant and model were used, and when? Tool capabilities change, so a result applies first to the version and period studied.
  • Outcome: Was the study measuring elapsed task time, completion, code quality, reported time saved, satisfaction, or team throughput?
  • Quality controls: Were tests, code review, correctness, and follow-up fixes included in the measurement?

For a team trial, compare similar work with and without the assistant, define in advance what counts as completed and acceptable, and track time through testing and review rather than stopping when a suggestion appears. Record rework and developer experience as well as elapsed time. That can show whether the tool helps with the work your team actually does; a single benchmark or survey cannot answer that for every organization.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What can be concluded in 2026

The strongest conclusion is conditional: AI coding tools have produced faster completion in some measured settings, but other credible settings have shown slower completion, and survey-reported savings are not equivalent to controlled time measurements. METR’s February 2026 follow-up does not resolve the disagreement; its authors say selection effects and measurement problems make the estimates unreliable. Claims that AI makes developers universally faster—or that it never helps—go beyond what these results establish.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.