Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
Skip to content
World desk7 min

From Skepticism to Overreliance: How Coders Can Use AI Without Losing Their Skills

AI coding assistants can speed up some work, but the gains depend on the task, and using AI while learning can reduce understanding. Here is what the evidence shows and how to keep your skills sharp.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI coding assistants can make some kinds of coding work faster, and the measured gains are real but uneven. The more serious risk is different. When AI takes over the work of learning something new, you can finish with code that runs and still understand it less well than you would have otherwise. The practical question is not whether to use AI, but which parts of the work it should take over and which parts you should keep doing yourself.

What the studies actually measured

The headline figures about AI and coding come from studies that measured different things, with different people, tools and tasks. Placed side by side, they explain why no single “AI productivity” number is meaningful on its own.

As an Amazon Associate I earn from qualifying purchases.

Source and date Who was studied Task What was measured Reported result Important limit
Microsoft Research, June 2025 (publication page) 4,867 developers across three field experiments, at Microsoft, Accenture and an anonymous Fortune 100 company Regular work using AI code-completion assistants Completed tasks 26.08% increase in completed tasks for AI-tool users, combined across the three experiments; standard error 10.3% Gains were reported as higher for less-experienced developers. Tools were code-completion assistants, not whole-implementation agents.
Government Digital Service, UK public sector trial, November 2024 to February 2025 (findings report) UK government trial participants Everyday development work with GitHub Copilot Self-reported time saved; acceptance rate of suggested lines from trial telemetry Average of 56 minutes saved per working day; 24 minutes per day for code creation and analysis; 15.8% average acceptance of suggested lines Time saving is survey-reported, not a randomized measured difference. Only 39% of surveyed users said they committed suggested code.
Anthropic, January 29, 2026 (study page) 52 mostly junior developers, randomly assigned Learning an unfamiliar Python library Post-task quiz score and completion time Average quiz score of 50% in the AI group versus 67% in the hand-coding group; AI group about two minutes faster, a difference not statistically significant Measures immediate quiz performance in a small sample, not long-term career skill.
GitHub, November 18, 2024, updated February 6, 2025 (article) 202 experienced developers in a randomized study Writing API endpoints for a fictional web server Whether code passed all 10 unit tests 53.2% greater likelihood of passing all 10 unit tests with Copilot One bounded task. GitHub makes the product being tested, so the result is task-specific evidence, not independent proof for every coding context.

These sources ask different questions. Completing familiar work, perceived time saved, passing tests on a controlled assignment, and retaining an unfamiliar skill are separate outcomes. A result on one does not transfer to the others.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Does AI make coding faster?

In some settings, yes, but the evidence does not support a blanket claim that AI makes every developer faster on every task.

Completed work in field experiments

The largest field evidence in this set comes from Microsoft Research’s three field experiments, which together covered 4,867 developers. Across them, AI-tool users completed more tasks, with a combined increase of 26.08%. The standard error of 10.3% means the estimate carries real uncertainty, and the reported gains were larger for less-experienced developers. The tools were code-completion assistants that suggest code as you type, which is a different workflow from asking an agent to write an entire feature.

Self-reported time saved in a public-sector trial

The UK Government Digital Service trial ran from November 2024 to February 2025. Participants reported saving an average of 56 minutes per working day, and the largest reported category, code creation and analysis, accounted for 24 minutes of that per day. Those are estimates from participants, not timed measurements against a control group. The same trial’s telemetry showed that suggested lines were accepted at an average rate of 15.8%, and only 39% of surveyed users said they committed suggested code. Perceived time saved and the amount of suggested code that actually survives are different measures, and the gap between them is a useful warning about treating either as a complete picture.

Where speed claims stop

A July 2025 METR study of experienced open-source developers using early-2025 tools (METR report) examined a different population and tool generation from the field experiments above. Its findings should not be merged with the results in the table, and neither set of findings should be generalized to all developers, all languages or all tools.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Am I getting worse at coding if I use AI?

The most direct evidence on this question is Anthropic’s randomized study of 52 mostly junior developers learning an unfamiliar Python library. It does not show that AI use causes long-term skill loss, but it does show a short-term pattern worth taking seriously.

What the learning study found

Developers who used an AI assistant while learning the library scored an average of 50% on the follow-up quiz, compared with 67% for the group that coded by hand. The AI group finished about two minutes faster, but that difference was not statistically significant, so the study did not show a time advantage for AI in this setting. The quiz measured understanding immediately after the task, which is not the same as the durable skill a working developer needs months later.

AI use was not the whole story

Within the AI group, how people interacted with the assistant mattered. Anthropic’s qualitative observations associated better comprehension with asking conceptual questions, reading explanations and following up on them, while those who mainly delegated the code scored lower. The researchers did not claim that these patterns caused the difference, so they should be read as a description of what the higher-scoring participants tended to do, not as a proven method.

The same logic applies to the skills that matter most when code is generated for you. Code reading and debugging are the core oversight skills: you need to recognize when generated code is wrong and understand why it fails. If you cannot do that, you cannot reliably tell a correct suggestion from a plausible wrong one.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What appropriate reliance means

Microsoft Research’s 2024 review of generative AI reliance, Appropriate reliance on Generative AI (MSR-TR-2024-7), frames the goal as accepting output when it is correct and rejecting it when it is not. Both failure modes are costly. Overreliance means accepting wrong output; under-reliance means discarding correct output and losing the productivity the tool could have provided. Being a good coder with AI is less about using it more or less and more about calibrating when to trust it.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

A routine for using AI without becoming dependent on it

The following routine is an editorial recommendation grounded in the debugging and reliance evidence above. It has not been tested as a method with a measured effect.

  1. Decide what the task is for. If you are shipping familiar code, let the assistant take more of the typing. If you are learning a library or concept, reserve the core part of the work for yourself.
  2. Attempt first on unfamiliar material. Predict what the code will do, or write a small piece before asking for the full implementation.
  3. Ask for explanations, not only solutions. Request an explanation of the concept or of an error message, then follow up with questions about the parts you did not understand.
  4. Read every generated change before you accept it. Trace the behavior line by line for anything that touches state, data, security or external calls.
  5. Run tests, and add the missing ones. If the existing suite does not exercise the new behavior, write a test that would fail if the behavior were wrong.
  6. Explain the key behavior in your own words. If you cannot, treat the code as unreviewed and do not merge it.
  7. Keep some unaided practice on purpose. Choose a recurring exercise, such as writing one small function a week without assistance, so the skill does not depend on the tool being available.

A checklist for reviewing AI-generated code

  • Does it handle empty inputs, null values and boundary conditions, or only the happy path?
  • Does it call functions, methods or packages that exist in the version your project uses?
  • Does a failing test appear if you deliberately break the behavior it claims to provide?
  • Could you find the cause of a failure in this code without asking the assistant again?
  • Would the code still make sense to a teammate who did not see how it was produced?

How to tell whether AI is helping you

Do not judge AI use by how much code it generated. Include the time you spend checking, correcting and maintaining the result. Useful personal measures include the time to a working, tested version of a task, the time spent fixing problems the assistant introduced, and how often you can explain the code you committed without rereading it. Track these over several weeks rather than from a single task, because one good or bad session says little about the overall pattern.

Limits of the current evidence

The evidence is useful but narrow. The sources cover different tools from 2024 to early 2026, and several of the most important results come from small samples, single tasks or a vendor’s own testing. None of these sources follows developers for years, so claims that AI use causes long-term skill loss remain unestablished, and so do claims that it reliably makes every developer more productive. Treat the figures as evidence about specific conditions, and check how a claim you read elsewhere was measured before you act on it.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.