October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PCOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk7 min

Can AI Get Better Without Getting Bigger? What Test-Time Compute Does and Doesn’t Do

Test-time compute lets an AI model spend more computation on each answer without increasing its parameter count. Gains are real on some checkable tasks, but they depend on how the compute is spent and on the task.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Sometimes, yes, and only under specific conditions. Test-time compute means spending more computation while a model is answering a particular input, through longer reasoning, several candidate answers, or a scoring step that selects the best one. It improves results without changing the size of the model that produces the answer. It does not make answers free, and the gains reported so far depend heavily on the task, on how the extra computation is spent, and on whether the system can tell a correct answer from an incorrect one.

What test-time compute means

Most discussion of AI progress focuses on what happens before a model is released: how many parameters it has, how much data and training compute went into it. Test-time compute concerns a different moment, the time when a model is actually responding to a question. The same trained model can be allowed a short, single attempt or a larger budget of work on that one question.

As an Amazon Associate I earn from qualifying purchases.

The term is not used uniformly. OpenAI’s discussion of its o1 models uses “test-time compute,” while academic and research papers often say “test-time scaling” or “inference-time scaling.” All three describe the same basic idea: more computation allocated at answer time.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

OpenAI’s own description of o1 pairs the two levers directly. In its “Learning to reason with LLMs” explainer, the company states: “We have found that the performance of o1 consistently improves with more reinforcement learning (train-time compute) and with more time spent thinking (test-time compute).” That is OpenAI’s first-person account of its reported findings, not a general law of AI development.

#1 Best Overall
AMD Ryzen™ AI Halo - Personal AI Desktop Computer - Developer Platform - Linux OS
  • Built for Local AI Development: AMD Ryzen AI Halo is designed for local AI development and inference, featuring 128GB unified memory and support for up to 200B parameter models to build and run intensive AI workloads locally.
  • 128GB Unified Memory: Features 128GB LPDDR5x unified memory at 8000 MT/s with 256 GB/s memory bandwidth, providing a shared memory pool across the CPU, GPU, and NPU to support larger AI models.
  • AMD Ryzen AI Max+ 395 Processor: Features 16 cores, 32 threads, and Zen 5 architecture, paired with AMD Radeon 8060S integrated graphics featuring 40 RDNA 3.5 compute units and an AMD XDNA 2 NPU with up to 50 TOPS.
  • Linux AI Developer Platform: Purpose-built for Linux-based AI development with full AMD ROCm software support and preloaded tools, models, and workflows optimized for local AI development.
  • Compact, Connected Design: Includes a 2TB M.2 SSD, 10GbE LAN, Wi-Fi 7, Bluetooth 5.4, USB-C connectivity, and HDMI 2.1b.
Lever When the cost is paid What it changes How the cited sources treat it
Parameter count (model size) Fixed during model design and training The capacity of the model used for every answer The ICLR 2025 paper compares test-time compute against scaling parameters
Train-time compute During training, for example reinforcement learning How the model was built OpenAI names it alongside test-time compute in its o1 explainer
Test-time compute Each time the model answers a question How much work goes into one answer Covered by OpenAI’s o1 explainer and the ICLR 2025 paper

The phrase “without getting bigger” is accurate only in one narrow sense: the parameter count of the model answering the question does not change. Test-time methods still consume extra inference computation, and some of them call the model several times or run a separate scoring model.

Four ways to spend extra computation at answer time

The cited work describes several distinct strategies. They are not interchangeable, and each has different costs and failure modes.

Longer reasoning before answering

The simplest form lets the model work through a problem step by step before giving its final answer. OpenAI reports that o1’s performance improves as it spends more time thinking. This is the approach most readers associate with “thinking longer,” and it is the one that the NeurIPS 2025 critique discussed below examines most closely.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Sampling several answers and taking consensus

Instead of one attempt, the system generates many independent answers and selects the answer that appears most often. OpenAI’s AIME results include a consensus setting using 64 samples per problem. Consensus only helps when the correct answer is the most common one among the samples, so it depends on the model producing a useful distribution of answers.

Reranking candidates with a learned scoring function

A more elaborate version generates many candidates and then uses a learned model to score them and choose the best. OpenAI’s reported AIME result for this setting reranks 1,000 samples. The scoring function is itself a trained model, so this approach adds a second model’s work on top of the generation cost.

Verifier-guided search and adaptive allocation

The ICLR 2025 paper, “Scaling LLM Test-Time Compute Optimally Can be More Effective than Scaling Parameters for Reasoning”, analyzes two families of methods: search guided by a process-based verifier reward model, and adaptive updating of the model’s response distribution during answering. Its central idea is that the strategy should be chosen to fit the difficulty of the question and the compute available, rather than applying one fixed procedure everywhere.

Rank #2
GMKtec EVO-X2 AI Mini PC AMD Ryzen Al Max+ 395 Up to 5.1GHz, 16C/32T
  • EVOLUTION AMD RYZEN AI MAX+ 395 MINI PC - GMKtec EVO-X2 is the next evolution in AI mini PC Ryzen Strix Halo series. Thanks to AMD Simultaneous Multithreading (SMT) the core-count is effectively doubled, to 32 threads. Ryzen AI Max+ 395 has 64 MB of L3 cache and can boost up to 5.1 GHz, depending on the workload. The Ryzen AI Max+ 395 is currently rated as the "most powerful x86 APU" on the market for AI computing.
  • AI NPU with XDNA 2 ARCHITECTURE - Powered by 16 “Zen 5” CPU cores, 50+ peak AI TOPS XDNA 2 NPU and a truly massive integrated GPU driven by 40 AMD RDNA 3.5 CUs, the Ryzen AI MAX+ 395 is a transformative upgrade and delivers a significant performance boost over the competition. The Ryzen AI Max+ 395 excels in consumer AI workloads like the llama.cpp-powered application: LM Studio. Shaping up to be the must-have app for client LLM workloads, LM Studio allows users to locally run the latest language model without any technical knowledge required and unleash their creativity and productivity.
  • AMD RADEON 8090S iGPU GAMING PC - The AMD Radeon RX 8060S offers all 40 CUs with up to 2.9 GHz graphics clock and uses the new RDNA 3.5 architecture. The powerful iGPU is positioned between an RTX 4060 and 4070 laptop GPU and therefore enables gaming in FHD at maximum details in most demanding games. The 8060S can also utilize the full 64GB pool, which is perfect for running LLMs such as Deepseek 32B, which runs comfortably on this machine.
  • EIGHT CHANNEL LPDDR5X - LPDDR5X is a new ground breaking memory small form factor installed on-board. With blazing speeds up to to 8000MT/s, it runs 1.5x faster than the DDR5 SODIMMs; 90% better performance over DDR5 SODIMMs in video conferencing and photo editing; 30% better performance in productivity apps; 4% better performance in digital content workloads.
  • QUAD SCREEN 8K DISPLAY SUPPORT - EVO-X2 AI Mini PC support 4-screen 4K/8K output via HDMI 2.1 (8K@60Hz), DisplayPort 1.4 (4K@60Hz), and dual USB 4 40Gbps Transfer speed (supporting PD3.0/DP1.4/DATA). Ideal for gaming, video editing, and multitasking, it provides expansive and crisp multi-display support.

DeepSeek-R1 takes a similar view. Its paper, published in Nature, “DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning”, describes dynamic allocation of reasoning effort according to problem complexity.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What the 2024 AIME results show

OpenAI’s o1 explainer reports results on the 2024 American Invitational Mathematics Examination (AIME), a contest with 15 problems. The figures below are company-reported results from a single evaluation, and each row reflects a different way of spending computation.

Setup (2024 AIME, as reported by OpenAI) Average score Average problems solved (of 15) Compute pattern
GPT-4o (comparison model) 12% 1.8 Not described as a test-time method in the cited explainer
o1, single sample per problem 74% 11.1 One attempt, with reasoning before answering
o1, consensus among 64 samples 83% 12.5 64 independent attempts, majority answer selected
o1, reranking 1,000 samples 93% 13.9 1,000 attempts, selected by a learned scoring function

The table shows that, in OpenAI’s evaluation, moving from one attempt to a larger, better-selected set of attempts raised the average score substantially. It does not show that the same percentages would appear on other exams, other kinds of tasks, or later model versions. The figures should be read as one company’s measurement of one contest in 2024, not as a benchmark that other systems can be expected to reproduce.

Why the allocation method matters as much as the amount

Spending more computation does not, by itself, settle how good the result will be. The ICLR 2025 study frames the choice as one of allocation: given a fixed budget, which strategy gives the best answers. On math reasoning problems, the authors report that their compute-optimal strategy improved efficiency by more than 4x compared with a best-of-N baseline.

Best-of-N is a simple method: generate N answers and keep the best one according to some scoring rule. The 4x figure refers to how efficiently the proposed strategy uses a given compute budget compared with that baseline, measured on the math tasks the paper studied. It is not a general claim that the method saves 4x on every workload, and it does not show that a smaller model will outperform a larger one across tasks. The paper’s title makes a narrower claim, that test-time compute can be more effective than scaling parameters for reasoning.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Why more thinking is not automatically better

It is tempting to assume that a longer chain of reasoning always produces a better answer. A NeurIPS 2025 paper, “Does Thinking More Always Help? Mirage of Test-Time Scaling in Reasoning Models”, challenges that assumption. Its abstract describes outcomes that do not improve steadily with longer traces, increased variance in outputs, and a potential loss of precision when reasoning is simply extended.

Rank #3
msi Aegis R2 AI Gaming Desktop: Intel Core Ultra 9 285, Geforce RTX 5070Ti, 32GB DDR5, 2TB M.2 NVMe SSD, Air Cooling, USB Type C, VR-Ready, Window 11 Home: C2NVR9-1452US
  • Intel Core Ultra 9 285 Processor: Newly developed cores deliver ultra-smooth and responsive gameplay. AI accelerators prepare users for the next era of gaming on an AI PC.
  • Simplistic Design: Enjoy the latest generation of Windows 11 Home for your everyday needs. *MSI recommends Windows 11 Pro for business use.
  • NVIDIA GeForce RTX 5070 Ti GPU
  • Cool While Gaming: In conjunction with an RGB CPU Air Cooler, the Aegis RS features four system cooling fans; three in the front and one in the rear to pull in cool air and push heat out of the PC.
  • Turn on the Bright Lights: With the built-in RGB lighting, take your gaming experience to the next level by pressing the MSI LED button to cycle through lighting options. Customize lighting even further with MSI Center software.

Microsoft Research’s overview, “Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead”, raises the same question: whether excessively long chains of thought can hurt reasoning performance. These are findings about specific tested methods and models. They do not show that every form of inference-time compute fails, but they do show that more output is not a reliable proxy for better output.

For that reason, test-time compute should not be reduced to “chain-of-thought length.” Sampling, search, verifier guidance, and dynamic allocation are separate ways of using inference resources, and each can behave differently.

Checkability decides where extra compute helps

The gains described above come mostly from tasks where a candidate answer can be checked. Math problems have a definite correct result, which lets a scoring function or verifier tell candidates apart. The DeepSeek-R1 paper explicitly discusses the difficulty of making progress on tasks without robust feedback, where the system cannot reliably judge whether an intermediate step or final answer is right.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

In practice, that leads to a few working rules:

  • Where the answer can be verified, such as a calculation, a proof with a known result, or code that passes tests, selection-based methods have something to select on.
  • Where the answer is a judgment call, such as an open-ended analysis, extra samples may add variety without adding a reliable way to pick the better one.
  • Benchmark progress on checkable tasks does not guarantee the same reliability on messy, real-world work. The DeepSeek-R1 study itself flags these limits.

Costs readers should count

Test-time compute is not free. The cited methods add cost in several ways:

  • Latency: longer reasoning and multiple attempts take more time before a final answer appears.
  • Inference cost: generating more tokens or more candidate answers consumes more computation for each question.
  • Extra models: reranking and verifier-guided search depend on a learned scoring model, which must be run and maintained alongside the main model.
  • Variance: more attempts can make a system less consistent, as the NeurIPS 2025 critique warns, so a larger budget does not guarantee a more reliable answer.

How to judge a claim that AI got “smarter without getting bigger”

When you see a headline or product announcement claiming improvement from extra inference compute, check the following before drawing a conclusion:

  1. Task: Is the task checkable, such as a math contest, or open-ended? Results from checkable tasks do not transfer automatically.
  2. Method: Was the extra computation spent on longer reasoning, independent samples, a learned reranker, or verifier-guided search? These are different methods with different costs.
  3. Budget: Were methods compared at the same compute budget? A more expensive method can look better simply because it used more resources.
  4. Baseline: What was the comparison point, such as a single attempt, a best-of-N baseline, or a larger model?
  5. Measurement: Who ran the evaluation, on which benchmark, for which model version, and when? Company-reported results and peer-reviewed papers deserve different levels of confidence.

Applying these questions to the sources above shows the shape of the evidence: extra computation at answer time can produce large gains on checkable math problems in the reported settings, the way that computation is spent matters, and more output is not always better output.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.