DriversRecommendedOutdated drivers can make a good PC feel brokenScan driver issues before chasing fixes manually.Scan NowHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
FREEDOM251

Freedom251 › Blog › API pricing

LLM API Pricing Explained: Input Tokens, Output Tokens, Caching, and Batching

By Freedom251 Team · · 8 min read

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The short answer: an LLM API bill is usually the number of input tokens multiplied by the model’s input rate, plus output tokens multiplied by its output rate, with separate charges or discounts for cached context, batch processing, tools, and other features. Prices are normally listed per million tokens, and the same prompt can cost different amounts on different models because tokenizers, output length, reasoning, and pricing rules differ.

This guide shows how to estimate a real workload, understand cache and batch economics, and compare providers without being misled by a single list-price number. Provider pages change frequently; the examples and policies below were checked on October 13, 2026, so verify the linked rate cards before committing budget.

As an Amazon Associate I earn from qualifying purchases.

What an LLM API actually charges for

An API request contains more than the text a user types into a chat box. The billable input can include system instructions, conversation history, retrieved documents, tool results, images or other modalities, and the current user message. The model’s generated response is billed as output. Some services also expose reasoning or “thinking” tokens, which can be included in output usage even when they are not shown in the final answer.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Most text rate cards use a price per 1,000,000 tokens. A practical estimate is:

#1 Best Overall
Sale
TOZO A1 Wireless Earbuds Bluetooth 5.3 Light Weight in Ear Headphones | IPX5 Waterproof,2 Mics for AI Calls,Immersive Premium Sound Bass Headset with Charging Case,32 EQ via App Black
  • [Ultra-Lightweight Ear Buds Designed for Small Ears] Each earbud weighs only 3.7g and features a compact, ergonomic in-ear design made especially for small ears. Secure, low-profile, and comfortable for workouts, all-day wear or overnight sleeping.The ultra-slim profile sits flush in your ear with no hard edges poking or rubbing, so you can even sleep on your side without discomfort.
  • [Immersive Stereo Sound with TOZO OrigX Technology] TOZO OrigX tuning delivers clear vocals, balanced mids, and natural stereo sound for music, podcasts, and videos.
  • [Long Battery Life for Daily Use] Get up to 7 hours of playtime on a single charge, with up to 32 hours total using the charging case—ideal for workdays, commuting, and extended listening sessions.
  • [Bluetooth 5.3 & Stable Connection] Bluetooth 5.3 provides fast pairing, stable wireless performance, and reduced dropouts as you move around home or office.
  • [Deep Bass with Clear Vocals] High-performance drivers produce punchy bass while keeping vocals clean and detailed for everyday listening.

estimated cost = (input tokens ÷ 1,000,000 × input rate) + (output tokens ÷ 1,000,000 × output rate) + other applicable charges

“Other applicable charges” should not be assumed to be zero. Depending on the model and endpoint, a request can incur cache-write or cache-creation fees, cached-input fees, cache storage, tool-use charges, image/audio/video units, search grounding, data-residency modifiers, or a different rate for a long context. OpenAI’s pricing page presents separate input, cached-input, cache-write and output columns for applicable models, while context length and processing mode can create additional distinctions: OpenAI API pricing.

Input tokens: the largest hidden variable

Input tokens are the pieces of text or other content the model processes before generating an answer. They include every message sent in the request, not just the latest question. A support bot that resends a 20-page policy, a system prompt and a long conversation on every turn can consume far more input tokens than its visible reply suggests.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Why word count is an unreliable proxy

Tokenization depends on the model. Common words may be represented by one token, while unusual words, code, URLs, punctuation, and non-English text can split into several. Two providers can tokenize identical content differently. OpenAI’s token guidance warns: “A lower price per million tokens does not necessarily produce a lower total cost: models can tokenize the same text differently and generate different amounts of output or reasoning.” Read the underlying explanation at Understanding and counting tokens.

For budgeting, measure representative requests with the tokenizer or usage fields for the exact model you plan to run. Include system messages, retrieved passages, prior turns and tool results. Do not multiply a short user-message estimate by monthly requests and call it a forecast unless those other components are measured.

Rank #2
Sale
Smart Watch for Men Women Compatible with iPhone Samsung Android Phone 1.69 inch Full Touch Screen IP68 Waterproof Bluetooh Fitness Tracker Heart Rate/Sleep Monitor (Black)
  • 【IP68 Waterproof Multifunctinal Smart Watch】Torjalph fitness activity tracker smart watch is IP68 waterproof technology ,you can wear it when swimming,handwashing,it's rain-proof which means that you perform multiple exercise modes outside without worrying about sweat or rain corroding your fitness smart watch,and this watch equipped with a 230 mAh large capacity battery magnetic charging ,and this sports activity tracker watch can be used 5-7 days If fully charged.
  • 【Larger 1.83'' Full Screen Watch & Multi-dial Selection】1.83 inch full HD color touch screen smart watch for men / women provides excellent 240*284 resolution image quality ,This Bluetooth smart watch offers a better touch experience and remarkable immersion and ,more than 200 watch faces for you to choose from App"Da Fit ", you can change the dial style according to your mood to wear keeping the world on your wrist
  • 【Accurate Activity Tracker Smart Watch 】sports watch activity tracker uses sweat and dust resistant breathable silicone strap, our Fitness Tracker Smart Watch for Android iOS Phones supports 12 sports modes,walking,running,bicycle,swimming,badminton,basketball,football,rope skipping. This bluetooth calls smart watch for men women is lightweight and stylish, bringing more convenient and relaxing sports experience while also providing more protection.
  • 【Your 24 Hour Personal Daily Health Monitor】Fitness watch for women men full touch screen IP67 waterproof bluetooth smartwatch for Android iOS Phones with heart rate blood pressure monitor multifunction Andriod smart watch with steps counter sleep monitor sports fitness watch, monitoring blood oxygen saturation allows you to understand your physical condition in real time to track fitness progress ,to know your health status in time.
  • 【More Functions Bluetooth Call Smart Watch】This fitness activity smart watch full screen for iPhone and Android phones includes a bunch of new features including:The bluetooth smart watch can hang up the phone, receive and display WhatsAPP /Text /Facebook /Twitter /Messenger reminder.Support sedentary reminder, alarm clock, stopwatch, timer,weather information,music control, remote camera control compatible with Android 5.0 and above or iOS 9.0 and above smartphones.

Long context can change the rate

Some rate cards apply a different price when a request crosses a context-length threshold. Check whether the higher rate applies to all tokens or only the portion beyond the threshold. The applicable model page, not a generic provider headline, is the authority.

Output tokens and reasoning usage

Output tokens are generated tokens. They usually have their own rate and may cost substantially more than input tokens. A request that supplies a small prompt but asks for a long report can therefore be output-heavy.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Visible text is not always the full generation. Models that perform internal reasoning may count those tokens in usage; some pricing tables explicitly place reasoning or “thinking” tokens in the output category. A short final answer does not prove that the generation was inexpensive. Capture the API’s input, output and reasoning-usage fields, when exposed, and set a maximum output limit appropriate to the task.

A simple measured estimate

Suppose a measured workload averages 12,000 input tokens and 2,000 output tokens per request. At 100,000 requests, the monthly volume is 1.2 billion input tokens and 200 million output tokens. Apply the chosen model’s current per-million rates independently:

  • Input component: 1,200 × input rate.
  • Output component: 200 × output rate.
  • Add cache writes, cached reads, storage, tools, modalities or other listed charges.

This is an accounting framework, not a universal price estimate. Substitute the exact rate-card values, model, region and billing terms you will use.

Rank #3
New Bee Guitar Cable 10ft Electric Instrument Bass AMP Cord | 6.35mm Jack, Durable Design, Stage and Home Studio Use, Low Noise Shielded Electric Cord for Bass, Keyboard, Amp, Mixer
  • [Low Noise High Fidelity] New bee guitar cord with 22AWG oxygen-free-copper center conductors provides enhanced signal transfer, the PVC insulation material and the high-density stranded copper double shield provide noise rejection for quiet operation
  • [Ideal for Choice] New bee 1/4 straight and right angle metal connectors, ensures a secure connection in any instrument, pedal, or amp jack. L shape great fro on stage guitar stands
  • [Wide Compatible] Suitable for mixer, power amplifier, microphone, effector, decoder, equalizer, electoronic organ, electric guitar, electric bass and other electronic equipments. Widely used in the installation of smart home, karaoke speaker, professional stage audio, etc
  • [Easy Disassemble] Making incidental repairs quick and easy! Very nice, flexible cable
  • [Dont Hesite to Order] 24 hours customer services and professional technology team are standing by

Prompt caching: discounted reads are not free

Prompt or context caching stores a reusable portion of a request so subsequent calls can process it at a different rate. It is most useful when a stable, substantial prefix—such as policy text, a codebase snapshot or a long system instruction—is reused across many calls.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The three cost dimensions

Do not describe caching as one universal discount. Provider tables can distinguish:

Charge What it represents Question to answer
Cache read Processing tokens that matched an existing cached prefix What is the per-million cached-input rate, and what content qualifies?
Cache write or creation Preparing new content for reuse Is creation charged once per cache, per request, or under a minimum size?
Storage Keeping cached tokens available over time Is storage metered, and is it priced per million tokens per hour?

OpenAI lists separate cached-input and cache-write columns for applicable models: official pricing. Google’s Gemini pricing page lists storage charged per million tokens per hour for applicable models: Gemini Developer API pricing. Anthropic notes that a request’s prompt length includes all input tokens, including cache reads and cache writes, which matters if a context-length threshold is involved: Claude Platform pricing.

When caching breaks even

Estimate caching with the same traffic assumptions as ordinary billing:

  1. Measure the stable prefix size and the number of expected reuses during its cache lifetime.
  2. Apply the provider’s cache-creation rate to the write volume.
  3. Apply the cached-read rate to every token actually served from the cache.
  4. Add storage for the time the cache remains resident.
  5. Compare that total with sending the same prefix as ordinary input on every request.

A cache can lose money when the prefix is small, reused only once or twice, expires quickly, or carries a high creation or storage charge. Conversely, a large prefix reused many times can make the discounted read rate valuable. There is no cross-provider cache lifetime or break-even percentage that can be safely assumed; use the model’s current rules.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #4
BSIMB 15.6" Digital Family Calendar & Chore Chart, No Subscription Fees
  • Digital Family Calendar: BSIMB digital calendar wall touch screen puts an end to your chaotic life. Designed for busy families, the digital calendar keeps you organised and in step with your family. Assign different colours and tasks to each family member to make family scheduling easier and more intuitive.
  • Easy Setup and Auto-Sync: Plug in, connect to WLAN and auto-syn your electric calendar in minutes. Digital wall calendar compatible with Google calendar, iCloud calendar, Outlook calendar, Cozi calendar and Yahoo calendar. Add events directly on the device or through the ecalendar app. Electronic calendar stays current whether you're at work or traveling—no manual updates needed.
  • All-In-One Home Assistant: Smart calendar builds habits and encourage independence with personalised chores. Display daily meal plan to reduce the daily ‘What's for dinner?’ stress. To-do lists keep track of everything you want. Turning chores into valuable achievements with stars and rewards, making life easier and more enjoyable.
  • Manage Anytime Anywhere: BSIMB electronic calendar for family stay connected with the powerful ecalendar app. Access and manage your digital wall calendar anytime, anywhere with free features like stars & rewards, photo screensaver, chore charts, meals plans, to-do lists etc. Electronic planner paid features like Magic Import tailor advanced tools for users with special needs.
  • Stay in Touch with Loved Ones: Share photos or videos from your phone to electronic wall calendar with app, instantly update your life moment, and keep in touch with your family, especially those who are far away; you can also surprise your smart calendar digital wall by sending him a wish card; it's also great for keeping tech-illiterate elders in touch with the youngsters.

Batch APIs: lower cost in exchange for latency

A batch endpoint accepts a collection of requests for asynchronous processing instead of returning each answer immediately. That delay is the trade-off for lower eligible processing cost. Batch is a strong fit for offline evaluation, document backfills, nightly classification, embeddings or other jobs where minutes or hours of queue time are acceptable.

Published discounts checked in October 2026

Provider documentation Published batch treatment Qualification
Anthropic Batch API 50% discount on input and output token prices Verify model support, limits, timing and current terms on the pricing page.
Google Gemini API Batch API 50% cost reduction advertised Eligibility, model, region and request limits can vary; check the current page.

Anthropic’s details are in its pricing documentation; Google’s are in Gemini pricing documentation. These discounts are provider-specific examples, not a promise that every model, account or geography receives the same reduction. A batch job can also have size limits, completion windows, cancellation rules and separate failure handling.

How to decide whether batch fits

  • Use synchronous calls when a user is waiting, an agent must take the next action, or a strict response-time objective applies.
  • Use batch when work can queue, results can be retried or reordered, and a lower token rate is worth delayed completion.
  • Use a hybrid when interactive traffic is urgent but backfills, analytics and evaluation can run asynchronously.

Recalculate with the actual batch rate rather than simply halving a synchronous invoice. Tool calls, modalities, long-context surcharges and storage may remain separately billable.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How to compare models and providers fairly

A single “price per million tokens” cell is not a total-cost comparison. Build a workload sheet with the following fields:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Axis What to measure or verify
Workload volume Representative input and output tokens, including system prompts, history, retrieval and exposed reasoning.
Input/output mix Apply each model’s own input and output rates; an input-only comparison misleads output-heavy jobs.
Tokenizer and generation Run equivalent tasks and record token counts, output length and reasoning usage.
Cache behavior Reuse frequency, eligible prefix, cache-read and write rates, expiry and storage.
Batch fit Asynchronous tolerance, model eligibility, queue limits, completion window and batch rates.
Context length Thresholds that change the rate for a long prompt or part of a request.
Extra features Tools, images, audio, video, search grounding, residency and other units or modifiers.
Quality and latency Whether the model meets accuracy and response-time requirements on the same task set.

The cheapest rate card can produce the highest acceptable-result cost if it needs more output, retries, tool calls or human correction. Compare measured end-to-end workload cost at the quality and latency you actually require.

A repeatable monthly cost-estimation process

  1. Define the workload. Separate interactive, batch-eligible and cacheable traffic. Record requests per day, peak concurrency and retention requirements.
  2. Measure tokens. Sample real requests for input, output and reasoning. Include every automatically appended message and retrieved document.
  3. Select the exact model and date. Record the model name, provider, region, context tier and the date the rate card was checked.
  4. Split billable categories. Put ordinary input, cached reads, cache writes, storage, output and feature charges in separate spreadsheet columns.
  5. Run scenarios. Calculate no-cache, expected cache-hit, low-cache-hit, synchronous and batch cases. Vary output length because it often dominates the total.
  6. Add operational headroom. Include retries, failed tool calls, traffic spikes and a rate-change review. Do not hide negotiated, committed-use or reseller terms inside a public list-price estimate.
  7. Validate against invoices. After launch, compare usage records with the provider bill and investigate any category that differs from the forecast.

Important date and pricing qualifications

Provider pricing is a moving target. The figures and discounts cited here were visible on October 13, 2026, not a permanent tariff or an independent benchmark. Google’s pricing page displays model rates with explicit effective-date changes, including rates shown through December 31, 2026 and a different rate beginning January 1, 2027. Tie every quoted number to the model and date on the live page.

The linked pages cover selected first-party APIs. They do not establish reseller prices, negotiated enterprise contracts, committed-use discounts, every geography, taxes or every available model. Check account-specific terms before making a purchase decision.

Common billing mistakes and fixes

Budgeting from the visible prompt

Symptom: the invoice is several times higher than a word-count estimate. Fix: log the serialized request, including system text, history, retrieval and tool output, then measure tokens for the selected model.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Using input price to forecast an output-heavy job

Symptom: a report generator costs more than expected despite short instructions. Fix: model output tokens separately, cap unnecessary verbosity and include reasoning usage when the API reports it.

Calling every cache hit a saving

Symptom: caching adds fees without reducing the bill. Fix: include creation, read and storage charges, then test the actual reuse count and expiry behavior.

Assuming batch is an instant 50% discount

Symptom: a job is ineligible or misses a delivery deadline. Fix: confirm model support, limits, queue timing and the provider’s current batch rate before moving production traffic.

Ignoring non-token charges

Symptom: token arithmetic looks correct but the invoice is higher. Fix: audit tools, images, audio, video, search grounding, storage, long-context tiers and regional or service modifiers.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Bottom line: estimate the workload, not the headline rate

LLM API pricing becomes predictable when you measure the request the provider actually receives. Keep input, output, cached reads, cache writes, storage, batch eligibility and extra features as separate line items. Then compare equivalent tasks for tokenization, reasoning, quality and latency. Caching can reward stable, heavily reused context; batching can reduce eligible asynchronous processing costs; neither is automatically cheaper. Recheck the official rate cards at deployment and whenever the model, context length or traffic pattern changes.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

API pricingbatch processingCloud Computinginput tokensLLM APIsoutput tokensprompt caching

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.