Halloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan NowHalloween DealsAmazon USOctober picks are moving - compare before checkoutAmazon US: current deals, useful picks and tech finds.See Picks×
FREEDOM251

Freedom251 › Blog › AI Performance

How to Measure Conversational AI Performance: Containment, Resolution, and Escalation Metrics

By Freedom251 Team · · 11 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Measure containment, resolution, and escalation as different outcomes. Containment tells you whether an interaction stayed in automation; resolution tells you whether the user’s goal was achieved; escalation tells you whether the case was handed to a person or another service. A reliable report defines the interaction unit, eligible population, denominator, success evidence, timeout rules, and escalation reasons before calculating any rate.

A session that ends without a handoff may be operationally contained while still being unresolved. Pair the three headline rates with abandonment, customer feedback, repeat-contact or first-contact-resolution data, and time-to-outcome measures so that “the bot kept the conversation” is not mistaken for “the bot helped the customer.”

As an Amazon Associate I earn from qualifying purchases.

Start with a metric contract

Write a short metric contract before building a dashboard. It should answer five questions:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • What is the interaction unit? Choose a session, conversation, case, or another explicitly defined unit.
  • Who is eligible? State whether the denominator includes every incoming interaction, only interactions that engaged the bot, or another population.
  • What event starts and ends the unit? Document greeting-only traffic, inactivity, transfers, reconnects, and repeated topics.
  • What evidence proves resolution? Use a user confirmation, a documented successful flow, a later outcome, or a combination; do not silently equate silence with success.
  • How are handoffs and abandonment classified? Record the destination and reason for every escalation and define when an inactive interaction becomes abandoned.

Keep this definition alongside every published rate. A number without its unit and denominator cannot be compared safely with another number carrying a similar label.

#1 Best Overall
Sale
JIAMQISHI USB Headset with Microphone for PC, On-Ear Computer Laptop Headphones with Noise Cancelling Microphone in-line Control for Home Office Online Class Skype Zoom (USB+3.5mm, Black)
  • ✅【Outstanding Noise cancelling Microphone】 The headphones with unidirectional boom 270°microphone that only picks up your voice and block out unwanted background noises. Also, you can wear it on the left or right ear as you like.
  • ✅【All-Day Comfort for All Head Shape】 Eaglend always designed for all-day comfort using, there will be no restraint pressure, with the adjustable headbend fit adult and kids easily.The soft protein memory foam earpads is made of high-level breathable materials,ROHS certified materials prevent your ears from heat and sweat.
  • ✅【Enhanced sound performance & 40mm audio driver】:Corded phone headset with built-in audio sound card, Eaglend sound lab tested thousands of times for your daily conversation/music/movie/gaming, bringing you extra clear and bass for pleasant experience.
  • ✅【USB/3.5mm Connection】 The headphone is designed for multiple use, 3.5mm audio cable with USB In-line audio volume control (cord length 5+4 feet),with mic mute &indicators /speaker mute.Compatible with PC/Tablet/Mac/iOS/laptop /Android phone and other devices."
  • ✅【Global warranty &multi-purpose】24 months warranty by eaglend. Great ideal for online courses, Skype chat, call center, Webinars Presentations, Office, Business, Rosetta Stone, Dragon Speaking, Conference Calls and more.

Choose the interaction unit and denominator

Session versus conversation

A session usually represents one continuous topic-level interaction. A conversation may span multiple sessions when a user moves between topics. Microsoft’s Bot dashboard documentation explicitly warns that one conversation can contain one or more sessions, so session and conversation counts can differ. Use sessions when you are diagnosing topic flows; use conversations when you are evaluating the broader customer interaction. If you report both, label them separately rather than adding them together.

Eligibility rules

Decide whether a greeting that receives no reply is eligible, whether system-generated events count, and what qualifies as engagement. For example, you might exclude a session that displays a welcome message but receives no user input, while including a session in which the user asks a question and then leaves. Whatever rule you choose, apply it to all periods being compared.

Denominator choices

The denominator changes the apparent performance:

Rate scope Numerator Denominator Best use
All incoming interactions Interactions meeting the outcome definition Every interaction received Operational capacity and total-channel impact
Bot-engaged interactions Interactions meeting the outcome definition Interactions that engaged with the bot Bot experience after a user starts participating
Engaged sessions Sessions meeting the outcome definition Sessions that satisfy the documented engagement trigger Topic-flow and agent-performance analysis

Use one denominator within a rate and display it in the metric name or definition. “Resolution rate” is incomplete; “resolved engaged sessions ÷ eligible engaged sessions” is auditable.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Containment: measure the handoff outcome, not success

Containment rate is the share of eligible interactions that end without a human handoff. A practical operational formula is:

Containment rate = eligible bot interactions ending without a human handoff ÷ eligible bot interactions

Define what counts as a handoff. Include transfers to a live representative, an external number, or another service when those transfers remove the case from the bot’s responsibility. If the bot can transfer between specialized agents, decide whether that is internal routing or escalation out of automation.

Containment is a routing result, not proof that the user’s problem was solved. A user can stop replying, close a window, or fail to find a useful answer without requesting a person. Microsoft’s bot reporting illustrates this distinction: its dashboard documentation describes a deflected conversation as one that was resolved or abandoned before resolution. In that context, deflection includes interactions that were not solved. Always identify the dashboard and calculation behind a “deflection” label.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Track contained interactions by final state, at minimum:

  • Contained and resolved with evidence.
  • Contained but abandoned or outcome unknown.
  • Contained and later followed by a repeat contact for the same issue.

This breakdown prevents a rising containment rate from hiding quiet failure.

Resolution: define and verify the user’s outcome

Resolution rate measures interactions classified as resolved, using a stated eligible population:

Resolution rate = eligible interactions with a resolved outcome ÷ stated eligible population

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The numerator needs an evidence rule. Strong options include:

Rank #2
Sale
Logitech H390 Wired Headset PC/Laptop Stereo Headphones, USB-A, Black | For PC/Laptop, stereo headphones, microphone, in-line controls, works with Chromebook
  • Digital Stereo Sound: Fine-tuned drivers provide enhanced digital audio for music, calls, meetings and more
  • Rotating Noise Canceling Mic: Minimizes unwanted background noise for clear conversations; the rotating boom arm can be tucked out of the way when you’re not using it
  • Handy In-line Controls: Simple in-line controls on the headset cable let you adjust the volume or mute calls without disruption
  • Plug-and-Play USB Computer Headset: Simply plug the USB-A connector into your computer and you’re ready to talk or listen without the need to install software
  • Padded Comfort: Comfortable headphones with adjustable headband features swivel-mounted, leatherette ear cushions for hours of comfort and is easy to clean

User-confirmed resolution

Ask a clear closing question such as whether the issue was solved, and count a positive response as confirmed resolution. Record non-response separately. A “yes” to a genuine outcome question is stronger evidence than the absence of a transfer.

Flow-implied resolution

A workflow can mark success after a verifiable event, such as a completed password reset or a successfully issued document. Document the event and the conditions that trigger it. A flow should not infer success merely because it reached its final message.

Post-interaction evidence

Repeat-contact data can test whether an apparent resolution persisted. For example, a first-contact-resolution measure can require no return contact for a defined period. Microsoft’s metric reference uses a seven-day no-return-contact window for its own first-contact-resolution definition; that window is a Microsoft convention, not a universal standard.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Where your data permits, publish user-confirmed and flow-inferred resolution separately, then show the combined figure only if readers can see how it was constructed. Do not classify an interaction as resolved solely because the user stopped responding, did not ask for a human, or reached a timeout.

Escalation: count handoffs and explain why they happened

Escalation rate is the share of eligible interactions handed to a human or external service:

Escalation rate = eligible interactions handed off ÷ stated eligible population

An escalation is not automatically a failure. A complex, sensitive, or regulated case may be handled correctly only by a person. The useful question is whether the right cases were transferred at the right time and with enough context.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Record the reason mix

Use mutually understandable reason codes, such as:

  • User explicitly requested a person.
  • A business rule required human handling.
  • The bot reached an attempt limit.
  • Input validation or recognition failed repeatedly.
  • The requested topic was outside the bot’s coverage.
  • Technical, authentication, or service failure triggered transfer.

Report both the total escalation rate and the distribution of reasons. A stable total can conceal a shift from appropriate policy transfers to avoidable recognition failures.

Measure handoff quality

Capture destination, queue, wait time, transcript or context availability, and the eventual human outcome when those fields are available. A transfer that arrives with the required account details is materially different from one that forces the customer to repeat the entire issue. Escalation time and time to final outcome are useful companion measures.

Build the measurement pipeline step by step

  1. Define the event model. Create fields for unit ID, conversation ID, session ID, channel, start time, end time, engagement event, topic, bot version, outcome, resolution evidence, escalation reason, destination, abandonment, survey response, and repeat contact.
  2. Set the eligibility filter. Write the exact rule in plain language and in query logic. Store excluded interactions and the exclusion reason so a denominator change can be audited.
  3. Assign one final primary outcome. Use a controlled set such as resolved, escalated, abandoned, still open, or unknown. Do not let a single interaction count as both resolved and escalated in the same headline rate unless you publish a precedence rule.
  4. Attach evidence to resolution. Store whether the classification came from user confirmation, a successful flow event, a post-contact rule, or an inference. Keep the evidence timestamp.
  5. Classify handoffs. Record who or what received the interaction and why. Preserve the original bot outcome when a handoff later fails, rather than rewriting history.
  6. Apply timeout and inactivity rules. Specify the inactivity duration, whether it is measured from session start or last user event, and how reopened interactions are treated.
  7. Calculate rates from the same population. Produce counts as well as percentages: eligible count, resolved count, escalated count, abandoned count, and unknown count. Counts expose small-sample volatility.
  8. Validate with a sample. Review transcripts from each outcome and reason category. Look for false resolution, duplicate sessions, unclassified transfers, and users who returned through another channel.
  9. Version the definitions. Record metric-definition changes, bot releases, routing changes, channel additions, and dashboard migrations. Annotate trend charts at each break.

Use companion metrics to detect quiet failure

Abandonment

Abandonment identifies an engaged interaction that ends without resolution or escalation. Microsoft’s metric reference defines an abandoned engaged session as one with no resolution or escalation after 60 minutes of inactivity; its bot dashboard describes the one-hour rule from session start. These are product-specific implementations, so verify the current configuration before adopting the same logic. Report abandonment separately from containment.

Customer satisfaction

Ask for feedback at a defined point and publish response count and response rate with the score. Microsoft notes that its bot CSAT is calculated from users who answer the end-of-session survey. Respondents may differ from all users, so do not present the score as if every session supplied feedback.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Repeat contact and first-contact resolution

Join interactions by customer, case, or a privacy-safe issue key and look for a return contact within a declared window. A seven-day window is used in Microsoft’s documented first-contact-resolution metric, but organizations should choose a period that fits their issue lifecycle and state it explicitly. Segment repeat contact by channel because a customer may return through phone, email, or another chat queue.

Rank #3
Sale
Logitech H391 Wired Headset PC/Laptop Stereo Headphones, USB-C, Graphite | Stereo headphones for PC or laptop, in-line controls, works with Chromebook
  • Digital Stereo Sound: Fine-tuned drivers provide enhanced digital audio for calls, meetings, music, and more
  • Rotating Noise-Canceling Mic: Minimizes unwanted background noise for clear conversations; the rotating boom arm can be tucked out of the way when not in use
  • Handy Inline Controls: Simple inline controls on the headset cable let you adjust the volume or mute calls without disruption
  • USB-C Plug-and-Play: Simply plug the USB-C cable into your computer, including MacBook Neo laptops, and you're ready to talk or listen without installing software.
  • Padded Comfort: Comfortable USB C headphones with adjustable headband feature swivel-mounted, leatherette ear cushions for hours of comfort

Time to outcome

Measure time to resolution, time to escalation, and time from escalation to human acceptance. Include distributions such as median and high percentiles when volume allows; an average can hide a long tail of waiting customers.

Coverage and fallback

Track the share of incoming topics recognized by the bot, fallback frequency, authentication failures, and tool errors. These diagnostics explain why escalation or abandonment changes even when the headline rates do not.

Microsoft metric definitions: useful examples, not universal standards

Microsoft’s official references provide a concrete implementation vocabulary. The Agent metrics reference for Microsoft Copilot Studio defines resolution as the share of engaged sessions ending with a resolved outcome, either confirmed by the user or implied by the flow. It defines escalation as the share of engaged sessions handed off through an Escalate topic or Transfer conversation node.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The same reference documents an abandonment rule based on 60 minutes of inactivity without resolution or escalation and describes first-contact resolution using a seven-day return-contact criterion. Treat each as a Microsoft definition tied to its product behavior, not as an industry-mandated formula.

Microsoft’s Bot dashboard provides outcome and handoff views, including drill-downs by topic, agent, channel, queue, and service representative. Its terminology can vary by dashboard context. The Omnichannel Summary dashboard, for example, describes deflection as the percentage of AI-agent-engaged conversations that were resolved, while the bot dashboard’s deflection description includes resolved or abandoned conversations without escalation. Name the dashboard and date in any report that uses “deflection.”

Compare teams, channels, or versions fairly

Before comparing two agents, channels, periods, or systems, hold constant or segment the following dimensions:

Comparison control Why it matters How to report it
Unit and denominator Sessions and conversations can produce different populations. Put the unit and eligibility rule in the chart title or caption.
Channel and period Phone, web chat, and messaging attract different intents and operating hours. Show separate channel and date segments.
Topic mix A change in issue complexity can move rates without a flow-quality change. Segment by topic or issue type and show volume.
Resolution evidence User-confirmed and flow-inferred outcomes have different certainty. Publish the evidence mix and any post-contact rule.
Escalation reason Appropriate policy transfers differ from recognition failures. Show reason and destination, not only the total.
Version and configuration Prompt, flow, timeout, routing, and dashboard changes can reset the baseline. Annotate release dates and retain historical definitions.

For trend reviews, maintain a metric dictionary with the field name, formula, unit, denominator, source system, owner, and effective date. If a vendor changes its dashboard logic, preserve the old definition for historical data or clearly mark the break rather than silently restating the past.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

A worked example with explicit denominators

Suppose a month contains 10,000 eligible bot-engaged sessions. Of these, 6,200 receive a user-confirmed or flow-verified resolved outcome, 1,500 are handed to a person, 1,800 become abandoned under the organization’s inactivity rule, and 500 remain open or unclassified at extraction time.

Outcome Count Rate of eligible sessions
Resolved 6,200 62%
Escalated 1,500 15%
Abandoned 1,800 18%
Open or unknown 500 5%

The operational containment rate is 85% if all 10,000 sessions are considered contained unless escalated: (10,000 − 1,500) ÷ 10,000. That 85% must not be reported as an 85% resolution rate; verified resolution is 62%. If the organization instead defines containment as resolved only, the label and formula change. Publishing both definitions would create two different metrics, not a contradiction, provided each is named.

Next, inspect the 1,500 escalations by reason and test repeat contact among the 6,200 resolved sessions. If many “resolved” users return within the chosen window, the resolution rule is too optimistic or the underlying service is failing after the chat ends.

Common measurement mistakes and fixes

Calling every non-transfer a success

Problem: A user disappears and the interaction is counted as resolved.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Fix: Separate resolved, abandoned, and unknown outcomes. Require confirmation or a verifiable completion event.

Rank #4
Sale
Logitech H390 Wired Headset PC/Laptop Stereo Headphones, USB-A, Rose | For PC/Laptop, Stereo, USB-A, In-Line Controls, Works with Chromebook
  • Digital Stereo Sound: Fine-tuned drivers provide enhanced digital audio for music, calls, meetings and more
  • Rotating Noise Canceling Mic: Minimizes unwanted background noise for clear conversations; the rotating boom arm can be tucked out of the way when you’re not using it
  • Handy In-line Controls: Simple in-line controls on the headset cable let you adjust the volume or mute calls without disruption
  • Plug-and-Play USB Computer Headset: Simply plug the USB-A connector into your computer and you’re ready to talk or listen without the need to install software
  • Padded Comfort: Comfortable headphones with adjustable headband features swivel-mounted, leatherette ear cushions for hours of comfort and is easy to clean

Mixing sessions and conversations

Problem: A conversation containing several topic sessions is counted once in one report and several times in another.

Fix: Put the unit in every metric definition and never combine counts from different units without a documented conversion.

Changing the denominator mid-trend

Problem: A dashboard switches from all incoming traffic to engaged sessions, making performance appear to jump.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Fix: Version the eligibility rule, restate historical data only when possible, and annotate the change.

Hiding handoff reasons

Problem: A single escalation percentage cannot distinguish customer choice from bot failure.

Fix: Require a reason code and destination, then review reason-specific rates and outcomes.

Ignoring repeat contact

Problem: Containment rises while customers repeatedly reopen the same issue.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Fix: Join contacts across channels with a privacy-safe key and publish a declared return-contact window.

Comparing unsupported benchmarks

Problem: A team is told that a particular containment or resolution percentage is “good” without matching population, channel, issue mix, or date.

Fix: Use internal baselines, controlled experiments, and transparent segments unless you have a comparable external benchmark with its methodology.

A practical reporting layout

A monthly scorecard can fit on one page if every number remains auditable:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Population: eligible sessions, eligibility rule, date range, channels, and bot version.
  • Outcomes: resolved, escalated, abandoned, open, and unknown counts.
  • Headline rates: containment, resolution, and escalation with formulas and denominators.
  • Evidence quality: share of resolutions that were user-confirmed, flow-implied, or post-contact verified.
  • Escalation mix: user-requested, policy-required, attempt-limit, recognition, technical, and other reasons.
  • Customer signal: CSAT response count and score, repeat-contact rate, and first-contact resolution using the stated window.
  • Speed: median and tail time to resolution, escalation, and human acceptance.
  • Change log: flow, prompt, routing, timeout, channel, and metric-definition changes.

Include raw counts beside percentages. A rate based on a small topic segment should not carry the same confidence as a rate based on thousands of interactions.

How to interpret the three headline rates together

A rising containment rate with falling escalation can mean more customers are successfully served by automation, but it can also mean more customers are abandoning. A rising resolution rate accompanied by stable or falling repeat contact is stronger evidence of useful automation than containment alone. An escalation increase may be healthy when it reflects deliberate routing of complex cases, and concerning when it is driven by avoidable fallback or tool failures. Validate these interpretations against your outcome, feedback, and repeat-contact data rather than treating any single movement as proof.

The most defensible conclusion is therefore not “the bot has an X% success rate.” It is a clearly scoped statement such as: “During this period, X% of eligible engaged sessions were verified as resolved, Y% were transferred, Z% were abandoned under the stated timeout, and the remaining sessions were open or unknown.” That wording keeps containment, resolution, and escalation analytically distinct.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

AI Performancechatbot analyticscontainment rateconversational AIcustomer service metricsescalation rateresolution rate

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.