October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan NowOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk5 min

Stop Kubernetes Rollout 503s: Find the Failure Along the Request Path

RollingUpdate manages Pod replacement, not end-to-end availability. Correlate 503 timestamps with readiness, EndpointSlice conditions, shutdown behavior, and the complete request path.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

A Kubernetes Deployment rolling update controls how many Pods are replaced at once; it does not guarantee that replacement Pods can serve requests or that every traffic layer has updated its routing and drained connections. To find why a rollout produces 503s, correlate the error timestamps with Pod readiness, Service EndpointSlice conditions, shutdown behavior, and the actual path through proxies or load balancers.

What a rolling update does—and what it cannot guarantee

A Deployment using the RollingUpdate strategy coordinates old and new replica counts. Its maxUnavailable and maxSurge settings limit how many replicas may be unavailable or temporarily added during the update. They do not establish that the application is ready, that the cluster has enough schedulable capacity, or that every traffic consumer has observed endpoint changes.

As an Amazon Associate I earn from qualifying purchases.

Kubernetes documentation lists 25% as the default for both settings. Percentage values are rounded down for maxUnavailable and up for maxSurge. With a small replica count, those rounding rules matter: inspect the calculated values for your Deployment rather than assuming a percentage creates a particular number of Pods. Check the manifest and cluster version as well as the documented defaults. Kubernetes: Update a Deployment Without Downtime and Kubernetes: Deployments

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Trace the 503 in timestamp order

Start with the exact interval when clients received 503 responses. A Deployment’s replica counts show rollout progress, but the request path and endpoint state help distinguish a capacity shortfall from a readiness or draining problem.

  1. Confirm the rollout settings and counts. Verify that the workload is a Deployment using RollingUpdate. Record desired, updated, ready, and available replicas, along with maxUnavailable, maxSurge, and minReadySeconds. The Deployment API documents a minReadySeconds default of 0; confirm the live configuration and version. Kubernetes: Deployments
  2. Inspect Pod status and events during the errors. Find whether new Pods fail readiness, restart, or take longer to initialize than the rollout allows. Compare the probe result with what the application actually needs to handle routed traffic, including dependency availability, cache warm-up, and handler initialization.
  3. Check the Service’s EndpointSlices. Correlate each endpoint’s ready, serving, and terminating conditions with the 503 timestamps. This shows whether endpoints were available, being terminated, or still represented while traffic consumers processed the change.
  4. Follow one request through every traffic layer. Identify whether the request goes through a Service proxy, ingress or gateway, service mesh, cloud load balancer, or another proxy. Check the relevant controller and load-balancer telemetry; Kubernetes’ endpoint model alone does not establish how quickly a particular implementation updates routes or drains connections.
  5. Compare rollout progress with the failure window. Deployment conditions and events can show a stalled update. The documented default for progressDeadlineSeconds is 600 seconds; an exceeded deadline surfaces a failed Progressing condition, but does not identify the application-level cause.

Readiness, liveness, and startup probes affect traffic differently

Readiness determines traffic eligibility

A failed readiness probe marks a Pod not ready while leaving its container running. Readiness is therefore the key probe to examine when traffic reaches a Pod that cannot yet handle requests, or when usable capacity disappears during a rollout. The probe should reflect the application’s ability to serve the traffic routed to it—not merely whether the process exists. Kubernetes: Configure Liveness, Readiness and Startup Probes

Liveness can restart a container

Liveness failures can trigger container restarts. If a check intended to signal “not ready for traffic” is instead configured as a liveness check, a temporary warm-up or dependency problem may cause restarts rather than simply excluding the Pod from Service traffic. Review what each probe means for your application before changing thresholds.

Startup probes protect slow initialization

A startup probe delays readiness and liveness checks until initialization succeeds. Review its timing and thresholds alongside the readiness and liveness probes and the application’s real startup behavior. A probe that passes before handlers or dependencies are usable can expose a Pod too early; one that never passes can keep it out of service. Probe-level terminationGracePeriodSeconds is documented as stable since Kubernetes v1.28, so check your cluster version before relying on that field. Kubernetes: Configure Liveness, Readiness and Startup Probes

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Endpoint termination and connection draining are separate concerns

When a Pod is deleted, its EndpointSlice entry can remain represented during termination, with conditions indicating whether it is ready, serving, or terminating. An endpoint marked terminating is not ready for ordinary traffic. The serving condition and the behavior of each traffic consumer matter when work is being drained; seeing a terminating endpoint in an EndpointSlice does not, by itself, prove that a proxy or external load balancer will complete active requests successfully.

Review the application’s shutdown sequence, any preStop handling, and the Pod’s termination grace period together. The application should stop accepting new work as appropriate while allowing active requests to finish within the intended window. Compare that window with request durations and the observed behavior of the ingress, proxy, mesh, or load balancer. Kubernetes documents the termination flow and endpoint conditions, but cannot guarantee how external clients or infrastructure converge. Kubernetes: Explore Termination Behavior for Pods And Their Endpoints and Kubernetes: EndpointSlices

Do not use a PodDisruptionBudget as a rollout fix

A PodDisruptionBudget (PDB) governs permitted voluntary evictions through the eviction API. It does not replace a Deployment’s maxUnavailable or maxSurge settings, repair failed readiness checks, or make an application ready to serve. Check the PDB when voluntary eviction is part of the incident; otherwise, focus on rollout configuration, readiness, endpoint state, and traffic handling. Kubernetes: PodDisruptionBudget

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Use the evidence to choose the next change

  • New Pods are not ready: Inspect readiness failures, startup timing, and whether the probe represents the traffic the application must serve.
  • Ready capacity falls below what traffic needs: Recheck the rollout’s replica counts and availability limits, including percentage rounding for small replica sets, and determine whether additional Pods can actually be scheduled.
  • Endpoint conditions change but 503s persist: Trace how the specific Service proxy, ingress, mesh, or load balancer consumes endpoint updates and handles terminating Pods.
  • Errors occur as old Pods shut down: Compare the application’s stop-accepting and drain behavior, request duration, preStop handling, and termination grace period with the traffic layer’s observed behavior.
  • The Deployment reports stalled progress: Use its condition and events to locate the stage that stopped advancing; the deadline reports lack of progress, not its root cause.

Make one evidence-based change at a time and compare the same signals during the next rollout. A Deployment strategy sets rollout bounds; uninterrupted service depends on application health, available capacity, endpoint updates, and the behavior of every layer handling requests.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.