October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix NowOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
World desk3 min

Twelve Test Containers—and One Ran for 26 Minutes

A slowest-shard bottleneck turned a 12-container test stage into a 26-minute wait. Sergey Shinder’s case explains why file counts mislead and how timing-based allocation helped.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

One slow shard can hold an entire parallel test stage open. In a case study, developer Sergey Shinder describes splitting 2,900 tests across 12 containers by file count: nine containers finished within two minutes, but one ran for 26 minutes. The imbalance came from treating every file as equal work, even though several integration classes in the slow container had to start a database and message broker.

Why did one container take 26 minutes?

Shinder’s account concerns one repository, not a general benchmark. Its suite contained 2,900 tests across 214 files, divided into 12 groups with the same number of files in each. That method balanced file counts, but not the time or setup each file required.

As an Amazon Associate I earn from qualifying purchases.

Four integration classes landed in one container. Each started a database and a message broker before running assertions, and that container reportedly took 26 minutes. By contrast, nine of the 12 containers finished within two minutes; the fastest took 80 seconds.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The project’s file-count approach became still less representative when about 400 repetitive unit tests were consolidated into a parameterized class. The number of files fell, but counting files did not reveal how much execution work was inside each one.

#1 Best Overall
Dell PowerEdge R730xd Server 24B SFF 2U, 2X Intel Xeon E5-2690 v4 2.6Ghz (28-cores Total), 128GB DDR4 RAM, 4X 1.2TB 10K SAS 2.5” 12Gb/s HDD, H730P 2GB RAID, NIC 10Gb + I350 1Gb (Renewed)
  • Dell PowerEdge R730xd 24B SFF 2U Server
  • 2x Intel Xeon E5-2690 v4 2.6Ghz 14-Core (28-cores Total)
  • 128GB DDR4 RAM – 4x 1.2TB 10K SAS 2.5” 12Gb/s
  • Dell H730P mini 2GB 12Gb/s RAID
  • 2x 750W PSU - 2x 10Gb SFP+ 2x 1Gb (RJ45) NIC

Why the average duration was misleading

The test containers ran in parallel, so the stage could not finish until its slowest container finished. Shinder reports that the dashboard showed an average job duration of three minutes and 40 seconds, but that average did not describe the end-to-end wait: the 26-minute shard remained the gate.

In other words, adding parallel workers or looking only at an average does not solve uneven allocation. If one shard receives several expensive tests while others finish early, those idle workers cannot make the slow shard complete sooner.

Rank #2
Dell Optiplex 7050 SFF Desktop PC Intel i7-7700 4-Cores 3.60GHz 32GB DDR4 1TB SSD WiFi BT HDMI Duel Monitor Support Windows 11 Pro Excellent Condition(Renewed)
  • Model: Dell OptiPlex 7050 Small Form Factor (SFF)
  • Processor: Intel Core i7-7700 3.60 GHz
  • Memory: 32GB DDR4 Ram
  • Storage: 1TB Solid State Drive (SSD) Fast Boot + Storage
  • Operating System: Windows 11 Pro (64-bit)

How the team redistributed the tests

Shinder says the team changed its splitter to use historical execution time at the class level. It recorded each class’s duration in a file in the cache, then used the timing history on a later run to distribute classes among 12 bins.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  1. Record durations: Save per-class execution times so later runs can estimate the cost of each class.
  2. Place long-running classes first: Sort classes by recorded duration from longest to shortest, then place each into the bin with the least assigned work. This longest-processing-time-first approach aims to prevent several known expensive classes from clustering together.
  3. Handle classes without history: Assign a class with no recorded duration to the currently shortest bin, rather than treating it as if it had a known cost.
  4. Expose the result: Print each container’s duration as a bar so the distribution can be inspected.
  5. Flag imbalance: Fail the pipeline if the gap between the longest and shortest container exceeds 25 percent. Shinder describes this as a way to notice when timing data has become stale.

The 25-percent limit is the guardrail used in this project’s account, not an established standard. Teams adopting a similar check would need to choose a threshold that fits their own test variability and release process.

Rank #3
Hewlett Packard Enterprise ProLiant MicroServer Gen11 Tower Server with Intel Xeon 6315P, 16GB DDR5, 4LFF Bays, 180W PSU (P86811-005)
  • 2.80 GHz processor speed ensures efficient operation with consistent reliability
  • Intel Xeon 2.80 GHz processor provides enterprise-grade performance with built-in security and remote management capabilities
  • Quad-core (4 Core) processor core helps server process data quickly and reliably for maximum productivity
  • 1 processors supported for faster processing and improved access to data, optimizing performance under heavy loads
  • With 16 GB memory, you can multitask between applications seamlessly, keeping productivity high and response times quick

What changed in this case—and what the numbers prove

Shinder reports that after switching to duration-aware allocation, the test stage fell from 26 minutes to six and a half minutes, using the same runners. He also reports that the repository’s runner bill dropped by about one fifth.

Those are author-reported results for one repository. The available account does not include raw timing data, a cost breakdown, independent replication, or results from other projects, so the figures should not be treated as guaranteed savings. The transferable lesson is narrower: when work varies significantly, historical duration can be a more useful sharding signal than file count, and shard-level timings make imbalance visible.

Rank #4
HPE Hewlett Packard Enterprise ProLiant MicroServer Gen11 Tower Server, Intel Pentium Gold G7400 Processor, 16GB Memory, 1TB HDD Storage, External 180W US Power Supply Smart Choice P74439-005
  • MODEL P74439-005: Compact and affordable HPE ProLiant MicroServer Gen11 powered by Intel Pentium Gold G7400 3.7GHz processor, ideal for file sharing, NAS, and basic business workloads
  • READY OUT OF THE BOX: Includes 16GB DDR5 UDIMM memory (expandable to 128GB), one 1TB SATA 6G Business Critical HDD, embedded Intel VROC SATA, dedicated iLO-M.2 port kit, 180w external power adapter and 1/1/1 warranty for dependable plug-and-play server operation
  • WHISPER-QUIET & SPACE-SAVING: Ultra-compact mini tower design fits easily in small office spaces; supports wall, flat, or vertical placement for deployment flexibility
  • INTEGRATED REMOTE MANAGEMENT: Comes with HPE iLO 6 and embedded TPM 2.0 for secure, license-free remote server administration through shared port access
  • EXPANDABLE DESIGN: Two PCIe slots (including PCIe 5.0) and four LFF-NHP drive bays provide robust options for storage and component scalability. Features new MR408i-p controller support for enhanced storage performance
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

When duration-based sharding is worth considering

This approach is most relevant when parallel test jobs finish at noticeably different times and the longest one determines when the stage completes. Before changing the splitter, inspect whether the skew comes from a few costly tests, environment setup, or another source of work; the case study specifically attributes its outlier to integration classes that started services.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Use file counts cautiously if files contain very different test workloads.
  • Keep timing history available to subsequent runs, and decide how to treat classes with no history.
  • Look at the spread between individual shard durations, not only the average job duration.
  • Choose an imbalance alert threshold for your own pipeline; the 25-percent figure belongs to Shinder’s implementation.

Shinder’s post is on DEV Community; the reported example is the author’s case study rather than an independently verified performance comparison.

Best Value
HP Z4 G4 Workstation, Intel Xeon W-2133 (6-Core) up to 3.9GHz, 64GB DDR4, 512GB NVMe M.2 SSD + 2TB HDD, Nvidia Quadro P400 2GB, USB 3.1, Windows 11 Pro (Renewed)
  • HP Z4 G4 Workstation Tower
  • Intel Xeon W-2133 6-Core 3.6GHz (3.9GHz Turbo)
  • 64GB DDR4 Memory - Nvidia Quadro P400 2GB
  • 512GB NVMe M.2 SSD (boot) + 2TB HDD (storage)
  • Windows 11 Pro 64-bit

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Windows Errors? Fix Them Before They SpreadFree repair scan
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.