Quick wins for a faster PC:
Clear out junk files and repair common Windows errorsFree Scan →Scan for outdated or missing drivers - takes under a minuteDriver Scan →Repair Windows errors before they cause bigger problemsFix Now →A request sent at the wrong moment during llama-server’s automatic sleep transition may be queued but never handled, leaving the client to time out. That is the timing race described by the reporter of llama.cpp issue #29689, opened September 30, 2026. It is a code-reading diagnosis in an open issue—not a confirmed failure across every version or configuration.
What automatic sleep does
The --sleep-idle-seconds option tells the server to sleep after a period without incoming tasks. The server unloads the model and associated memory, including the KV cache; a new task triggers a reload. This behavior is documented in the llama.cpp server README.
As an Amazon Associate I earn from qualifying purchases.
Sleep does not mean every route becomes unavailable. The server developer README says read-only endpoints such as /health, /props, /models and /metrics can return cached responses while sleeping. Requests that pass through wait_until_no_sleep() request a wake and wait for the server to load before handling the work.
Recommended Free Tools
How the reported request race happens
According to issue author mozophe, an HTTP thread can pass wait_until_no_sleep() while the server is awake, then be overtaken by the main loop. The loop sees no queued tasks, decides to sleep, sets sleeping = true and waits on condition_tasks. The HTTP thread subsequently posts its task and notifies that condition.
#1 Best Overall
- 【High-Performance APU】The MS-S1 MAX features an AMD Ryzen AI Max+ 395 APU, integrating a Zen 5 architecture CPU (up to 5.1GHz, 16C/32T, 64M L3 Cache), an RDNA 3.5 GPU, and an NPU (50 TOPS). The total system output is 126 TOPS. It provides powerful parallel computing capabilities for demanding AI workflows. It is ideal for running local LLMs, multimodal models, and computationally intensive tasks
- 【128GB UMA Memory】Equipped with up to 128GB of LPDDR5x-8000MT/s unified memory, it enables the CPU and GPU to access a shared, high-bandwidth memory pool with extremely low latency. Ideal for large-scale AI inference, 3D workloads, and complex timelines in video editing. It eliminates traditional VRAM bottlenecks, ensuring smoother data transfer during high-intensity computations. The UMA design maximizes performance stability under high loads
- 【Flexible Expansion】The MS-S1 MAX features USB4 V2 (up to 80Gbps), dual 10GbE LAN, HDMI 2.1 (up to 8K60), a full-length PCIe x16 expansion slot, and dual M.2 slots supporting up to 16TB RAID 0/1. Wi-Fi 7 provides stronger signal coverage and a more stable wireless experience. The slide-out design facilitates upgrades and maintenance. It easily adapts to personal, studio, or rack-mount enterprise environments
- 【High-Efficiency Cooling System】Utilizing an aerospace-grade aluminum alloy chassis, copper base plate, six heat pipes, dual turbine fans, and advanced PCM thermal conductive material, it maintains stable cooling performance even under continuous load. This system supports 130W continuous power and 160W peak power operation, with a built-in 320W power supply. It boasts multiple global certifications including CCC, FCC, UL, CE, and UKCA, ensuring stable and reliable operation in various environments
- 【Cluster Design】Two MS-S1 MAX units can be configured as a dual-unit cluster to run a large 235B Q4 model locally, achieving an output speed of 10.87 tok/s. Supporting 2U rack deployment, multiple MS-S1 MAX units can be cascaded into a distributed cluster to create a high-efficiency AI computing center. A cluster of four MS-S1 MAX units successfully ran a DeepSeek-R1 671B Q4 large model. A reserved cluster power-on interface allows for unified start-up and shutdown
The reporter’s diagnosis is that the sleeping wait predicate checks !running || req_stop_sleeping, but not whether queue_tasks has become nonempty. In that account, the notification does not cause the queued task to be handled, so the client can wait until its own timeout. The issue says the only observed log line in the reproduction after waiting is the cancellation when the client gives up.
The author also warns that the same interval may leave a route handler with stale ctx_server state if sleep callbacks destroy that state after the handler passes the barrier but before it posts work. That is an implication described by the issue author, not a separately confirmed result.
Rank #2
- 【Intel 13th Generation Core i9】:Mini desktop computer MS-01 S1390 is equipped with the high-end Intel 13th Core i9 13900H Processor. 14C/20T, 24MB Cache,up to 5.4GHz, Featuring integrated Intel Iris Xe Graphics with maximum frequencies of 1.5GHz and 1.45GHz,it bring powerful performance and ultimate smooth experience for gaming and working.
- 【Super Fast Network Speed】2x 10Gbps SFP+ network ports, supporting link aggregation; 2x 2.5G RJ45 network ports with I226-LM and I226-V (I226-LM supports Windows Server); 2x USB4 interfaces, supporting Thunderbolt Ethernet of 20Gbps.To sum up: a total network transmission speed of up to 65Gbps. With so many high-speed interfaces, you can quickly upload and access your NAS documents.
- 【Enterprise storage】MS-01 Mini Workstation supports up to 3x M.2 NVME SSDs, including one interface that supports PCIE4.0 with a transmission speed of up to 7000MB/s, and also supports Raid0 for increased capacity and Raid1 for data safety. It is designed for business buyers which can support up to 1x U.2 NVME SSD and 2x22110 M.2 MVNE SSDs, ensuring greater capacity and stronger stability, while also meeting the storage needs of geek enthusiasts Homelabserver.
- 【Standard PCIE slot】Minisforum MS-01 is equipped with a PCIe 4.0 x16 slot, allowing for the installation of high-performance external GPUs, network cards, storage controllers, and other external devices. The PCIe 4.0 x16 slot enables faster data transfer, delivering optimal performance in various applications that require high computational power and bandwidth, such as gaming, video editing, and 3D rendering.
- 【Rich Interfaces】3*USB3.0 type-A ports +2*USB2.0 type-A ports +1*HDMI2.0 ports(4K@60Hz) +2*USB4 40Gbps Type-C(Alt DP,8K@30Hz). Including 1xMS-01 MiniWorkStation, 1x U.2- M.2 conversion adapter, 1x power adapter, 1x power cord, 1x SSD heat sink, 1x HDMI cable, 1x mounting screw, 1x manual.
How to recognize the reported failure
The report describes this reproduction pattern with --sleep-idle-seconds 1:
- Start
llama-serverwith the one-second idle-sleep setting. - Have a client call
/health,/propsand/tokenize. - Shortly after readiness, post to
/completion. - If the completion request lands in the transition window, it may remain unprocessed until the client times out.
The reporter says /tokenize does not reset the idle timer, which can make the completion request coincide with expiration. On their setup, they estimated the failure occurred in about one in eight runs. That is an approximate observation from this reporter’s reproduction, not a general failure rate. The report identifies a Windows x86_64 build as 0.5.0-dev, build 11160, commit 70c4e1582; the author says the queue logic also appears unchanged in current master and v0.5.0. This scope assessment is the reporter’s, not an independently verified version matrix.
Rank #3
- 【AMD Ryzen 5 3501U Mini PC For Enhanced Daily Performance】Powered by AMD Ryzen 5 3501U processor with 4 cores and 8 threads, this mini pc provides responsive performance for office applications, home entertainment, online learning, media playback, and everyday computing.
- 【16GB Memory & 512GB Storage With Expansion Options】Built with 16GB DDR4 RAM and 512GB PCIe 3.0 NVMe SSD, this mini computer provides more space for applications, files, videos, and daily content. Upgrade memory up to 32GB, expand SSD storage up to 2TB, or add a 2.5-inch HDD.
- 【Flexible Small Desktop Computer For Home Applications】This small desktop computer is designed for home office, streaming, personal server setups, digital entertainment, and light gaming. The upgraded memory helps support smoother operation when using more applications.
- 【Triple Display Setup & Flexible Connectivity】Dual HDMI ports and a full-function USB-C port support up to three displays. This micro pc offers convenient connectivity with WiFi 6, Bluetooth 5.3, Gigabit Ethernet, and multiple USB ports.
- 【Compact Mini Desktop With Space-Saving Design】Measuring only 5.0 × 4.4 × 1.6 inches, this small pc saves valuable desk space. VESA mount support allows installation behind compatible monitors, making it suitable for home offices and compact workspaces.
Workaround: wait for confirmed sleep before sending work
The issue author’s workaround is to poll GET /props until the response reports is_sleeping: true, then issue the request. In the report, a request arriving while the server is already asleep takes the wake path and is processed normally. The server README documents /props as an endpoint for checking sleep status.
This avoids sending work during the transition described in the issue, but it changes the client flow: it must wait for confirmed sleep before starting the operation. The report does not provide comparative latency or reliability measurements for other traffic patterns.
Rank #4
- 【1-Year Worry-Free Warranty】Your satisfaction is our priority. Glorlin provides a 1-year warranty covering any hardware malfunctions. We support returns or exchanges to ensure a 100% worry-free shopping experience. Have a question? Reach out to us through our official after-sales email for a prompt solution.
- 【Reliable Performance with Ryzen 7 Processor】Powered by AMD Ryzen 7 8745HS (8 cores, 16 threads, up to 4.9GHz), this mini pc delivers stable performance for daily workloads. Suitable for office tasks, programming, and multitasking, it works well as a ryzen mini pc for both home and business use.
- 【Radeon 780M Graphics for Media and Light Gaming】Equipped with integrated Radeon 780M graphics, this mini gaming pc supports smooth 4K video playback and handles many popular games at adjusted settings. A practical mini computer for media, editing, and casual gaming.
- 【Mini PC 16GB RAM and Fast Storage】This mini pc 16gb ram configuration includes single 16GB DDR5 memory (4800MHz，3GB is assigned to VRAM by default) and a 1TB NVMe SSD, offering quick boot times and responsive system performance. Dual M.2 slots allow storage expansion up to 4TB for growing files and projects.
- 【Quad 4K Display Support for Productivity】The mini desktop computer supports up to four 4K displays via HDMI, DisplayPort, and dual USB-C ports. Ideal for multi-screen workflows such as coding, trading, or content creation with improved efficiency.
Is there a fix?
Issue #29689 proposes two possible remedies: add a check for !queue_tasks.empty() to the sleeping wait predicate, or track in-flight requests under mutex_tasks so the server cannot sleep while a request is between the wake barrier and post(). These are proposals in the issue, not evidence that either change has been merged. The report also does not establish that the race affects every build, platform or configuration.
Free tools Windows power users keep installed
One-click scans. No signup required.
Other llama.cpp issues describe different sleep/wake failures: #29188 concerns an input-token-counting crash, while #24537 concerns a CUDA flash-attention wake crash. Those reports do not establish the queue race described here.
Quick Recap
Best Value
- ❓Why Choose Mini PC: Reclaim 60% of your workspace with the ultra-compact Mini Computers 24GB 1TB. Small enough to slip into your backpack for travel, business trips, or remote work, it’s a powerhouse that defies its size. Designed to handle everyday professional tasks with ease, the Ryzen 9 6900HX provides smooth and stable responsiveness for multitasking and essential content creation. It’s an efficient solution for those who need a snappy, compact system for consistent daily workloads—at a price point far more accessible than bulky towers or laptops. it’s the ultimate high-value investment for good performance and total peace of mind.
- ⚡Unleash Powerful Performance with Ryzen 9 6900HX: Bosgame P6 mini pc ryzen 9 powers through demanding tasks with the AMD Ryzen 9 6900HX(8C/16T,up to 4.9GHz). It makes Handles smooth 1080p video editing in DaVinci Resolve, runs 2–3 lightweight virtual machines, and plays esports titles like CS2 at high settings.This CPU delivers powerful performance in a compact form factor—ideal for creators, developers, and power users who need speed without compromise.
- 🖥️ Experience Smooth Light Gaming & Multitasking on Three Monitors: Drive three 4K displays simultaneously via HDMI, DisplayPort, and USB-C (all supporting 4K@60Hz). The ryzen 9 mini desktop pc is perfect for light gaming, professional workflows, or content creation where every screen matters. Enjoy lag-free performance across all monitors with powerful integrated Radeon 680M graphics.
- 🚀 Fast Memory & Storage for Instant Responsiveness: Equipped with 24GB onboard LPDDR5X RAM (4800MT/s) and a 1TB M.2 NVMe PCIe 4.0 x4 SSD, this mini desktop computer ryzen 9 boots instantly and handles large files effortlessly. Great for office tasks, light photo editing (Photoshop), and 2D drafting in AutoCAD, ensuring seamless multitasking and zero slowdowns.
- 🌍 Future-Proof Expansion & Connectivity for Professional Needs: Expand storage up to 8TB with an additional M.2 NVMe drive. This ryzen mini pc features dual USB 3.2 Gen2 ports and a full-function USB-C (supports data, PD3.0, and DP). The dual 1Gbps Ethernet ports are purpose-built for advanced setups, including DIY soft routers (OpenWrt/pfsense), home servers, hardware firewalls, and high-speed network switching. With built-in Wi-Fi 6E and Bluetooth 5.3, it’s the ultimate hub for home offices, media streaming, or complex lab environments. {Please note: To activate Bluetooth 5.3, please download the latest driver from the official Intel website; otherwise, it defaults to Bluetooth 5.2.}
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
