Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PC×
FREEDOM251

Freedom251 › Blog › gaming laptops

Can a Gaming Laptop Run VIDRAFT’s 180B MoE Model? What to Expect

By Freedom251 Team · · 4 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Yes—with an important qualification: VIDRAFT’s POCKET-Darwin-180B-GGUF can run on some gaming laptops by memory-mapping its roughly 111.3 GB checkpoint from an NVMe SSD, rather than loading the whole model into RAM or VRAM. The publisher reports 4.17 generated tokens per second on one laptop with an RTX 5060 Laptop GPU, 8 GB VRAM and 32 GB RAM. That is a specific, self-reported result, not a speed guarantee for other laptops.

What the 180B label means—and what must fit

POCKET-Darwin-180B-GGUF is a four-file, 4-bit GGUF version of Darwin-180B-RSI-R3, intended for llama.cpp. The model card lists 180 billion total parameters, 512 routed experts and about 10 experts—roughly 3 billion parameters—active for each generated token. Sparse activation reduces the parameters involved in each token’s computation; it does not shrink the checkpoint to 3 billion parameters. The four files total 111.3 GB, compared with 360 GB for the BF16 original, according to FINAL-Bench’s model card.

As an Amazon Associate I earn from qualifying purchases.

That distinction explains how the model can be usable on a machine with less than 111 GB of RAM. The runtime memory-maps the model files and reads the needed experts from storage. The model does not all need to be resident in GPU memory, but SSD access becomes part of inference. Storage performance, access patterns and how much of the checkpoint can remain resident affect latency; the active-parameter count alone does not predict speed. Hugging Face Blog Editorial describes SSD streaming as part of the inference pipeline.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What hardware and software it calls for

The model publisher’s entry-level laptop or desktop configuration is 32 GB of system RAM, at least 8 GB of GPU VRAM, an NVMe SSD and 120 GB of free disk space. The free-space figure exceeds the listed 111.3 GB checkpoint size. More memory can keep more of the model resident and improve speed, but the card does not promise a particular performance level for every system meeting these minimums.

#1 Best Overall
Sale
Acer Predator Helios Neo 18 AI Gaming Laptop | Intel Core Ultra 9 Processor 275HX | NVIDIA GeForce RTX 5070 Ti | 18" WQXGA 240Hz G-SYNC | 32GB DDR5 | 2TB Gen 4 SSD | Killer Wi-Fi 6E | PHN18-72-9474
  • Desktop-Level Performance, Anywhere: Get legendary gaming performance with the Intel Core Ultra 9 275HX processor, delivering ultra-smooth gameplay and future-ready AI (Up to 13 NPU TOPS). Offload tasks like background removal and audio optimization to the NPU for seamless streaming and gaming, while Intel Application Optimization enhances performance on classic titles.
  • Game-Changing Realism: Powered by NVIDIA Blackwell architecture, GeForce RTX 5070 Ti Laptop GPU unlocks the game changing realism of full ray tracing. Equipped with a massive level of 992 AI TOPS horsepower, the RTX 50 Series enables new experiences and next-level graphics fidelity. Experience cinematic quality visuals at unprecedented speed with fourth-gen RT Cores and breakthrough neural rendering technologies accelerated with fifth-gen Tensor Cores.
  • Supreme Speed. Superior Visuals. Powered by AI: DLSS is a revolutionary suite of neural rendering technologies that uses AI to boost FPS, reduce latency, and improve image quality. DLSS 4 brings a new Multi Frame Generation and enhanced Ray Reconstruction and Super Resolution, powered by GeForce RTX 50 Series GPUs and fifth-generation Tensor Cores.
  • The Ultimate in Ray Tracing and AI: NVIDIA RTX is the most advanced platform for full ray tracing and neural rendering technologies that are revolutionizing the ways we play and create. Over 700 games and applications use RTX to deliver realistic graphics and incredibly fast performance with cutting-edge AI features like DLSS Multi Frame Generation.
  • Immersive Depth and Detail: At 18 inches with a 16:10 aspect ratio, the pristine WQXGA screen offering vibrant colors with up to 100% DCI-P3 operates at a fast 240Hz refresh and 3ms overdrive response time. Alongside the suite of features from NVIDIA G-SYNC and NVIDIA Advanced Optimus, you're guaranteed that whatever's on-screen is a distinct viewing delight.

The model card says the qwen4exp architecture requires llama.cpp b11048 or newer. Check the current model card and llama.cpp support before setup: supported flags, build compatibility and file paths can change.

Example server command

The card provides this example laptop or desktop command. Replace the model path with the location of the downloaded shard:

llama-server -m POCKET-Darwin-180B-UD-Q4_K_XL-00001-of-00004.gguf -ngl 999 --cpu-moe -fa on -c 8192 --jinja

The command uses the first shard as the model path; keep all four model files together as required by the model format. The card also provides a CPU-only mode using -ngl 0, 16 threads, context 8192 and --load-mode none. Its example flags are not a guarantee that every GPU, llama.cpp build or laptop configuration will use the same settings successfully.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #2
Lenovo Legion 5 15IRX10 15.1" WQXGA OLED, Gaming Laptop, Intel Core i9 14th Gen 14900HX 1.6GHz; NVIDIA GeForce RTX 5070 8GB GDDR7; 32GB DDR5 RAM; 1TB NVMe M.2 SSD; Gigabit LAN, 2x2 WiFi 7
  • Intel Core i9 14th Gen 14900HX 1.6GHz Processor, NVIDIA GeForce RTX 5070 8GB GDDR7, 32GB DDR5-5600 RAM
  • 1TB PCIe Gen4 x4 NVMe M.2 SSD
  • 15.1" WQXGA OLED Glossy Display
  • Gigabit LAN, 2x2 WiFi 7 (802.11be), Bluetooth 5.4
  • 4.19 lbs. (1.90 kg),Windows 11 Home

How fast the published laptop result was

FINAL-Bench reports 4.17 generated tokens per second on an RTX 5060 Laptop GPU with 8 GB VRAM, 32 GB RAM and an NVMe SSD, using llama.cpp with the model memory-mapped from SSD. This is the publisher’s measurement, checked in 2026—not an independently replicated typical result. Your laptop’s storage, memory residency, context, prompt, offload settings, power limits and thermals can change the experience.

The same publisher reports 18.4–21.0 tokens per second and 78.8 GB peak RAM for a CPU-only run on a 16-thread AMD EPYC 9365 server with the model resident in memory. That server result is not a like-for-like laptop comparison: it uses different hardware and keeps the model in memory rather than relying on the laptop’s SSD-streaming setup.

How to decide whether the speed is usable for you

A tokens-per-second figure by itself does not tell you whether the model will suit your work. Measure the parts of the interaction that matter: time to first token, generation rate, output quality and the longest response time you can accept. Short and long prompts can behave differently, and context length and prompt processing can change both memory use and latency.

Rank #3
Light Gaming Laptop, ΑΜD Ryzen 5700U (Up to 4.3GHz), 16GB RAM 512GB SSD | 15.6 inch Laptop Computer, WiFi 6, BT5.2, Webcam, Type-C, Windows 11 Laptop for Student, Business
  • [Top Performance Processors] KAIGERR Light gaming laptop R7-5700U by ΑΜD ZEN 3 architecture, matched with 16MB of L3 cache, built by TSMC 7nm process with 8 cores & 16 threads (turbo up to 4.3GHz). KAIGERR office light gaming laptops makes it easy to qualify for your PC work and PC games which have amazing loading and processing power for a smoother PC used experience
  • [Huge Capacity Storage] KAIGERR laptop comes with 16GB SODIMM DDR4 RAM, advantages of large operating memory capacity both can reduce read latency of memory data and improve CPU utilization. KAIGERR laptop computer configured with an M.2 2280 NVMe 512GB SSD which offers fast startup and loading of applications, as well as a large amount of storage space for your various files
  • [Brilliant Display & Integrated Graphics] KAIGERR Light gaming laptop features an innovative thin-bezel display that provides more usable onscreen space for immersive FHD viewing. KAIGERR laptop integrates with ΑΜD Radeon Graphics and delivers strong graphics processing like a rich level of image detail making it possible to play computer games or edit pictures with a great experience on this laptop
  • [Rich Interfaces & Wireless Connectivity] KAIGERR traditional laptop offers a variety of connectivity options, including HDMI, Type-C, 3.5mm TRRS Jack, Memory Card Slot and USB3.2 ports. You can easily connect to various devices and peripherals to expand your capabilities. Mini laptop computers equipped with WiFi6 & Bluetooth 5.2 which offer strong wireless signal, fast wireless connections, and reliable transmission speed
  • [Portable Design & Durable] KAIGERR laptop compact design makes it easy to carry with you wherever you go. Also, you can enjoy the benefits of a powerful computer without the bulk of a traditional desktop. KAIGERR laptop computers are built with high-quality components and designed to handle heavy workloads and deliver consistent performance and longevity. If you encounter any problems, please contact us and we will help you solve the problem within 12 hours
  1. Test your actual workload. Use representative prompts and response lengths rather than relying on a single short sample.
  2. Record the setup. Note RAM, VRAM, SSD type, llama.cpp build, context size and offload settings so you can reproduce the result.
  3. Compare alternatives on the same machine. Test a smaller dense or MoE model as well. A model that fits fully in memory may respond faster or support more simultaneous requests.
  4. Check operational limits. Consider portability, storage traffic, concurrency, power use, thermals and total system cost alongside speed and output quality.

FINAL-Bench also reports 87.65% before and after quantization on 2,000 paired MMLU-Pro questions, with a 0.00-point difference and a 95% confidence interval of [−0.95, +1.00]. This is the publisher’s test, not independent replication; it does not establish identical quality on other tasks.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

When another device or a smaller model makes more sense

If the workload depends on low latency, long sessions or multiple concurrent requests, compare the laptop’s SSD-streamed setup with a configuration that holds more of the checkpoint in memory. FINAL-Bench lists a 128 GB RAM mini PC as a configuration able to hold the full model in memory; that is an alternative device class, not a guarantee for every mini PC. A smaller model may also better fit a machine’s memory and response-time needs. Decide by testing the same prompts and measuring the same outcomes on each option.

Hugging Face Blog Editorial’s October 4, 2026 article puts the practical caveat plainly: “Sparse activation and SSD streaming can make a 111 GB model usable on a laptop, but workload-level testing is essential before treating technical compatibility as practical deployment readiness.”

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

gaming laptopsGGUFLarge Language Modelsllama.cpplocal AI

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
Outdated Drivers Are Slowing You DownFree scan - exact matches
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.