Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix Now×
Skip to content
World desk4 min

A Laptop-Run AI Safety Classifier Nearly Matched a 35B Model on Prompt Injection

A roughly 200-million-parameter DeBERTa classifier came within 0.30 percentage points of Qwen3.6-35B on reported prompt-injection accuracy, with substantially lower median latency in the tested setup.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

In a benchmark reported by The New Stack on October 5, 2026, a roughly 200-million-parameter DeBERTa classifier reached 89.01% accuracy detecting prompt injection, just 0.30 percentage points below Qwen3.6-35B used as an LLM judge. The classifier’s reported median latency was 54.1 ms, compared with 312.5 ms for Qwen. These results suggest that a compact, task-specific safety model can be a practical alternative for a defined risk—but they do not establish that it is as capable across other safety tasks or deployment conditions.

What the benchmark found on prompt injection

The New Stack reported that Red Hat’s AI Safety team evaluated nine guardrail configurations with NVIDIA’s open-source NeMo Guardrails toolkit. For prompt injection, the reported accuracy and median latency were:

As an Amazon Associate I earn from qualifying purchases.

Configuration Prompt-injection accuracy Median latency Reported approach
Qwen3.6-35B 89.31% 312.5 ms LLM judge
Red Hat DeBERTa classifier 89.01% 54.1 ms Purpose-built classifier, roughly 200 million parameters
Jev 86.35% 348.1 ms Decision model

The 0.30-point accuracy gap between Qwen and DeBERTa is small in this particular test. The latency figures are also striking: DeBERTa’s reported median was about one-sixth of Qwen’s. But this was not a same-hardware head-to-head: the systems used different inference setups and network paths, so the latency difference cannot be attributed to model size alone.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Nor does “35B” mean Qwen used 35 billion parameters for every token. The report describes Qwen as a mixture-of-experts model with about 3 billion parameters active per token. Parameter counts provide useful context, but they are not a direct measure of inference compute or speed.

#1 Best Overall
Sale
AKCHART 15.6'' AI Laptop with Office 365 12GB RAM 256GB SSD Win 11 Laptops | 7000mAh Battery, IPS FHD, 180°Viewing, Quad-Core Processor, Type-C, WiFi5, Portable Thin Business Student Laptops, Light Gray
  • Stunning 15.6" FHD IPS Display: Experience crisp 1920x1080 resolution on this 15.6 inch laptop with an IPS panel that delivers wide viewing angles and vivid colors. The narrow-bezel design maximizes screen real estate for comfortable viewing on this Win 11 laptop, whether you're studying or working.
  • Celeron J4105 Processor & 256GB SSD: Powered by a reliable Celeron J4105 processor paired with 12GB DDR4 memory and a fast 256GB M.2 SSD. This laptop computer supports SSD expansion up to 2TB and TF card expansion up to 1TB, so your storage grows with your needs. Delivers smooth multitasking for daily productivity.
  • AI-Powered Win 11 Laptop: Built-in AI features enhance your productivity with smart assistance for writing, summarizing, and task management. Pre-installed with Win 11 and includes Office 365 subscription. This student laptop is backed by 1-year warranty and 24/7 customer support.
  • All-Day 7000mAh Battery & 180° Hinge: The high-capacity 7000mAh battery keeps this laptop powered through long classes or meetings. The 180-degree lay-flat hinge lets you share your screen effortlessly during presentations. This durable laptop computer adapts to your dynamic workflow.
  • Versatile Connectivity Hub: Equipped with USB 3.2, Type-C, Mini HDMI, and 3.5mm audio jack to connect all your peripherals. Stay online anywhere with high-speed 5G WiFi and Bluetooth 4.2. This college laptop keeps you connected at home, in the library, or on the go.

Content safety produced a different ranking

Prompt-injection results do not predict performance on broader content-safety policies. In the content-safety benchmark, the report gave these results:

Configuration Content-safety accuracy Median latency
Jev 86.20% Not stated in the report
DiffusionGemma 85.53% Not stated in the report
Qwen 85.47% Not stated in the report
Granite Guardian classifier 80.27% 33.2 ms

Granite Guardian, Red Hat’s 125-million-parameter classifier, was the fastest option in this content-safety comparison, but it scored below Jev, DiffusionGemma, and Qwen. Red Hat’s policy covered prejudice, violence, profanity, illegal activity, sexual content, and role-play pretexts. Jev is described as a decision model that takes application state and typed questions and returns typed answers, such as a probability.

Rank #2
Sale
Acer Predator Helios Neo 18 AI Gaming Laptop | Intel Core Ultra 9 Processor 275HX | NVIDIA GeForce RTX 5070 Ti | 18" WQXGA 240Hz G-SYNC | 32GB DDR5 | 2TB Gen 4 SSD | Killer Wi-Fi 6E | PHN18-72-9474
  • Desktop-Level Performance, Anywhere: Get legendary gaming performance with the Intel Core Ultra 9 275HX processor, delivering ultra-smooth gameplay and future-ready AI (Up to 13 NPU TOPS). Offload tasks like background removal and audio optimization to the NPU for seamless streaming and gaming, while Intel Application Optimization enhances performance on classic titles.
  • Game-Changing Realism: Powered by NVIDIA Blackwell architecture, GeForce RTX 5070 Ti Laptop GPU unlocks the game changing realism of full ray tracing. Equipped with a massive level of 992 AI TOPS horsepower, the RTX 50 Series enables new experiences and next-level graphics fidelity. Experience cinematic quality visuals at unprecedented speed with fourth-gen RT Cores and breakthrough neural rendering technologies accelerated with fifth-gen Tensor Cores.
  • Supreme Speed. Superior Visuals. Powered by AI: DLSS is a revolutionary suite of neural rendering technologies that uses AI to boost FPS, reduce latency, and improve image quality. DLSS 4 brings a new Multi Frame Generation and enhanced Ray Reconstruction and Super Resolution, powered by GeForce RTX 50 Series GPUs and fifth-generation Tensor Cores.
  • The Ultimate in Ray Tracing and AI: NVIDIA RTX is the most advanced platform for full ray tracing and neural rendering technologies that are revolutionizing the ways we play and create. Over 700 games and applications use RTX to deliver realistic graphics and incredibly fast performance with cutting-edge AI features like DLSS Multi Frame Generation.
  • Immersive Depth and Detail: At 18 inches with a 16:10 aspect ratio, the pristine WQXGA screen offering vibrant colors with up to 100% DCI-P3 operates at a fast 240Hz refresh and 3ms overdrive response time. Alongside the suite of features from NVIDIA G-SYNC and NVIDIA Advanced Optimus, you're guaranteed that whatever's on-screen is a distinct viewing delight.

Policy wording changed some scores substantially

The measured ranking depended partly on how the safety policy was expressed. The New Stack reported that replacing NVIDIA’s default risk definitions with Red Hat’s definitions raised Nemotron’s prompt-injection score from 69.37% to 84.84%. In the content-safety test, a policy tuned for Laya raised its score from 57.87% to 75.20%, while lowering Jev’s score from 86.20% to 82.53%.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Red Hat reportedly said its original risk definitions had been adapted from prompts that worked well for LLM judges and might not suit zero-shot classifiers. The practical implication is that a benchmark score belongs to a model-plus-policy configuration, not just to a model name. Teams should evaluate the policy wording they intend to deploy, rather than assume the published ordering will hold unchanged.

Rank #3
Acer Aspire 14 AI Copilot+ PC | 14" WUXGA Display | Intel Core Ultra 7 Processor 256V | NPU: Up to 47 Tops - GPU: Up to 64 Tops | Intel ARC 140V | 16GB LPDDR5X | 1TB SSD | Wi-Fi 6E | A14-52M-72S0
  • It's possible on your Intel AI PC - Equipped with an Intel Core Ultra 7 processor (Series 2), the Aspire 14 Al brings new AI experiences in productivity, creativity and security through a combination of CPU, GPU and NPU. This combo delivers the speed and responsiveness to handle any task with ease -along with all-day battery life of up to 22 hours and smooth multitasking performance. (Battery life was measured under specific test settings pursuant to video playback scenarios)
  • New AI Superpowers - Discover the power of Recall (preview), improved Windows search, and Click to Do (preview) on Copilot plus PCs. Effortlessly locate past content, perform natural searches, and interact with text and images – all while ensuring your data remains private and you stay productive. ( Copilot plus PC experiences vary by device and market and may require updates continuing to roll out through 2025; Recall and Click to Do will be coming to European Economic Area later in 2025; timing varies. See aka.ms/copilotpluspcs)
  • Indulge Your Eyes - Immerse yourself in a world of vibrant detail with a breathtaking 14" WUXGA 1920 x 1200 ultra high-resolution display. This expansive, panoramic screen is your canvas for entertainment, artistic creativity, and captivating AI experiences that will leave you in awe.
  • Smart and Effortless AI - Intelligent AI solutions are at your fingertips with AcerSense. Streamline settings, optimize your video presence, and elevate communication - all with intuitive AI that’s easy to use and enhances productivity seamlessly. Just press the AcerSense key on the backlit keyboard for instant access and experience the magic of AI
  • Style and Substance - The Aspire 14 Al boasts a sleek, durable, and lightweight aluminum chassis, with an ultra-modern design and a 180° lie-flat hinge for versatile and convenient use on the go. Ideal for work, study, or creative pursuits wherever you are.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How and where the systems ran

The reported laptop-side classifier runs used pretrained classifiers, Laya, and BART-large-mnli on a MacBook Pro with an M1 CPU. Qwen, Nemotron, Shieldstral, and DiffusionGemma ran through vLLM on GPU nodes with 96 GB of VRAM in a U.S. East Red Hat OpenShift Service on AWS cluster. Jev was called through TypeSafe’s API. The calls originated in the United Kingdom; Red Hat estimated that the transatlantic network hop added at least 56 ms per request.

Those details matter when interpreting the latency table. The numbers combine local CPU inference, GPU-hosted inference, an external API, and a cross-Atlantic connection; they are benchmark-specific measurements, not controlled comparisons on identical machines. They do not establish what response times a team will see on its own hardware, in another region, or with a different serving stack.

Rank #4
NIMO 15.6" FHD Copilot AI-Laptop, Intel 4 Cores, 16GB RAM, 512GB SSD Win 11
  • 【POWERFUL INTEL N150 CPU (UP TO 3.6GHZ)】 Powered by the 15W Intel Twin Lake N150 4-Core processor, this 15.6" laptop smoothly handles 20+ browser tabs and 1080P Zoom video calls simultaneously with zero lag. Ideal for college students and remote workers needing quiet, high-efficiency performance.
  • 【8-SEC FAST BOOT & LAG-FREE DAILY USE】 Pre-installed with Windows 11 Home, this laptop delivers lightning-fast 8-second boots and instant app launches. Built for 3-5 years of everyday stability, it easily runs online classes and office tasks without the annoying lag of cheap budget PCs.
  • 【16GB RAM + 512GB NVME SSD & EXPANDABLE】 Features 16GB DDR4 RAM and a huge 512GB M.2 NVMe SSD (up to 3500MB/s speed) for fast multitasking and file loading. Includes an expandable DDR4 SODIMM slot and a Micro SD slot supporting up to 1TB extra storage for 250,000+ media files.
  • 【15.6" FHD DISPLAY & 175° FLAT HINGE】 Features a crisp 15.6-inch 1920x1080 Full HD screen with an 85% screen-to-body ratio for sharp visuals. The 175° flat-lay hinge allows project teams and students to easily lay the screen flat and share documents across the table during group meetings.
  • 【USA FINAL ASSEMBLY & 2-YEAR WARRANTY】 Finalized and quality-tested in the USA for maximum reliability. Backed by an industry-leading 2-Year Manufacturer Warranty, 90-Day Hassle-Free Returns, and US-based customer service with fast 50-hour local replacement support for complete peace of mind.

When a small classifier is a sensible choice

The reported results support a task-dependent choice, not a universal winner. A compact classifier is a strong candidate when the risk is well defined and the team has enough labeled examples to train and validate it. A zero-shot decision model or an LLM judge may be worth its additional latency and cost when the policy is broader or there is no suitable task-specific classifier. Red Hat did not present decision models as replacements for LLM judges.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For a deployment decision, compare the options against the conditions that matter in your application:

  • Risk and policy breadth: Is the check for a narrow risk such as prompt injection, or a wider set of content rules?
  • Evaluation data: Do you have enough representative labeled examples to assess or train a specialized classifier?
  • Policy sensitivity: Does the model remain reliable when the policy wording changes or includes your actual definitions?
  • Deployment-path latency: Measure the full request path—including inference, network calls, and any guardrail orchestration—in the environment you plan to use.
  • Cost and language coverage: Account for serving or API costs, and validate performance in each language your users need.

The evaluation used English-language datasets. It does not establish that the results transfer to multilingual guardrails. The report also said Red Hat planned for both of its classifiers to become default guardrail configurations in OpenShift AI 3.6; that was a reported plan, not confirmation of their current release status.

What the result does—and does not—show

This benchmark shows that a roughly 200-million-parameter classifier can come close to a much larger LLM judge on one English-language prompt-injection accuracy test, with lower reported median latency under the tested setup. It does not show equivalent performance on content safety, other datasets, other languages, or every deployment path. The best choice depends on the risk being checked, policy wording, available data, and the infrastructure where the guardrail will run.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
PC Slower Than It Used to Be?Free scan - under a minute

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.