Hardware FixRecommendedDevice not working? Your driver may be the problemCheck updates for common hardware issues.Fix DriversOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsClean PCRecommendedOne scan can reveal what keeps slowing WindowsLook for cleanup and repair opportunities.Run Scan×
Skip to content
World desk4 min

How to Block Automated Traffic Without Locking Out Legitimate Users

Use graduated controls: block clearly unwanted automation, challenge ambiguous browser traffic, preserve known-good clients, and tune narrow rules against observed false positives.
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Use different controls for different levels of certainty: block clearly unwanted automation, challenge ambiguous browser traffic, and explicitly preserve expected APIs, partner clients, mobile apps, and verified crawlers. Start with narrow rules, then review security events and analytics for false positives before tightening enforcement.

Match the action to the confidence and client type

A single blanket rule can stop legitimate traffic along with bots. Choose a response based on how certain you are that a request is unwanted, how disruptive the control is, and whether the client can complete it.

As an Amazon Associate I earn from qualifying purchases.

Traffic or situation Practical response What to watch
Clearly automated and unwanted requests Block with a narrow rule; exclude verified or explicitly approved clients. Whether the rule matches only the intended paths and client class.
Likely automated browser requests Use a challenge, then review challenge outcomes and reports of access problems. Whether legitimate visitors are being interrupted or failing the challenge.
Expected API, partner, or mobile traffic Identify the route and client type explicitly; avoid browser-only checks or blanket blocks on that traffic. Whether the exception is limited to the routes and methods the client needs.
Excessive activity against a sensitive endpoint Apply an endpoint-specific rate limit, with a challenge at an earlier threshold where appropriate and a stricter response for persistent excess. Normal request patterns for that endpoint and the effect on legitimate bursts.
A legitimate client appears misclassified Inspect its request characteristics and make the smallest useful exception. Whether the IP address or fingerprint is shared with unrelated users.

Preserve known-good traffic before enforcing blocks

List the automation the service is meant to support: verified crawlers, API consumers, partner integrations, and other known clients. Make explicit exceptions for these clients before applying broader bot controls. Keep an exception as narrow as the client’s actual need—specific routes and methods are safer than a site-wide bypass.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Do not assume all legitimate clients behave like desktop browsers. Native mobile apps, APIs, partner integrations, and WebSocket connections may not run the JavaScript or complete the browser interaction expected by a browser-focused rule. Distinguish these request types before applying browser signals or challenges.

#1 Best Overall
Fortinet Web Application Firewall - Virtual Appliance for All Supported Platforms. Supports up to 2 x vCPU core FWB-VM02
  • Fortinet Web Application Firewall - virtual appliance for all supported platforms. Supports up to 2 x vCPU core
  • Fortinet HW FWB-VM02
  • Manufacturer Part: FWB-VM02

Block high-confidence bots and challenge uncertain browser traffic

When a platform provides a bot score, treat its labels and thresholds as vendor-specific signals, not universal definitions. Cloudflare’s documentation, for example, describes a score from 1 to 99, with 1 labeled definitely automated and 2–29 labeled likely automated. Its example blocks score 1 and uses a Managed Challenge for scores 2–29. These are Cloudflare examples; they are not recommended cutoffs for every site or security product.

The useful principle is graduated enforcement: reserve blocking for requests with strong evidence of unwanted automation, and challenge uncertain browser traffic rather than denying it outright. Review what happens after the challenge and adjust the rule if legitimate users are affected.

Rank #2
Fortinet Web Application Firewall - Virtual Appliance for All Supported Platforms. Supports up to 4 x vCPU core FWB-VM04
  • Fortinet Web Application Firewall - virtual appliance for all supported platforms. Supports up to 4 x vCPU core
  • Fortinet HW FWB-VM04
  • Manufacturer Part: FWB-VM04

Use JavaScript detection only where a browser can provide the signal

Cloudflare’s JavaScript-detection guidance says to apply the signal to browser traffic after an initial HTML request. It is not intended for first visits, native mobile applications, or WebSocket endpoints. Network problems, ad blockers, or disabled JavaScript can also prevent a successful signal, so a missing signal alone can misclassify a legitimate visitor.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For relevant browser rules, Cloudflare recommends Managed Challenge rather than treating the signal as an automatic reason to block. Its documentation states that the JavaScript-detection signal has a 15-minute lifespan. Check the current product documentation and applicable plan before relying on this behavior.

Rank #3
Fortinet Web Application Firewall - Virtual Appliance for All Supported Platforms. Supports up to 8 x vCPU core FWB-VM08
  • Fortinet Web Application Firewall - virtual appliance for all supported platforms. Supports up to 8 x vCPU core
  • Fortinet HW FWB-VM08
  • Manufacturer Part: FWB-VM08

Rate-limit sensitive routes according to their normal use

Bot classification is not the only way to reduce abuse. Repeated requests can create risk on particular endpoints even when the traffic is not confidently classified as automated. Set limits per endpoint using observed legitimate traffic, rather than copying a threshold from an example.

A staged response can make a limit less disruptive: challenge at an earlier threshold, then apply a stricter limit or block when excess activity persists. Cloudflare’s examples combine request rates with bot scores and session or fingerprint counting characteristics. Those examples illustrate possible configurations, not universal thresholds; tune each route to its own behavior.

Rank #4
Cisco Meraki MX100 Security Appliance, Firewall, GigE, 1U, Rack-Mountable
  • Meraki MX100: A building block for SASE in a rack-mountable form factor. Medium- to large-branch security and SD-WAN appliance for up to 500 users.
  • WAN: 1 x GbE RJ45, 1 x USB (cellular failover), Dual-purpose: 1 x GbE RJ45 +++ LAN: 8 x GbE RJ45, 2 x GbE SFP
  • Stateful firewall throughput: 750 Mbps +++ 500 Mbps site-to-site VPN throughput
  • Unified management for security, SD-WAN, Wi-Fi, switching, MDM, and IoT +++ Centralized management via web-based dashboard or API
  • True zero-touch provisioning +++ Smartphone-like firmware updates

Roll out rules in a way that exposes false positives

  1. Review traffic first. Identify expected clients, sensitive routes, and the normal request patterns for each route.
  2. Write a narrow rule. Target a particular path and client class rather than applying a broad rule across the site.
  3. Choose a proportionate action. Block only high-confidence unwanted automation; challenge uncertain browser traffic. Keep API and other non-browser clients out of browser-only checks.
  4. Inspect events and outcomes. Use security events and analytics to see which requests matched, whether challenges were completed, and whether legitimate traffic was interrupted.
  5. Adjust with evidence. Tighten, broaden, or add an exception only after reviewing the affected requests. If an IP address or fingerprint is involved, check whether legitimate users share it before excluding or blocking it.

Account for the interruption a challenge creates

An interstitial challenge holds a request and prevents the visitor from reaching the destination until the browser completes the check. That interruption may be acceptable for suspicious browser traffic but harmful on a critical user journey or incompatible with a non-browser client. Where a full-page interruption would cause problems, prefer a less disruptive or endpoint-specific control.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Keep exceptions as narrow as the evidence allows

If a legitimate client is incorrectly scored or challenged, inspect the request and identify what makes it distinct. Then exempt only the client’s required route, method, or other well-supported scope. Broad IP or fingerprint exceptions can affect other traffic that shares those identifiers, so verify their reach before relying on them.

Best Value
UDPTCP Firewall, Intelligent Soft Routing Micro Appliance/Fanless Mini PC • Celeron N2840, 2 x RJ45(1000M), USB 3.0,HDMI,VGA,NO RAM NO mSATA SSD (8GB RAM 256GB SSD)
  • ◆Powerful Celeron N2840 Processor: N2840 Processor, 2 Cores 2 Threads, 1M Cache, Max Turbo Frequency 2.58 GHz, TDP 7.5 W. Whether you need a robust home server, a versatile tool for school education, seamless web browsing, or even efficient business office or industrial tasks, providing efficient performance for everyday tasks.
  • ◆Dual 1000M LAN: Mini Router PC with 2*Realtek RTL8111H network card chip full UDE 1000M with filter connector.Soft Router can monitor network data, improve network security, powerful and widely used.
  • ◆DDR3L Memory & Large Storage Capacity: Firewall box computer with 1 x DDR3L SO-DIMM memory 1333/1600MHz, 1xMSATA3.0 SSD.
  • ◆UHD Graphics & 4K Dual Screen Display: N2840 processor integrated UHD Graphics, HD and VGA dual display interfaces support 4K@60Hz. 
  • ◆Versatile Connections ports: 2 x1000M Realtek RTL8111H-LAN,2 xUSB3.0, 4 xUSB2.0, HDMI,VGA,AUDIO supports data storage and system boot.Mini desktop computer with WIFI dual antenna, which providing high-speed transmission and reliable connectivity. Support Dual Band Wifi, Internet, streaming media and audio can be used perfectly without interrupting the connection. Enjoy faster file transfers and smoother online experiences.

Cloudflare’s published guidance is useful for understanding its own features, but it does not establish that Cloudflare is the right choice for every site or that its score thresholds apply elsewhere. The appropriate rules depend on endpoint behavior, legitimate automation, user geography and client mix, and observed false positives. Feature availability and behavior can change; verify the current documentation and your plan’s prerequisites before implementation.

Quick Recap

Bestseller No. 4
Cisco Meraki MX100 Security Appliance, Firewall, GigE, 1U, Rack-Mountable
Cisco Meraki MX100 Security Appliance, Firewall, GigE, 1U, Rack-Mountable
Stateful firewall throughput: 750 Mbps +++ 500 Mbps site-to-site VPN throughput; True zero-touch provisioning +++ Smartphone-like firmware updates
$344.00

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More from the Wire

  1. World desk4 min
    How to Spot an AI Voice Scam Before Sending MoneyDon’t rely on how a caller sounds. Pause, call back through a known number, and verify the emergency with another trusted person before sending money.
  2. Mountain View desk4 min
    Google’s SynthID Detector: How to Check AI-Generated Images, Video and AudioGoogle’s SynthID Detector looks for an embedded watermark in supported images, video and audio. Here is what its results do—and do not—show.
  3. Redmond desk20 min
    How to create a link to File or Folder in Windows 11Windows 11 gives you several ways to point to a file or folder without moving or duplicating it. You can create a desktop shortcut,…
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Crashes, No Sound, or Screen Glitches?Free driver scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.