Every hour, day and night, bots visit your website that aren't there to buy anything. They look at your product pages, note your prices exactly, then leave to feed that data into a competitor's system. It's called AI price scraping, and it's probably happening on your site right now. If you've found this post by searching "how to stop AI agent price scraping on my website," you already know what it's like: you set a new price, and within hours your competitor is a dollar lower — across every product, automatically.
What AI Price Scraping Actually Costs You
First, it destroys your pricing power. Scraping isn't new, but AI agents have made it cheap and constant. In the past, a competitor might have paid someone to check your site weekly. Now, a bot does it hourly. Your discounts, your sales, your backup pricing — all visible in near real-time. You are effectively telling your competitors your strategy before your own customers even see it.
Second, it costs real money in server fees and performance. A single AI agent can load your entire catalog dozens of times a night. That's bandwidth you pay for. That's database requests that slow your site down for the paying visitors you actually want. Slow sites lose sales, lose search rankings, and drive customers to faster competitors.
Third, scrapers often break things. Some aggressive crawlers end up taking actions regular users take — filling carts, submitting forms — which can trigger security alerts, lockouts, and a flood of junk in your records. You end up doing IT work instead of running your business.
How to Stop AI Agent Price Scraping on Your Website — The Real Fix
Most advice about how to stop AI agent price scraping on your website is wrong. You'll read about "robots.txt," a text file that tells polite bots to leave. Here's the honest explanation: it's a note on your door, not a lock. Google's bot respects it. The scrapers who are copying your prices don't even read it. So a robots.txt edit doesn't actually stop anyone who's determined.
The real fix is to stop those visitors before they reach your website, with a cloud service called Cloudflare. Cloudflare works like a guard at your front gate. Every single visitor — human or bot — has to pass through it first. Cloudflare checks their ID, and if their name or behavior looks like a known scraper, they never reach your store at all. Real customers pass through and barely notice. And Cloudflare's free plan has genuinely powerful features that are exactly right for stopping AI price scrapers.
The best part: because Cloudflare protects the gate rather than your specific software, it works for WordPress, WooCommerce, Shopify, Squarespace, and even completely custom-built stores. One standard interface, one set of steps, no matter what your website is built on.
The Step-by-Step: Cloudflare's Free Tier Works With Any Website
Here's the exact path, in the exact order.
Step 1 — Create a free Cloudflare account. Go to cloudflare.com, sign up with your email, and choose the Free plan when asked.
Step 2 — Add your website. Enter your domain name (like yourstore.com) into Cloudflare, and it will show you two "nameserver" addresses. Nameservers are just location labels that tell the internet where your site lives. Then, log in at the company where you bought your domain (GoDaddy, Namecheap, 1&1, etc.), find "My Domains" or "DNS Settings," and replace your old nameservers with the two Cloudflare gave you. It sounds scary, but Cloudflare's setup wizard walks you through it step by step.
Step 3 — Turn on Bot Fight Mode. Inside Cloudflare, click "Security" in the left menu, then "Bots." Toggle "Bot Fight Mode" to On. This is a real, automatic shield that detects and blocks automated visitors, including most AI crawlers. It's the closest thing to a free "turn it off" switch for scraping.
Step 4 — Block the specific AI crawlers by name. In the same left menu, click "Security," then "WAF," then "Custom Rules," and click "Create Rule." Name it "Block AI scrapers." For the field, choose "User Agent" — think of that as the official name badge bots wear. Choose "contains" as the operator. In the value box, type: GPTBot. Then click "Or" to add another condition, and repeat for each of these names: ClaudeBot, Amazonbot, PerplexityBot, Bytespider, CCBot, Google-Extended. Those are the real names of the major AI scrapers — you're simply writing a "do not admit" list. Finally, set the action to "Block" and click "Deploy."
Step 5 — Check that it worked. A few days later, click "Analytics" then "Security" in Cloudflare. You'll see a chart of blocked requests. Most store owners who do this are surprised — often hundreds of bot requests get stopped in the first week.
That's the complete, working fix for most businesses. It takes about 30 minutes to an hour, it's free, and you can undo every step if you change your mind.
What If My Site Isn't Built on WordPress?
The steps above don't change. Cloudflare sits in front of your site regardless of what's behind it. Shopify, Wix, Squarespace, WooCommerce, custom-built — the exact same Cloudflare dashboard, the exact same steps, the exact same results.
The only thing that might differ is Step 2, where you change your nameservers. Every domain registrar puts that setting in a slightly different place, but the label is always some version of "DNS" or "Nameservers." Your registrar's own help pages can point you to the right spot in minutes.
And if anyone tells you to just "add a plugin to block scrapers," be cautious. Plugins work only inside your website software, and most of them do a slower, worse version of what that Cloudflare step already did. The guard belongs at the gate — and Cloudflare is the gate.
When the Basics Aren't Enough
If you complete all five steps and your prices are still being mirrored by competitors, or your site still crawls, then the scrapers aiming at you are sophisticated enough to get past the standard shield. Solutions from this point get much more custom: analyzing server logs to find suspicious IP addresses, adding stricter rules for high-frequency visitors, or implementing a challenge that stops bots from disguising themselves. The exact menus and settings depend heavily on your hosting setup and how your store is built — there isn't one universal path I could honestly hand you without seeing it.
If you followed the steps above and it's still broken, or you'd rather not spend an hour poking at settings yourself, that's exactly when DevCev Digital can help — one conversation, and the leak gets found for real.