AI bots
Some of our expert tips on preventing (AI) scrapers getting your content.
AI scraping and republishing website content has become an escalating concern, infiltrating online platforms and diminishing originality. At The Admin Academy, we understand the detrimental impact this trend can have on your brand’s integrity and credibility.
That’s why we provide you with expert tips and solutions to safeguard your valuable content against unwanted AI bots. Our dedicated team is committed to creating a secure admin resource space for WordPress & WooCommerce, ensuring that your unique voice and offerings remain protected. Let’s get started to combat the rising challenge of AI scraping, so you can focus on delivering exceptional experiences to your audience.
Fortunately, knowing what UA (User Agent) to block, you can add this Nginx rule to your server block:
This rule checks the User-Agent header of the incoming HTTP request for any of the listed bot names. If any of them are found, it returns a 403 Forbidden status, effectively blocking the request. Make sure to place this rule within the appropriate server block in your Nginx configuration file.
After making changes, remember to test your configuration with nginx -t and then reload Nginx to apply the changes.
It will block the following bots and their respective UA’s:
– OmigiliBot
– GPTBot
– Google-Extended (Bard/Gemini)
– FacebookBot
– ChatGPT-User
– CCBot
– anthropic-ai
This information as of November 17th, 2023 is up-to-date, but may change. I will try to keep this list updated as much as I can.