Block AI Crawlers

Protect Your Content from AI Scraping

This plugin helps you prevent AI crawlers from using your content as training data for their products. By updating your site’s robots.txt, it blocks common AI crawlers and scrapers, aiming to protect your content from being used in the training of Large Language Models (LLMs).

Features

Blocks AI Crawlers

Includes:

  • OpenAI – Blocks crawlers used for ChatGPT
  • Google – Blocks crawlers used by Google’s Gemini AI products
  • Facebook / Meta – Used for Facebook’s AI training
  • Anthropic AI – Blocks crawlers used by Anthropic
  • Perplexity – Block crawlers used by Perplexity
  • Applebot – Blocks crawlers used by Apple
  • … and more!

Experimental Meta Tags

The plugin adds the “noai, noimageai” directive to your site’s meta tags, instructing AI bots not to use your content in their datasets. Please note that these tags are experimental and have not been standardized.

Custom robots.txt Rules

Have custom entries for your robots.txt file? You can now add them directly through the plugin!

Usage

After activation, the plugin will automatically update your robots.txt and add the necessary meta tags. No further configuration is required, but you can check the settings page for a full list of blocked crawlers.

Limitations

While this plugin aims to block specified crawlers, it cannot guarantee complete protection against all forms of scraping, as some bots may disregard robots.txt directives.

Support

For questions or support, please post on the forums or on GitHub.

  1. Download the plugin zip file.
  2. Go to your WordPress admin panel.
  3. Navigate to Plugins > Add New > Upload Plugin.
  4. Choose the zip file and click “Install Now.”
  5. Activate the plugin.1. Activate the plugin through the ‘Plugins’ menu in WordPress
  6. Once installed the plugin is automatically activated. There are no user configured settings
  7. You can view more about what crawlers are being blocked at “Settings > Block AI Crawlers”

سوالات متداول

Will this remove my site from existing data sets?

Unfortunately, no. However, it does tell bots that your site shouldn’t be used for future datasets.

How does this work?

The plugin adds directives to the robots.txt file to tell AI crawlers that they shouldn’t index your site. It also adds the noai meta tag to your site’s header to do the same.

How often is this updated?

I try to keep up with new crawlers and update the block list regularly.

Can I suggest crawlers for blocking?

Yes! please share suggestions on the forums or on GitHub.

What if I already have a `robots.txt` file on my web server?

If you have a physical robots.txt file on your web server, you won’t be able to activate this plugin. The plugin only works when using WordPress’ built-in virtual robots.txt.

Will this work with other plugins that modify the virtual `robots.txt`?

It should in theory. It just appends the directives to the robots.txt file.

Will this prevent my site from being indexed by search engines?

No. Search engines follow different robots.txt rules.

×
نظری برای این آیتم موجود نیست.
0 0 رای ها
امتیازدهی
اشتراک در
اطلاع از
0 نظرات
قدیمی‌ترین
تازه‌ترین بیشترین رأی
بازخورد (Feedback) های اینلاین
مشاهده همه دیدگاه ها
نسخه حجم فایل SHA256 تغییرات دانلود
1.5.6 12 کیلوبایت -
دانلود
×
★★★★★
★★★★★
4.8 /5 (5 نظر)

قیمت:

رایگان

نگارش

1.5.6

آخرین انتشار

13 اردیبهشت 1405

آخرین بروزرسانی

2 ماه پیش

نصب های فعال

1,000+

نگارش وردپرس

وردپرس 6.8+

تست شده از نسخه

وردپرس 6.9.4

نگارش PHP

PHP 8.2+

نسخه ها

1 نسخه