Eklenti etiketi: robots.txt
-
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots
-
Block Common Crawl via robots.txt
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
AI Scrape Protect
Protect your website from AI scraping by adding opt-out instructions to your robots.txt file and including meta tags in the HTML “ with this easy-to- …
-
-
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
ChatBot Blocker by CellarWeb
ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
Thin Content Manager
See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Check System Details
Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.
-
AI Deny
Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
A3 Robots Warning
Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.
-
AWP Disallow Root Control
Disallow access to the root directory via robots.txt with an option to enable or disable.
-
AI Rights Protection by SimpleFeed
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
Advanced SEO Toolkit
Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
