Etiqueta del Plugin: robots.txt
-
Block eCommerce Assets via robots.txt
(0 evaluación total)Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Check Search Engine Visibility on Migration
(1 evaluación total)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Forge AI Bot Log – Block AI Bots, Crawler Detection & Verification
(0 evaluación total)Detect, verify and block AI crawlers, bots and scrapers. Vendor IP lists and reverse-DNS checks flag spoofed user agents, not trust them.
-
Unblock CSS & JS for Googlebot
(0 evaluación total)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 evaluación total)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Block Common Crawl via robots.txt
(0 evaluación total)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 evaluación total)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
AI Deny
(1 evaluación total)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Block Feed and Comments via robots.txt
(0 evaluación total)Blocks some Feed and Comment resources in order to avoid spam bots
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 evaluación total)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
ProAI TXT Manager for LLMS and Robots
(1 evaluación total)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
ChatBot Blocker by CellarWeb
(0 evaluación total)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
LJPL Armored robots.txt
(0 evaluación total)Add some directives to your robots.txt file to keep your site safer
-
HumanGate
(0 evaluación total)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
Thin Content Manager
(1 evaluación total)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Mephivio Robots LLMs
(0 evaluación total)Generates llms.txt, llms-full.txt, JSON-LD and robots.txt discovery files for AI agents and search crawlers, without promising ranking gains.
-
Robots.txt Extender
(0 evaluación total)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
GoBookMart Robots Editor
(1 evaluación total)A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
Softglaze AI Crawler Monitor
(0 evaluación total)See which AI crawlers request pages on your site, choose what each one is told, and check whether it took any notice.
-
SEO & AI Readiness Check
(0 evaluación total)See what search engines and AI crawlers find on your site: titles, meta, H1, schema, sitemap, GPTBot access and llms.txt. No account needed.