This Tool helps you make confident, intentional choices about how AI systems can use your website. Whether you want maximum visibility in AI search or firm opt-outs from AI training, you’ve got switches—not scripts. One click, clear results. No guesswork.

What this plugin does

• Manages your AI policy where bots look first: robots.txt (dynamic or physical).
• Gives you presets for common goals (e.g., “AI Search Allowed, Training Blocked”).
• Lets you fine-tune per bot (allow/deny specific AI user-agents).
• Optionally sends X-Robots-Tag headers (noai, noimageai) for extra clarity.
• Verifies behavior (simulate UA access on any path) and logs visits from known AI bots.
• Generates server snippets (Apache/Nginx/Cloudflare) if you want blocking at the edge.
• Ships a REST ping endpoint you can hit from anywhere to see how a path+UA would be treated.
• Manages a physical robots.txt with one-click backups, restore, and safe updates.
• Accessible UI with colorblind-friendly & high-contrast themes.
• Import/Export settings as JSON to replicate configurations.

Who it’s for

• Site owners who want a simple, trustworthy way to be “AI-ready.”
• Agencies that need repeatable, auditable policies across many sites.
• Admins who prefer UI controls to editing server configs at 2 AM.

 

 

Individual bot guidance (Allow vs Block)

Here’s when allowing vs blocking can be beneficial. Remember: robots.txt is a policy signal—compliant bots will follow it.

• OAI-SearchBot(Allow)
  • Helps your content be discoverable inside ChatGPT’s browsing results (link previews, citations).
  • Benefit: Presence in AI-assisted search experiences.
• ChatGPT-User(Allow)
  • Fetches pages when a ChatGPT user opens your link.
  • Benefit: Ensures end-users can actually view your content from within the app.
• PerplexityBot(Usually Allow)
  • Used by Perplexity AI for summaries and search.
  • Benefit: Visibility in a popular AI search engine.
• GPTBot(Often Block)
  • Used for training models (not for basic link discovery).
  • Benefit of Block: Respectful opt-out from training datasets.
  • Allow only if you intentionally want to contribute to training.
• Google-Extended(Often Block)
  • Google’s “data usage control” UA for AI features/training.
  • Benefit of Block: Opt-out signal for training/use in certain AI features.
• Applebot-Extended(Often Block)
  • Apple’s AI data usage control.
  • Benefit of Block: Opt-out signal for Apple’s AI usage.
• CCBot (Common Crawl)(Often Block)
  • Powers large public crawls used by many researchers and potentially training datasets.
  • Benefit of Block: Reduces inclusion in broad open datasets.

 

 

How to get it?

• Very soon you will see the basic version (FREE) in the wordpress directory and you will be able to purchase the commercial version directly from this website. 

---