Better Robots.txt – AI-Ready Crawl Control & Bot Governance

About this plugin

Better Robots.txt replaces the default WordPress robots.txt workflow with a smarter, structured version you can configure and preview before publishing. Instead of a blank textarea, you get a guided wizard with presets, plain-language explanations, and a final Review & Save step so you can inspect the generated robots.txt before it goes live. Built for beginners and advanced users alike, Better Robots.txt helps you control how search engines, AI crawlers, SEO tools, archive bots, bad bots, social preview bots, and other automated agents interact with your site. Trusted by thousands of Word...

Read the source

Browse every file in this release with syntax highlighting and a file tree, or link straight to a line. Older releases and trunk are available from the version switcher.