Switch toolRobots directive decoder
Tool 14
Robots directive decoder
Paste your robots directives and read back exactly what they permit and forbid.
These generators run in your browser, so they need JavaScript enabled. Everything explained on this page is still readable without it.
Nothing is sent anywhere. Reload to clear.
A noindex on a blocked page is never read
This is the trap that keeps unwanted pages in Google. A crawler has to fetch the page to see
the directive, so if robots.txt disallows it, the noindex might as
well not be there. Check the path in the
robots.txt tester first, and leave it crawlable.
- Paste something to check.
Nothing read yet
The findings will be listed above.