Skip to main content
AmPuH Sign in
Switch toolrobots.txt tester

Tags and markup

Meta tag generator Meta tag analyser JSON-LD generator Structured data validator Social card proof Hreflang generator

Structure and content

Slug generator Heading outline checker Image alt auditor Link and anchor auditor Duplicate URL finder

Files and rules

robots.txt builder robots.txt tester Robots directive decoder Sitemap XML generator Sitemap validator Redirect rule generator Security header builder

Tool 13

robots.txt tester

Paste a robots.txt and a path, and see which rule decides it and why that rule wins.

These generators run in your browser, so they need JavaScript enabled. Everything explained on this page is still readable without it.

Nothing is sent anywhere. Reload to clear.

Longest match wins, not first match

This is the rule almost every guide gets wrong. A crawler does not read top to bottom and stop: it collects every rule that matches your path, then obeys the longest one. Allow: /search/label/ therefore beats Disallow: /search even though it comes after it. On an exact tie in length, Allow wins.

Pulled proof · The verdict

Paste a robots.txt and a path.

Every rule that matched
  • Rules that match your path will be listed here, with the winner marked.

Also in files and rules

All 18 tools