Runs in your browser · Last updated 4 September 2026
Robots.txt Checker — Test Paths in Your Browser
Free robots.txt checker. Paste a robots.txt and test any path for a user-agent — longest-match Allow/Disallow in your browser.
Blocked · Disallow: /
Parsed groups
- *Allow / · Disallow /admin
- GPTBotAllow — · Disallow /
How to use this tool
- Paste a robots.txt.
- Enter a user-agent and a path.
- Read Allowed/Blocked and the winning rule.
Worked example
The sample blocks GPTBot on every path and leaves * open except /admin. Testing GPTBot + /blog/hello should be Blocked. Testing Mozilla + /blog/hello should be Allowed.
Frequently asked questions
- Do you fetch my live robots.txt?
- No. Paste it. Fetching would be a backend. This keeps the tool private and cheap.
- Which spec is this?
- Google-style longest match. If Allow and Disallow are the same length, Allow wins.
- Are wildcards supported?
- Yes — * in a path and $ for end-of-path, which Google documents.
- What if there is no matching group?
- The path is allowed. That matches how crawlers treat an empty file.
- Does this replace Search Console?
- No. It is a local dry-run before you deploy.