Skip to content
Free Tab Toolsnothing uploaded

Runs in your browser · Last updated 4 September 2026

Robots.txt Checker — Test Paths in Your Browser

Free robots.txt checker. Paste a robots.txt and test any path for a user-agent — longest-match Allow/Disallow in your browser.

Blocked · Disallow: /

Parsed groups

  • *Allow / · Disallow /admin
  • GPTBotAllow — · Disallow /

How to use this tool

  1. Paste a robots.txt.
  2. Enter a user-agent and a path.
  3. Read Allowed/Blocked and the winning rule.

Worked example

The sample blocks GPTBot on every path and leaves * open except /admin. Testing GPTBot + /blog/hello should be Blocked. Testing Mozilla + /blog/hello should be Allowed.

Frequently asked questions

Do you fetch my live robots.txt?
No. Paste it. Fetching would be a backend. This keeps the tool private and cheap.
Which spec is this?
Google-style longest match. If Allow and Disallow are the same length, Allow wins.
Are wildcards supported?
Yes — * in a path and $ for end-of-path, which Google documents.
What if there is no matching group?
The path is allowed. That matches how crawlers treat an empty file.
Does this replace Search Console?
No. It is a local dry-run before you deploy.