Runs in your browser · Last updated 4 September 2026
Robots.txt Generator — Block GPTBot
Generate a robots.txt that blocks GPTBot, ChatGPT-User, Google-Extended, and other AI crawlers.
User-agent: * Allow: / User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / Sitemap: https://example.com/sitemap.xml
How to use this tool
- Tick the AI crawlers you want to refuse.
- Leave * allowed unless you really want a private site.
- Copy robots.txt to the domain root.
- Recheck in the robots.txt checker with user-agent GPTBot.
Why this page exists
“robots.txt generator block gptbot” is a 2026 query with weak SERPs. A generic generator buries the AI toggles. This URL is the preset. After you block training crawlers, use the llms.txt generator to list docs you still want assistants to quote.
Frequently asked questions
- Does blocking GPTBot hide me from ChatGPT answers?
- It opts you out of OpenAI training (GPTBot) and browsing (ChatGPT-User). Ranking in Google is a different crawler.
- What is Google-Extended?
- Gemini / Vertex training. It is not Googlebot. You can block Extended and still appear in Search.
- Should I also block CCBot?
- If you do not want Common Crawl (and models that train on it). The checkbox is off by default.
- Will this block Googlebot?
- Not if you leave “Keep User-agent: * allowed” on.
- Is this uploaded?
- No.