Loading…
Build a robots.txt with Sitemap directives and common Allow/Disallow rules — including toggles for GPTBot and CCBot. Runs entirely in your browser.
User-agent: * Disallow: /admin Disallow: /cgi-bin Allow: / Sitemap: https://example.com/sitemap.xml