Robots.txt Generator
Generate robots.txt rules.
Configure rules
Add Crawl Rule
Active Crawl Rules (2)
UA: * DISALLOW /admin/
UA: * ALLOW /
Add Sitemap
Active Sitemaps (1)
https://example.com/sitemap.xml
Generated robots.txt
Related Tools
UTM Builder
Runs locally
Generate UTM-tagged URLs.
CSP Builder
Runs locally
Build Content-Security-Policy header safely.
CORS Header Builder
Runs locally
Build/explain CORS headers.
Cookie Parser
Runs locally
Parse Cookie and Set-Cookie headers.
Schema.org JSON-LD Generator
Runs locally
Generate common JSON-LD snippets.