Robots.txt Generator
Build a clean robots.txt file with multi-rule sections for search engines and AI crawlers.
Lite-first: keep rule sets short, accurate, and focused on real crawler needs. For maximum visibility, keep important pages allowed and publish a sitemap.