Robots.txt Generator
Build a valid robots.txt file to control how search engines crawl your site.
Why we built this
A malformed robots.txt can accidentally block search engines from your whole site. We built this so the syntax is generated correctly instead of hand-typed and hoped for.