🤖 Robots.txt Generator

Easily generate a standard robots.txt file to configure how search engine bots crawl your directories.

Default All Robots Are:

Crawl-Delay (Seconds)

Sitemap XML URL (Optional)

Restricted Directories (Disallow)

Paths that search engines should not scan (e.g. /cgi-bin/ or /admin/).

Generated `robots.txt`