← All SEO tools

Crawl control

Robots.txt Generator

Set crawl rules for your website and include the location of your XML sitemap.

Enter one path per line. Leave empty to allow all paths.

Generated rules apply to all user agents. Review them before publishing.

Your robots.txt