Robots.txt Generator & Directives Builder
Create custom robots.txt directives to instruct search engine bots on which directories to index or disallow.
Generated Robots.txt
What is a Robots.txt File?
A robots.txt file is a plain text file located at the root directory of your website (e.g. yoursite.com/robots.txt). It informs web robots (crawlers) which areas of your site should not be visited or indexed.
Frequently Asked Questions
Upload it directly to your primary public root directory (e.g. /public_html/robots.txt).