Robots.txt Generator
Create a properly formatted robots.txt file to control how search engines crawl your website
Use * to apply rules to all search engine bots, or specify a bot name
Enter paths that should not be crawled by search engines
Time in seconds between successive crawler requests