Free robots.txt file creator

Free robots.txt file creator

A robots.txt file will tell the search engine bot which pages it may or may not crawl on your site. For instance, if you are linking to download product pages, you can add these to the robots.txt file to ensure they are not indexed for search engines. You can create a free robots.txt file here.

http://www.mcanerin.com/EN/search-engine/robots-txt.asp