CodeClerks

Free robots.txt file creator



Write the reason you're deleting this FAQ

Free robots.txt file creator

A robots.txt file will tell the search engine bot which pages it may or may not crawl on your site. For instance, if you are linking to download product pages, you can add these to the robots.txt file to ensure they are not indexed for search engines. You can create a free robots.txt file here.

http://www.mcanerin.com/EN/search-engine/robots-txt.asp

Comments

Please login or sign up to leave a comment

Join
Sean101
Here is a simple, easy to use Robots.txt Builder: http://www.seomind.net/tools/RoboGen/index.php



Are you sure you want to delete this post?