A robots.txt file will tell the search engine bot which pages it may or may not crawl on your site. For instance, if you are linking to download product pages, you can add these to the robots.txt file to ensure they are not indexed for search engines. You can create a free robots.txt file here.
Here is a simple, easy to use Robots.txt Builder: http://www.seomind.net/tools/RoboGen/index.phpHere is a simple, easy to use Robots.txt Builder: [url]http://www.seomind.net/tools/RoboGen/index.php[/url]
Sean101
Are you sure you want to delete this post?