Free robots.txt file creator

Beverly Level X³

0

November 8, 2013, 12:05 pm

2

Free robots.txt file creator

A robots.txt file will tell the search engine bot which pages it may or may not crawl on your site. For instance, if you are linking to download product pages, you can add these to the robots.txt file to ensure they are not indexed for search engines. You can create a free robots.txt file here.

http://www.mcanerin.com/EN/search-engine/robots-txt.asp

Comments

Please login or sign up to leave a comment

Join

Sean101

Here is a simple, easy to use Robots.txt Builder: http://www.seomind.net/tools/RoboGen/index.php

0 11 years ago

---

Select a reason you're reporting this comment Cyberbullying and Harassment Threats to Personal Safety Hate Speech Sexually Explicit Content Breach of User Privacy Illegal Service/Offer Spam Scam

Or

Submit

---

Are you sure you want to delete this post?

Delete

Post Comment

Cancel Edit