A text file which tells search engines which can be used to control the actions of search engine spiders and/or deny access to specific files.

This entry was posted on Thursday, August 27th, 2009 at 12:51 pm and is filed under SEO. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.