Guide to the robots.txt file - How to follow the Google webmaster guidelines
If you do not want to use the tool above, you can check from any browser. The robots.txt file is always located in the same place on any website, so it is easy to determine if a site has one. Just add "/robots.txt" to the end of a domain name as shown bel...