How to Create a Robots.txt File - Bing Webmaster Tools
Learn how to create a robots.txt file for your website and tell crawlers exactly what the are allowed to access. ... Note You cannot list multiple content references in one line, so you’ll need to create a new Disallow: directive for each pattern to be bl...