robots.txt - Google
User-agent: * Disallow: /search Allow: /search/about Disallow: /sdch Disallow: /groups Disallow: /catalogs Allow: /catalogs ... /chromecast/setup$ Allow: /chromecast/setup/$ Sitemap: http://www.gstatic.com/culturalinstitute/sitemaps/www_google_com .xml .....