User-agent: * Disallow: /admin/ Disallow: /documents/*.html$ Disallow: /documents/*.htm$ Sitemap: http://www.bigbetworld.com/sitemap.xml.gz