# Robots.txt file for control of search engine spiders on http://www.gamblingexclusive.com # # All robots will be treated the same apart from the googlebot, where we are # able to exclude *.js, *.asp and *.css files. User-agent: * Disallow: /manager/ Disallow: /adsrv/ Disallow: /ssp_director/ Disallow: /assets/ Disallow: /users User-Agent: googlebot Disallow: /*.js$ Disallow: /*.css$ Sitemap: http://www.gamblingexclusive.com/sitemap.xml