# Robots.txt file for control of search engine spiders on http://www.base.com # # All robots will be treated the same User-Agent: * Allow: / Sitemap: http://www.base.com/sitemap_index.xml