# This robots.txt file has been created to prevent all robots from "walking" your website. # Go to http://www.searchengineworld.com/misc/robots_txt_crawl.htm for more information. User-agent: Googlebot Disallow:/cgi-bin/ Disallow:/webmail/ Disallow:/logs/ Disallow:/OLD site/ Allow: User-agent: Slurp Disallow:/cgi-bin/ Disallow:/webmail/ Disallow:/logs/ Disallow:/OLD site/ Allow: User-agent: * Disallow:/cgi-bin/ Disallow:/webmail/ Disallow:/logs Disallow:/OLD site/ Disallow: /