User-agent: * Crawl-delay: 1 Disallow: /_ Disallow: /cgi-bin/ Disallow: /do/ Disallow: /*?*rf= Disallow: /_cpanel Disallow: /cgi-bin/suppliers/ Disallow: /_mycart Disallow: /_myacct