User-agent: * Disallow: /cgibin/ Disallow: /pilot/ Disallow: /traffic/ Disallow: /hterror/ Disallow: /hterrors-global/ # http://info.webcrawler.com/mak/projects/robots/exclusion-admin.html