User-agent: grub-client Disallow: / User-agent: EmailCollector Disallow: / User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy Disallow: / User-agent: * # directed to all spiders, not just Scooter Disallow: /_private/ Disallow: /adserver/ Disallow: /banner/ Disallow: /cgi-bin/ Disallow: /cover/ Disallow: /cs-guide/ Disallow: /Excite/ Disallow: /guide/ Disallow: /images/ Disallow: /jobs/ Disallow: /presse/ Disallow: /shop/ Disallow: /system/ Disallow: /tomatissimo/ Disallow: /medianews/