# directed to all spiders, not just Scooter User-agent: * Disallow: /admin/ Disallow: /cgi-local/ Disallow: /alpha/ Disallow: /bin/ Disallow: /etc/ Disallow: /images/ Disallow: /lib/ Disallow: /mysql13/ Disallow: /POP/ Disallow: /pop/ Disallow: /press/ Disallow: /shopping/ Disallow: /stats/