# Robot.txt set to disallow all crawlers from the entire server 11/14/01 # User-agent: * Disallow: / Disallow: /cgi-bin/ Disallow: /sportsplace.storefront/ Disallow: /trainingstore.storefront/ Disallow: /golfstore.storefront/ User-agent: Scooter Disallow: /