# FULL access (Alta Vista) User-agent: Scooter Disallow: /client_access/ Disallow: /common/ Disallow: /r/ Disallow: /sitemap/ # FULL access (FAST/AllTheWeb) User-agent: FAST-WebCrawler Disallow: /client_access/ Disallow: /common/ Disallow: /r/ Disallow: /sitemap/ # FULL access (Google) User-agent: Googlebot Disallow: /client_access/ Disallow: /common/ Disallow: /r/ Disallow: /sitemap/ # FULL access (Inktomi) User-agent: Slurp Disallow: /client_access/ Disallow: /common/ Disallow: /r/ Disallow: /sitemap/ # FULL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: /client_access/ Disallow: /common/ Disallow: /r/ Disallow: /sitemap/ # FULL access (All Spiders) User-agent: * Disallow: