#subject all bots to this ruleset User-agent: * #define which pages are off limits #disallow versions of page currently out of use: Disallow: /v1.5/ Disallow: /v2.5/ #disallow other dirs Disallow: /PcaExpress/ Disallow: /sitechecker/ Disallow: /stats/ Disallow: /cgi-bin/ Disallow: /announcer/ Disallow: /logs/ Disallow: /private/ Disallow: /secure/ Disallow: /secure-cgi-bin/ #disallow v2.0 pages with email adresses Disallow: /v2.0/people.htm Disallow: /v2.0/home.htm #disallow v2.5 pages with email adresses Diasllow: /v2.5/contact/