# Where robots can't go # This is a bad robot = ipfw.gsa.crawler # I have told all agents no access 09/29/2006 as a test. cft # I have opened the site up for agents again 05/23/2007 cft User-agent: * Disallow: /argast/ Disallow: /_borders/ Disallow: /cgi-bin_old/ Disallow: /cgi-bin/ Disallow: /control/ Disallow: /crow/ Disallow: /docs/ Disallow: /geo/GeoServ/ Disallow: /geo/reports/ Disallow: /geo/special/ Disallow: /geo/tennisc/ Disallow: /geo/www2/ Disallow: /CVS/ Disallow: /download/ Disallow: /farlow/ Disallow: /images/ Disallow: /inventory/ Disallow: /isiorho/ Disallow: /manual/ Disallow: /protogeo/ Disallow: /scripts/ Disallow: /styles/ Disallow: /tennisc/ Disallow: /usage/ Disallow: /xfer/