# Application development making changes to help control robot crawler access. # Google User-agent: Googlebot Disallow: # MSN User-agent: MSNBot Disallow: # Yahoo User-agent: Slurp Disallow: # IU User-agent: iu-crawler Disallow: # Google Mini User-agent: gsa-crawler Disallow: User-agent: * Disallow: /