# Disallowing Certain Directories From All Robots User-Agent: * Disallow: /ads Disallow: /B Disallow: /cgi-bin Disallow: /images Disallow: /Module Disallow: /perldiver Disallow: /Pod2 Disallow: /webstats