# Robots.txt to do exclusions. User-agent: * Disallow: /cgi-bin/ Disallow: /manager/ Disallow: /admanager/ Disallow: /adverts/ Disallow: /temp/ Disallow: /Mailshots/