# Disallow all web spiders from all parts of the site
User-agent: *
Disallow: /