# this file directs web crawlers to avoid certain areas| * = all crawlers User-agent: * Disallow: /awstats/ Disallow: /private/ Disallow: /css/ Disallow: /common/ Disallow: /holding/ Disallow: /working images/