# All robots will spider the domain User-agent: * Disallow: # Disallow directory /images/ User-agent: * Disallow: /images/ # Disallow directory /common/ User-agent: * Disallow: /common/ # Disallow directory /styles/ User-agent: * Disallow: /styles/ # Disallow directory /restricted/ User-agent: * Disallow: /restricted/ # Disallow directory /restricted/ User-agent: * Disallow: /download1/ # Disallow directory /restricted/ User-agent: * Disallow: /Webinars/