# All robots will spider the domain User-agent:* Disallow: # Disallow directory /may05/ User-agent:* Disallow: /may05/