# All robots will spider the domain User-agent: * Disallow: /album/ Disallow: /me_naked Disallow: /private_stuff #yahoo will search it at min 30 s User-agent: Slurp Crawl-delay: 30