# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: * Disallow: /images/ Disallow: /mdb/ Disallow: /wedding/ Disallow: /dillon/ Disallow: /ermintrude/ Disallow: /humour/ Disallow: /eyesupply/ Disallow: /classicco