# Robots.txt file from http://www.dc18.com # All robots will spider the domain User-Agent: * Disallow: /blog/ Disallow: /zf/ Disallow: /esf/