# Robots.txt file from http://taokeline.com # All robots will spider the domain User-agent: * Disallow: /404.htm Disallow: /d/ Disallow: /e/admin/ Disallow: /e/class/ Disallow: /e/data/ Disallow: /e/enews/ Disallow: /e/tool/gfen/ Disallow: /e/update/