# $Id$ # robots.txt RFC: http://www.robotstxt.org/wc/norobots-rfc.html # Validated by http://www.searchengineworld.com/cgi-bin/robotcheck.cgi User-agent: * Crawl-delay: 2000 Disallow: /articlemanage/ Disallow: /newarticle/ Disallow: /RegionalChannel/ Disallow: /smbarticlemanage/ Disallow: /mceo/ Disallow: /register/ Disallow: /servlet/ Disallow: /js/