# /robots.txt file for http://webcrawler.com/ # mail george at bickner.net for constructive criticism User-agent: * #Disallow: /cms