##################################################################### # CL Hurst Electric robots.txt file updated 2007-12-26 # ##################################################################### # # This robots.txt file is optimized for clhurstelectric.com Do not # simply plug this in and expect it to work. Read the robots # exclusion standard at http://www.robotstxt.org/wc/norobots.html # and understand your own file structure before you exclude robots # or you could accidentally prevent your site from being spidered # correctly or you could even prevent it from being spidered at all! # Some spiders are ill-behaved and will ignore this file! # # For all other robots and spiders User-agent: * ##################################################################### # Extended standards - these may or may not be used by some spiders # ##################################################################### # Sitemap based upon the Google standard Sitemap 0.9 Protocol Sitemap: http://clhurstelectric.com/sitemap.xml # CL Hurst Electric - use trailing slash # to exclude files below specified directory Disallow: /cgi-bin/