# See http://www.robotstxt.org/wc/norobots.html for documentation # # # # User-agent: Fasterfox Disallow: / # #User-agent: wiceler #Disallow: / # User-agent: psbot Disallow: / # User-agent: ia_archiver Disallow: / # User-agent: SurveyBot Disallow: / # #User-agent: Googlebot-Image #Disallow: /photos/ # per google.com webmasters page. User-agent: * Disallow: /secure/ Disallow: /happy/ Crawl-delay: 5 ##