# Robots.txt file for http://www.straightrunning.com User-agent: ChangeDetection Disallow: / User-agent: psbot Disallow: / User-agent: ia_archiver Disallow: / User-agent: MJ12bot Disallow: / User-agent: Fatbot Disallow: / User-agent: baiduspider Disallow: / User-agent: dotbot Disallow: / User-agent: twiceler Disallow: / User-agent: * Crawl-delay: 30 Disallow: /cgi-bin/ Disallow: /cgi-perl/ Disallow: /perl/ Disallow: /code/ Disallow: /vrs/ Disallow: /images/ Disallow: /videos/ Disallow: /usage/ Disallow: /guestbook/ Disallow: /bannerfilter/ Disallow: /contacts/ Disallow: /cv/ Disallow: /bookshelf1/ Disallow: /functions/ Disallow: /XmingCode/ Disallow: /mail/ Disallow: /candidate/ Disallow: /order/ Disallow: /licenses/