User-agent: * Disallow: /admin/ Disallow: /bms/admin/ Disallow: /cgi-bin/ Disallow: /crawltrack/ Disallow: /counter/ Disallow: /freecounter/ Disallow: /inc/ Disallow: /include/ Disallow: /news/ Disallow: /pagepeel/ Disallow: /password Disallow: /stats/ Disallow: /sys/ Disallow: /system/ Disallow: /user/ Disallow: /wp-out Disallow: /webtools/ Disallow: /xandra/ User-agent: Nutch Disallow: / User-agent: ICCrawler - iCjobs Disallow: / User-agent: jobs.de- Robot Disallow: / User-agent: ia_archiver Disallow: / User-agent: ia_archiver/1.6 Disallow: / User-agent: Twisted PageGetter Disallow: / User-agent: spbot Disallow: / Sitemap:http://www.dayforday.info/sitemaps.xml