User-agent: heritrix Disallow: / User-agent: webcrawler Disallow: / User-agent: 80bot Disallow: / User-agent: 008 Disallow: / User-agent: Yandex bot Disallow: / User-agent: http://www.uni-koblenz.de/~flocke/robot-info.txt Disallow: / User-agent: abby Disallow: / User-agent: AboutUsBot Disallow: / User-agent: ACONTBOT Disallow: / User-agent: Acoon-Robot Disallow: / User-agent: Advista Disallow: / User-agent: AMZNKAssocBot Disallow: / User-agent: Cabot Disallow: / User-agent: CazoodleBot Disallow: / User-agent: Charlotte Disallow: / User-agent: cityreview Disallow: / User-agent: CiZilla Disallow: / User-agent: DjangoTraineeBot Disallow: / User-agent: dotbot Disallow: / User-agent: Exabot Disallow: / User-agent: eventax Disallow: / User-agent: findlinks Disallow: / User-agent: FairShare Disallow: / User-agent: Gaisbot Disallow: / User-agent: Galbot Disallow: / User-agent: Gigabot Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: ia_archiver Disallow: / User-agent: ICCrawler Disallow: / User-agent: ICjobs Disallow: / User-agent: isara-search Disallow: / User-agent: Jyxobot Disallow: / User-agent: LapozzBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Mail.Ru Disallow: / User-agent: MJ12bot Disallow: / User-agent: MLBot Disallow: / User-agent: msnbot Disallow: / User-agent: Naverbot Disallow: / User-agent: Netluchs Disallow: / User-agent: Newskraft Disallow: / User-agent: Nutch Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: ScoutJet Disallow: / User-agent: semager Disallow: / User-agent: SeznamBot Disallow: / User-agent: Shelob Disallow: / User-agent: SI-BOT Disallow: / User-agent: Slurp Disallow: / User-agent: Snoopy Disallow: / User-agent: Speedy Disallow: / User-agent: suchbaer Disallow: / User-agent: technoratibot Disallow: / User-agent: Teoma Disallow: / User-agent: toplistbot Disallow: / User-Agent: trendictionbot Disallow: / User-agent: turnitinbot Disallow: / User-agent: Twiceler Disallow: / User-agent: Webalta Disallow: / User-agent: WebDataCentreBot Disallow: / User-agent: WebsiteWiki Disallow: / User-agent: websitewiki Disallow: / User-agent: yacybot Disallow: / User-agent: Yandex Disallow: / User-agent: yovadis Disallow: / User-agent: * Disallow: /impressum/ Disallow: /cgi-bin/ Disallow: /jobs/ Disallow: /murx/