User-agent: * Disallow: /cgi-bin/ Disallow: /gfx/ Disallow: /wwwstat/ Disallow: /codes/ Disallow: /forum/ Disallow: *.gif$ Disallow: *.jpg$ Disallow: *.pdf$ Disallow: *.png$ Disallow: /cgi-bin/ Disallow: /gfx/ Disallow: /postads/ Disallow: /css/ Disallow: /survey/ Disallow: /postclient/gfx/ Disallow: /postnews/gfx/ Disallow: /postnews/postsearch/ Disallow: /postpgs/ Disallow: /postextras/gfx/ Disallow: /postextras/cladgfx/ Disallow: /postgallery/ Disallow: /postforum/ Disallow: /postschools/kermit/gfx/ Disallow: /postschools/wink/gfx/ User-agent: TwengaBot Disallow: / User-agent: aiHitBot Disallow: / User-agent: DBLBot Disallow: / User-agent: WebReaper Disallow: / User-agent: BPImageWalker Disallow: / User-agent: Exabot Disallow: *.gif$ User-agent: Exabot Disallow: *.jpg$ User-agent: Exabot Disallow: *.pdf$ User-agent: Exabot Disallow: *.png$ User-agent: Exabot-Images Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: msnbot-media Disallow: / User-agent: ccbot Disallow: / User-agent: kalooga Disallow: / User-agent: DKIMRepBot/1.0 Disallow: / User-agent: SimilarPages Disallow: / User-agent: dotbot Disallow: / User-agent: Jyxobot Disallow: / User-agent: CatchBot Disallow: / User-agent: discobot Disallow: / User-agent: Charlotte/1.0b Disallow: / User-agent: CazoodleBot Disallow: / User-agent: ilial Disallow: / User-agent: LocalcomBot Disallow: / User-Agent: OmniExplorer_Bot Disallow: / User-agent: asterias Disallow: / User-agent: Fatbot Disallow: / User-Agent: NetResearchServer Disallow: / User-agent: BDFetch Disallow: / User-agent: MJ12bot Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: Faxobot/1.0 Disallow: / User-agent: pompos Disallow: / User-agent: Jetbot/1.0 Disallow: / User-agent: kuloko-bot Disallow: / User-agent: dloader(NaverRobot)/1.5 Disallow: / User-agent: Gaisbot/3.0 Disallow: / User-agent: Zao Disallow: / User-agent: NutchOrg Disallow: / User-agent: Nutch Disallow: / User-agent: NPBot Disallow: / User-agent: Steeler Disallow: / User-agent: FusionBot Disallow: / User-agent: metacarta Disallow: / User-agent: szukacz Disallow: / User-agent: moget/2.1 Disallow: / User-agent: Mercator-2.0 Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: bumblebee/1.0 Disallow: / User-agent: LinkWalker Disallow: / User-agent: BaiDuSpider Disallow: / User-agent: grub-client Disallow: / User-agent: Openbot Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: DiaGem Disallow: / User-agent: psbot Disallow: / User-agent: NICErsPRO Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Crescent Internet ToolPak Disallow: / User-agent: CherryPicker Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailWolf Disallow: / User-agent: WebBandit Disallow: / User-agent: eCatch Disallow: / User-agent: cyveillance Disallow: / User-agent: Indy Library Disallow: / User-agent: heritrix/1.6.0 Disallow: /