User-agent: duoding crawler Disallow: / User-agent: netEstate NE Crawler Disallow: / User-agent: noopsis Spider Disallow: / User-agent: ptd-crawler Disallow: / User-agent: robot Disallow: / User-agent: robots Disallow: / User-agent: spbot Disallow: / User-agent: spider Disallow: / User-agent: zlspider Disallow: / User-agent: MSR-ISRCCrawler Disallow: / User-agent: MSNBOT-MOBILE Disallow: / User-agent: LocoySpider Disallow: / User-agent: GazoPabot Disallow: / User-agent: GGSafe Spider Disallow: / User-agent: Flight Deck Bot Disallow: / User-agent: CCBot Disallow: / User-agent: librabot Disallow: / User-agent: msnbot-media Disallow: / User-agent: ia_archiver Disallow: / User-agent: eybaospider Disallow: / User-agent: com sitemap robot Disallow: / User-agent: ZmlsZW5hbWU9UG93ZXJ3b3JkMjAwOVByby4zNjc3Mi4wLmV4ZS Disallow: / User-agent: ZmlsZW5hbWU9UG93ZXJ3b3JkMjAwOVByby4yNTI2OS40MDExLm Disallow: / User-agent: HuaweiSymantec spider Disallow: / User-agent: E-Crawler Disallow: / User-agent: Huaweisymantecspider Disallow: / User-agent: Tasapspider Disallow: / User-agent: baiduspider-cpro Disallow: / User-agent: askpeter_bot Disallow: / User-agent: SurveyBot Disallow: / User-agent: Speedy Spider Disallow: / User-agent: SheenBot Disallow: / User-agent: Search17Bot Disallow: / User-agent: S2Bot Disallow: / User-agent: QunarBot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: MLBot Disallow: / User-agent: Exabot Disallow: / User-agent: EuripBot Disallow: / User-agent: AISearchBot Disallow: / User-agent: 0JJJSpider Disallow: / User-agent: Gaisbot Disallow: / User-agent: Gigabot Disallow: / User-agent: CamontSpider Disallow: / User-agent: DotBot Disallow: / User-agent: ZmlsZW5hbWU9UG93ZXJ3b3JkMjAwOU94Zi4zOTc5Ny4wLmV4ZS Disallow: / User-agent: aiHitBot Disallow: / User-agent: bot Disallow: / User-agent: botje Disallow: / User-agent: com_bot Disallow: / User-agent: crawler Disallow: / User-agent: LolongBot Disallow: / User-agent: betaBot Disallow: / User-agent: PWeBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: QihooBot Disallow: / User-agent: CollapsarWEB qihoobot Disallow: / # # robots.txt # User-agent: * Allow: / Disallow: /templates/ Disallow: /images/thumb/ Disallow: /ajax.php? Disallow: /admin.php?