User-agent: * Disallow: /resbook-form.asp* Disallow: /resbook-create.asp* Disallow: /resapplication-edit.asp* Disallow: /resbook*?*customsearch* Disallow: /admin/ User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot-CT Disallow: / User-agent: SemrushBot-BM Disallow: / User-agent: Baiduspider Disallow: / User-agent: AhrefsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Slurp Disallow: / User-agent: Yahoo! Slurp Disallow: / User-agent: Yahoo! Disallow: / User-agent: Yahoo Disallow: / User-agent: Findxbot Disallow: / User-agent: YandexBot Disallow: / User-agent: XoviBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: ltx71 Disallow: / User-agent: SiteExplorer Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: MegaIndex Disallow: / User-agent: netEstate Disallow: / User-agent: sqlmap Disallow: / User-agent: Siteimprove.com Disallow: / User-agent: LinkCheck by Siteimprove.com Disallow: / User-agent: Linguee Disallow: / User-agent: Linguee Bot Disallow: / User-agent: DomainCrawler Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: SJUUP Disallow: / User-agent: Exabot Disallow: / User-agent: GarlikCrawler Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: ZoominfoBot (zoominfobot at zoominfo dot com) Disallow: / User-agent: ZoominfoBot/Nutch-1.12-SNAPSHOT Disallow: / User-agent: Barkrowler Disallow: / User-agent: extensa Disallow: / User-agent: JobboerseBot Disallow: / User-agent: XING-contenttabreceiver Disallow: / User-agent: XING Disallow: / User-agent: contenttabreceiver Disallow: / User-agent: HostHarvest Disallow: / User-agent: Seekport Disallow: / User-agent: Seekport+Crawler Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: seocompany.store Disallow: / User-agent: seocompany Disallow: / User-agent: spider@seocompany.store Disallow: / User-agent: serpstatbot Disallow: / User-agent: SJUUPBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: TurnitinBot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: Sogou+web+spider Disallow: / User-agent: Sogou Disallow: / User-agent: CCBot Crawl-Delay: 10 User-agent: AlphaSeoBot Disallow: / User-agent: AlphaSeoBot-SA Disallow: / User-agent: Baiduspider Disallow: / User-agent: YisouSpider Disallow: / User-agent: Sogou+web+spider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: IstellaBot Disallow:/ User-agent: ltx71 - (http://ltx71.com/) Disallow: / User-agent: ltx71 Disallow: / User-agent : DAUM Disallow : / User-Agent: trendictionbot Disallow: / User-Agent: SearchAtlas Disallow: / User-Agent: SearchAtlas.com Disallow: / User-Agent: SearchAtlas.com SEO Crawler Disallow: / User-Agent: AccompanyBot Disallow: / User-Agent: AlphaBot Disallow: / User-Agent: Monsidobot Crawl-delay: 30 User-agent: BLEXBot Crawl-delay: 30 User-Agent: MJ12bot Disallow: / User-Agent: Nimbostratus Disallow: / User-Agent: Nimbostratus-Bot Disallow: / User-Agent: AhrefsBot Disallow: / Brugeragent: RU_Bot Disallow: / User-agent: PetalBot Disallow: / User-agent: Seekport Disallow: / User-agent: Seekport+Crawler Disallow: / User-agent: BLEXBot Disallow: /