User-agent: * Crawl-delay: 20 Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /events/ User-Agent: bingbot Disallow: /tag/ User-agent: 8 Disallow: / User-agent: 80legs Disallow: / User-agent: A6-Indexer Disallow: / User-agent: ABACHOBot Disallow: / User-agent: Aboundexbot Disallow: / User-agent: Accoona-AI-Agent Disallow: / User-agent: AddSugarSpiderBot Disallow: / User-agent: ADmantX Disallow: / User-agent: AhrefsBot Disallow: / User-agent: amaya Disallow: / User-agent: AnyApexBot Disallow: / User-agent: appie Disallow: / User-agent: Arachmo Disallow: / User-agent: BecomeBot Disallow: / User-agent: BeslistBot Disallow: / User-agent: BillyBobBot Disallow: / User-agent: Bimbot Disallow: / User-agent: BlitzBOT Disallow: / User-agent: B-l-i-t-z-B-O-T Disallow: / User-agent: BLP_bbot Disallow: / User-agent: boithocom-dc Disallow: / User-agent: boithocom-robot Disallow: / User-agent: btbot Disallow: / User-agent: Casterly Disallow: / User-agent: CatchBot Disallow: / User-agent: CerberianDrtrs Disallow: / User-agent: Charlotte Disallow: / User-agent: CMRadar Disallow: / User-agent: ContextAdBot Disallow: / User-agent: Contiki Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: CorenSearchBot Disallow: / User-agent: cosmos Disallow: / User-agent: CovarioIDS Disallow: / User-agent: CPython Disallow: / User-agent: Cutbot Disallow: / User-agent: DataparkSearch Disallow: / User-agent: DeepnetExplorer Disallow: / User-agent: DiamondBot Disallow: / User-agent: Discobot Disallow: / User-agent: Dispatch Disallow: / User-agent: Dotbot Disallow: / User-agent: Emacs Disallow: / User-agent: Embedly Disallow: / User-agent: EmeraldShieldcomWebBot Disallow: / User-agent: envolk[ITS]spider Disallow: / User-agent: EsperanzaBot Disallow: / User-agent: Exabot Disallow: / User-agent: exabot Disallow: / User-agent: Ezooms Disallow: / User-agent: FDSErobot Disallow: / User-agent: FindLinks Disallow: / User-agent: Firefly Disallow: / User-agent: fr-crawler/1.1 Disallow: / User-agent: fr_crawler Disallow: / User-agent: FTRF Disallow: / User-agent: FyberSpider Disallow: / User-agent: g2crawler Disallow: / User-agent: Gaisbot Disallow: / User-agent: GalaxyBot Disallow: / User-agent: GarlikCrawler Disallow: / User-agent: genieBot Disallow: / User-agent: GermCrawler Disallow: / User-agent: Girafabot Disallow: / User-agent: Grapeshot Disallow: / User-agent: GurujiBot Disallow: / User-agent: HappyFunBot Disallow: / User-agent: heritrix Disallow: / User-agent: hl_ftien_spider Disallow: / User-agent: Holmes Disallow: / User-agent: htdig Disallow: / User-agent: iaskspider Disallow: / User-agent: IBrowse Disallow: / User-agent: ICAP-IOD Disallow: / User-agent: iCCrawler Disallow: / User-agent: ICEBrowser Disallow: / User-agent: ichiro Disallow: / User-agent: igdeSpyder Disallow: / User-agent: imspider Disallow: / User-agent: Instapaper Disallow: / User-agent: IRLbot Disallow: / User-agent: IssueCrawler Disallow: / User-agent: JaxifiedBot Disallow: / User-agent: Jyxobot Disallow: / User-agent: KoepaBot Disallow: / User-agent: LapozzBot Disallow: / User-agent: Larbin Disallow: / User-agent: LDSpider Disallow: / User-agent: LexxeBot Disallow: / User-agent: libwww-perl Disallow: / User-agent: Liferea Disallow: / User-agent: lindex Disallow: / User-agent: LinexBot Disallow: / User-agent: LinexBot Disallow: / User-agent: LingueeBot Disallow: / User-agent: LinkWalker Disallow: / User-agent: lmspider Disallow: / User-agent: Lwebis Disallow: / User-agent: lwp-trivial Disallow: / User-agent: Lynx Disallow: / User-agent: mabontland Disallow: / User-agent: MailRU Disallow: / User-agent: magpie-crawler Disallow: / User-agent: MaxPointCrawler Disallow: / User-agent: Mercury Disallow: / User-agent: MetaURI Disallow: / User-agent: MJ12bot Disallow: / User-agent: Mnogosearch Disallow: / User-agent: mogimogi Disallow: / User-agent: MojeekBot Disallow: / User-agent: MSRBot Disallow: / User-agent: MVAClient Disallow: / User-agent: mxbot Disallow: / User-agent: NationalDirectory Disallow: / User-agent: naver Disallow: / User-agent: netEstate Disallow: / User-agent: NetResearchServer Disallow: / User-agent: NetSeerCrawler Disallow: / User-agent: NG-Search Disallow: / User-agent: nicebot Disallow: / User-agent: Ning Disallow: / User-agent: noxtrumbot Disallow: / User-agent: NusearchSpider Disallow: / User-agent: NutchCVS Disallow: / User-agent: Nymesis Disallow: / User-agent: oegp Disallow: / User-agent: omgilibot Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: OOZBOT Disallow: / User-agent: OpenHoseBot Disallow: / User-agent: Orbiter Disallow: / User-agent: PageBitesHyperBot Disallow: / User-agent: pagespeed Disallow: / User-agent: PaperLiBot Disallow: / User-agent: Papers Disallow: / User-agent: Peew Disallow: / User-agent: PercolateCrawler Disallow: / User-agent: photon Disallow: / User-agent: PHPbot Disallow: / User-agent: polybot Disallow: / User-agent: Pompos Disallow: / User-agent: PostPost Disallow: / User-agent: Prismatic Disallow: / User-agent: proximic Disallow: / User-agent: Psbot Disallow: / User-agent: PulseCrawler Disallow: / User-agent: PycURL Disallow: / User-agent: python-requests Disallow: / User-agent: Qseero Disallow: / User-agent: QuerySeekerSpider Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: rabaz Disallow: / User-agent: Radian6 Disallow: / User-agent: RAMPyBot Disallow: / User-agent: Rankivabot Disallow: / User-agent: RebelMouse Disallow: / User-agent: rogerbot Disallow: / User-agent: RufusBot Disallow: / User-agent: SandCrawler Disallow: / User-agent: SBIder Disallow: / User-agent: Scooter Disallow: / User-agent: ScoutJet Disallow: / User-agent: ScreenerBot Disallow: / User-agent: Scrubby Disallow: / User-agent: Search4Free Disallow: / User-agent: SearchSight Disallow: / User-agent: Seekbot Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: SEOChat::Bot Disallow: / User-agent: Seznam Disallow: / User-agent: SeznamBot Disallow: / User-agent: Shim-Crawler Disallow: / User-agent: ShopWiki Disallow: / User-agent: Shoularobot Disallow: / User-agent: ShowyouBot Disallow: / User-agent: silk Disallow: / User-agent: SimpleCrawler Disallow: / User-agent: sistrix Disallow: / User-agent: Sitebot Disallow: / User-agent: SkimBot Disallow: / User-agent: Snappy Disallow: / User-agent: sogouspider Disallow: / User-agent: Sogouwebspider Disallow: / User-agent: Sosospider Disallow: / User-agent: Spade Disallow: / User-agent: spbot Disallow: / User-agent: SpeedySpider Disallow: / User-agent: Sqworm Disallow: / User-agent: squirrobot Disallow: / User-agent: SSL-Crawler Disallow: / User-agent: StackRambler Disallow: / User-agent: suggybot Disallow: / User-agent: SurveyBot Disallow: / User-agent: SynooBot Disallow: / User-agent: TechnoratiSnoop Disallow: / User-agent: TECNOSEEK Disallow: / User-agent: TerrawizBot Disallow: / User-agent: TheSuBot Disallow: / User-agent: ThumbnailCZrobot Disallow: / User-agent: TinEye Disallow: / User-agent: truwoGPS Disallow: / User-agent: TurnitinBot Disallow: / User-agent: TweetedTimesBot Disallow: / User-agent: TwengaBot Disallow: / User-agent: uMBot Disallow: / User-agent: updated Disallow: / User-agent: updown_tester Disallow: / User-agent: URL_Spider_SQL Disallow: / User-agent: Urlfilebot Disallow: / User-agent: Vagabondo Disallow: / User-agent: VoilaBot Disallow: / User-agent: Vortex Disallow: / User-agent: voyager Disallow: / User-agent: VYU2 Disallow: / User-agent: Wazzup Disallow: / User-agent: WebAltaCrawler Disallow: / User-agent: WebBug Disallow: / User-agent: webcheck Disallow: / User-agent: webcollage Disallow: / User-agent: WebFindBot Disallow: / User-agent: Websquashcom Disallow: / User-agent: WeSEE Disallow: / User-agent: wf84 Disallow: / User-agent: WoFindeIchRobot Disallow: / User-agent: WomlpeFactory Disallow: / User-agent: Xaldon_WebSpider Disallow: / User-agent: xChaos_Arachne Disallow: / User-agent: XenuLinkSleuth Disallow: / User-agent: yacy Disallow: / User-agent: Yasaklibot Disallow: / User-agent: Yeti Disallow: / User-agent: YodaoBot Disallow: / User-agent: yoogliFetchAgent Disallow: / User-agent: YoudaoBot Disallow: / User-agent: Zao Disallow: / User-agent: Zealbot Disallow: / User-agent: zspider Disallow: / User-agent: Zumbot Disallow: / User-agent: ZyBorg Disallow: /