User-agent: * Disallow: Disallow: /cgi-bin/ # Blocking specific bad bots User-agent: Anthropic-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: FacebookBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: Image2dataset Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Omgilibot Disallow: / User-agent: Dataprovider Disallow: / User-agent: Dalvik/2.1.0 Disallow: / User-agent: Go-http-client Disallow: / User-agent: GoogleOther Disallow: / User-agent: IonCrawl Disallow: / User-agent: ISSCyberRiskCrawler Disallow: / User-agent: Java Disallow: / User-agent: Mozlila Disallow: / User-agent: Orbbot Disallow: / User-agent: python-requests Disallow: / User-agent: Scrapy Disallow: / User-agent: BW/1.1 Disallow: / User-agent: wp_is_mobile Disallow: / User-agent: ZoominfoBot Disallow: / # Blocking SEO Crawlers User-agent: AhrefsBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12Bot Disallow: / User-agent: SemrushBot Disallow: / # Blocking Security Scanners User-agent: CensysInspect Disallow: / User-agent: Expanse Disallow: / User-agent: internet-measurement Disallow: / # Blocking Search Engine Crawlers User-agent: PetalBot Disallow: / User-agent: Baidu Disallow: / User-agent: YandexBot Disallow: / User-agent: Seznam Disallow: / User-agent: Sogou Disallow: / User-agent: Cốc Cốc Disallow: / User-agent: DuckDuckBot Disallow: / # Blocking Other Bots and Scrapers User-agent: Medialogia Bot Disallow: / User-agent: HoneybadgerBot Disallow: / User-agent: Prerender Disallow: / User-agent: marketgoo Disallow: / User-agent: Botify Disallow: / User-agent: Siteimprove Crawl Disallow: / User-agent: AddThis Disallow: / # Blocking Old Browser Versions User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0) Disallow: / User-agent: Mozilla/5.0 (Windows NT 5.1; rv:2.0) Gecko/20100101 Firefox/4.0 Disallow: / Sitemap: https://www.leromlaw.com/sitemap.xml