# ============================================================== # -------------------------------------------------------------- # Block aggressive SEO / scraper bots that ignore crawl budgets #updated 13/07/2026 # -------------------------------------------------------------- User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / # -------------------------------------------------------------- # Rules for all other crawlers # -------------------------------------------------------------- User-agent: * # --- SFRA search & faceted navigation --- Disallow: /search?* Disallow: /*/search?* Disallow: */search?q=* # Sorting / ordering parameters Disallow: /*?srule= Disallow: /*&srule= # Facet / filter parameters Disallow: /*?facet_colour= Disallow: /*&facet_colour= Disallow: /*?size= Disallow: /*&size= Disallow: /*?prefn*= Disallow: /*&prefn*= Disallow: /*?prefv*= Disallow: /*&prefv*= # --- SFRA Product controller AJAX actions --- Disallow: /*Product-ShowQuickView Disallow: */Search-UpdateGrid* # --- Salesforce Commerce Cloud internal pipeline / store URLs --- # Crawl delay — be polite to the origin server Crawl-delay: 10 # -------------------------------------------------------------- # Sitemaps — one per site # -------------------------------------------------------------- Sitemap: https://www.barbour.com/us/sitemap_index.xml Sitemap: https://www.barbour.com/gb/sitemap_index.xml Sitemap: https://www.barbour.com/de/sitemap_index.xml Sitemap: https://www.barbour.com/it/sitemap_index.xml Sitemap: https://www.barbour.com/row/sitemap_index.xml