User-agent: * # -------------------------------------------------------------------- # 1. COOPERATIVE RENDERING RULES (Fixes Resource Crawl Recommendation) # -------------------------------------------------------------------- # Explicitly ensures that CSS, JS, and image types can always be crawled, # overriding any accidental downstream blocks. Allow: /*.js$ Allow: /*.css$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.jpeg$ Allow: /*.webp$ Allow: /*.svg$ Allow: /*.pdf$ # -------------------------------------------------------------------- # 2. ALLOW PUBLIC CONTENT DIRECTORIES # -------------------------------------------------------------------- Allow: /products/ (changes based on site) Allow: /learning/ (changes based on site) # -------------------------------------------------------------------- # 3. DISALLOW HUBSPOT SYSTEM & PREVIEW PATHS # -------------------------------------------------------------------- Disallow: /_hcms/ Disallow: /hs/ Disallow: /preview/ Disallow: /__hs_preview/ Disallow: /*?*hs_preview=* Disallow: /*?*hsCacheBuster=* # -------------------------------------------------------------------- # 4. DISALLOW INTERNAL SEARCH & MARKETING TOOLS # -------------------------------------------------------------------- Disallow: /hs-search Disallow: /email/ Disallow: /meetings/ # -------------------------------------------------------------------- # 5. DISALLOW LOW-VALUE / DUPLICATE ORGANIC PAGES # -------------------------------------------------------------------- # Keeps your crawl budget focused on core landing pages and blog posts # rather than infinite tag/author combinations. Disallow: /topic/ Disallow: /tag/ Disallow: /tags/ Disallow: /author/ Disallow: /authors/ # -------------------------------------------------------------------- # XML SITEMAP # -------------------------------------------------------------------- Sitemap: https://www.laffertyequipment.com/sitemap.xml Disallow: /_hcms/preview/ Disallow: /hs/manage-preferences/ Disallow: /hs/preferences-center/