Sort URL Patterns by Crawl Treatment
Assign crawl and index treatments to recurring URL patterns on a large site.
Sort each URL pattern into the treatment that best matches its search value. Indexable canonical Canonicalize duplicate Block crawl waste Return not found /running-shoes/nike with inventory, demand, copy, and internal links /guides/crawl-budget with stable 200 content and internal links /product/123?utm_source=newsletter showing same product content /shoes?sort=popular showing same category products in different order /cart?sessionid=abc123 generated for every visit /shoes?color=lime&sort=price&page=19 with no unique search demand /boots?size=99 where the store has no such size and no results /events/2020-workshop with no replacement and intentionally retired pattern-treatment-grid url-chip-sort crawl-inventory-map
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in