Magento · 29 July 2026 · 10 min read
Technical SEO for large-catalogue stores
Layered navigation, duplicate content and crawl budget — the three problems that appear in any store above a few thousand products.
Under a thousand products, a store's technical SEO is more or less solved by the platform. Above ten thousand, it becomes the main problem — and the least visible one, because nothing looks broken.
Three things make the difference. We see them in nearly every audit of a large catalogue.
1. Layered navigation generates millions of URLs
You have a category with five filters, each with six values. The possible combinations pass tens of thousands of addresses very quickly — each with near-identical content, each eating into your crawl budget.
The result: Google spends time on ?colour=red&size=42&price=100-200 instead of recrawling the products that matter. And the good pages get indexed less often.
How it's solved
- Decide which filters deserve indexing. Usually very few: the ones with real search volume, for example “men's leather shoes”. The rest get blocked.
- `rel=canonical` to the base category for the combinations that shouldn't be indexed.
- `noindex, follow` on combinations that need crawling but not indexing.
- Block in `robots.txt` the parameters that don't change the content: sorting, display mode, products per page.
2. Duplicate content from variants
The same product in five colours, each with its own URL and the same description. From Google's point of view those are five pages competing with each other for the same query — and none of them wins clearly.
| Situation | What to do |
|---|---|
| Colour or size variants | One indexable configurable product, with the variants canonicalising to it. |
| The same product in several categories | One canonical address. On Magento, disable URLs that include the category path. |
| Supplier descriptions, identical to your competitors' | Rewrite at least the first 100 words on the products that matter. The rest of the catalogue can stay. |
| Pagination | Every page self-canonicalises. Don't canonicalise page 2 to page 1 — you lose indexing of the products that only appear there. |
3. Crawl budget
Google allocates every site a limited amount of crawling. On a store with 40,000 products, how you spend it decides what reaches the index and how quickly prices and stock update in results.
- A fast server gets more crawling. TTFB directly influences how many pages Google gets through per day — another reason performance isn't only about users.
- Remove from the sitemap the pages you don't want indexed. A sitemap is a recommendation, not an inventory list.
- Clear redirect chains. Every hop consumes budget.
- Fix internal 404s. A broken internal link sends the crawler into a wall.
- Internal link structure decides what's important. A product six clicks from the homepage is, to Google, an unimportant product.
If a product can't be reached in three clicks from the homepage, treat it as though it doesn't exist.
What to check, in order
- Compare discovered pages with indexed pages in Search Console. A large gap means wasted crawling.
- Crawl the site with Screaming Frog, capped at 50,000 URLs, and look at which address types dominate. If most of them carry parameters, you've found the problem.
- Check the coverage report for how many pages are “Crawled – currently not indexed”. That's the classic signal of thin or duplicate content.
- Measure click depth to your products. Above four, you have an architecture problem, not a content one.
- Check the structured data on products: price, availability, reviews.
Why it turns up more often on Magento
Not because Magento is weak at SEO — quite the opposite, it has the necessary tooling natively. It's because Magento stores are usually the ones with large catalogues and complex layered navigation. The same problems appear on PrestaShop or WooCommerce as the catalogue grows; there, only the control tooling is missing.
If you've just migrated or are about to, read how to avoid losing traffic in a migration too — the problems above amplify in exactly that period.
The next step
The three problems are solved in order of impact, not of ease. The audit sets the order; see what it covers on the SEO campaigns page, or look at the projects where we did SEO.