Duplicate Content SEO

I used to think duplicate content meant a Google penalty. It does not. Google simply picks one version of a near-identical page to show in results — and it might be the wrong one from your perspective. Duplicate content is when the same or appreciably similar text exists at multiple URLs. For example, I once ran a site where the same blog post was accessible at /blog/post.html and /blog/post?ref=email. Google saw two URLs with matching text and chose the parameterised one, which had zero backlinks. That mistake cost that post six months of rankings.

The fix is straightforward: decide which URL should rank, then consolidate signals to it. If the duplicate has no reason to exist — like a printer-friendly version that is identical — use a [301 redirect](/301-redirect/) to send users and search engines to the preferred URL. If both versions must stay accessible, such as a mobile variant or a paginated series, use [rel=canonical](/canonical-tag/) to point to the original. One counter-argument I hear is that some duplicate content is intentional, like content syndication across partner sites. In that case, the syndicated version should carry a canonical tag pointing back to your original article.

The key is to stop Google guessing. You choose the URL. I cover the exact tools and checks in the sections below.

Duplicate content becomes a practical problem when it interferes with your ranking and crawl efficiency. The most common scenario I see is e-commerce sites with product pages accessible via multiple URLs: /product?colour=red, /product?size=large, /product?material=cotton. Each parameter creates a new URL, but the underlying product description is identical. I audited a fashion site last year that had 120 duplicate URLs for one pair of shoes. Google indexed only the ?colour=red variant because it had a few backlinks, but the canonical product page they wanted to rank was the clean /product/ without parameters. We consolidated with 301s and ranking improved by 30% in two months.

Blogs with [pagination](/pagination/) also produce duplicates. /category/seo/page/2/ repeats much of /category/seo/page/3/. Google may treat them as separate pages. The rule I use now: canonical each paginated page to the first page of the series, or implement a view-all page if user experience allows.

Another real problem is www vs non-www and http vs https duplicates. If both versions remain live, search engines see duplicate content across the domain. The fix is a single [301 redirect strategy](/website-structure/) to your preferred domain.

Content syndication matters too. If your article appears on Medium or a news site, and you do not add a canonical tag back, Google may choose the syndicated version. I always require syndication partners to include a canonical link to my piece. For language variants, use [hreflang tags](/hreflang-tags/) — that is not duplicate content.

Finally, [robots.txt](/robots-txt/) blocking duplicates does not fix indexing; it just prevents crawling. Use canonicalisation or redirects instead.

I have made three significant mistakes with duplicate content.

First, I spent years believing duplicate content triggered a manual penalty. It does not. Google Search Central states it is not a penalty issue. However, I still saw rank drops because Google consolidated signals to the wrong URL. A client's homepage lost 70% of its authority when Google chose http://example.com over https://example.com after a migration. A 301 would have fixed it.

Second, I used rel=canonical on pages that should have been 301 redirected. Early in my career, I added a canonical tag to printer-friendly pages, thinking it was safer than a redirect. Later, I learned that Google still crawls canonicalised pages, wasting crawl budget. If a page has no independent value, a 301 is cleaner. I now redirect printer versions, session IDs, and tracking parameters.

Third, I ignored URL parameters entirely. A consulting client had parameterised URLs from an old CMS. Google indexed ?session=1, ?session=2, and so on, each with the same content. Organic traffic dropped 40% in six months. I had to clean up with canonical tags and parameter handling in Search Console. Since then, I check parameter settings during every [SEO audit](/seo-audit/).

One more thing: I used to confuse noindex with canonicalisation. Noindex removes a URL from the index, but it does not consolidate signals. Canonicalisation passes ranking signals. If you want to keep a page but remove it from search, use noindex. If you want to consolidate authority, use canonical or redirect.