Duplicate Content
Duplicate content is the same or very similar content that appears at more than one URL, either on the same site or across different sites.
Start here
- Duplicate content is identical or very similar content at multiple URLs.
- It is not a penalty—search engines try to pick a canonical version.
- Common causes: URL parameters, www/non‑www, HTTP/HTTPS, printer-friendly pages, syndication.
- Fixes: 301 redirects, rel=canonical, or controlling indexing.
- For product pages, rewrite manufacturer descriptions to avoid duplicate product descriptions SEO issues.
For SEO, duplicate content can force search engines to choose which URL to index and rank, which can split signals and weaken visibility for the preferred page.
Example
- An e‑commerce site sells a blue T‑shirt in sizes S, M, L. Each size has its own URL (e.g.,
/blue-tshirt-s,/blue-tshirt-m,/blue-tshirt-l) but the product description is identical on all three pages. This is duplicate content. - A blog post appears at both
https://example.com/blog/postandhttps://example.com/blog/post?utm_source=twitter. The content is the same, but the URLs differ. - A manufacturer's product description is copied verbatim across 50 retailer sites. Each retailer has the same text on their product page.
When Should I Use This?
- You have multiple URLs serving the same or very similar content (e.g., paginated lists, printer-friendly versions, session IDs).
- You syndicate your content to other sites and want to avoid duplicate content issues.
- You run an e‑commerce site with many product variants that share descriptions.
- You are consolidating old and new URLs after a site migration or redesign.
What It Is Not
- Not a penalty: Google does not automatically penalize duplicate content; it tries to pick a canonical version.
- Not the same as thin content: Thin content is low-value or shallow, while duplicate content is identical or near-identical.
- Not always malicious: Most duplicate content is technical (URL parameters, www vs non‑www) or operational (syndication), not spam.
- Not fixed by noindex alone: Noindex tells search engines to ignore the page entirely, but the real issue is multiple indexable URLs competing for the same content.
Quick Start
- Crawl your site with a tool like Screaming Frog or Siteliner to find duplicate pages.
- Identify the preferred (canonical) URL for each set of duplicates.
- Choose a fix:
- Use a 301 redirect if the duplicate should permanently point to the canonical URL.
- Use a rel=canonical tag if both URLs should remain accessible but search engines should treat one as the original.
- Use noindex only if the page should not be indexed at all (e.g., printer-friendly versions).
- Update internal links to point to the canonical URL.
- Update your sitemap to include only the canonical URLs.
- Monitor in Google Search Console for any remaining duplicate issues.
Common Mistakes
- Treating all duplicate content as a penalty issue instead of a canonicalization and consolidation issue.
- Using noindex as the only fix when the real problem is multiple indexable URLs competing for the same page.
- Leaving duplicate product descriptions unchanged across many product or category pages.
- Forgetting to update internal links, sitemaps, and redirects after choosing a canonical URL.
Next step
Quick answers
Does duplicate content hurt SEO?
Duplicate content can dilute ranking signals and cause search engines to choose the wrong URL to index, but it is not a penalty. The fix is to consolidate duplicates using canonical tags or redirects.
What is the difference between duplicate content and thin content?
Duplicate content is identical or very similar content at multiple URLs. Thin content is low-quality or shallow content that provides little value. Both can harm SEO but require different fixes.
How do I find duplicate content on my site?
Use site crawlers like Screaming Frog or tools like Siteliner. Also check Google Search Console for duplicate URL issues.
Sources
Primary documentation is linked directly. Anything commercial is marked nofollow.
- Google Search Central — Primary guidance on consolidating duplicate URLs and choosing canonical versions.
- Google Search Central — Useful for distinguishing duplicate content issues from spam policies and manual-action concerns.
- Moz — Clear practical explanation of duplicate content causes, effects, and fixes.
Notes from Callum Bennett.