Duplicate content: find the copies search has to reconcile

Separate copies from useful repetition

A repeated phone number or a shared disclaimer is not duplicate content in any practical sense. The problem is two indexable URLs whose main answer, title, and intent are the same.

Common sources are print versions, tag archives, HTTP and HTTPS twins, trailing-slash pairs, and location pages that swap a district name and nothing else.

• Crawl the site and group URLs with near-identical titles.
• Check parameters that do not change the document.
• Compare language versions only if they are literal copies.

Choose a canonical home for the answer

Keep the URL you want cited and linked. Redirect exact copies. Use a canonical link only when both URLs must remain reachable and one is clearly the preferred version.

Canonical tags are a hint. They will not rescue a set of location pages that have no unique information. Those need real differences or consolidation.

Stop the template from minting new copies

If a CMS creates a filtered URL, a campaign parameter, or a tag page by default, block the pattern at the source. A one-off canonical does not fix a template that publishes a new duplicate tomorrow.

After cleanup, request indexing for the preferred URL and watch whether the copies drop out of the index over the next crawls.

Does duplicate content cause a penalty?

Search usually filters copies rather than punishing the site. The cost is split signals, wasted crawl, and the wrong URL showing in results.

When should a canonical tag be used instead of a redirect?

Use a redirect for exact duplicates that do not need to stay in the browser. Use a canonical when a variant must remain reachable, such as a tracked or print view of the same document.