LEYUN · SITE LAUNCH CHECKLIST独立站上线自查清单库

Duplicate Content Risk Review

Sections: Crawl & Indexing · Reviewed: 2026-11-21 · 12 items

Key takeawayOne product can exist at a dozen addresses because of host name, parameters, pagination and language versions, and the system must pick one to show. This sheet works from URL layer to page layer to content layer, consolidating what should merge and separating what should not.

Industries and use cases

  • Standardising URLs before a new site launches
  • After product variants and language versions multiply
  • When indexed pages far exceed the real page count
  • When a campaign landing page closely mirrors an existing page

Checklist

Checklist: duplicate content risk review
Check itemPass criteriaRisk levelFix hint
Protocol and host formOnly one canonical version of http or https and www or non-www is keptHigh301 the other three to the canonical version so content is not split four ways.
Trailing slashOne form with or without the trailing slash is kept and the other redirectsMediumHandle it at server level and keep template links in one style.
Case conventionPaths are lowercase and case variants 301 to the lowercase addressMediumThis matters most on case-sensitive servers, so add rewrite rules.
Parameter combinationsSort, filter and tracking parameters do not create indexable pagesHighCanonicalise or restrict combinations with no standalone value.
PaginationPaginated pages canonical to themselves and are not forced to page oneMediumLater pages carry different items, so pointing them at page one hides them from indexing.
Product variantsColour and size variants merge on the main product page or carry unique descriptionsHighMerge variants that differ only by parameter so dozens of near-duplicates do not compete.
Language and regionEach language version canonicals to itself and is separated by language annotationHighCross-language canonicals remove non-primary versions from display entirely.
Print and plain text viewsPrint or plain text pages are noindexed or canonical to the main articleLowThese pages add no standalone value and need not be indexed separately.
Aggregation and tag pagesThin tag, author and archive pages are restricted or mergedMediumKeep pages with real aggregation value and consolidate the rest.
Self canonicalNormal pages canonical to their own URL without gaps or cross-page targetsHighOutput at template level and spot check source after a redesign.
Body duplicationBody text overlap between pages on the same site stays below 30%MediumDo not paste supplier copy wholesale; add application notes and parameter explanations.
Cross-site copiesContent mirrored to other domains does not remain indexedMediumHandle mirrors with canonical signals and direct contact before filing complaints.

Common misjudgements

  • Assuming two identical pages are both duplicates, when one is correctly canonicalised or redirected and only one participates in the index.
  • Canonicalising every paginated page to page one, which removes the chance for page two and beyond to be crawled.
  • Canonicalising across language versions: translated content differs, so cross-language canonicals are a configuration error, not deduplication.

How to use this checklist

  • Pair with the hreflang sheet: language versions are separated by annotation, not merged by canonical.
  • Run when a product line or variants are added and do a full quarterly scan.
  • Link with the redirect sheet, since redirects are one deduplication method.

FAQ

How similar does content have to be to count as duplicate?
There is no published threshold; the test is whether a page offers standalone value, not a similarity ratio.
Should canonical or 301 be used?
Use a 301 when the old address is retired; use canonical when both addresses must stay reachable.
Is duplicate content penalised?
Usually not; the system picks one version to show and filters the other.
Version notes2026-11-21: first release, compiled from official Google documentation and public sources; updated as engine rules and regulations change.

If you prefer not to verify each item yourself, a pre-checked B2B template site package is available as an alternative.

Note: this checklist is a self-check reference only. Search-engine behaviour and regulations follow the latest official documentation of each provider and jurisdiction.