Near-duplicates split your effort across pages that should be one. A 3,000-row export collapsed to 1,840 unique targets.
— Step 1: lowercase, trim, strip plurals and stop words
— Step 2: sort by SERP overlap, not by string match
— Step 3: merge terms sharing 4+ top-10 URLs ▇▇▇ caught 38% of dupes
— Step 4: keep the highest-volume variant as the canonical target
— Step 5: log the merged variants as secondary terms, don't delete
3,000 to 1,840: a 39% reduction. The so what: string de-dup alone caught only 21%; SERP overlap nearly doubled it by catching synonyms.
Benchmark of the week: real exports carry 30 to 40% functional duplicates.
Keyword Lab Numbers
@KeywordLabNumbers
De-duplicate a messy keyword export, ordered correctly
This post was published in the Telegram channel Keyword Lab Numbers (@KeywordLabNumbers). All its posts are on the channel page.
Open on Telegram