What is deduplication?
Deduplication finds records that are the same person or the same event and merges or skips the extras. It is a data cleanup. Idempotency stops one event from being processed twice. Deduping cleans a list that already has twins.
Also called: dedupe
In plain English
The same buyer is in the CRM twice, once with a typo. An agent that emails the list will email them twice and may tell two different stories. Match on a stable id or on email plus phone, then decide which fields survive. Do not merge on first name. Duplicates are the same customer wearing two spellings. Decide the rule: same email is the same person, same phone is the same person, similar names are a maybe. Auto-merge only the sure ones. Send the maybes to a person with both records on screen. A bad merge combines two strangers and then your assistant emails the wrong history to both. Keep the loser record's id in a note on the winner. You will need it when a payment arrives addressed to the old row. Do not delete the loser until the books agree. Freeze merges late on Friday so a weekend payment does not hit a record you combined at dusk.
How an owner would use it
Clean the list before you connect an agent to it. Decide the match rule with someone who knows the customers. Keep a backup of the pre-merge export. Review merges. Unmerging is miserable.
Common mistakes
Auto-merging on a fuzzy name will combine two different people. Deduping inside the AI prompt instead of the CRM means the next export brings the twins back. Do not dedupe by asking a model 'are these the same human?' on a spreadsheet of strangers and accepting every yes.
A worked example
A two-person real estate team
One buyer, one follow-up
This is an illustration, not a customer result. Two contacts share a phone and a slightly different email. The team merges them, keeps the email the buyer actually replies from, and only then lets a draft follow-up run. The draft uses the single record's price range, which a person typed.
Related terms
Prompts and guides
Questions owners ask
What is deduplication?
Deduplication removes or merges duplicate records so a person or an automation acts on them once.
How do I dedupe before an AI follow-up?
Match on a stable id, email, or phone in the CRM. Review the merges. Point the assistant at the cleaned record only.
How is this different from idempotency?
Idempotency prevents one new event from being applied twice. Deduplication cleans duplicates that already exist in the data.
Product guides are on AI apps for business.