Objective

Today’s mission is to eliminate duplication - the silent saboteur of data quality.
Duplicate entries distort totals, inflate metrics, and create confusion across systems.
Your goal is to identify, merge, and validate unique records so every data point in your ecosystem has one single, trusted version of the truth.

Why This Matters

Duplicate data doesn’t just waste storage - it wastes time, trust, and money.
When your team operates from multiple versions of “the same” list, mistakes multiply: two emails to one client, two invoices for one job, or reports that don’t match.
By merging duplicates today, you’re removing friction from your future, and preparing your systems for accurate automation and AI training.

The Exercise

Step 1 - Focus on Your Core Lists (5 mins)

Start with your most important datasets:

• 📇 CRM contacts and clients
• 📧 Mailing lists or form submissions
• 📁 Project, task, or invoice records
• 🏷️ Vendor or supplier lists

These are the areas where duplication tends to hurt the most.

Step 2 - Run a Duplicate Scan (10–15 mins)

Depending on where your data lives:

• 🟦 Google Sheets or Excel → Use Remove Duplicates or conditional formatting to highlight identical rows.
• 🟩 Airtable or Notion → Use filters or Group By to cluster similar entries.
• 🟧 CRMs (HubSpot, Capsule, etc.) → Run the built-in duplicate detection tool or export data for manual review.

Look for duplicates based on:

• 👤 Names, emails, or company names
• 🔢 IDs or invoice numbers
• 📅 Dates or unique identifiers

Step 3 - Merge or Archive (10 mins)

For each duplicate found, decide whether to:

• ✅ Merge – Combine the most accurate, complete data into a single record.
• 🗂 Archive – Retain one copy and mark the rest as archived or inactive.
• ❌ Delete – Remove exact duplicates or irrelevant records.

If uncertain, tag as “Pending Review” and move on - don’t get stuck debating.

Step 4 - Document Your Rules (Optional)

Record your approach in your Data Handling Notes:

• ✍️ How do you define a “duplicate”?
• 👥 Who approves deletions or merges?
• 🔁 How will this process be repeated monthly or quarterly?

This turns a one-time cleanup into a repeatable standard.