How to use
- Drop an
.xlsx,.csvor.tsvfile, or paste cells copied from Excel. This page opens with the Remove duplicates step already added. - Choose the key columns. Rows whose values are equal in all chosen columns count as duplicates. If you choose none, every column must match.
- Decide whether to ignore case and leading/trailing spaces, which row to keep (first or last), and what to do with duplicates.
- Check the row count (
before N → after M) and the step report (Removed 2 duplicate rows) in the result preview, then download as xlsx, csv or json.
Modes
| Mode | Result |
|---|---|
| Remove | Deletes the extra rows and keeps one |
| Only duplicates | Keeps every row whose key appears more than once (including the first) and drops the rest |
| Mark column | Adds a “Duplicate” column without deleting: blank for the row you keep, Duplicate (2), Duplicate (3)… for the others |
Use “Only duplicates” to see which values collide, and “Mark column” when a person should review before anything is deleted.
Choosing key columns
Example table (Email, Name):
| Name | |
|---|---|
| kim@a.com | Kim Cheolsu |
| KIM@a.com (trailing space) | Kim Cheolsu |
| lee@b.com | Lee Younghee |
| kim@a.com | Kim Cheolsu (rejoined) |
- Email only, default settings (spaces ignored, case-sensitive): 1 of 4 rows is removed. The fourth row’s
kim@a.comequals the first, butKIM@a.comis uppercase and counts as different. - Ignore case too: 2 rows are removed and
kim@a.com(first) andlee@b.comremain. - Turning space-trimming off makes
KIM@a.complus a trailing space a separate value. Invisible spaces are the most common reason duplicates slip through. - All columns: the fourth row differs in Name, so nothing is a duplicate in this example (0 rows removed). Narrow the key to catch the duplicates you mean.
- Keep last preserves the most recent record. With case ignored, the example leaves
lee@b.comthenkim@a.com(rejoined). The mark column uses the same rule, so the last row is the blank one.
How it differs from Excel’s Remove Duplicates
- Excel edits the sheet in place; here the original stays untouched and the result is saved as a new file.
- The number
1and the text'1'are treated as the same value, while01is different. CSV values are all read as text, so codes with leading zeros stay distinct. - Before deleting anything you can review collisions with “Only duplicates” or the mark column.
- Dedupe depends on order. Stack a sort step first, then dedupe keeping the first row, to get “only the highest-scoring row per person”. Stack steps on one file and save once.
Related tools
- Several steps at once: Excel & CSV Workbench
- Duplicates in a plain list of lines: Remove Duplicate Lines
- Trim spaces and blank rows: Remove Blank Rows & Columns
- Sorting and filtering: Sort & Filter Spreadsheet
Your file is processed only in your browser and is never sent to a server.