How to use
- Drop a folder, or press
Choose folder. Everything inside it is scanned, up to 50,000 files and 50 GB. - If you like, set a minimum size, a file type, whether to skip hidden files, and whether to include 0-byte files.
- Press
Find duplicates. You see progress and can cancel at any time. - Check the
Keepchoice in each group. A sensible default is already selected. - Download the CSV report, the delete list or a delete script, whichever you need.
How identical files are found
A file name or modified date cannot tell you whether two files are the same. This tool compares content, but filters in three stages so it does not read every file to the end.
| Stage | Compared | Files ruled out |
|---|---|---|
| 1 | Size | A unique size cannot be a duplicate, so it is dropped at once |
| 2 | SHA-1 of the first 64 KB + last 64 KB | Same size, but a different start or end |
| 3 | SHA-256 of the whole file | Even files that differ only in the middle |
Stage 3 reads the file in 4 MB pieces and hashes as it goes, so even a large video uses little memory. Matching SHA-256 values mean the contents are identical for all practical purposes. Changing one bit changes the hash completely, so a file with the same size and the same start and end but a different middle is still caught in stage 3. If you want to see a hash itself, use the Hash Generator.
Default rule for the file to keep
In each group the tool suggests keeping one file, chosen in this order. You can change it with the radio buttons.
- A name without a copy marker such as
copy,(1),복사본or사본 - The oldest modified time
- The shorter path
- Alphabetical path order
For example, if Photos/trip.jpg, Photos/trip - 복사본.jpg and Backup/trip.jpg are identical, it suggests keeping Photos/trip.jpg: of the two files without a copy marker, it has the older modified time. A group is never exported with no file to keep, so you cannot end up deleting every copy.
How reclaimable space is counted
For one group it is (count - 1) x file size. With a group of two 1,000,000-byte files and a group of three 4,000,000-byte files, there are 3 unneeded copies in total and 9,000,000 bytes can be reclaimed.
Deleting, and the scripts
A web page cannot delete files on your computer. So the tool gives you a delete list (.txt) and a script: a PowerShell script (Remove-Item -LiteralPath) for Windows, and a shell script (rm --) for macOS and Linux. A script asks for confirmation once, but after that it deletes files without using the Recycle Bin. Read it line by line, and back up first.
Quoting in paths is handled safely. For Photos/Tom's trip.jpg, which has a space and an apostrophe, the lines are:
- macOS/Linux:
rm -- 'Photos/Tom'\''s trip.jpg' - PowerShell:
Remove-Item -LiteralPath 'Photos/Tom''s trip.jpg'
Paths are relative to the parent of the folder you scanned, so run a script from there.
Limits
- Similar photos with slightly different content (resized or re-saved) are not detected. Check those by eye with Image Compare.
- A path is added only once, so dropping the same folder twice never marks a file as its own duplicate.
- To rename files instead, see Batch File Rename; to bundle the files you keep, see ZIP Creator.
Your files are processed in your browser only and are never sent to a server.