1. Home
  2. Files & Archives
  3. Duplicate File Finder

Duplicate File Finder

Find identical files in a folder by hash and export a delete list or script.

Runs in your browser · No upload
A browser cannot delete files. Export a list or a delete script and run it yourself. Deleted files cannot be recovered, so back up first.
KB

Your files are processed in your browser only and are never sent to a server.

How to use

  1. Drop a folder, or press Choose folder. Everything inside it is scanned, up to 50,000 files and 50 GB.
  2. If you like, set a minimum size, a file type, whether to skip hidden files, and whether to include 0-byte files.
  3. Press Find duplicates. You see progress and can cancel at any time.
  4. Check the Keep choice in each group. A sensible default is already selected.
  5. Download the CSV report, the delete list or a delete script, whichever you need.

How identical files are found

A file name or modified date cannot tell you whether two files are the same. This tool compares content, but filters in three stages so it does not read every file to the end.

Stage Compared Files ruled out
1 Size A unique size cannot be a duplicate, so it is dropped at once
2 SHA-1 of the first 64 KB + last 64 KB Same size, but a different start or end
3 SHA-256 of the whole file Even files that differ only in the middle

Stage 3 reads the file in 4 MB pieces and hashes as it goes, so even a large video uses little memory. Matching SHA-256 values mean the contents are identical for all practical purposes. Changing one bit changes the hash completely, so a file with the same size and the same start and end but a different middle is still caught in stage 3. If you want to see a hash itself, use the Hash Generator.

Default rule for the file to keep

In each group the tool suggests keeping one file, chosen in this order. You can change it with the radio buttons.

  1. A name without a copy marker such as copy, (1), 복사본 or 사본
  2. The oldest modified time
  3. The shorter path
  4. Alphabetical path order

For example, if Photos/trip.jpg, Photos/trip - 복사본.jpg and Backup/trip.jpg are identical, it suggests keeping Photos/trip.jpg: of the two files without a copy marker, it has the older modified time. A group is never exported with no file to keep, so you cannot end up deleting every copy.

How reclaimable space is counted

For one group it is (count - 1) x file size. With a group of two 1,000,000-byte files and a group of three 4,000,000-byte files, there are 3 unneeded copies in total and 9,000,000 bytes can be reclaimed.

Deleting, and the scripts

A web page cannot delete files on your computer. So the tool gives you a delete list (.txt) and a script: a PowerShell script (Remove-Item -LiteralPath) for Windows, and a shell script (rm --) for macOS and Linux. A script asks for confirmation once, but after that it deletes files without using the Recycle Bin. Read it line by line, and back up first.

Quoting in paths is handled safely. For Photos/Tom's trip.jpg, which has a space and an apostrophe, the lines are:

  • macOS/Linux: rm -- 'Photos/Tom'\''s trip.jpg'
  • PowerShell: Remove-Item -LiteralPath 'Photos/Tom''s trip.jpg'

Paths are relative to the parent of the folder you scanned, so run a script from there.

Limits

  • Similar photos with slightly different content (resized or re-saved) are not detected. Check those by eye with Image Compare.
  • A path is added only once, so dropping the same folder twice never marks a file as its own duplicate.
  • To rename files instead, see Batch File Rename; to bundle the files you keep, see ZIP Creator.

Your files are processed in your browser only and are never sent to a server.

Can't find the tool you need?

Tell us what you want to do. We build the most requested tools first.