Duplicate File Finder

Drop a folder and find every set of files with exactly the same content, whatever their names, dates or extensions. Files are compared by size and SHA-256 in your browser, and only the files that could be duplicates are ever read.

Tool Media & Files Updated Oct 16, 2026
How to Use
  1. Drop a folder (or several files) on the box, or use choose a folder. Sub-folders are included, up to 100,000 files.
  2. Wait for the three passes: files are grouped by size, then by the SHA-256 of their first 64 KiB, then by the SHA-256 of their whole content.
  3. Read the sets of identical files on the right. Pick which copy to mark keep: the first, the oldest, the newest or the one with the shortest path.
  4. Press Download CSV or Copy list and delete the extra copies yourself; the tool never deletes or changes anything.
  5. Leave Skip empty files ticked unless you want zero-byte files listed: every empty file is identical to every other one.
Input
Drop a folder or files, or
Read on your device and never uploaded; nothing is deleted
No files yet. Drop a folder to check everything inside it.
Presets (sample folders)
From All Files to Identical Ones
Files
—
Duplicate sets
—
Extra copies
—
Space wasted
—

Worked Example

A holiday folder of 7 files. IMG_0001.jpg is there three times (40,000 bytes each, one in a backup sub-folder), IMG_0002.jpg is also 40,000 bytes, IMG_0003.jpg and IMG_0003-edit.jpg are 52,000 bytes each but differ in their last byte, and notes.txt is 33 bytes. Pass 1: notes.txt is the only file of its size, so it is never read. Pass 2 hashes the other six; they are all under 65,536 bytes, so that is their full SHA-256. Only the three IMG_0001 copies match. Space wasted: (3 − 1) × 40,000 = 80,000 bytes.

Big files that differ at the very end. Three 3 MiB (3,145,728-byte) clips, one trimmed by a single byte at the end. Pass 2 reads 3 × 65,536 = 196,608 bytes and all three still match, so pass 3 hashes all of them in full. The two untouched clips share a SHA-256; the trimmed one does not. One set, 3,145,728 bytes wasted.

The common mistake: judging by name or size. IMG_0002.jpg is exactly as big as IMG_0001.jpg (40,000 bytes) but is a different photo, and two README.txt files in different project folders share a name but not their text. Deleting by size or name would lose them. Meanwhile “Copy of report (2).pdf” matches report.pdf byte for byte despite the new name. Only the content decides.

Show Work

Drop files or a folder, or press a preset, to see each pass of the comparison.

How It Works

Duplicate
sizeA = sizeB and SHA-256(A) = SHA-256(B)
Same bytes; names, dates and folders are ignored
Pass 1: size
unique size ⇒ no twin
Costs nothing: sizes come from the file list
Pass 2: the start
SHA-256(first 65,536 bytes)
For files up to 64 KiB this is already the full hash
Pass 3: everything
SHA-256(whole file), 4 MiB at a time
Only for big files whose size and start still match
Space wasted by a set
wasted = (copies − 1) × size
One copy is kept
Chance of an accidental match
p ≈ n(n−1)/2 ÷ 2256
The birthday bound: about 4 × 10−66 for a million files

Background: Fingerprints for Files

A cryptographic hash such as SHA-256 turns any amount of data into a fixed 256-bit value, and changing a single bit of the input changes about half of the output bits. That makes the hash a practical fingerprint: comparing two 64-character values is as good as comparing the files byte by byte, and one file’s fingerprint can be compared with thousands of others at once. SHA-256 is one of the SHA-2 functions specified by the US National Institute of Standards and Technology in FIPS 180 (the current edition, FIPS 180-4, dates from August 2015).

Older hashes are not safe for this job when someone might be trying to fool you. On 23 February 2017, researchers from CWI Amsterdam and Google announced the first practical SHA-1 collision: two different PDF files with the same SHA-1 value. No such pair has ever been found for SHA-256, which is why this tool and most modern de-duplication and backup software use it. The size and first-64-KiB passes are an old trick of duplicate finders: they skip most of the reading, because files of different sizes, or with different first bytes, cannot be identical.

About This Tool

This tool finds sets of byte-identical files in the files or folders you drop. It groups them by size, then by the SHA-256 of their first 64 KiB, then by the SHA-256 of their entire content, using your browser’s Web Crypto and the same streaming SHA-256 worker as the Checksum Calculator, so large files are never loaded whole. You choose which copy in each set to keep and export the list; deleting stays in your hands.

Everything runs on your device and nothing is uploaded, so private photos and documents never leave it. It suits anyone tidying a photo library, a downloads folder or two backups that overlap.

Related tools: Image Diff, ZIP & Unzip Tool and File Inspector.

Frequently Asked Questions

How does it decide that two files are duplicates?

Two files are duplicates only when they have the same size and the same SHA-256 of their entire content, so they are the same bytes. Names, dates, folders and extensions are ignored: report.pdf and Copy of report (2).pdf are a set if their bytes match, and two README.txt files in different folders are not if theirs differ.

Could two different files get the same SHA-256?

Not in practice. No two different inputs with the same SHA-256 have ever been found. For a million files the chance that any two collide by accident is about n²/2 ÷ 2256 = 5 × 1011 ÷ 1.16 × 1077, roughly 4 × 10−66. That is why it uses SHA-256 rather than SHA-1, for which Google and CWI Amsterdam published two different PDF files with the same hash in February 2017.

Does it delete the duplicates?

No. A web page cannot delete files on your disk, and that is a good thing for a tool like this. It shows each set with one copy marked keep, and gives you a CSV and a plain list of the extra copies so you can delete or move them yourself.

Will it find similar photos, such as a resized or re-saved copy?

No. It finds byte-identical files only. Resizing a photo, saving it again as JPEG or editing its EXIF data changes the bytes, so the SHA-256 changes too. To compare how two pictures look, use Image Compare or Image Diff.

How large a folder can it check?

Up to 100,000 files, of any size. A file whose size no other file shares is never opened, files up to 64 KiB are read once, and only big files that share a size and their first 64 KiB are read in full, 4 MiB at a time in a background worker, so the page stays responsive. Nothing is uploaded.

How do I use the Duplicate File Finder?

Just type your numbers. The answer shows up right away — there is no button to press. Change anything and it updates by itself.

Is it free? Does it work without internet?

Yes to both. It is free with no sign-up, and once the page has loaded it keeps working even with no internet.

Where does my data go?

Nowhere — every calculation runs on your own device. Nothing you enter is uploaded, logged, or stored.

Common Use Cases

Photo library clean-up

A phone backup imported twice: 1,200 photos of about 3 MB each come back as 1,200 sets of 2 and roughly 3.6 GB to free.

Downloads folder

Installer.exe, Installer (1).exe and Installer (2).exe of 85 MB each: one set, 170 MB of extra copies.

Before merging two drives

Drop both backup folders together to see which of the 40,000 files exist on both before copying one onto the other.

Checking a renamed copy

Confirm that Copy of report (2).pdf really is report.pdf, byte for byte, before deleting it.

Last updated: