Duplicate File Finder: Detect Identical Files by Hash in Your Browser

Hard drives and cloud storage quietly fill up with duplicates: the same photo saved twice during an import, a document copied "just in case" and then forgotten, a downloads folder with three identical versions of the same PDF. Finding them by eye is nearly impossible once you're past a few dozen files, especially when duplicates have different names.

The obvious search-engine answer is a "duplicate file finder" website, but think about what that actually means: uploading potentially thousands of your personal files to a stranger's server just so it can tell you which ones are copies of each other. That's an enormous amount of trust to extend for a task that doesn't require anyone else to see your files at all.

Why hashing duplicates should never leave your browser

Detecting duplicates doesn't require comparing file names or even looking at file content directly; it requires computing a cryptographic hash (like SHA-256) of each file's bytes and comparing those hashes. Two files with the same hash are, for all practical purposes, identical. The important part is that this hash computation can happen entirely inside your browser using the Web Crypto API, meaning your files are read locally, hashed locally, and only the resulting short hash values are compared, nothing about the file contents themselves is ever sent anywhere. For anything personal (family photos, financial documents, legal files), that distinction is the difference between a quick cleanup task and a privacy incident.

How to find duplicate files with ihatetools

1. Open the Duplicate File Finder tool.
2. Select the folder or batch of files you want to scan.
3. The tool computes a SHA-256 hash for each file and groups files with matching hashes together.
4. Review each duplicate group. Since the grouping is based on exact content, every file in a group is bit-for-bit identical to the others, not just similarly named.
5. Decide which copy to keep and delete the rest manually from your file system (the tool identifies duplicates; it doesn't delete files without your say).

Because hashing runs locally, the scan speed depends on your device, not an upload connection, so even large batches of files process quickly.

What this tool will and won't catch

• It catches exact duplicates, meaning files with identical content, regardless of file name, folder location, or creation date.
• It won't catch near-duplicates, like a photo re-saved at a slightly different quality or a document re-exported with a different compression level. Those have different bytes and therefore different hashes, even though they look the same to a human.
• If you suspect you have both exact duplicates and near-duplicate re-exports, run this tool first for the easy wins, then manually review visually similar files separately.

Practical tips for cleaning up duplicates

• Before deleting anything, sort duplicate groups by file size to catch the largest space savings first, cleaning up a handful of large video files frees more space than deleting dozens of small duplicate text files.
• If duplicates came from inconsistent file naming during past imports, run the Bulk File Renamer afterward to standardize what's left into a clean naming convention.
• When deciding which copy of a duplicate to keep, favor the one in a well-organized folder structure over one sitting loose in a Downloads folder.
• If you're archiving final copies after cleanup, consider compressing large image duplicates you're keeping with the Image Compressor to save additional space.

FAQ

Does SHA-256 ever produce the same hash for two different files?

In practice, no. SHA-256 collisions (two different files producing the same hash) are considered computationally infeasible with current technology. If two files share a SHA-256 hash, they are the same file, bit for bit.

Will this find duplicate photos that were resized or edited?

No. Any change to a file's bytes, including resizing, re-compressing, or even resaving at the exact same settings through different software, produces a different hash. This tool only finds exact, unmodified duplicates.

Is it safe to scan a folder with sensitive documents?

Yes. The scan happens entirely in your browser; your files are never uploaded or transmitted anywhere during the hashing or comparison process.

Can I scan very large files or folders?

You can, though performance depends on your device's processing power and available memory, since all the hashing work happens locally rather than on a server with dedicated resources.

Clean up your storage

Stop guessing which files are copies of each other. Open the Duplicate File Finder on ihatetools and let SHA-256 hashing do the comparison for you, with nothing ever leaving your device.