GitXplorerGitXplorer
b

fddf

public
116 stars
9 forks
9 issues

Commits

List of commits on branch master.
Unverified
742ade72e1e6291dea38a9df170532cc15c0cf4e

Check inodes using (dev, ino).

bbirkenfeld committed 5 years ago
Unverified
2fc13f17b900869478bb5e02068f7310ea8d5c7c

If no root is given, use current dir.

bbirkenfeld committed 5 years ago
Unverified
909c2bef8fa7630280164926f0a53e70c2117c34

Update dependencies

bbirkenfeld committed 5 years ago
Unverified
1b8952e8e36b6071cba0bdc81ffbea769a5e6381

cargo/edition update

bbirkenfeld committed 6 years ago
Unverified
075fc8b05fbad748769ab2d55f473ba8c008606c

Update dependencies.

bbirkenfeld committed 6 years ago
Unverified
076e238d041cdd8a06390f941f361c4f4d296a8c

Update dependencies.

bbirkenfeld committed 7 years ago

README

The README file for this repository.

fddf

Fast data dupe finder

This is a small Rust command-line program to find duplicate files in a directory recursively. It uses a thread pool to calculate file hashes in parallel.

Duplicates are found by checking size, then (Blake3) hashes of parts of files of same size, then a byte-for-byte comparison.

Build/install

Directly from crates.io with cargo install fddf.

From checkout:

cargo build --release
cargo run --release

Minimum supported Rust version is 1.48.0.

Usage

fddf [-s] [-t] [-S] [-m SIZE] [-M SIZE] [-v] <rootdir>

-s: report dupe groups in a single line
-t: produce a grand total
-S: don't scan recursively for each directory given
-f: check for files with given pattern only
-F: check for files with given regular expression only
-m: minimum size (default 1 byte)
-M: maximum size (default unlimited)
-v: verbose operation

By default, zero-length files are ignored, since there is no meaningful data to be duplicated. Pass -m 0 to include them.

PRs welcome!