Deduplicator

Find, Sort, Filter & Delete duplicate files

Usage

```bash Usage: deduplicator [OPTIONS] Options: -t, --types Filetypes to deduplicate (default = all) -d, --delete Delete files by algorithm (default = oldest) [options = oldest | newest] --dir Run Deduplicator on dir different from pwd -n, --nocache Don't use cache for indexing files (default = true) -h, --help Print help information -V, --version Print version information ```

Performance

Deduplicator uses fxhash (a non-cryptographic hashing algorithm) which is extremely fast. As a result, deduplicator is able to process huge amounts of data in a couple of seconds.

While testing, Deduplicator was able to go through 8.6GB of pdf files and detect duplicates in 2.9 seconds

Screenshots

![_039](https://user-images.githubusercontent.com/36154121/210031222-d8b79143-5a1e-47ca-926e-8855d5bbab60.png)