smolkik_adm/deduplicator
1
0
Fork 0
mirror of https://github.com/sreedevk/deduplicator.git synced 2026-08-31 20:45:34 +00:00
Code Issues Packages Projects Releases Wiki Activity

updated benchmarks

Browse Source
This commit is contained in:
sreedev
2023-01-27 09:54:39 -05:00
parent 7119f019d3
commit 5532ded331
1 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@@ -96,10 +96,10 @@ Deduplicator uses size comparison and fxhash (a non non-cryptographic hashing al
| Command | Dirsize | Filecount | Mean [ms] | Min [ms] | Max [ms] | Relative |
|:---|:---|---:|---:|---:|---:|---:|
| `deduplicator --dir ~/Data/tmp` | (~120G) | 721 files | 82.6 ± 11.0 | 72.8 | 114.3 | 1.00 |
| `deduplicator --dir ~/Data/books` | (~8.6G) | 1419 files | 86.7 ± 17.7 | 71.2 | 144.4 | 1.05 ± 0.26 |
| `deduplicator --dir ~/Data/books --min-size 10M` | (~8.6G) | 1419 files | 97.7 ± 35.0 | 63.1 | 228.8 | 1.18 ± 0.45 |
| `deduplicator --dir ~/Data/ --types pdf,jpg,png,jpeg` | (~290G) | 104222 files | 1253.1 ± 30.6 | 1214.2 | 1301.4 | 15.17 ± 2.05 |
| `deduplicator --dir ~/Data/tmp` | (~120G) | 721 files | 33.5 ± 28.6 | 25.3 | 151.5 | 1.87 ± 1.60 |
| `deduplicator --dir ~/Data/books` | (~8.6G) | 1419 files | 24.5 ± 1.0 | 22.9 | 28.1 | 1.37 ± 0.08 |
| `deduplicator --dir ~/Data/books --min-size 10M` | (~8.6G) | 1419 files | 17.9 ± 0.7 | 16.8 | 20.0 | 1.00 |
| `deduplicator --dir ~/Data/ --types pdf,jpg,png,jpeg` | (~290G) | 104222 files | 1207.2 ± 37.0 | 1172.2 | 1287.7 | 67.27 ± 3.33 |
* The last entry is lower because of the number of files deduplicator had to go through (~660895 Files). The average size of the files rarely affect the performance of deduplicator.