smolkik_adm/deduplicator
1
0
Fork 0
mirror of https://github.com/sreedevk/deduplicator.git synced 2026-09-05 23:10:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

memory usage improvements

Browse Source
This commit is contained in:
sreedevk
2025-07-12 21:30:05 +00:00
parent 8826a87f32
commit 4d85f0bbc9
8 changed files with 14 additions and 51 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -21,7 +21,6 @@ Options:
-f, --follow-links Follow links while scanning directories
-h, --help Print help information
-V, --version Print version information
--json
```
### Examples
@@ -136,6 +135,6 @@ Memory: 31731MiB (~32GiB)
## v0.3 checklist
- [x] parallelization of scanning, processing and formatting
- [x] reduce cloning values on the heap
- [ ] add a partial hashing mode
- [x] add a partial hashing mode (--strict)
- [ ] add an option to use a bloom filter for very large filesystems
- [ ] max file path size should use the last set of duplicates