p.1 #1 · Is There An Effective Lightroom Classic Duplicate Finder?
I’ve been recovering images from twenty five years of multiple editing software and computers. To do this I’ve been scouring a NAS with 50TB of storage. The NAS has the contents of every drive used over the years and images of every meal that my wife has ever eaten.
So, I’m already past half a million images and still going, but specifying not to import duplicates hasn’t really worked in that I have many multiple images.
For anyone that might try to collect massive number of images and import them into LRC, a few things that I’ve learned…. You can run out of internal memory, even when a system has 64GB. You can run out of storage memory, even when your SSD has 8GB.
Is there a reliable duplicate finder program available as a Lightroom Classic Plug-in?
p.1 #2 · Is There An Effective Lightroom Classic Duplicate Finder?
Might be a risky thing to do with LRC, since the edits are keyed to the photos. If you delete a duplicate, I would think that you would also delete the edits associated with that copy.
p.1 #3 · Is There An Effective Lightroom Classic Duplicate Finder?
LrC's Plug-in Manager>Adobe Add-ons has a Deduplicator plug-in but I don't hold out hope for it working well. Several strikes against it: 2017, v1.0.1, for Lightroom Classic 6.0 - 7.99.
[my UGreen NAS has a Deduplicator that ran very quickly, less than 5 minutes (compared to searching for one partial filename!) through 609 GB/128K items of images]
p.1 #4 · Is There An Effective Lightroom Classic Duplicate Finder?
How do you want to qualify "duplicate" files? Do you want to physically delete all traces of the dupes? Or maintain references to the dupes while cleaning up disk space?
Most NAS have deduping options in their storage management that let you remove redundant data blocks from your disks while retaining virtual pointers to a single copy of the data. That cleans up storage space but does nothing to reduce clutter in your Lr catalogs.
What NAS are you using? Synology has an optional storage analyzer you can set to run scheduled reports listing dupes.
You can always script a hash grouping yourself using bash or powershell.
p.1 #5 · Is There An Effective Lightroom Classic Duplicate Finder?
I’ve started a three to four day process of moving files with (02),(03)..etc in file name. Once moved, I will remove the folder from LRC.
I would like a reliable program that identities duplicates by using file metadata and size as search characteristics.
I have a Synology 1522+ running in two fault tollerance. All desktop drives backed up to BackBlaze.
This project is now passing one week of work. I really don’t know what I will end up with. Most of my images are uploaded as JPG to Flickr..so, many forms of backup.
