The Best Way to handle finding and removiong Duplicate Files

[4wd]

I'm looking for something with source code because I'm a bit wary of using a program that's going to be scanning a lot of files -- though in this case it's for someone who is unlikely to be using a non-GUI solution.

My preliminary searches turned up a couple of candidates.

Are there any reasons to not consider the current incarnation of dupeguru or Duplicate Files Finder?

https://github.com/arsenetar/dupeguru

Appreciate some opinions (informed or otherwise)

-ewemoa (December 21, 2019, 01:54 PM)

Used dupeGuru reasonably recently to remove something like 400+GB of duplicate backup files for a friend, (a laborious undertaking - backups of backups of backups of .... ), worked well.

There's also AntiDupl if you want to find primarily image duplicates, (or close duplicates), including across different formats - my go to software for that instance.

[rjbull]

Back when I was more excercised about nuking dupes, I used

DoubleKiller.  Last update was 2015, as the author is probably working on his PhD.

Two more different approaches:

Cathy is a media cataloguing tool; in my experience, it's very fast at making catalogues.  It has a "search duplicates or singles" feature.

Nir Sofer's SearchMyFiles has a "Find duplicates" feature that can be combined with normal file-finding criteria.

[ewemoa]

Used dupeGuru reasonably recently to remove something like 400+GB of duplicate backup files for a friend, (a laborious undertaking - backups of backups of backups of .... ), worked well.

There's also AntiDupl if you want to find primarily image duplicates, (or close duplicates), including across different formats - my go to software for that instance.

-4wd (December 22, 2019, 01:27 AM)

I'm more in favor of dupeGuru now.  I had used it a bit before, but your opinion is much appreciated!

Had never heard of AntiDupl, thanks for mentioning it.

[ewemoa]

Nir Sofer's SearchMyFiles has a "Find duplicates" feature that can be combined with normal file-finding criteria.

-rjbull (December 22, 2019, 04:22 PM)

I have had good success with this one in the past