topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Tuesday December 10, 2024, 12:00 pm
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Last post Author Topic: The Best Way to handle finding and removiong Duplicate Files  (Read 47498 times)

4wd

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 5,644
    • View Profile
    • Donate to Member
Re: The Best Way to handle finding and removiong Duplicate Files
« Reply #25 on: December 22, 2019, 01:27 AM »
I'm looking for something with source code because I'm a bit wary of using a program that's going to be scanning a lot of files -- though in this case it's for someone who is unlikely to be using a non-GUI solution.

My preliminary searches turned up a couple of candidates.

Are there any reasons to not consider the current incarnation of dupeguru or Duplicate Files Finder?

https://github.com/arsenetar/dupeguru

Appreciate some opinions (informed or otherwise) :)

Used dupeGuru reasonably recently to remove something like 400+GB of duplicate backup files for a friend, (a laborious undertaking - backups of backups of backups of .... ), worked well.

There's also AntiDupl if you want to find primarily image duplicates, (or close duplicates), including across different formats - my go to software for that instance.

rjbull

  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 3,205
    • View Profile
    • Donate to Member
Re: The Best Way to handle finding and removiong Duplicate Files
« Reply #26 on: December 22, 2019, 04:22 PM »
Back when I was more excercised about nuking dupes, I used

DoubleKiller.  Last update was 2015, as the author is probably working on his PhD.

Two more different approaches:

Cathy is a media cataloguing tool; in my experience, it's very fast at making catalogues.  It has a "search duplicates or singles" feature.

Nir Sofer's SearchMyFiles has a "Find duplicates" feature that can be combined with normal file-finding criteria.

ewemoa

  • Honorary Member
  • Joined in 2008
  • **
  • Posts: 2,922
    • View Profile
    • Donate to Member
Re: The Best Way to handle finding and removiong Duplicate Files
« Reply #27 on: December 25, 2019, 10:42 AM »
Used dupeGuru reasonably recently to remove something like 400+GB of duplicate backup files for a friend, (a laborious undertaking - backups of backups of backups of .... ), worked well.

There's also AntiDupl if you want to find primarily image duplicates, (or close duplicates), including across different formats - my go to software for that instance.

I'm more in favor of dupeGuru now.  I had used it a bit before, but your opinion is much appreciated!

Had never heard of AntiDupl, thanks for mentioning it.

ewemoa

  • Honorary Member
  • Joined in 2008
  • **
  • Posts: 2,922
    • View Profile
    • Donate to Member
Re: The Best Way to handle finding and removiong Duplicate Files
« Reply #28 on: December 25, 2019, 10:44 AM »
Nir Sofer's SearchMyFiles has a "Find duplicates" feature that can be combined with normal file-finding criteria.

I have had good success with this one in the past  :Thmbsup: