topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Wednesday December 11, 2024, 10:54 pm
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: Duplicated Folders/Directories...  (Read 6149 times)

awopbamboo

  • Honorary Member
  • Joined in 2009
  • **
  • Posts: 118
    • View Profile
    • Donate to Member
Duplicated Folders/Directories...
« on: April 13, 2023, 06:13 AM »
Hi All

I have not posted for yonks, but still check back here every now and then...  I have a question or request if anyone is bored...

I have scanned the forum, and can't find anything relating to this...

Anyway. I am trying to find something that will scan for duplicate folders/directories. In that, a whole folder has been copied elsewhere and now two versions exist. A crude method could be that it simply checks the number of files and the names of the files (bur would be better if content/checksum were checked also).

I use onedrive, and if I scan for a file often it comes back in more than one destination. I am sure this is there I have accidentally copied a folder or uploaded the same images more than once.

I know I can use a filededupe (I created a command line one myself, which is why I now know I have duplicated folders). I appear to be using so much space on duplicated stuff, it is so annoying!

Anyone got anything that can do this at a folder level?

Cheers
_____________________________________________
J.

publicdomain

  • Honorary Member
  • Joined in 2019
  • **
  • Posts: 736
  • Call me Vic!
    • View Profile
    • Donate to Member
Re: Duplicated Folders/Directories...
« Reply #1 on: April 13, 2023, 07:23 AM »
Hello @awopbamboo!

Such a tool can perform the check by:

  • Directory name.
  • File name and size (in bits).
  • File checksum(s).

If it does it in this order, then the duplicate finding time can be sped-up.

I'm happy to do a tool with such a 3-step algorithm :)

(Specifying the resulting type of match)

Cheers!

Hi All

I have not posted for yonks, but still check back here every now and then...  I have a question or request if anyone is bored...

I have scanned the forum, and can't find anything relating to this...

Anyway. I am trying to find something that will scan for duplicate folders/directories. In that, a whole folder has been copied elsewhere and now two versions exist. A crude method could be that it simply checks the number of files and the names of the files (bur would be better if content/checksum were checked also).

I use onedrive, and if I scan for a file often it comes back in more than one destination. I am sure this is there I have accidentally copied a folder or uploaded the same images more than once.

I know I can use a filededupe (I created a command line one myself, which is why I now know I have duplicated folders). I appear to be using so much space on duplicated stuff, it is so annoying!

Anyone got anything that can do this at a folder level?

Cheers
My name's Victor but do feel free to call me Vic! (now known as "paradisusvic")

❤️ Support on Patreon @ www.patreon.com/paradisusis
New Email/Paypal: paradisusvicgmail.com

publicdomain

  • Honorary Member
  • Joined in 2019
  • **
  • Posts: 736
  • Call me Vic!
    • View Profile
    • Donate to Member
Re: Duplicated Folders/Directories...
« Reply #2 on: April 30, 2023, 12:30 PM »
I'm happy to do a tool with such a 3-step algorithm ...
-publicdomain

It's on the way!  :)

Repo @ https://github.com/publicdomain/stepped-duplicated-folders

(with long path support right off the bat, via AlphaFS)
My name's Victor but do feel free to call me Vic! (now known as "paradisusvic")

❤️ Support on Patreon @ www.patreon.com/paradisusis
New Email/Paypal: paradisusvicgmail.com
« Last Edit: April 30, 2023, 02:45 PM by publicdomain »