Duplicated Folders/Directories...

[awopbamboo]

Hi All

I have not posted for yonks, but still check back here every now and then...  I have a question or request if anyone is bored...

I have scanned the forum, and can't find anything relating to this...

Anyway. I am trying to find something that will scan for duplicate folders/directories. In that, a whole folder has been copied elsewhere and now two versions exist. A crude method could be that it simply checks the number of files and the names of the files (bur would be better if content/checksum were checked also).

I use onedrive, and if I scan for a file often it comes back in more than one destination. I am sure this is there I have accidentally copied a folder or uploaded the same images more than once.

I know I can use a filededupe (I created a command line one myself, which is why I now know I have duplicated folders). I appear to be using so much space on duplicated stuff, it is so annoying!

Anyone got anything that can do this at a folder level?

Cheers

[publicdomain]

Hello @awopbamboo!

Such a tool can perform the check by:

• Directory name.
• File name and size (in bits).
• File checksum(s).

If it does it in this order, then the duplicate finding time can be sped-up.

I'm happy to do a tool with such a 3-step algorithm

(Specifying the resulting type of match)

Cheers!

Hi All

I have not posted for yonks, but still check back here every now and then...  I have a question or request if anyone is bored...

I have scanned the forum, and can't find anything relating to this...

Anyway. I am trying to find something that will scan for duplicate folders/directories. In that, a whole folder has been copied elsewhere and now two versions exist. A crude method could be that it simply checks the number of files and the names of the files (bur would be better if content/checksum were checked also).

I use onedrive, and if I scan for a file often it comes back in more than one destination. I am sure this is there I have accidentally copied a folder or uploaded the same images more than once.

I know I can use a filededupe (I created a command line one myself, which is why I now know I have duplicated folders). I appear to be using so much space on duplicated stuff, it is so annoying!

Anyone got anything that can do this at a folder level?

Cheers

-awopbamboo (April 13, 2023, 06:13 AM)

[publicdomain]

I'm happy to do a tool with such a 3-step algorithm ...

-publicdomain

It's on the way! 

Repo @ https://github.com/publicdomain/stepped-duplicated-folders

(with long path support right off the bat, via AlphaFS)