topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Tuesday March 19, 2024, 4:58 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Last post Author Topic: photo duplicate scanner  (Read 107269 times)

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #100 on: November 06, 2010, 07:36 PM »
-yeah, I know, the proper word is retrofixiation, but i couldn't spell it.
I already all sorts of dictionaries, they couldn't spell it either...


Now, is it:  :P  or:  ;D ? Hmm..


sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #101 on: November 06, 2010, 07:41 PM »
Ha Ha! ;D Cool, works for me 4wd! The intent was sufficiently clear!

Just kidding around with Curt of course! (certainly no offense was intended :))

edit: Oops, Curt posted before me. Curt, no offense man, my spelling gets worse and worse with each passing year!
« Last Edit: November 06, 2010, 07:47 PM by sajman99 »

Szero

  • Participant
  • Joined in 2010
  • *
  • Posts: 10
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #102 on: November 08, 2010, 08:28 AM »
Or you need a smaller porn collecion. :P

Szero

  • Participant
  • Joined in 2010
  • *
  • Posts: 10
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #103 on: November 11, 2010, 01:27 AM »
Seems like both AntiDupl & UniqueFiler have their bugs, AD finds a bunch of quasi-equal images (few pixels different for a 1280*1024 image) that UF didn't catch, while the exact same happens the other way around. :(

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #104 on: November 11, 2010, 05:14 AM »
Seems like both AntiDupl & UniqueFiler have their bugs, AD finds a bunch of quasi-equal images (few pixels different for a 1280*1024 image)

I would not call this a bug, but a feature. They all try to find 'similar' pictures.

----------------------------

You people are suffering from retrofixial!   :o
btw Curt it seems I need a larger (and I mean much much larger) dictionary.
It's an Americanism - ie. make up a word when the right one doesn't seem right, (or comes to mind)
-yeah, I know, the proper word is retrofixiation, but i couldn't spell it.
I already have all sorts of dictionaries, they couldn't spell it either...

Now, what must I do to get retrofixiation officially recognized? I guess I could try to write down an article to be posted in one of the major magazines, but I have a strong feeling this may sound a heck of a lot easier said than done. I had the same problem with Vistable. Hmm... maybe I should just try to learn proper English?
 :-\

cranioscopical

  • Friend of the Site
  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 4,776
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #105 on: November 11, 2010, 06:51 AM »
Hmm... maybe I should just try to learn proper English?
What a fantamazing idea!  ;)

tomos

  • Charter Member
  • Joined in 2006
  • ***
  • Posts: 11,958
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #106 on: November 11, 2010, 07:18 AM »
Hmm... maybe I should just try to learn proper English?

OTOH wouldnt it be nice to have a new English word originating here at dc
(or there in dk) :)
Tom

sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #107 on: November 11, 2010, 04:56 PM »
Seems like both AntiDupl & UniqueFiler have their bugs, AD finds a bunch of quasi-equal images (few pixels different for a 1280*1024 image) that UF didn't catch, while the exact same happens the other way around. :(

This finding is fairly common, and it's why I don't rely on a single program to detect similar images. All of these duplicate image finders have strengths and weaknesses based on algorithm.

For example, I recently had a pic which was much darker than its duplicate. I could easily see they were the same, but many of these tools were blind to the match. Also, inaccuracies will occur with dark/light backgrounds and captioned images; many algorithms aren't smart enough to deal with these situations. It's sometimes really surprising when a particular software is unable to "see" what is in fact a visually similar image.

sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #108 on: March 09, 2011, 01:53 PM »
Greetings,

The author of Prismatic Dup Detector has released version 3.30.
http://www.prismatic...tor/dupdetector.html

Wow, it's been six years since the last version of this great freeware.

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #109 on: March 09, 2011, 05:21 PM »
Dup Detector used 22% CPU for 22 minutes, in order to "Build" a data file from my 5.772 medium sized JPGs. The following analysis was both fast (a few seconds) and exact. This is a keeper!

Thanks for telling  :up:

sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #110 on: March 10, 2011, 12:50 PM »
...both fast (a few seconds) and exact. This is a keeper!...

I agree. I've used Dup Detector for many years because it works great. The program has good cache management via the "Fast rebuild" command. Free, fast and accurate! :)

btw the last version of SimilarImages can be found at this site:  https://tn123.org/simimages
I don't use SimilarImages very often nowadays, but it seems many folks like the program.

AntiDupl.NET has also had some new releases lately, but I have chosen to stick with the older version 1.6.0.0.  I tested the newer versions and didn't much care for some of the supposed "improvements".

sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #111 on: April 20, 2011, 01:45 PM »
Greetings,

Dup Detector version 3.3.01 has been released. The author has (finally after 10 years!) added support for alternate file extensions. 

http://www.prismatic...tor/dupdetector.html

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #112 on: April 20, 2011, 02:21 PM »
we should also know about today's giveaway, http://www.giveawayo.../visual-search-pony/, Visual Search Pony. Photos and videos only. Slow scanning (disappointingly slow) because it doesn't just search for meta data but really takes a look at each picture, to compare content.

http://visualsearchpony.com/ $25

Edited:
I believe this is the only one also comparing videos?

The giveaway version doesn't set shortcut on the desktop.
Executor: C:\Program Files\Visual Search Pony\bin\vsp.exe
« Last Edit: April 20, 2011, 02:40 PM by Curt »

sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #113 on: April 20, 2011, 02:59 PM »
I tried Visual Search Pony a while back and had no luck with that particular software. Perhaps I overlooked something(?), but I found it to be a major disappointment (btw certainly not an uncommon experience with this type of software) .

Hmm...I hope they continue to develop their "revolutionary content-based search". Who knows? In time it could be fantastic. :-\

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #114 on: April 21, 2011, 01:25 AM »
a disappointment ot not, I am keeping it for the video part.
As I type this, there is still half an hour to get it for free.

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #115 on: April 21, 2011, 02:48 AM »
a disappointment ot not, I am keeping it for the video part.

-no, I am not. Whether it was due to broken files or something else, the program never managed to scan all of my photo or video collections, before crashing. It is a gonner!

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #116 on: April 21, 2011, 03:05 AM »
I was very surprised and disappointed to realize that Revo Uninstaller > 'Advanced' didn't find C:\Users\Curt\AppData\Roaming\visualsearchpony.com What else has it not found over time?
Hmm...  :(

sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #117 on: April 23, 2011, 12:34 PM »
... Visual Search Pony...I believe this is the only one also comparing videos?

Good question--I haven't seen many tools which can evaluate video similarity.

You might want to try SimilarImages for that purpose. :-\ Seems it can process video and compare frames to evaluate similarity. But it's hard to find much information on SimilarImages' video comparison capabilities because the old site is gone, the current location isn't a fully developed site, and the documentation included with the latest 2010.09 (beta) contains outdated/incorrect info.

crabby3

  • Supporting Member
  • Joined in 2012
  • **
  • Posts: 1,018
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #118 on: March 17, 2014, 06:16 PM »
Thought maybe I should include this DC topic here.  The FDFF link is still valid.  For those who may not be aware of Free Duplicate (Photo) File Finder.   :)

http://www.mindgems....ile-Finder-About.htm

Curt

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 7,566
    • View Profile
    • Donate to Member
Duplicate Video Search
« Reply #119 on: March 18, 2014, 03:02 AM »
And for those who may not be aware of Duplicate Video Search:
http://duplicatevideosearch.com
http://duplicatevide...arch.com/how-to-use/

Yet another Bolide product, so I cannot say if it ever will be updated.
But it still is brand new and well working.  :up:
Modified: Only now do I notice my copy calls itself version 16 ! But, ehm... how can a version "16" be so different from normal programs, lacking both this and that normal feature? The user's graphical interface is abnormal, to say the least.

Anyway, the scanning's end result is fine
- and should be, because this is not freeware, but $30

Duplicate Video Search

Step 4: Specify video indexing and matching options (optional)

    First, you need to specify how many seconds of each video should be indexed. The longer this interval is, the more accuratelly duplicate videos will be detected (there will be less false positives). However, it takes more time to index long intervals, we recommend to find some optimum or keep default value (3 seconds).

    Enable “Skipe first 3 minutes” option if you are going to organize a movie collection. Movies can have similar beginnings (intro of a movie company), so to avoid wrong detections, our program allows to start processing only from 3rd minute of a video (after all intros).

    “Fast video reading” option makes video reading 2-3 times faster by ansyncing video and audio. Unfortunatelly some DirectShow codecs may be unstable in that circumstances and lead to crash. Disable “Fast video reading” option in case you faced smth. like this.

    Adjust “Sensitivity” slider to regulate how close the detected duplicates should be. It is recommended to change this option after running a first scan, in case there are too many false detections or vise versa. Second scan is usually pretty fast, cause Duplicate Video Search stores all indexes to the cash and so does not have to repeate video indexing twice.

    Some video duplicates can be misaligned in time, i.e. same momemnt can take a place on 2:03 on a first video and and on 2:07 on a second one. To accept this, set “Max shift” value to 5 seconds.


Step 5: Start retrieval

Click the “Search” button to start retrieval. Duplicate Video Search will scan the selected folders for duplicate video files. Found clips are compared against each other and grouped together if they have similar content.

Since there are many video formats in the world, our software determines duplicates on the basis of the visual content of files. For this, the program processes each file and generates it`s short signature which is compared against signatures of other files. This process is also known as video fingerprinting.

To index video, Duplicate Video Search processes only limited number of seconds of each video and stores a calculated signature in cache, so that next time you need to organize video files, the program can re-use cached signatures and process only new clips.

http://duplicatevide...arch.com/how-to-use/
-Duplicate Video Search
« Last Edit: March 18, 2014, 03:34 AM by Curt »

sajman99

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 664
    • View Profile
    • Donate to Member
Re: photo duplicate scanner
« Reply #120 on: March 27, 2014, 03:15 PM »
Yet another Bolide product, so I cannot say if it ever will be updated.

Yes, very well stated. It is their unfortunate practice to celebrate a revolutionary new product X, charge for full functionality, and then never (or very infrequently) update it. Since this is yet another of their offerings, I'm not inclined to try it.

Anyway, it appears this is a "new version" of the old Visual Search Pony (mentioned above). The old link re-directs to Duplicate Video Search.