Author Topic: photo duplicate scanner (Read 113452 times)

Curt · « **Reply #100 on:** November 06, 2010, 07:36 PM »

-yeah, I know, the proper word is retrofixiation, but i couldn't spell it.
I already all sorts of dictionaries, they couldn't spell it either...

Now, is it:

or:

? Hmm..

sajman99 · « **Reply #101 on:** November 06, 2010, 07:41 PM »

Ha Ha!

Cool, works for me 4wd! The intent was sufficiently clear!

Just kidding around with Curt of course! (certainly no offense was intended

)

edit: Oops, Curt posted before me. Curt, no offense man, my spelling gets worse and worse with each passing year!

Szero · « **Reply #102 on:** November 08, 2010, 08:28 AM »

Or you need a smaller porn collecion.

Szero · « **Reply #103 on:** November 11, 2010, 01:27 AM »

Seems like both AntiDupl & UniqueFiler have their bugs, AD finds a bunch of quasi-equal images (few pixels different for a 1280*1024 image) that UF didn't catch, while the exact same happens the other way around.

Curt · « **Reply #104 on:** November 11, 2010, 05:14 AM »

Seems like both AntiDupl & UniqueFiler have their bugs, AD finds a bunch of quasi-equal images (few pixels different for a 1280*1024 image)
-Szero (November 11, 2010, 01:27 AM)

I would not call this a bug, but a feature. They all try to find 'similar' pictures.

----------------------------

You people are suffering from retrofixial!
-Curt (November 05, 2010, 07:19 PM)
btw Curt it seems I need a larger (and I mean much much larger) dictionary.
-sajman99 (November 06, 2010, 01:55 PM)
It's an Americanism - ie. make up a word when the right one doesn't seem right, (or comes to mind)
-yeah, I know, the proper word is retrofixiation, but i couldn't spell it.
I already have all sorts of dictionaries, they couldn't spell it either...
-Curt (November 06, 2010, 07:36 PM)
-4wd (November 06, 2010, 07:18 PM)

Now, what must I do to get retrofixiation officially recognized? I guess I could try to write down an article to be posted in one of the major magazines, but I have a strong feeling this may sound a heck of a lot easier said than done. I had the same problem with Vistable. Hmm... maybe I should just try to learn proper English?
$:-\$

cranioscopical · « **Reply #105 on:** November 11, 2010, 06:51 AM »

Hmm... maybe I should just try to learn proper English?
-Curt (November 11, 2010, 05:14 AM)

What a fantamazing idea!

tomos · « **Reply #106 on:** November 11, 2010, 07:18 AM »

Hmm... maybe I should just try to learn proper English?
-Curt (November 11, 2010, 05:14 AM)

OTOH wouldnt it be nice to have a new English word originating here at dc
(or there in dk)

sajman99 · « **Reply #107 on:** November 11, 2010, 04:56 PM »

Seems like both AntiDupl & UniqueFiler have their bugs, AD finds a bunch of quasi-equal images (few pixels different for a 1280*1024 image) that UF didn't catch, while the exact same happens the other way around.
-Szero (November 11, 2010, 01:27 AM)

This finding is fairly common, and it's why I don't rely on a single program to detect similar images. All of these duplicate image finders have strengths and weaknesses based on algorithm.

For example, I recently had a pic which was much darker than its duplicate. I could easily see they were the same, but many of these tools were blind to the match. Also, inaccuracies will occur with dark/light backgrounds and captioned images; many algorithms aren't smart enough to deal with these situations. It's sometimes really surprising when a particular software is unable to "see" what is in fact a visually similar image.

sajman99 · « **Reply #108 on:** March 09, 2011, 01:53 PM »

Greetings,

The author of Prismatic Dup Detector has released version 3.30.
http://www.prismatic...tor/dupdetector.html

Wow, it's been six years since the last version of this great freeware.

Curt · « **Reply #109 on:** March 09, 2011, 05:21 PM »

Dup Detector used 22% CPU for 22 minutes, in order to "Build" a data file from my 5.772 medium sized JPGs. The following analysis was both fast (a few seconds) and exact. This is a keeper!

Thanks for telling

sajman99 · « **Reply #110 on:** March 10, 2011, 12:50 PM »

...both fast (a few seconds) and exact. This is a keeper!...
-Curt (March 09, 2011, 05:21 PM)

I agree. I've used Dup Detector for many years because it works great. The program has good cache management via the "Fast rebuild" command. Free, fast and accurate!

btw the last version of SimilarImages can be found at this site: https://tn123.org/simimages
I don't use SimilarImages very often nowadays, but it seems many folks like the program.

AntiDupl.NET has also had some new releases lately, but I have chosen to stick with the older version 1.6.0.0. I tested the newer versions and didn't much care for some of the supposed "improvements".

sajman99 · « **Reply #111 on:** April 20, 2011, 01:45 PM »

Greetings,

Dup Detector version 3.3.01 has been released. The author has (finally after 10 years!) added support for alternate file extensions.

http://www.prismatic...tor/dupdetector.html

Curt · « **Reply #112 on:** April 20, 2011, 02:21 PM »

we should also know about today's giveaway, http://www.giveawayo.../visual-search-pony/, Visual Search Pony. Photos and videos only. Slow scanning (disappointingly slow) because it doesn't just search for meta data but really takes a look at each picture, to compare content.

http://visualsearchpony.com/ $25

Edited:
I believe this is the only one also comparing videos?

The giveaway version doesn't set shortcut on the desktop.
Executor: C:\Program Files\Visual Search Pony\bin\vsp.exe

sajman99 · « **Reply #113 on:** April 20, 2011, 02:59 PM »

I tried Visual Search Pony a while back and had no luck with that particular software. Perhaps I overlooked something(?), but I found it to be a major disappointment (btw certainly not an uncommon experience with this type of software) .

Hmm...I hope they continue to develop their "revolutionary content-based search". Who knows? In time it could be fantastic. $:-\$

Curt · « **Reply #114 on:** April 21, 2011, 01:25 AM »

a disappointment ot not, I am keeping it for the video part.
As I type this, there is still half an hour to get it for free.

Curt · « **Reply #115 on:** April 21, 2011, 02:48 AM »

a disappointment ot not, I am keeping it for the video part.
-Curt (April 21, 2011, 01:25 AM)

-no, I am not. Whether it was due to broken files or something else, the program never managed to scan all of my photo or video collections, before crashing. It is a gonner!

Curt · « **Reply #116 on:** April 21, 2011, 03:05 AM »

I was very surprised and disappointed to realize that Revo Uninstaller > 'Advanced' didn't find C:\Users\Curt\AppData\Roaming\visualsearchpony.com What else has it not found over time?
Hmm...

sajman99 · « **Reply #117 on:** April 23, 2011, 12:34 PM »

... Visual Search Pony...I believe this is the only one also comparing videos?
-Curt (April 20, 2011, 02:21 PM)

Good question--I haven't seen many tools which can evaluate video similarity.

You might want to try SimilarImages for that purpose. $:-\$ Seems it can process video and compare frames to evaluate similarity. But it's hard to find much information on SimilarImages' video comparison capabilities because the old site is gone, the current location isn't a fully developed site, and the documentation included with the latest 2010.09 (beta) contains outdated/incorrect info.

crabby3 · « **Reply #118 on:** March 17, 2014, 06:16 PM »

Thought maybe I should include this DC topic here. The FDFF link is still valid. For those who may not be aware of Free Duplicate (Photo) File Finder.

http://www.mindgems....ile-Finder-About.htm

Curt · « **Reply #119 on:** March 18, 2014, 03:02 AM »

And for those who may not be aware of Duplicate Video Search:
http://duplicatevideosearch.com
http://duplicatevide...arch.com/how-to-use/

Yet another Bolide product, so I cannot say if it ever will be updated.
But it still is ~~brand new~~ and well working.

Modified: Only now do I notice my copy calls itself version 16 ! But, ehm... how can a version "16" be so different from normal programs, lacking both this and that normal feature? The user's graphical interface is abnormal, to say the least.

Anyway, the scanning's end result is fine
- and should be, because this is not freeware, but $30

Duplicate Video Search

Step 4: Specify video indexing and matching options (optional)

   First, you need to specify how many seconds of each video should be indexed. The longer this interval is, the more accuratelly duplicate videos will be detected (there will be less false positives). However, it takes more time to index long intervals, we recommend to find some optimum or keep default value (3 seconds).

   Enable “Skipe first 3 minutes” option if you are going to organize a movie collection. Movies can have similar beginnings (intro of a movie company), so to avoid wrong detections, our program allows to start processing only from 3rd minute of a video (after all intros).

   “Fast video reading” option makes video reading 2-3 times faster by ansyncing video and audio. Unfortunatelly some DirectShow codecs may be unstable in that circumstances and lead to crash. Disable “Fast video reading” option in case you faced smth. like this.

   Adjust “Sensitivity” slider to regulate how close the detected duplicates should be. It is recommended to change this option after running a first scan, in case there are too many false detections or vise versa. Second scan is usually pretty fast, cause Duplicate Video Search stores all indexes to the cash and so does not have to repeate video indexing twice.

   Some video duplicates can be misaligned in time, i.e. same momemnt can take a place on 2:03 on a first video and and on 2:07 on a second one. To accept this, set “Max shift” value to 5 seconds.

Step 5: Start retrieval

Click the “Search” button to start retrieval. Duplicate Video Search will scan the selected folders for duplicate video files. Found clips are compared against each other and grouped together if they have similar content.

Since there are many video formats in the world, our software determines duplicates on the basis of the visual content of files. For this, the program processes each file and generates it`s short signature which is compared against signatures of other files. This process is also known as video fingerprinting.

To index video, Duplicate Video Search processes only limited number of seconds of each video and stores a calculated signature in cache, so that next time you need to organize video files, the program can re-use cached signatures and process only new clips.

http://duplicatevide...arch.com/how-to-use/
-Duplicate Video Search

sajman99 · « **Reply #120 on:** March 27, 2014, 03:15 PM »

Yet another Bolide product, so I cannot say if it ever will be updated.
-Curt (March 18, 2014, 03:02 AM)

Yes, very well stated. It is their unfortunate practice to celebrate a revolutionary new product X, charge for full functionality, and then never (or very infrequently) update it. Since this is yet another of their offerings, I'm not inclined to try it.

Anyway, it appears this is a "new version" of the old Visual Search Pony (mentioned above). The old link re-directs to Duplicate Video Search.