DonationCoder.com Forum

DonationCoder.com Software => DC Member Programs and Projects => Skwire Empire => Topic started by: skwire on March 27, 2011, 03:41 PM

Title: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 27, 2011, 03:41 PM
Name SFV Ninja (Simple File Verification application)
Short Description SFV (Simple File Verification) (http://en.wikipedia.org/wiki/Simple_file_verification) application.  It also supports MD5, SHA-1, SHA-256, SHA-384, and SHA-512 checksum files.  I wrote this several years ago for my own use but cleaned up the code for a public release.
 
Features
  • Two verifcation modes.  The first will verify all files in the list like any typical SFV application.  The second mode will only verify any newly added files.  This second mode allows you to "update" an existing SFV file without having to verify all of the files.
  • Recursively scan a folder for SFV/MD5/SHA-1/SHA-256 files and load them all at once.
  • Uses relative paths whenever possible when generating checksum files.
Supported OSes Windows 7.  Probably works, but not tested, on Windows XP/Vista/8/10
Website http://skwire.dcmembers.com/fp/?page=sfv-ninja (http://skwire.dcmembers.com/fp/?page=sfv-ninja)
Download Link Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
Author Jody Holmes - Skwire Empire (http://skwire.dcmembers.com)

[ You are not allowed to view attachments ]
Title: Re: SFV Ninja (Simple File Verification application)
Post by: lanux128 on March 27, 2011, 09:41 PM
this is nice.. thanks! :Thmbsup:
Title: Re: SFV Ninja (Simple File Verification application)
Post by: f0dder on March 28, 2011, 11:08 AM
Screenshot looks nice - does it have decent progress bars? Does speed rock? Does it handle >2GB files? Does it support the MD5 SFV extensions?

I personally still use the freeware FlashSFV 2.0f (iirc done by the guys that did FlashFXP) - but at one point it kinda disappeared off the radar, and I haven't checked out the most recent (http://www.trvx.com/flashsfv/) 2.6. Might be interesting to pit it against your tool :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on March 28, 2011, 11:24 AM
does it have decent progress bars?
Does speed rock?
Does it handle >2GB files?
Does it support the MD5 SFV extensions?


One of the main reasons I wrote this five years ago was that I wanted to be able to easily scan through a directory, load all the SFV files found and batch check them.  Nothing I could find back then really suited my purposes.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on March 28, 2011, 12:14 PM
I just tested out the latest FlashSFV and, unless I'm mistaken (entirely possible), here are some of my findings:


The above items are important to me so SFV Ninja does all three.  It handles Unicode paths just fine and writes its SFV files out in UTF-8 format.  You can also build an SFV file out of files that come from any number of folders.  The resulting SFV file is then saved with paths relative to the save folder of the SFV file.  Furthermore, I tested out SFV Ninja on a 4GB VM hard drive file and it worked just fine.  Give it a shot, you may like it.   :D
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Marc.D on April 03, 2011, 08:13 PM
Hello, I've just signed up after I saw your app..
I've been looking for months for this feature: Recursively scan a folder for verification files and load them all at once.
So I've to ask is it planned to add support for md5 anytime in the future?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on April 03, 2011, 08:45 PM
So I've to ask is it planned to add support for md5 anytime in the future?

Honestly, I hadn't planned on it.   :-[  I'm going to assume that you use .MD5 files instead of .SFV?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on April 03, 2011, 09:18 PM
BTW, Marc.D, welcome to the site.   :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Marc.D on April 03, 2011, 10:03 PM
Well yes I've used them all the way long for my music (along with foobar :-*... )
I'm out of luck? duh

BTW, Marc.D, welcome to the site.   :)

Thanks :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on April 03, 2011, 10:21 PM
I'm out of luck?

Not necessarily.  Let me do some research and see what it will take to add MD5 support.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on April 06, 2011, 05:42 PM
Update:  I have the application working with MD5 and SHA-1 hashes.  I just need to write the file loading and saving routines (easy stuff) and it should be done.  

I did want to get some input on how to handle the three different types of hashes.  Even though it's easy to differentiate between the different hashes due to their checksum length, I'd like to stay away from any sort of fuzzy logic stuff that would attempt guess at which type of hash is being called for.  The reason for this is that I don't want to encourage mixed hash types in the list.  Does this make sense?  So, with that being said, I was thinking three new "mode" buttons on the toolbar; one each for crc32 (SFV), md5 and sha-1 modes.  The user will need to set one of the three modes before attempting to load and/or check files.  Does this sound like a reasonable solution?  If not, feel free to suggest something else.  
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Marc.D on April 07, 2011, 02:03 PM
It sounds reasonable to me. I actually didn't thought about it and I agree I would prefer not to check other types of hashes that may be loaded and mixed in the list.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on April 08, 2011, 05:23 PM
Give this a try:

Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.0.3 - 2011-04-08
    + Added modes/support for MD5 and SHA-1 algorithms.  (Thanks, Marc.D)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Marc.D on April 09, 2011, 10:24 PM
Thank you Skwire, really appreciated :):):)
It's working nice here. :beerchug:
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on April 09, 2011, 10:49 PM
So, I presume you were able to recursively load MD5 files from your music folder?  Also, if I may, are the changes intuitive enough?  One thing I still need to add is a way to cancel a scan (either with a button or, say, the Escape key).
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Marc.D on April 10, 2011, 07:57 PM
IMHO I think they are ok...

One thing I still need to add is a way to cancel a scan (either with a button or, say, the Escape key).
Well yes, I thought of using the exit button in those cases :-[ ...

There seems to be an error when loading checksums recursively for a drive. I noticed that the file path has a double "\\" like "E:\\" and it returns an error when is closed. This is the report:

Exception Information
Code: 0xc0000005 Flags: 0x00000000
Record: 0x0000000000000000 Address: 0x000000007c921689

System Information
Windows NT 5.1 Build: 2600
CPU Vendor Code: 68747541 - 69746E65 - 444D4163
CPU Version: 00040FF2  CPU Feature Code: 078BFBFF
CPU AMD Feature Code: EBD3FBFF

PD: Out of laziness could the selected checksum mode button be remembered? : D
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on April 11, 2011, 01:14 AM
Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.0.4 - 2011-04-11
    + Pressing the Escape key during a scan will cancel the scan.
    + Checksum mode is now saved.  (Thanks, Marc.D)



As for that error, I can reproduce it.  However, I haven't a clue why it happens.   :-[
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Marc.D on April 12, 2011, 10:24 AM
 : O : O
+ Checksum mode is now saved.
Thanks again :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: mitzevo on April 17, 2011, 12:58 AM
Nice tool skwire.  ;D
Title: Re: SFV Ninja (Simple File Verification application)
Post by: mouser on September 30, 2011, 10:19 AM
Mentioned on ghacks today!
http://www.ghacks.net/2011/09/30/sfv-ninja-simple-file-verification-software/
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on September 30, 2011, 10:25 AM
Nice, thanks for the heads up.   :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: ewemoa on October 30, 2011, 09:54 PM
Awesome tool, Sir Skwire :)

Any chance of SHA-256 support?  I came across:

  http://www.imagemagick.org/download/binaries/digest.rdf (http://www.imagemagick.org/download/binaries/digest.rdf)

and failed to find other checksums...

Oh...and is there some hidden feature in the Help -> Contents dialog?


P.S. No official checksums for SFVNinja itself?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on October 30, 2011, 11:06 PM
Awesome tool, Sir Skwire :)

Thanks.  =]

Any chance of SHA-256 support?

Find me a free, stand-alone commandline executable that will spit out an SHA-256 checksum and, sure, I'll add it.

Oh...and is there some hidden feature in the Help -> Contents dialog?

Nope...yet another example of my laziness.  I really should put something there, eh?

P.S. No official checksums for SFVNinja itself?

Oh, the irony.   :P
Title: Re: SFV Ninja (Simple File Verification application)
Post by: mwb1100 on October 31, 2011, 01:14 AM
Find me a free, stand-alone commandline executable that will spit out an SHA-256 checksum and, sure, I'll add it.

I haven't tried any of these, but they may work (they're standard GNU tools):

I have compiled native (no Cygwin, no other dlls) Windows versions of md5sum.exe, sha1sum.exe, sha224sum.exe, sha256sum.exe, sha384sum.exe and sha512sum.exe. Download binaries here (http://www.nfllab.com/sums/sums.zip), and source (as required by GPL) here (http://www.nfllab.com/sums/coreutils-6.9.tar.bz2).
-http://blog.nfllab.com/archives/152-Win32-native-md5sum,-sha1sum,-sha256sum-etc..html

You might have to pass the `-b` option to force the programs to read in binary mode.

Title: Re: SFV Ninja (Simple File Verification application)
Post by: ewemoa on October 31, 2011, 04:18 AM
Find me a free, stand-alone commandline executable that will spit out an SHA-256 checksum and, sure, I'll add it.

How does sha256deep.exe from md5deep (http://md5deep.sourceforge.net/) look?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: ewemoa on October 31, 2011, 08:04 PM
I'd like to be able to copy a checksum to the clipboard...but I haven't figured out how.  Is there already a way?

I noticed that double-clicking on a row seems to result in a value getting displayed in the cell corresponding to the checksum column.  I'm guessing that what I'm seeing is a CRC32 value -- even when in MD5 or SHA-1 mode.  Is this expected behavior?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on October 31, 2011, 09:32 PM
The latest update should fix both issues.  Thanks for reporting them.

Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.0.6 - 2011-10-31
    + Added right-click context menu to the list to allow copying the
      checksum to the clipboard.  (Thanks, ewemoa)
    ! Double-clicking a row verified the file in CRC32 mode instead of the
      currently selected mode.  (Thanks, ewemoa)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: ewemoa on November 01, 2011, 01:16 AM
Thanks for the update!  Double-clicking and right-clicking both give expected results here now :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: ewemoa on November 06, 2011, 03:11 AM
I forgot to thank lanux128 for pointing me at SFV Ninja.

Thanks lanux128 :)

On the issue of additional hashing algorithms, I think OpenSSL supports a variety of hashes and is theoretically buildable on Windows -- licensing info from Wikipedia (http://en.wikipedia.org/wiki/OpenSSL#Licensing) follows:

OpenSSL is "dual licensed" under the OpenSSL License and the SSLeay License.  OpenSSL License is Apache License 1.0 and SSLeay License is 4-clause BSD License. The common usage of the term dual-license is that the user may pick which license they wish to use. However, OpenSSL documentation uses the term dual-license to mean that both licenses apply.

As the OpenSSL License is Apache License 1.0, but not Apache License 2.0, it requires the phrase This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit. (http://www.openssl.org/) to appear in advertising material and any redistributions (Sections 3 and 6 of the OpenSSL License).

Also, licensing info from the OpenSSL site:

  http://www.openssl.org/source/license.html (http://www.openssl.org/source/license.html)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on November 10, 2011, 10:42 PM
Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.0.7 - 2011-11-10
    + Added SHA-256 support.  (Thanks, ewemoa)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on November 28, 2011, 08:58 PM
Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.0.9 - 2011-11-28
    + Added sort arrows to the columns.
    * Changed the sorting order of the Filename and Filepath columns to match
      the operating system since Windows 7 seems to default to "logical"
      sorting.  (Thanks, ewemoa)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Deozaan on December 12, 2011, 02:54 PM
Is there a way to trim duplicates from the list?

Say I've got a music folder with many many subdirectories of artists and albums, etc. If I have a single SFV file in the root music folder and I want to update it with newly added music, it would be most convenient to just have it scan the entire music folder (recursively) without adding duplicates that are already in the SFV file.

If this isn't in the program already, please consider this an official feature request.  :Thmbsup:
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on January 26, 2012, 08:40 PM
Hi! I created 5 files (Calaméo.zip, Calaméo.rar, Calaméo.xls, Calaméo.doc, Calaméo.txt) then I wanted to check crc32. And I saw the 0000000. I used SFVNinja ANSI. I think a problem is in symbol "é"? MD5 is OK! Sorry for my Eng.
(http://s018.radikal.ru/i512/1201/9f/787d70113d65t.jpg) (http://radikal.ru/F/s018.radikal.ru/i512/1201/9f/787d70113d65.png.html)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: lanux128 on January 26, 2012, 08:49 PM
Hi! I created 5 files (Calaméo.zip, Calaméo.rar, Calaméo.xls, Calaméo.doc, Calaméo.txt) then I wanted to check crc32. And I saw the 0000000. I used SFVNinja ANSI. I think a problem is in symbol "é"? MD5 is OK! Sorry for my Eng.
(http://s018.radikal.ru/i512/1201/9f/787d70113d65t.jpg) (http://radikal.ru/F/s018.radikal.ru/i512/1201/9f/787d70113d65.png.html)

have you tried the unicode version? that should support the accents..
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on January 26, 2012, 10:30 PM
lanux128
Yes, I know in Unicode version is OK. MD5 is OK in ANSI. Why crc32 is not? I don't use Unicode version because it incompatible with QuickSFV and many other programs. Sorry for my Eng.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on January 27, 2012, 12:02 AM
Hi, Cornucopiae, and welcome to the site.

Yes, I know in Unicode version is OK. MD5 is OK in ANSI. Why crc32 is not? I don't use Unicode version because it incompatible with QuickSFV and many other programs. Sorry for my Eng.

I've tested the ANSI version out a bit and the MD5 checksum reported in the ANSI version (for Unicode filenames) is not right.  It will report the same checksum for all Unicode filenames (D41D8CD98F00B204E9800998ECF8427E).  Is this the same checksum you get?  If so, this is a bug in the ANSI version.  In other words, you're going to have to use the Unicode version for your Unicode filenames.  The resulting SFV is written in UTF-8 format which is why a lot of other SFV programs can't handle SFV files produced by the SFV Ninja Unicode version.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on January 27, 2012, 06:13 AM
skwire
Yes, I got this checksum D41D8CD98F00B204E9800998ECF8427E. Thanks, now I understand.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: daws0n on February 12, 2012, 03:26 PM
Thanks for creating this really helpful tool, I have been looking for something like this for a long time!

GUI is nice and it works great for scanning and checking files via existing SFVs, but I am having problems with the update feature. Unless I am using it incorrectly, this is the problem I face...

I have a folder of pictures, with a single .sfv file for checking (verify.sfv, created with your software). This loads and checks the folder contents fine, but after I add new pictures I want to update the SFV to include them also. So... first I "add folders to list" and select the photo folder, and then "load checksum file" and select the corresponding existing verify.sfv.

I expected it to simply add the new photos to the main window since the existing files were accounted for... But it treats everything in the verify.sfv list as a "newly added file"... So, the "verify newly added files only" option doesn't not work properly in this case.... It it no quicker than creating an entire SFV again due to the duplicate entries!

I am with Deozaan on this, any chance of incorporating "trim duplicates" option? Could you implement this easily with the information referenced in file paths column? I.e if an absolute file path appears more than once, the duplicates are deleted. This would make updating SFVs far easier and would be a most welcome feature - I've yet to find another tool that offers such flexibility as yours.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on February 12, 2012, 10:53 PM
Thanks for creating this really helpful tool, I have been looking for something like this for a long time!

You're welcome and welcome to the site.   :)

I am with Deozaan on this, any chance of incorporating "trim duplicates" option?

I've added this type of logic into the latest build.  However, the expectation is that the user load any checksum file(s) FIRST.  This way, all files within the checksum file get added with their appropriate checksums.  After that, you can add files/folders and it will only add files that don't already exist in the list, to the list.  Does that make sense?  At any rate, give this version a try:

Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.1.0 - 2012-02-12
    + Duplicate files are no longer added to the list.  (Thanks, Deozaan and daws0n)
    + Last used folder should be remembered now when adding folders.  (Thanks, Deozaan)
    ! Handled bug where an erroneous MD5 checksum would be generated for a Unicode
      filename whilst using the ANSI version.  (Thanks, Cornucopiae)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: daws0n on February 13, 2012, 03:24 PM
Wow that was quick, great work skwire! Tried and tested - no problems here, works 100% as expected :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on February 13, 2012, 04:47 PM
Wow that was quick, great work skwire! Tried and tested - no problems here, works 100% as expected :)

Great to hear.  Thanks for reporting back.   ;)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 08, 2012, 07:13 AM
skwire, first i must say i love the program. i spent hours searching google for recursive sfv checkers and after installing, testing, deleting quite a few i came across your one.  :Thmbsup:

some things i would like to recommend:

first: at the bottom of the screen alongside "total", "ok", "bad"... can you put one for "sfv"? this would show the total number of sfvs there are.

second: when i am doing a recursive check on a hdd, it is normally for thousands of files. i dont care too much to have all the files showing up in the screen. what do you think of having just a sfv file line showing then having a "+" or arrow (like in the registry) next to it which will expand to show the actual files which are being checked. if you are not sure what i mean, sort of like how the registry does it (i.e. you click the arrow to expand the next section). so if i dropped 30 folders onto the main window it should only show the 30 sfv rows then i can expand to see the files if need be.

third: if there is a bad or missing file, to highlight the line in yellow, red or some other color. this makes it visually stand out more. so if the second recommendation is implemented, the sfv main row would be red, then when you expand the missing/bad files row is also red.

what do you think?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 08, 2012, 10:47 AM
skwire, first i must say i love the program. i spent hours searching google for recursive sfv checkers and after installing, testing, deleting quite a few i came across your one.  :Thmbsup:

Thank you and welcome to DonationCoder.  =]

first: at the bottom of the screen alongside "total", "ok", "bad"... can you put one for "sfv"? this would show the total number of sfvs there are.

Can do.

what do you think of having just a sfv file line showing then having a "+" or arrow (like in the registry) next to it which will expand to show the actual files which are being checked.

Unfortunately, I don't think this can be done with the standard listview control that is available to me in AutoHotkey (the language all my tools are written in).

third: if there is a bad or missing file, to highlight the line in yellow, red or some other color. this makes it visually stand out more. so if the second recommendation is implemented, the sfv main row would be red, then when you expand the missing/bad files row is also red.

I have done this before for other apps but there are some programming-related caveats.  I'll check which libraries are available these days and see if they've solved some of those issues.  I assume you did see that the row icons do change colour if a file is missing or the hash doesn't match?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 09, 2012, 12:50 AM
hi skwire, thanks for the speedy response.

thanks for the first part.

about the second part, if it cannot be done i can live without it. i do like how the interface is clean and does what it does. some other ones i found to be too gimmicky and showed too many things which made it cluttered.

for the third part, yes i did notice the colour change when either the checksums differ or the file is missing. i do not want to change the program too much because some other people might not like the idea, but if it was possible to add a row highlight colour, maybe have that as an option so as to leave the default as it is now.

another thing i thought of is to be able to right-click on any file and have the option to open folder location so you can go straight to the folder.

i think i will keep using this program.  :)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 11, 2012, 05:47 PM
Thanks for your patience.  Please give this version a test and let me know if it does what you requested.

http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.2.zip (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.2.zip)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 11, 2012, 07:30 PM
wow skwire, i wasn't expecting a release so soon.  :Thmbsup:

the row colors aren't too harsh but they still stand out which is good and is what i am looking for.

you forgot to add the sfv total at the bottom of the screen along side the other counters.

another thing i have noticed is, when i use "scan folder for checksum files and load" it loads the sfv but it won't check the row which has missing files. so if i verify all files, the counter at the bottom still shows 0 missing at the end of the check (the row is highlighted as missing though which is fine). so at the moment i have to remember to "check all rows" option before running the verify. could you make it default to "check" all the rows when adding the sfv?

thanks a lot.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 11, 2012, 08:47 PM
you forgot to add the sfv total at the bottom of the screen along side the other counters.

Well, I wasn't sure how to implement this.  For instance, let's say you add five SFVs to the list but then delete some rows and add, say, five more SFVs to the list.  Are we now at ten?  Or, do we start over on every add action so we'd be at five?  Let's say you load two SFVs and then remove some rows.  Are we now still at two even with partial loads?  Lots of different scenarios here.

another thing i have noticed is, when i use "scan folder for checksum files and load" it loads the sfv but it won't check the row which has missing files. so if i verify all files, the counter at the bottom still shows 0 missing at the end of the check (the row is highlighted as missing though which is fine). so at the moment i have to remember to "check all rows" option before running the verify. could you make it default to "check" all the rows when adding the sfv?

Actually, that's a bug.  It should be counting missing files even if they're not checked.  I'll fix this.  =]
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 11, 2012, 09:45 PM
i am glad i noticed the bug.  :P

regarding the sfv counter... it shouldn't really matter how many you add or delete because it depends on the verified check at the end. the counter should show how many sfvs were checked in total.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 11, 2012, 10:29 PM
regarding the sfv counter... it shouldn't really matter how many you add or delete because it depends on the verified check at the end. the counter should show how many sfvs were checked in total.

Right, but you're not checking SFVs...you're checking files.  As in, once you load an SFV's files into the list, SFV Ninja doesn't know or care about which SFV the file(s) came from.  I mean, I can certainly keep count of the number of SFVs parsed through and loaded but it would become meaningless if you were you, say, clear the list and add more SFVs to the list.  Follow me?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 12, 2012, 05:32 AM
oooh, of course.. the sfv itself isn't getting checked.  :-[

but wouldn't most people clear the files in the list before adding some more folders? thats what i do. i plan to check one hard drive, once the verify is complete, remove files from list, grab another hard drive and do the same for that. if the list is cleared it gets reset back to zero. its just that if i added 30 folders, i would expect there to be 30 sfvs, so it would be confirming that they were all picked up.

if it can't be done, then it's ok.  ;)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 12, 2012, 07:50 AM
if it can't be done, then it's ok.  ;)

Well, it can be done but I'm struggling to find an elegant way to handle it.  I know that sounds lame and I apologise.   :-[

At any rate, here's the latest build with some further changes and the bug fix you reported.  Please let me know how this build checks out.  Thank you.

http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.4.zip (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.4.zip)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 12, 2012, 09:03 PM
just tested the latest version, the row checkbox for missing files still remains unticked (which i suppose is fine seeing as there is no file found), but as the verify reaches the row the counter is adjusted as necessary.

the clear list button is a simple but nice addition. :)

in this example one i am doing, the end counters are:

total: 29        ok: 28        bad: 1        missing: 2

"bad" is included in the total because i suppose a file was present so its not representative if it was successful or not. how about it showing the results like:

total: 28/31        ok: 28        bad: 1        missing: 2
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 14, 2012, 03:25 PM
Give this build a try:  http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.32.zip (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.4.zip)

I made some internal changes and sacrificed a bit of GUI responsiveness for speed when verifying a list.  Let me know how it goes.  Thanks.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 15, 2012, 01:37 AM
ok, now every row is checked when adding a sfv, so thats good.

i have noticed the slowdown when trying to scroll down or up.

so end results are:

total: 31/31        ok: 28        bad: 1        missing: 2

so the total is just confirming the rows?

one other minor thing which might be a little hard to explain. i use the scroll wheel on the mouse quite a lot and when i open the program, the cursor default is on the mode menu. so if i add the files then start scrolling, the mode changes because i haven't clicked elsewhere in the program.  :-[

also, maybe have the counters reset after clearing the list. at the moment, they are reset only once a new verify begins.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 15, 2012, 07:55 AM
i have noticed the slowdown when trying to scroll down or up.

Agreed, and I'm not sure I like it.  I'll probably switch it back to the original way.

so the total is just confirming the rows?

Yes, and it also acts as a counter while it's verifying files.  BTW, if you double-click the statusbar, it will take you to the currently verifying row.

one other minor thing which might be a little hard to explain. i use the scroll wheel on the mouse quite a lot and when i open the program, the cursor default is on the mode menu. so if i add the files then start scrolling, the mode changes because i haven't clicked elsewhere in the program.  :-[

Hehehe, I got burned by this very thing last night and already have fixed it in the next build.

also, maybe have the counters reset after clearing the list. at the moment, they are reset only once a new verify begins.

Can do.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 15, 2012, 11:15 AM
Build 34: http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.34.zip (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja_v1.1.0.34.zip)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 16, 2012, 07:21 AM
the slowdown has gone completely seeing as i can scroll normally. i guess u reverted back to the original way. it is better this way.

the mode scrolling issue is fixed.  :D

the counters reset when list is cleared.

for the missing/bad files row, the colored row appears only after the verify is finished for all the files in the list. could you change it to color the row as a problem is found? as long as it doesn't slow down the program.

other than that, i am pleased with the program.  :Thmbsup:
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 16, 2012, 07:37 AM
could you change it to color the row as a problem is found?

This is the way I had initially tried to make it work but, for some reason, it wouldn't.  I tried various tweaks to get the listview to repaint while it was scanning files but nothing worked so colouring it at the end of a scan was the next best thing.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 16, 2012, 01:31 PM
Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.1.1 - 2012-05-12
    + Added "Open file location", "Open folder location" and "Launch file" options to the context/edit menu.  (Thanks, sfv4me)
    + Added optional row colouring.  Enable it from the options menu.  (Thanks, sfv4me)
    + Added "Clear list" button to the toolbar.
    * Some listview adjustments to hopefully speed things up when checking large lists of files.
    * Improved the file loading performance when checking for dupes.
    * Changed individual mode buttons to one dropdown list.
    * Removed the ANSI build.  If you still need it, let me know.
    ! Missing files weren't counted properly if their row was unchecked.  (Thanks, sfv4me)
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 16, 2012, 06:15 PM
could you change it to color the row as a problem is found?

This is the way I had initially tried to make it work but, for some reason, it wouldn't.  I tried various tweaks to get the listview to repaint while it was scanning files but nothing worked so colouring it at the end of a scan was the next best thing.

it's not a big deal really so no need to worry about it.

anything different from 1.1.0.34 to 1.1.1, or is it just a non-beta release?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 24, 2012, 06:50 PM
hi skwire,

i came across an issue when i was checking some of my hdds.

i have this sfv which has the filenames surrounded by double quotes such as : "example.part01.rar" 8888d90d, "example.part02.rar" d7e6g7t0, etc.

so when it gets loaded into sfv ninja it looks for a file actually called that with the double quotes which doesn't exist so it is reported as missing. other sfv checkers work fine with it though so they must ignore these.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 24, 2012, 06:58 PM
Did you mean double-quotes instead of parentheses?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 24, 2012, 09:44 PM
yeah sorry, i meant double quotes..  :P

i edited the previous post.
Title: Re: SFV Ninja (Simple File Verification application)
Post by: skwire on May 25, 2012, 01:42 AM
Thanks for the bug report.  Here you go:

Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.1.2 - 2012-05-25
    ! Double-quotes around a filepath in a checksum file are now ignored.
      (Thanks, sfv4me)


If I may ask, has SFV Ninja been working well for you?
Title: Re: SFV Ninja (Simple File Verification application)
Post by: sfv4me on May 29, 2012, 07:03 AM
skwire, so far its been pretty good.  :Thmbsup:

much appreciated for all your hard work.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: kyrathaba on August 11, 2012, 07:23 AM
Very nice tool! Just added it to my pen-drive suite. Donation on its way...
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on August 11, 2012, 07:30 AM
Thanks, kyrathaba, I appreciate it.  =]
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on August 28, 2012, 02:37 PM
SFV Ninja v1.1.2 always crashed, when was checking files on PC. For example, when I check c:\window\

sorry for my ENG

winXP

http://desmond.imageshack.us/Himg546/scaled.php?server=546&filename=84463356.jpg&res=landing
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on August 30, 2012, 07:48 AM
SFV Ninja v1.1.2 always crashed, when was checking files on PC. For example, when I check c:\window\

Try v1.1.3 and see if that works any better.  Thanks.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on September 01, 2012, 05:53 AM
SFV Ninja v1.1.3, yes this version is OK! No crashing! But very very slow

1. Very very slow
2. Problem to saving sfv list (sometimes no saved)

I think v1.2 is better becuse faster, sometimes crashed, but faster

Sorry for my ENG
Thanks!
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: stefanobrunesci on September 07, 2012, 08:38 AM
Hi, thanks for this program :)

Pretty sure I've found a bug with it when running multiple instances on Win7 64bit. To recreate:-

1. Create a checksum file (I used Md5) for a directory containing a few hundred files of around 20mb each (I'm checking .CR2 image files). Save it in the directory.

2. Open TWO instances of SFVNinja by double-clicking the .Md5 file.

3. Start verifying all files in both instances.

Both instances should report a random selection of "bad" checksums.

If you only run 1 instance of SFVNinja or leave one open but not verifying while you verify with the other, then all files are verified as ok. As soon as two instances are verifying at the same time, spurious "bad" results occur.

The same problem occurs if two or more instances are verifying different directories against different checksum files.

I'm guessing it's some kind of threading issue.

I haven't checked if it also happens if one instance is creating new checksums while a second is verifying a different directory, but I expect it does as that's what I was doing when I first started seeing "bad" checksums. The scenario above was created specifically to test for this bug.

This had me very worried that my files were randomly corrupting themselves in-situ for a while!! :D

Luckily, the workaround (to only run one instance at a time) seems to work, although of course it's less convenient.

I'm using Version 1.1.3 Build 1

Thanks again anyway!


Ciao
Stefano

www.stefanobrunesci.com
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 07, 2012, 03:03 PM
Hi, thanks for this program :)
-stefanobrunesci (September 07, 2012, 08:38 AM)

You are welcome and welcome to the DonationCoder site.

2. Open TWO instances of SFVNinja by double-clicking the .Md5 file.
3. Start verifying all files in both instances.
Both instances should report a random selection of "bad" checksums.
-stefanobrunesci (September 07, 2012, 08:38 AM)

Hmmm...I did some thinking about this and made a small change in the code.  Please redownload the zip and let me know if v1.1.3.2 makes any difference in your tests.  Thank you.


Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on September 08, 2012, 04:37 AM
Hi skwire, thanks for the update!

just tested the latest version SFV Ninja v1.1.3.2

Why so slow?
For example, checking 369 files

SFV Ninja v1.1.2 = 00.00.03 min Elapsed time

(http://s13.radikal.ru/i186/1209/07/a965c4376ed0t.jpg) (http://radikal.ru/F/s13.radikal.ru/i186/1209/07/a965c4376ed0.png.html)

SFV Ninja v1.1.3.1
SFV Ninja v1.1.3.2 = 00.01.43 min Elapsed time

(http://s49.radikal.ru/i124/1209/aa/c4519ecd2bdet.jpg) (http://radikal.ru/F/s49.radikal.ru/i124/1209/aa/c4519ecd2bde.png.html)

what do you think?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: f0dder on September 08, 2012, 07:44 AM
Hmmm...I did some thinking about this and made a small change in the code.  Please redownload the zip and let me know if v1.1.3.2 makes any difference in your tests.  Thank you.
Any hints as to what the issue is (or what you thought it is)? Sounds interesting :)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 08, 2012, 08:33 AM
Why so slow?

In AutoHotkey, there are no native hash/checksum commands.  So, you have three options: 1) Use a command line executable, 2) a DLL, or 3) use a function library that somebody has developed.  SFV Ninja uses number one and three.  However, I've found that the function library, while very fast and accurate, has a tendency to crash randomly and I don't know why.  So, I changed SFV Ninja to only use that function when absolutely necessary where before it was using it for smaller files because of its speed.

Any hints as to what the issue is (or what you thought it is)?

So, back to the explanation of SFV Ninja using a command line executable for most of the grunt work.  SFV Ninja creates a temp folder and extracts the necessary files it needs into it.  During operation, it then calls the command line exe and dumps the output to a temp file named as the current ISO timestamp.  I thought this would be enough granularity (to the second) until stefanobrunesci's reported issue made me think that two concurrently running scans could attempt to create temp files with the same name and write to them at the same time.  This, perhaps, was what was causing stefanobrunesci's issue.  So, to solve it, the change I made was to have each running instance of SFV Ninja work out of its own unique temp folder.  The files it extracts total around half a meg so I'm not worried about multiple temp folders, etc.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: stefanobrunesci on September 09, 2012, 10:38 AM
Hmmm...I did some thinking about this and made a small change in the code.  Please redownload the zip and let me know if v1.1.3.2 makes any difference in your tests.  Thank you.
Hi skwire, thanks for the speedy update! :)

Just ran up 10 instances at the same time to test and no spurious "bad" results, so it looks good!

Thanks again

Ciao
Stefano
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 09, 2012, 01:58 PM
Good to know; thanks for the report back.  :Thmbsup:

BTW, SFV Ninja is single-threaded so I'm not certain how much benefit you're getting from running multiple instances.  Just thought you'd like to know.  Thanks for joining the site!
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: stefanobrunesci on September 09, 2012, 02:27 PM
SFV Ninja is single-threaded so I'm not certain how much benefit you're getting from running multiple instances.
I guess the benefit (for me) is that I can fire up a bunch of instances in one go and set them to creating/verify checksums on a load of folders, then just leave them to get on with it - eg. overnight - rather than having to do each one sequentially.

Thanks again :)

Ciao
Stefano
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 09, 2012, 02:37 PM
I guess the benefit (for me) is that I can fire up a bunch of instances in one go and set them to creating/verify checksums on a load of folders, then just leave them to get on with it - eg. overnight - rather than having to do each one sequentially.
-stefanobrunesci (September 09, 2012, 02:27 PM)

I see.  However, doing it that way is definitely going to very taxing on your harddrives.  Were you aware that one SFV Ninja instance can load multiple checksum files into its list?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: stefanobrunesci on September 10, 2012, 05:00 AM
Were you aware that one SFV Ninja instance can load multiple checksum files into its list?
Yes, thanks :)

My archiving "strategy" requires separate checksum files for each top level folder though, so when creating the files in the first place it's easier to just run up a separate instance per folder :)

Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: f0dder on September 10, 2012, 07:51 AM
My archiving "strategy" requires separate checksum files for each top level folder though, so when creating the files in the first place it's easier to just run up a separate instance per folder :)
-stefanobrunesci (September 10, 2012, 05:00 AM)
Hm, seems like a bad idea to run multiple instances at one time, at least for long-running jobs. You'll see much decreased throughput (way worse than linear degradation), and all the back-and-forth action is going to be stressful on your harddrive heads.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: stefanobrunesci on September 11, 2012, 06:39 AM
Hm, seems like a bad idea to run multiple instances at one time, at least for long-running jobs. You'll see much decreased throughput (way worse than linear degradation), and all the back-and-forth action is going to be stressful on your harddrive heads.

If I run 3 instances against folders on 3 separate physical drives it's definitely quicker than running them one after another, and I can go to bed and forget about it ;)

As for the wear on my drives - I figure that's why we have so many backups in the first place! :D
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 11, 2012, 08:58 AM
3 separate physical drives
-stefanobrunesci (September 11, 2012, 06:39 AM)

Ah, that's the key.  I (and f0dder, I bet) thought you were working with one physical drive.  =]
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: f0dder on September 12, 2012, 09:12 AM
3 separate physical drives
-stefanobrunesci (September 11, 2012, 06:39 AM)
Ah, that's the key.  I (and f0dder, I bet) thought you were working with one physical drive.  =]
Indeed :)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 22, 2012, 04:21 PM
Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.1.4 - 2012-09-22
    * No longer writes the Unicode BOM to checksum files.


@Cornucopiae: This version should allow you to use the Unicode version and still generate checksum files that are compatible with non-Unicode apps like QuickSFV.

Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on September 23, 2012, 04:44 AM
Hi skwire, thanks for the new update! :Thmbsup:

@Cornucopiae: This version should allow you to use the Unicode version and still generate checksum files that are compatible with non-Unicode apps like QuickSFV.

Thank you!

In AutoHotkey, there are no native hash/checksum commands.  So, you have three options: 1) Use a command line executable, 2) a DLL, or 3) use a function library that somebody has developed.  SFV Ninja uses number one and three.  However, I've found that the function library, while very fast and accurate, has a tendency to crash randomly and I don't know why.  So, I changed SFV Ninja to only use that function when absolutely necessary where before it was using it for smaller files because of its speed.

It is unfortunate that the library has tendency to crash. I'm using SFV Ninja v1.1.2 because it's faster. I'll wait for the news.

I'm very pleased with the program anyway! :up:
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on November 14, 2012, 10:37 PM
Website (http://skwire.dcmembers.com/wb/pages/software/sfv-ninja.php) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.1.5 - 2012-11-14
    + Added "Always on top" button to the toolbar.
    ! Prevented exiting the app if a save operation is in process.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: omeletted on January 21, 2013, 07:20 AM
Been looking all over for a lightweight, simple and free file verification program and SFV Ninja fits perfectly. ^_^ Minor feature requests:


Thanks for the great software!
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on January 22, 2013, 01:54 AM
Hi, omeletted, and welcome to the DonationCoder site.

Minor feature requests:
  • ability to delete from the file list
  • check/uncheck selected items from the right-click context menu. Alternatively press spacebar

Would deleting to the recycle bin be acceptable?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: omeletted on January 22, 2013, 04:22 AM
Would deleting to the recycle bin be acceptable?

I dont mean physical deletion of the actual files, I mean from the file listing in SFV Ninja. :3 I know it's kinda unnecessary since you can just uncheck the files you dont want to verify, having the other request would be sufficient if it's too much trouble.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on January 22, 2013, 12:05 PM
I dont mean physical deletion of the actual files, I mean from the file listing in SFV Ninja.

Ah, if that's what you mean, simply press the Delete key after highlighting the rows you want to remove.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on August 10, 2013, 05:12 AM
Hi skwire, is there any news on the expense of speed?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on August 10, 2013, 07:05 PM
Hi skwire, is there any news on the expense of speed?

Give this a build a thorough beating and let me know how it works for you, please.

http://skwire.dcmembers.com/apps/sfv_ninja/_SFVNinja.zip
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on August 11, 2013, 02:23 AM
This build has tendency to crash, like SFV Ninja v1.1.2. But speed is OK!
Thanks anyway!
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on August 11, 2013, 08:42 AM
Which operating system are you using?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on August 11, 2013, 10:03 AM
winxp
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on August 11, 2013, 10:13 AM
It would crash on me as well under XP but, in my tests yesterday, I couldn't get it to crash under Windows 7.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 01, 2014, 10:27 PM
@Cornucopiae: If you're still using SFV Ninja, would you mind trying this version and letting me know how it performs for you on XP?

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.1.7 - 2013-08-10
    * Speed improvements (hopefully).
    * Row colouring improvements.
    ! "Open folder location" was broken.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on March 09, 2014, 12:54 PM
skwire, this version is perfect!!!

Speed improvements (hopefully)
:Thmbsup:

Have only 1 problem:
(http://radikall.com/images/2014/03/09/ZT8aS.png) (http://radikall.com/images/2014/03/09/ZT8aS.png)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 09, 2014, 02:38 PM
skwire, this version is perfect!!!

So, I'll take this to say you have tested this under XP and aren't getting the random crashes you reported a while back?  If so, right on, and thanks for testing.

Have only 1 problem:

Uh, yeah, that would be a problem, eh?   :-[  Please try the version below:

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.1.9 - 2014-03-09
    ! Checksum dropdown wasn't functional due to toolbar changes
      in the 1.1.7 version.  (Thanks, Cornucopiae)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cornucopiae on March 10, 2014, 04:26 AM
1. No crash. In my tests I couldn't get it to crash under Windows XP.
2. Speed is OK!  :Thmbsup:
3. Bug? Can't save list to checksum file (md5), because some of files have zero byte.

MD5
(http://radikall.com/images/2014/03/10/Ae0K1.png) (http://radikall.com/images/2014/03/10/Nev7.png)

SFV
(http://radikall.com/images/2014/03/10/RMcx.png) (http://radikall.com/images/2014/03/10/qT28O.png)

Sorry for my Eng.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 13, 2014, 04:46 AM
Thanks for the bug report, Cornucopiae.  Please retest with the latest version and let me know how it goes.  I also added the ability to specify a custom listview font.

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.0 - 2014-03-13
    + Added ability to specify the listview font in the Options menu.
    ! Zero-byte files weren't handled correctly for MD5, SHA-1, and
      SHA-256 hash types.  (Thanks, Cornucopiae)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on April 30, 2014, 02:02 PM
Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.1 - 2014-04-30
    * Cancelling a scan should be much more responsive.
    ! Large files weren't hashed properly.  (Thanks, P. Montinaro)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Fgkl99 on July 01, 2014, 01:14 PM
This is a very good program. Thank you.
it would be nice to implement the ability to select multiple rows together.
It is very difficult to select hundreds of lines separately
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on July 02, 2014, 01:41 PM
Hi, Fgkl99, and welcome to DonationCoder.   :Thmbsup:

it would be nice to implement the ability to select multiple rows together.
It is very difficult to select hundreds of lines separately

Please try the new version and see if that is what you had in mind.  Also, don't forget that there are "Check all rows" and "Uncheck all rows" toolbar buttons.

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.2 - 2014-07-02
    + Added Ctrl+S hotkey for saving.
    + Added "Check selected" and "Uncheck selected" items to the context
      menu.  (Thanks, Fgkl99)
    * Changed the "Clear list" toolbar icon to a broom icon.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Fgkl99 on July 04, 2014, 10:24 AM
This is exactly what I meant. Thank you.
I found a little error.
The first row is not possible to be checked when you first time (after program start) use "check selected items"  feature.
[ You are not allowed to view attachments ]
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on July 07, 2014, 10:43 AM
Thanks, Fgkl99.   :)

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.3 - 2014-07-07
    * Worked around an issue where the first row was missed when using the
      "Check selected" and "Uncheck selected" features under certain
      scenarios.  (Thanks, Fgkl99)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 29, 2014, 01:59 AM
Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.4 - 2014-09-29
    + Added file scanning progress bar.
    + Added options to clear verified, missing, or bad files from the list.
    * Statusbar counts should be more accurate.
    ! Made some changes to, hopefully, fix the freeze-while-resizing bug.
    ! Pressing <ESC> triggered status bar "stopping" text whether a scan
      was in progress or not.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: enone on December 08, 2014, 05:21 PM
Hi All...

Thanks For That Nice Tool :)

...I'll Ask If It's Possible To Add .ZIP File CRC Check :)

Some Times Appen That Some Relase Are In ZIP Archive And There Is No SFV Files Inside
So It Will Be Nice To Have A Single Tool To Check For SFV And ZIP Archive CRC If Not SFV
Is Present...

Thanks
Keep Up The Good Work :Thmbsup:
enone 
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on December 08, 2014, 05:33 PM
Hi, enone, and welcome to the DonationCoder site.   :D

Thanks For That Nice Tool :)
...I'll Ask If It's Possible To Add .ZIP File CRC Check :)

Thank you for your kind words.  Unfortunately, I'm not familiar with the Zip File CRC check as you're describing it.  Can you provide me with more detail (or an example)?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: enone on December 09, 2014, 01:45 PM
I'm Not A Programmer I Don't Know In Witch Language You Coded Your Nice Tool

But I Suppose You Can Use unzip.dll And Check If The Exit Code Is Not "0"

Also I'Ve Found Some Informations Here...

http://stackoverflow.com/questions/3954505/how-to-quickly-check-if-a-zip-file-is-corrupted
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on December 09, 2014, 02:49 PM
I've been using this again recently and I've discovered 2 (possibly related) bugs:


On that last one, what I mean is this:

Say I have 10 files I'm verifying. And it gets through the first 5 and is working on #6. But I realize I don't care about #4, so I click on it and press Delete. Well, now #6 is #5 and #5 is #4, etc. But when it finishes verifying the file, it will write the data in the 6th row.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on December 09, 2014, 04:55 PM
@Deozaan: I've been meaning to make it so the list is disabled during verification so I'll work on that tonight.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on December 10, 2014, 03:06 PM
@Deo:

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.5 - 2014-12-10
    + Disabled most GUI elements when a scan is in progress.  (Thanks, Deozaan)
    + While a scan is in progress, the menu bar will reduce to a single Cancel
      menu with a Cancel option.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on December 10, 2014, 06:26 PM
Thanks!

Another issue I've noticed is that when I create/verify a bunch of checksums, with some new files added to the mix, if I save the file, SFV Ninja doesn't "reload" the md5 file. So the files I've generated checksums are are still considered "new" and will generate/verify them again if I add more files and click the "verify new" button again.

Not only that, but if I verify a bunch of new files, then save the checsums to a md5 file, then load the md5 file, the files are all still considered new. I have to clear the list first, then load the md5 file before the checksums appear in the "saved checksum" column.

It would be nice if, upon saving the file, all the checksums would be moved over to the "Saved Checksum" column. This would prevent checksums from being generated repeatedly. I suppose this could be "faked" by just clearing the list and reloading the newly saved file immediately.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on December 17, 2014, 02:12 AM
I found another bug:

If I click Load directory for md5 checksums, then click Load Directory for files to check, it will add an extra \ to the path if I load from the root of a drive, and will therefore consider the file to be "new" instead of matching it to previously saved checksums.

[ You are not allowed to view attachments ]

And now that the GUI is disabled while verifications are in progress, this includes the scrollbar, which means if you are scrolled down (or up?) then you can't see the results of scans as they're happening, other than the status bar at the bottom of the application. It would be nice if the application would keep the most recent results on screen by scrolling the list automatically as checksums are verified.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on December 17, 2014, 07:05 AM
Thanks for both of your last two posts.   :Thmbsup:  I'm currently working on some improvements to ClipTrap but SFV Ninja is next on my agenda.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on December 20, 2014, 07:37 PM
Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.6 - 2014-12-19
    + Added an option to automatically scroll the list so the current file being
      verified stays visible in the list.  This option can be found in the
      Options menu.
    * When a checksum file is saved, any current checksums will be copied over
      to the saved checksum column.  (Thanks, Deozaan)
    ! Duplicate slashes when a drive root was added.  (Thanks, Deozaan)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on December 20, 2014, 08:24 PM
Sweet! Thanks!
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: xviruz on December 26, 2014, 08:51 PM
I have a few feature requests... Apologies if they've already been asked for.

1. Do not remember "full screen" as the last used resolution. It's a bit annoying when the program starts up un-maximized but still takes up the entire screen.

2. Faster skips for files with saved checksums. It takes over 10 mins to go through 10k or so files that already have saved checksums when using "verify new files only" (Win 7 x64, Core i5, 8GB RAM, 7200RPM Seagate drive). I'm not sure why that is---if this is all in memory, it should very fast. If GUI is the issue, update it less frequently?

If this is not possible, then it'd be nice to enable saving an SFV without reverifying or skipping files that already have saved checksums. That is, the SFV is generated using "checksum" where possible and "saved checksum" otherwise, throwing a warning only when neither "checksum" nor "saved checksum" exist. So for example, if I load an SFV, I can immediately save it with no warnings. (Right now, it warns when "checksum" fields are empty, even when "saved checksum" is present.)

My use case is CRC'ing an entire drive and occasionally appending/adding CRCs of new files by first loading an existing SFV and drag-n-dropping the drive (or its folders). Ideally, files already with checksums can be skipped very quickly. If not, I'd (want to) sort by saved checksum, calculate it for the new files, sort by filepath, and save a new SFV without reverifying/skipping the existing ones.

3. Allow the comment to display "This file has been modified" when a file's modified timestamp is later than the SFV's creation timestamp. If the timestamp metadata is pulled together with file size when scanning files, there should be no performance penalty. Though, I'd understand if you think this bloats the program in a negative way.

Thanks for all your hard work.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on December 26, 2014, 10:59 PM
Hi, xviruz, and welcome to the DonationCoder site.   :)

1. Do not remember "full screen" as the last used resolution. It's a bit annoying when the program starts up un-maximized but still takes up the entire screen.

2. Faster skips for files with saved checksums. It takes over 10 mins to go through 10k or so files that already have saved checksums when using "verify new files only" (Win 7 x64, Core i5, 8GB RAM, 7200RPM Seagate drive). I'm not sure why that is---if this is all in memory, it should very fast. If GUI is the issue, update it less frequently?

Both these items should be addressed in the latest version I just uploaded.  Please test and let me know.  Links at bottom.

3. Allow the comment to display "This file has been modified" when a file's modified timestamp is later than the SFV's creation timestamp. If the timestamp metadata is pulled together with file size when scanning files, there should be no performance penalty. Though, I'd understand if you think this bloats the program in a negative way.

The timestamp data is not currently pulled for each file so I'm not certain how much cumulative time this would add.  So, how important is this feature to you?  

Thanks for all your hard work.

You're very welcome.   :Thmbsup:



Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.7 - 2014-12-26
    * Better window handling when launching the app after it had been closed in
      a maximised state.  (Thanks, xviruz)
    ! Fixed a slow speed issue when verifying files with an already saved
      checksum in place.  (Thanks, xviruz)


Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: xviruz on December 26, 2014, 11:43 PM
Both these items should be addressed in the latest version I just uploaded.  Please test and let me know.  Links at bottom.

Thanks, they both work great. It's much faster now!

The timestamp data is not currently pulled for each file so I'm not certain how much cumulative time this would add.  So, how important is this feature to you?

It's nice-to-have but not critical: the drives I'm CRC'ing are largely append/read-only, so it's not too hard to sift through the bad CRCs and figure out if it was because the file changed. I guess if most of your files are always changing, stale CRCs will be pretty useless.

I haven't ever developed in Windows, so my guess was that if it were anything like Unix, where stat-ing a file will give you a struct with both file size and timestamps, it wouldn't add any disk overheads (since you're already scanning for file sizes). If that's not the case, it'd probably take twice as long in the worst case (an additional scan, no caching).
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: xviruz on December 27, 2014, 09:56 PM
I just noticed that the "Total" bar is broken. It either doesn't update at all or, when verifying newly added files, gets stuck in a partial state (bar never goes to the end). It was working fine in 1.2.6.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on December 27, 2014, 10:45 PM
I just noticed that the "Total" bar is broken. It either doesn't update at all or, when verifying newly added files, gets stuck in a partial state (bar never goes to the end). It was working fine in 1.2.6.

Sorry about that.   :-[

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.2.8 - 2014-12-27
    ! Total progress bar was broken in the last build.  (Thanks, xviruz)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Bluedraft on May 08, 2015, 04:43 PM
Hi, I have 20 files from different directories ready for the checksum, it is possible to output 20 .sfv files in their respective directories instead just one with the 20 checksums? thanks in advance for any help and best regards.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on May 08, 2015, 05:05 PM
Hi, Bluedraft, and welcome to the DonationCoder site.   :D

Hi, I have 20 files from different directories ready for the checksum, it is possible to output 20 .sfv files in their respective directories instead just one with the 20 checksums? thanks in advance for any help and best regards.

No, this is not currently possible in SFV Ninja.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: BONZ on September 27, 2015, 10:01 AM
Really nice util. :Thmbsup: And to let ya know I have it running on Windows 10 with all updates, NO PROBLEM! :) So ya need to update that in desc. I'd suggest. ;) BTW, reallu DOES need a operations readme at least, your loafin'(https://www.donationcoder.com/forum/esmileys/gen3/3Smileys/eusa_naughty.gif)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 28, 2015, 11:55 AM
Really nice util. :Thmbsup: And to let ya know I have it running on Windows 10 with all updates, NO PROBLEM! :) So ya need to update that in desc. I'd suggest. ;) BTW, reallu DOES need a operations readme at least, your loafin'(https://www.donationcoder.com/forum/esmileys/gen3/3Smileys/eusa_naughty.gif)

Thank you for the report.   :Thmbsup:
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Sempfmaus on March 17, 2016, 10:27 AM
Hi there!

I saw your sfv-ninja-programm.. and i tried it, but it didnt make a .sfv-file when i dropped a folder on it (like your sPlayListMaker does).

What relay would be nice is adding the drag&drop-function from sPlayListMaker. (Dropping a folder & the .sfv is automatically created in the corresponding folder).
(And possibly "add .sfvs for all the the files". and/or  "add .sfv for the root-folder only" in the options).

So the main goal would be: adding the same functionally your sPlayListMaker has. (Drag & Drop wise).

I dont know how complicated it would be copying this functionality from sPlayListMaker to your SFV-Ninja, but that would make this program really outstanding.


Regards .. SempfMaus :)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 18, 2016, 06:27 PM
What relay would be nice is adding the drag&drop-function from sPlayListMaker.

Hi, Sempfmaus, and thank you for trying SFV Ninja as well as the feedback.  SFV Ninja is one of the few apps I've written that I actually wrote for my own uses as opposed to a Coding Snack request, etc.  As such, it's written to fit into my own workflow so I have no plans to add an sPlaylistMaker-like automatic mode.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: rm on May 12, 2016, 02:28 PM
SFV Ninja v1.2.9
Win XP
When launch get this:

(http://i.imgur.com/IyjRokd.png)

Something with Cyrillic locale again?
Thanks

[ You are not allowed to view attachments ]
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on May 13, 2016, 12:12 AM
Something with Cyrillic locale again?

Yes, and the fact that more recent AHK builds pop that error.  Please test v1.3.0 and let me know if that fixes things.

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.3.0 - 2016-05-13
    - Regressed progress bar changes from v1.2.9 until I can work out some bugs.
    ! Fixed some alternate keyboard hotkey issues.  (Thanks, rm)

v1.2.9 - 2016-05-12
    * Improved the accuracy of the "Total:" progress bar.

Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: rm on May 13, 2016, 10:06 AM
Version 1.3.0 works fine
Thank you very much!  :)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on June 04, 2016, 09:35 AM
Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.3.1 - 2016-06-02
    * Reintroduced total progress bar accuracy changes.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on July 07, 2016, 06:36 PM
Did the file format change? I just tried to load an .md5 file and it seems to have swapped the file path and the checksums.

The file lists them as:

[path] [checksum]
[path] [checksum]

Et cetera. But the client shows the checksum as the filename/path and the path as the saved checksum.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on July 08, 2016, 08:32 AM
Did the file format change? I just tried to load an .md5 file and it seems to have swapped the file path and the checksums.

The file lists them as:

[path] [checksum]
[path] [checksum]

Et cetera. But the client shows the checksum as the filename/path and the path as the saved checksum.

Are you certain this was an MD5 file generated by SFV Ninja?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on July 08, 2016, 05:29 PM
Are you certain this was an MD5 file generated by SFV Ninja?

We got this sorted out in DC's IRC channel. I had somehow accidentally saved over an MD5 file while SFVNinja was in CRC32 mode, so it wrote the format incorrectly for MD5 files. :Thmbsup:
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on July 10, 2016, 08:54 PM
Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.3.2 - 2016-07-08
    + Added support for SHA-384 and SHA-512.
    + Improved parser to better support older MD5/SHA-# file formats.
    * Automatically switch to the correct checksum mode when loading a single
      checksum file via the "File > Load checksum file" method.  (Thanks,
      Deozaan)
    ! The total progress bar was broken from MD5, SHA-1, and SHA-256 modes.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: xviruz on August 12, 2016, 01:04 AM
I'm liking the pause button in 1.3.3 but miss the ability to scroll while performing the checksum (the middle portion is grayed out/non-interactive). Any chance you could add that back?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on August 15, 2016, 09:49 AM
Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.3.5 - 2016-08-15
    * Re-enabled the listview while a scan is in progress.  However, sorting of
      columns is now disabled while a scan is in progress.  (Thanks, xviruz)

v1.3.4 - 2016-07-29
    + Added hotkeys to the "Clear Items" menu.

v1.3.3 - 2016-07-17
    + Added Pause/Resume and Cancel buttons to the main form.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: xviruz on August 15, 2016, 09:57 PM
1.3.5 works great, thanks a lot!  :D
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on August 16, 2016, 12:07 AM
1.3.5 works great, thanks a lot!  :D

Good to hear and you're welcome.  I use SFV Ninja many times daily so it's one app I like to keep improving.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: jammmie900 on September 06, 2016, 08:38 PM
Can you add right click on SFV and MD5 files to scan/check ? need to drag the files every time.  :(
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on September 06, 2016, 10:31 PM
Hi, jammmie900, and welcome to the DonationCoder site.

Can you add right click on SFV and MD5 files to scan/check ? need to drag the files every time.  :(

If you want SFV Ninja to open with SFV and MD5 files, do the following:


Repeat the same procedure for MD5 files.  At this point, you should be able to double-click either an SFV or an MD5 file and it should automatically load into SFV Ninja.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: jammmie900 on September 18, 2016, 05:21 PM
Hi, jammmie900, and welcome to the DonationCoder site.

Can you add right click on SFV and MD5 files to scan/check ? need to drag the files every time.  :(

If you want SFV Ninja to open with SFV and MD5 files, do the following:

  • Shift+right-click an SFV file and choose Open with > Choose default program from the menu.
  • Click the Browse... button and navigate to the SFVNinja.exe file.
  • Ensure the Always use the selected program to open this kind of file checkbox is ticked.
  • Click the OK button.

Repeat the same procedure for MD5 files.  At this point, you should be able to double-click either an SFV or an MD5 file and it should automatically load into SFV Ninja.

Yes,
Thank you, I figured it out :)
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cocoa on March 16, 2017, 04:04 AM
Hello!

I've very glad I spotted your software fairly quick after coming to the forums. I spent the entire evening testing out around 7 or 8 different checksum generating or verifying software after trawling the internet, and in the end I had to come back to Donationcoder to find something even close to approaching what I need. I just wish I had thought of coming here sooner, but the forum is still a bit difficult to sift through to find a particular software for a particular need.

Your SFV Ninja's ability to generate checksum files with relative paths is a big bonus for me to decide to try it out--all the other tools glaring oversight to only be able to generate and verify checksums with static paths frustrated me to no end... (You'd think this was one of the most basic things that's needed for verifying checksum files (https://www.donationcoder.com/forum/esmileys/gen3/1Small/WALLBASH.GIF))

Unforunately I still can't seem to figure out how to have SFV Ninja do all that I need, which is really quite simple:
I have two folders, say named Folder A and Folder B.
They're stored under different paths and have different names. Inside are other nested folders and files, which have the same general directory structure, but may or may not all match. What I'm trying to find out is exactly what's there and what's not, and for the ones that have same filename and path, whether they're indeed the exact same files.

So I need a file checksum tool that can do the following:

1. Scan and generate checksum files such as SFV or other formats for a folder, e.g. Folder A, with all subfolders and files inside.
2. Use the generated checksum file to compare against another folder, with different path and top level folder name, e.g. Folder B for the contents INSIDE.
3. Generate a report that tells me what matches and what's missing/changed. This doesn't have to be very comprehensive, but should be easy to read.

In the short amount of time I had left for the evening, I couldn't test SFV Ninja very thoroughly, but it seems it already got two out of the three down pretty well. Tihe only issue I have left is how can I accomplish the missing one (#2 in the steps)?
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on March 16, 2017, 09:40 AM
I have two folders, say named Folder A and Folder B.
They're stored under different paths and have different names. Inside are other nested folders and files, which have the same general directory structure, but may or may not all match. What I'm trying to find out is exactly what's there and what's not, and for the ones that have same filename and patch, whether they're indeed the exact same files.

The fact that SFV Ninja stores relative paths instead of absolute paths lets you accomplish what you want:


That said, it sounds like what you actually want is a diff program, such as WinMerge (http://winmerge.org/).
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 16, 2017, 12:31 PM
I have two folders, say named Folder A and Folder B.
They're stored under different paths and have different names. Inside are other nested folders and files, which have the same general directory structure, but may or may not all match. What I'm trying to find out is exactly what's there and what's not, and for the ones that have same filename and patch, whether they're indeed the exact same files.

Even though I'm the developer of SFV Ninja, as Deo mentioned, what you need is a diff program -- something like Beyond Compare (http://www.scootersoftware.com/features.php) from Scooter Software (http://http://www.scootersoftware.com).  Here's a screenshot showing what you're describing:

[ You are not allowed to view attachments ]

Beyond Compare is a wonderful program that I've used for over ten years.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cocoa on March 17, 2017, 05:18 AM
I have two folders, say named Folder A and Folder B.
They're stored under different paths and have different names. Inside are other nested folders and files, which have the same general directory structure, but may or may not all match. What I'm trying to find out is exactly what's there and what's not, and for the ones that have same filename and patch, whether they're indeed the exact same files.

The fact that SFV Ninja stores relative paths instead of absolute paths lets you accomplish what you want:

  • Use SFV Ninja to create a checksum file for Folder A.
  • Save the resulting checksum file in Folder A.
  • Move the checksum file (or copy it) to Folder B.
  • Open the checksum file with SFV Ninja and have it verify the checksums.
That's what I thought would be the steps, except when I created the checksum file and moved it to the other folder, then selected "Load checksum file" -> "Verify All", all I got was the program re-verifying all the files in the initial folder that the checksum was created from. I also tried "Scan folder for checksum file and load" and got the same result.

Also would like to make a suggestion to Jody/skwire (not sure which you prefer), can you add a "clear selected" option? Sometimes someone might want to clear only a portion of the results or list before saving it to file, and being able to clear the exact ones a user needs instead of everything or everything of one type would be nice.

Additionally, thank you both for the software suggestions. I'm aware of WinMerge, though I haven't heard of Beyond Compare before. At a glance, Beyond Compare would seem to be perfect for my other need of maintaining and cross syncing backups of folders and files on multiple hard drives. I've been searching for something like that as well, so thank you! I'll definitely give it a try.

It's true that from the singular usage example I described, there are other types of software that can do what I need. But I really value efficiency in software and like to look for applications that can do as much of what I need as possible, with as little resource usage as possible. Since I also have a need for generating sfv files to send to other people for their verification purposes, I was mainly trying to find such a checksum generating software that could also let me compare the two folders in this way. It would seem to be a very simple and basic usage need that's quite standard for this type of application. I honestly did not anticipate the difficulty I would have in finding what I needed, but I'm very glad I came here.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 17, 2017, 11:02 AM
That's what I thought would be the steps, except when I created the checksum file and moved it to the other folder, then selected "Load checksum file" -> "Verify All", all I got was the program re-verifying all the files in the initial folder that the checksum was created from. I also tried "Scan folder for checksum file and load" and got the same result.

This might be a bit confusing but where you save the SFV file is important in relation to which files are in the list:


So, in your example of using Folder A and Folder B, you load the contents of Folder A in SFV Ninja, check them, and then you must save the SFV directly in Folder A in order to generate the correct relative paths for use when you move the SFV file to Folder B.  Does this make sense?

Also would like to make a suggestion to Jody/skwire (not sure which you prefer), can you add a "clear selected" option?

I can add it to the menu (oversight on my part) but, in the meantime, simply press Delete after selecting/highlighting the items you want to remove.

Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Deozaan on March 17, 2017, 04:45 PM
I have two folders, say named Folder A and Folder B.
They're stored under different paths and have different names. Inside are other nested folders and files, which have the same general directory structure, but may or may not all match. What I'm trying to find out is exactly what's there and what's not, and for the ones that have same filename and patch, whether they're indeed the exact same files.

The fact that SFV Ninja stores relative paths instead of absolute paths lets you accomplish what you want:

  • Use SFV Ninja to create a checksum file for Folder A.
  • Save the resulting checksum file in Folder A.
  • Move the checksum file (or copy it) to Folder B.
  • Open the checksum file with SFV Ninja and have it verify the checksums.
That's what I thought would be the steps, except when I created the checksum file and moved it to the other folder, then selected "Load checksum file" -> "Verify All", all I got was the program re-verifying all the files in the initial folder that the checksum was created from. I also tried "Scan folder for checksum file and load" and got the same result.

That shouldn't happen if you follow my instructions to save the checksum in Folder A. Since the paths are relative, it should verify the checksums for the current folder, which will be Folder B after you copy/move the file.

I also forgot to say that after you've copied/moved the file, you should clear the list, and then add Folder B to the list using the "Add folders to list" option before loading/verifying the checksum file. This will show you which files don't exist in Folder A, since they won't have any checksums saved in the checksum file.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Cocoa on March 22, 2017, 09:30 AM
@Dezoaan Thanks, I got the sfv working now.

This might be a bit confusing but where you save the SFV file is important in relation to which files are in the list:
  • Files that are on the same drive as the saved SFV file path are saved with paths relative to the save folder.
  • Files that are on a different drive than the saved SFV file path are saved with full paths.

Thank you for the reply, but as an average user, it IS rather confusing for me why the location where the sfv file is saved should matter. It's especially hard to understand just from reading the two sentences.  :huh: BtW, by "same drive" do you mean an entire physical hard drive itself or just a logical partition?

I've managed to accomplish the initial goal of comparing those two folders by saving the sfv file first inside the first folder. After some more time testing and using SFV Ninja, I do have some additional questions:
There are some cases where it's not possible to save the sfv file in the exact same location as the files/folders the checksums were being generated for. For example, when reading the contents of a networked drive or an optical disk/image. The original path might be read-only. Is it absolutely necessary to save the checksum in the exact same path? Is there another way?

Also, it would be helpful to be able to export the results of the checksum comparison report as a txt or html formatted file. I've tried to directly use Ctrl + C to copy the results and paste it into notepad, but it appears the contents are not possible to copy into clipboard.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on May 06, 2017, 05:31 AM
BtW, by "same drive" do you mean an entire physical hard drive itself or just a logical partition?

Same logical partition.

Also, it would be helpful to be able to export the results of the checksum comparison report as a txt or html formatted file.

See new version below.

Website (http://skwire.dcmembers.com/fp/?page=sfv-ninja) | Download (http://skwire.dcmembers.com/apps/sfv_ninja/SFVNinja.zip)
v1.3.6 - 2017-05-06
    + List clear mode toolbar option is now saved.
    + Added "Save list to HTML file" option under the File menu. (Thanks, Cocoa)
    * Good rows are now coloured green.
    * Eliminated dependency on resources.dll for icon glyphs.
    * Eliminated dependency on temp directory.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Seveleven on May 09, 2018, 10:29 PM
Hello, thank you for this very handy program. I especially like the "check only new files" option which saves me so much time on really large folders.

I was wondering if you could add an "ignore list" where the user can add files and filetypes which SFV Ninja will completely ignore like "Thumbs.db", ".txt" files or other hash files like ".sha1", ".md5", etc.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Frog Manus on March 27, 2019, 02:49 PM
v1.3.6 - 2017-05-06

Can't open or check file if the file name is too long
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: skwire on March 28, 2019, 12:00 AM
Can't open or check file if the file name is too long

I'm not sure what to tell you other than to shorten your filenames.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Shades on March 28, 2019, 10:18 PM
If the file name is too long, are you sure the error message comes from SFV? Or is it a error message generated by Windows and its NTFS file system?

When it is the latter, there is only one thing to do and that is shorten your filenames. Because every piece of (Windows) software in existence (that reads or writes data to a drive), must comply with the filesystem from Windows and its limitations.

The file system in Windows has a rigid limit and there is nothing you can do about that, unless you happen to work for Microsoft, fixing this limitation in their Windows file system. But if you are not an employee, then there is nothing you can do.
Title: Re: Release: SFV Ninja (Simple File Verification application)
Post by: Frog Manus on March 29, 2019, 08:05 PM
Skwire

Ok. Thank you for the reply.
What should i do if folder names are too long?
How to check files in a folder? It's a bug?
----
I found a solution:

1. Generated report in WinRAR
2. Opened Excel and imported the report.
3. Checked files
https://transfer.sh/dUcih/Example.zip