topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Tuesday March 19, 2024, 4:52 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Last post Author Topic: Release: SFV Ninja (Simple File Verification application)  (Read 184573 times)

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #50 on: May 12, 2012, 07:50 AM »
if it can't be done, then it's ok.  ;)

Well, it can be done but I'm struggling to find an elegant way to handle it.  I know that sounds lame and I apologise.   :-[

At any rate, here's the latest build with some further changes and the bug fix you reported.  Please let me know how this build checks out.  Thank you.

http://skwire.dcmemb...FVNinja_v1.1.0.4.zip
« Last Edit: May 25, 2012, 01:43 AM by skwire »

sfv4me

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #51 on: May 12, 2012, 09:03 PM »
just tested the latest version, the row checkbox for missing files still remains unticked (which i suppose is fine seeing as there is no file found), but as the verify reaches the row the counter is adjusted as necessary.

the clear list button is a simple but nice addition. :)

in this example one i am doing, the end counters are:

total: 29        ok: 28        bad: 1        missing: 2

"bad" is included in the total because i suppose a file was present so its not representative if it was successful or not. how about it showing the results like:

total: 28/31        ok: 28        bad: 1        missing: 2

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #52 on: May 14, 2012, 03:25 PM »
Give this build a try:  http://skwire.dcmemb...VNinja_v1.1.0.32.zip

I made some internal changes and sacrificed a bit of GUI responsiveness for speed when verifying a list.  Let me know how it goes.  Thanks.
« Last Edit: May 25, 2012, 01:43 AM by skwire »

sfv4me

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #53 on: May 15, 2012, 01:37 AM »
ok, now every row is checked when adding a sfv, so thats good.

i have noticed the slowdown when trying to scroll down or up.

so end results are:

total: 31/31        ok: 28        bad: 1        missing: 2

so the total is just confirming the rows?

one other minor thing which might be a little hard to explain. i use the scroll wheel on the mouse quite a lot and when i open the program, the cursor default is on the mode menu. so if i add the files then start scrolling, the mode changes because i haven't clicked elsewhere in the program.  :-[

also, maybe have the counters reset after clearing the list. at the moment, they are reset only once a new verify begins.

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #54 on: May 15, 2012, 07:55 AM »
i have noticed the slowdown when trying to scroll down or up.

Agreed, and I'm not sure I like it.  I'll probably switch it back to the original way.

so the total is just confirming the rows?

Yes, and it also acts as a counter while it's verifying files.  BTW, if you double-click the statusbar, it will take you to the currently verifying row.

one other minor thing which might be a little hard to explain. i use the scroll wheel on the mouse quite a lot and when i open the program, the cursor default is on the mode menu. so if i add the files then start scrolling, the mode changes because i haven't clicked elsewhere in the program.  :-[

Hehehe, I got burned by this very thing last night and already have fixed it in the next build.

also, maybe have the counters reset after clearing the list. at the moment, they are reset only once a new verify begins.

Can do.

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
« Last Edit: May 25, 2012, 01:43 AM by skwire »

sfv4me

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #56 on: May 16, 2012, 07:21 AM »
the slowdown has gone completely seeing as i can scroll normally. i guess u reverted back to the original way. it is better this way.

the mode scrolling issue is fixed.  :D

the counters reset when list is cleared.

for the missing/bad files row, the colored row appears only after the verify is finished for all the files in the list. could you change it to color the row as a problem is found? as long as it doesn't slow down the program.

other than that, i am pleased with the program.  :Thmbsup:

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #57 on: May 16, 2012, 07:37 AM »
could you change it to color the row as a problem is found?

This is the way I had initially tried to make it work but, for some reason, it wouldn't.  I tried various tweaks to get the listview to repaint while it was scanning files but nothing worked so colouring it at the end of a scan was the next best thing.

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #58 on: May 16, 2012, 01:31 PM »
Website | Download
v1.1.1 - 2012-05-12
    + Added "Open file location", "Open folder location" and "Launch file" options to the context/edit menu.  (Thanks, sfv4me)
    + Added optional row colouring.  Enable it from the options menu.  (Thanks, sfv4me)
    + Added "Clear list" button to the toolbar.
    * Some listview adjustments to hopefully speed things up when checking large lists of files.
    * Improved the file loading performance when checking for dupes.
    * Changed individual mode buttons to one dropdown list.
    * Removed the ANSI build.  If you still need it, let me know.
    ! Missing files weren't counted properly if their row was unchecked.  (Thanks, sfv4me)

sfv4me

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #59 on: May 16, 2012, 06:15 PM »
could you change it to color the row as a problem is found?

This is the way I had initially tried to make it work but, for some reason, it wouldn't.  I tried various tweaks to get the listview to repaint while it was scanning files but nothing worked so colouring it at the end of a scan was the next best thing.

it's not a big deal really so no need to worry about it.

anything different from 1.1.0.34 to 1.1.1, or is it just a non-beta release?

sfv4me

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #60 on: May 24, 2012, 06:50 PM »
hi skwire,

i came across an issue when i was checking some of my hdds.

i have this sfv which has the filenames surrounded by double quotes such as : "example.part01.rar" 8888d90d, "example.part02.rar" d7e6g7t0, etc.

so when it gets loaded into sfv ninja it looks for a file actually called that with the double quotes which doesn't exist so it is reported as missing. other sfv checkers work fine with it though so they must ignore these.
« Last Edit: May 24, 2012, 09:44 PM by sfv4me »

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #61 on: May 24, 2012, 06:58 PM »
Did you mean double-quotes instead of parentheses?

sfv4me

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #62 on: May 24, 2012, 09:44 PM »
yeah sorry, i meant double quotes..  :P

i edited the previous post.
« Last Edit: May 24, 2012, 10:18 PM by sfv4me »

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #63 on: May 25, 2012, 01:42 AM »
Thanks for the bug report.  Here you go:

Website | Download
v1.1.2 - 2012-05-25
    ! Double-quotes around a filepath in a checksum file are now ignored.
      (Thanks, sfv4me)


If I may ask, has SFV Ninja been working well for you?

sfv4me

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: SFV Ninja (Simple File Verification application)
« Reply #64 on: May 29, 2012, 07:03 AM »
skwire, so far its been pretty good.  :Thmbsup:

much appreciated for all your hard work.

kyrathaba

  • N.A.N.Y. Organizer
  • Honorary Member
  • Joined in 2006
  • **
  • Posts: 3,200
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #65 on: August 11, 2012, 07:23 AM »
Very nice tool! Just added it to my pen-drive suite. Donation on its way...

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #66 on: August 11, 2012, 07:30 AM »
Thanks, kyrathaba, I appreciate it.  =]

Cornucopiae

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #67 on: August 28, 2012, 02:37 PM »
SFV Ninja v1.1.2 always crashed, when was checking files on PC. For example, when I check c:\window\

sorry for my ENG

winXP

http://desmond.image....jpg&res=landing
« Last Edit: August 28, 2012, 02:46 PM by Cornucopiae »

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #68 on: August 30, 2012, 07:48 AM »
SFV Ninja v1.1.2 always crashed, when was checking files on PC. For example, when I check c:\window\

Try v1.1.3 and see if that works any better.  Thanks.

Cornucopiae

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #69 on: September 01, 2012, 05:53 AM »
SFV Ninja v1.1.3, yes this version is OK! No crashing! But very very slow

1. Very very slow
2. Problem to saving sfv list (sometimes no saved)

I think v1.2 is better becuse faster, sometimes crashed, but faster

Sorry for my ENG
Thanks!

stefanobrunesci

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 5
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #70 on: September 07, 2012, 08:38 AM »
Hi, thanks for this program :)

Pretty sure I've found a bug with it when running multiple instances on Win7 64bit. To recreate:-

1. Create a checksum file (I used Md5) for a directory containing a few hundred files of around 20mb each (I'm checking .CR2 image files). Save it in the directory.

2. Open TWO instances of SFVNinja by double-clicking the .Md5 file.

3. Start verifying all files in both instances.

Both instances should report a random selection of "bad" checksums.

If you only run 1 instance of SFVNinja or leave one open but not verifying while you verify with the other, then all files are verified as ok. As soon as two instances are verifying at the same time, spurious "bad" results occur.

The same problem occurs if two or more instances are verifying different directories against different checksum files.

I'm guessing it's some kind of threading issue.

I haven't checked if it also happens if one instance is creating new checksums while a second is verifying a different directory, but I expect it does as that's what I was doing when I first started seeing "bad" checksums. The scenario above was created specifically to test for this bug.

This had me very worried that my files were randomly corrupting themselves in-situ for a while!! :D

Luckily, the workaround (to only run one instance at a time) seems to work, although of course it's less convenient.

I'm using Version 1.1.3 Build 1

Thanks again anyway!


Ciao
Stefano

www.stefanobrunesci.com

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #71 on: September 07, 2012, 03:03 PM »
Hi, thanks for this program :)
-stefanobrunesci (September 07, 2012, 08:38 AM)

You are welcome and welcome to the DonationCoder site.

2. Open TWO instances of SFVNinja by double-clicking the .Md5 file.
3. Start verifying all files in both instances.
Both instances should report a random selection of "bad" checksums.
-stefanobrunesci (September 07, 2012, 08:38 AM)

Hmmm...I did some thinking about this and made a small change in the code.  Please redownload the zip and let me know if v1.1.3.2 makes any difference in your tests.  Thank you.



Cornucopiae

  • Participant
  • Joined in 2012
  • *
  • default avatar
  • Posts: 12
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #72 on: September 08, 2012, 04:37 AM »
Hi skwire, thanks for the update!

just tested the latest version SFV Ninja v1.1.3.2

Why so slow?
For example, checking 369 files

SFV Ninja v1.1.2 = 00.00.03 min Elapsed time

http://s13.radikal.ru/i186/1209/07/a965c4376ed0.jpg
Release: SFV Ninja (Simple File Verification application)


SFV Ninja v1.1.3.1
SFV Ninja v1.1.3.2 = 00.01.43 min Elapsed time

http://s49.radikal.ru/i124/1209/aa/c4519ecd2bde.jpg
Release: SFV Ninja (Simple File Verification application)


what do you think?

f0dder

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 9,153
  • [Well, THAT escalated quickly!]
    • View Profile
    • f0dder's place
    • Read more about this member.
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #73 on: September 08, 2012, 07:44 AM »
Hmmm...I did some thinking about this and made a small change in the code.  Please redownload the zip and let me know if v1.1.3.2 makes any difference in your tests.  Thank you.
Any hints as to what the issue is (or what you thought it is)? Sounds interesting :)
- carpe noctem

skwire

  • Global Moderator
  • Joined in 2005
  • *****
  • Posts: 5,286
    • View Profile
    • Donate to Member
Re: Release: SFV Ninja (Simple File Verification application)
« Reply #74 on: September 08, 2012, 08:33 AM »
Why so slow?

In AutoHotkey, there are no native hash/checksum commands.  So, you have three options: 1) Use a command line executable, 2) a DLL, or 3) use a function library that somebody has developed.  SFV Ninja uses number one and three.  However, I've found that the function library, while very fast and accurate, has a tendency to crash randomly and I don't know why.  So, I changed SFV Ninja to only use that function when absolutely necessary where before it was using it for smaller files because of its speed.

Any hints as to what the issue is (or what you thought it is)?

So, back to the explanation of SFV Ninja using a command line executable for most of the grunt work.  SFV Ninja creates a temp folder and extracts the necessary files it needs into it.  During operation, it then calls the command line exe and dumps the output to a temp file named as the current ISO timestamp.  I thought this would be enough granularity (to the second) until stefanobrunesci's reported issue made me think that two concurrently running scans could attempt to create temp files with the same name and write to them at the same time.  This, perhaps, was what was causing stefanobrunesci's issue.  So, to solve it, the change I made was to have each running instance of SFV Ninja work out of its own unique temp folder.  The files it extracts total around half a meg so I'm not worried about multiple temp folders, etc.