Home | Blog | Software | Reviews and Features | Forum | Help | Donate | About us
topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • December 03, 2016, 07:50:47 AM
  • Proudly celebrating 10 years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: Any upload hash checking/comparing software?  (Read 1682 times)

Deozaan

  • Charter Member
  • Joined in 2006
  • ***
  • Points: 1
  • Posts: 7,713
    • View Profile
    • The Blog of Deozaan
    • Read more about this member.
    • Donate to Member
Any upload hash checking/comparing software?
« on: April 14, 2010, 01:17:38 PM »
Every once in a while I will upload some files to the internet as a backup, and when I restore the files back to my computer, I realize that the file is corrupt because my internet connection freaked out during the FTP upload.

Is there any FTP client/server software that will perform a checksum on the remote files and compare them to the local files? Or perhaps a php/website script that could do something like this?

The reason why I'd prefer FTP is because my host provides a special FTP-only backup account (with no web-access to the files) and that's usually where I upload my backups to.


f0dder

  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 9,029
  • [Well, THAT escalated quickly!]
    • View Profile
    • f0dder's place
    • Read more about this member.
    • Donate to Member
Re: Any upload hash checking/comparing software?
« Reply #1 on: April 14, 2010, 05:48:43 PM »
You can't do a checksum on the remote files without downloading them :) (unless there's some really funky FTP daemon that has a checksum SITE command, but haven't heard of one).

A guy I know worked on a custom ftp client years ago that would create checksum files for every file you uploaded, with a hash for each chunk of the file so you would only have to re-download corrupt pieces. Dunno if he ever produced even a proof-of-concept, I've never heard of other people doing this, and it would obviously only work for files that you've uploaded with the custom client. *shrug*.
- carpe noctem

JavaJones

  • Review 2.0 Designer
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 2,717
    • View Profile
    • Donate to Member
Re: Any upload hash checking/comparing software?
« Reply #2 on: April 14, 2010, 05:50:31 PM »
Do you have shell access? I reckon you could probably setup a CRON job to make MD5 hashes of all files uploaded to a specific directory/tree if said files did not already exist. Then you could just make local MD5s and download the ones from the FTP to compare if there was ever any doubt.

- Oshyan

Innuendo

  • Charter Member
  • Joined in 2005
  • ***
  • default avatar
  • Posts: 2,255
    • View Profile
    • Donate to Member
Re: Any upload hash checking/comparing software?
« Reply #3 on: April 14, 2010, 09:34:38 PM »
Globalscape or Rhino software (?) has the feature you want, but you have to be running their software on both ends of the transfer (their FTP server & their FTP client) so I doubt that option would work for you.

Deozaan

  • Charter Member
  • Joined in 2006
  • ***
  • Points: 1
  • Posts: 7,713
    • View Profile
    • The Blog of Deozaan
    • Read more about this member.
    • Donate to Member
Re: Any upload hash checking/comparing software?
« Reply #4 on: April 14, 2010, 10:39:03 PM »
A guy I know worked on a custom ftp client years ago that would create checksum files for every file you uploaded, with a hash for each chunk of the file so you would only have to re-download corrupt pieces. Dunno if he ever produced even a proof-of-concept, I've never heard of other people doing this, and it would obviously only work for files that you've uploaded with the custom client. *shrug*.

That sounds basically like BitTorrent.

Globalscape or Rhino software (?) has the feature you want, but you have to be running their software on both ends of the transfer (their FTP server & their FTP client) so I doubt that option would work for you.

It probably won't, unless I can convince my host to switch to that. It would be great to have an FTP server that would perform a checksum server side to compare with a client that was performing the checksums before it uploaded.