DonationCoder.com forum
 
Read-only archive. This is a static copy of the DonationCoder.com forum. Reading and searching work as before; logging in, posting and private messages do not.
Archive of 2026-10-21 · About this archive · Main site

Author Topic: Any upload hash checking/comparing software?  (Read 4,593 times)

Deozaan

  • Charter Member
  • Joined in 2006
  • ***
  • Posts: 9,827
    • Participated in NANY Challenge Eight Times
    • Cody Award
Any upload hash checking/comparing software?
« on: April 14, 2010, 06:17 PM »
Every once in a while I will upload some files to the internet as a backup, and when I restore the files back to my computer, I realize that the file is corrupt because my internet connection freaked out during the FTP upload.

Is there any FTP client/server software that will perform a checksum on the remote files and compare them to the local files? Or perhaps a php/website script that could do something like this?

The reason why I'd prefer FTP is because my host provides a special FTP-only backup account (with no web-access to the files) and that's usually where I upload my backups to.

f0dder

  • [Well, THAT escalated quickly!]
  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 9,153
    • Participated in NANY Challenge Once
Re: Any upload hash checking/comparing software?
« Reply #1 on: April 14, 2010, 10:48 PM »
You can't do a checksum on the remote files without downloading them :) (unless there's some really funky FTP daemon that has a checksum SITE command, but haven't heard of one).

A guy I know worked on a custom ftp client years ago that would create checksum files for every file you uploaded, with a hash for each chunk of the file so you would only have to re-download corrupt pieces. Dunno if he ever produced even a proof-of-concept, I've never heard of other people doing this, and it would obviously only work for files that you've uploaded with the custom client. *shrug*.
- carpe noctem

JavaJones

  • Review 2.0 Designer
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 2,739
    • Participated in NANY Challenge Once
Re: Any upload hash checking/comparing software?
« Reply #2 on: April 14, 2010, 10:50 PM »
Do you have shell access? I reckon you could probably setup a CRON job to make MD5 hashes of all files uploaded to a specific directory/tree if said files did not already exist. Then you could just make local MD5s and download the ones from the FTP to compare if there was ever any doubt.

- Oshyan

Innuendo

  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 2,266
Re: Any upload hash checking/comparing software?
« Reply #3 on: April 15, 2010, 02:34 AM »
Globalscape or Rhino software (?) has the feature you want, but you have to be running their software on both ends of the transfer (their FTP server & their FTP client) so I doubt that option would work for you.

Deozaan

  • Charter Member
  • Joined in 2006
  • ***
  • Posts: 9,827
    • Participated in NANY Challenge Eight Times
    • Cody Award
Re: Any upload hash checking/comparing software?
« Reply #4 on: April 15, 2010, 03:39 AM »
A guy I know worked on a custom ftp client years ago that would create checksum files for every file you uploaded, with a hash for each chunk of the file so you would only have to re-download corrupt pieces. Dunno if he ever produced even a proof-of-concept, I've never heard of other people doing this, and it would obviously only work for files that you've uploaded with the custom client. *shrug*.

That sounds basically like BitTorrent.

Globalscape or Rhino software (?) has the feature you want, but you have to be running their software on both ends of the transfer (their FTP server & their FTP client) so I doubt that option would work for you.

It probably won't, unless I can convince my host to switch to that. It would be great to have an FTP server that would perform a checksum server side to compare with a client that was performing the checksums before it uploaded.

Original address: https://www.donationcoder.com/forum/index.php?topic=22440.0