DonationCoder.com Forum

Main Area and Open Discussion => General Software Discussion => Topic started by: urlwolf on July 27, 2006, 11:59 AM

Title: ideas for perfect backup/sync software
Post by: urlwolf on July 27, 2006, 11:59 AM
Here are some discussions:
http://yabb.jriver.com/interact/index.php?topic=34807.0

http://www.lifehacker.com/software/backup-utilities/ask-lifehacker-syncing-directories-163469.php

but in general the programs discussed are pretty weak.
Here are my requeriments, met by NONE of the programs:

(1) Incremental backups
(2) recovery from incremental backups to any point in time automatically (!). See https://www.donationcoder.com/forum/index.php?topic=4532.0;topicseen
(3) rar compression, (I'd be nice to have the 10%-20% redundancy as extra safety againts corruption, plus better encryption capabilities).
(4) If using compression, I want indexing (find all versions of a file) and fast. Otherwise, I'll trust locate 3.0
(5) reliability
(6) sftp
(7) Monitoring. I want to be able to say: everytime a file in this folder changes, make a copy.
(8) versioning
(9) compare changes (a la beyond compare) of text files, highlighting syntax, and enabling live editing.

What are your thoughts? I know no program does all this. But, any combination that does all this?
Currently I'm using syncBackSE (no compression) + locate 3.0 + webdrive.
Title: Re: ideas for perfect backup/sync software
Post by: urlwolf on July 27, 2006, 12:01 PM
Also, Ideally I want a program that can keep a copy of EVERY FILE in use in the system. E.g., if any application crashes and no backup was made by the app. itself, this backup program should take care of things. Bye bye crappy MS studio, etc crashes, and "the computer ate my homework" excuses...
Title: Re: ideas for perfect backup/sync software
Post by: mukestar on July 28, 2006, 02:56 PM
As drives are cheap, why not just go for a raid 1 configuration.
Title: Re: ideas for perfect backup/sync software
Post by: f0dder on July 28, 2006, 03:00 PM
Please repeat the following 1.000 times after me:
RAID MIRRORING IS NOT BACKUP! :mad:
-f0dder
Title: Re: ideas for perfect backup/sync software
Post by: mukestar on July 28, 2006, 03:08 PM
Ahem

Also, Ideally I want a program that can keep a copy of EVERY FILE in use in the system.

Which sounds like a good use of Mirroring, dontcha think

Anyway, asking someone to repeat something 1.000 times is basically just repeating it once, you`d make a rubbish teacher  :P
Title: Re: ideas for perfect backup/sync software
Post by: f0dder on July 28, 2006, 03:41 PM
Ahem

Also, Ideally I want a program that can keep a copy of EVERY FILE in use in the system.

No, it is not.

If you accidentally delete or overwrite a file, or experience filesystem corruption, there's nothing a raid mirror can do to save your sorry ass. The only thing a mirror protects against is accidental death of one drive.

Syncing to some separate location means you have an "offline" copy that can be restored if you screw up.
Title: Re: ideas for perfect backup/sync software
Post by: mukestar on July 28, 2006, 04:00 PM
Ok, i see your point and stand corrected.

 
Title: Re: ideas for perfect backup/sync software
Post by: f0dder on July 28, 2006, 04:05 PM
Ok, i see your point and stand corrected.

Sorry if I sounded a bit harsh, but many people forget those points - ending up with trashed data because you put your faith in mirroring is "sorta unfortunate" :)
Title: Re: ideas for perfect backup/sync software
Post by: mukestar on July 28, 2006, 04:07 PM
Woah, Id never put faith in Raid 1,  I would in Raid 5. :)

And you werent being harsh, im just used to working with Huge files that are quite frankly impracticle to back up. Its just down to what your using your PC for.  But your right , theres no escaping the fact if youve overwritten a file , youve overwritten a file, and unless your a dab hand with MFT records (or have something like r-studio installed) , your going to need a backup.
Title: Re: ideas for perfect backup/sync software
Post by: urlwolf on July 28, 2006, 09:22 PM
Also, Ideally I want a program that can keep a copy of EVERY FILE _in_ _use_

Maybe I should have said "opened". Some backup applications do not copy opened files, or do so only after coughing up for a pricey extension (hello, genie backup :) ).

The reason why I think this is important is that I have lost my working files serveral times while editing them due to applications that do not care enought to let you save a security copy automatically. Adding real-time monitoring (e.g., mark "myMostImportantWork.txt" for monitoring means that everytime I open it, an extra copy is saved in the backup, and in real time, every change I make is saved. No need to wait for the scheduled backup to kick in. That may be troublesome, and it may make for a lot of files with tiny differences... but it may be worth it.

Unfortunately a backup cannot force the application to do autosaves.If you use e.g. powerpoint with no autosave, and edit a lot before hitting ctrl+S, you may be in for trouble. I wonder if all the changes would stay in memory (just wait for the crash:) ) or there is some temporary file somewhere...
Title: Re: ideas for perfect backup/sync software
Post by: patthecat on July 28, 2006, 10:44 PM
urlwolf,

I think your requirements lists fall into the software category of "continuous data protection"
See the following article to get an overview of it's definition:
http://www.infostor.com/Articles/Article_Display.cfm?Sectionfiltered=ARTCL&ARTICLE_ID=239640

I've been doing some research on CDP for the past week and the most reasonably priced ones for personal use seem to be
1.  IBM's Tivoli Continuous Data Protection for Files (http://www-306.ibm.com/software/tivoli/products/continuous-data-protection/)
It can be purchased for $35 via online download only from IBM; and Digital River through OfficeMax, Staples, and Circuit City Stores website.

2.  Stardock's Keepsafe (http://www.stardock.com/products/keepsafe/)
It can be purchased for $30.

I'm thinking of using one of the above for my sister-in-law's medical practice (RAID 1 being setup and now trying to think about a "set it and forget it" backup solution) and for my own use. So anyone out there with experience on these products I'd appreciate thgouhts and comments.

patrick
Title: Re: ideas for perfect backup/sync software
Post by: patthecat on July 28, 2006, 10:52 PM
The only thing with CDP I'm not sure about is how they handle open files especially databases. 

urlwolf - I, too, use syncbackse :)
Title: Re: ideas for perfect backup/sync software
Post by: urlwolf on July 29, 2006, 04:59 AM
patthecat, good find.
I tried downloading the ibm one, but they didn't let me register to dl the free code. No idea why (Try again later)
Title: Re: ideas for perfect backup/sync software
Post by: urlwolf on August 06, 2006, 06:45 AM
ok, I finally downloaded this IBM CDP for files thing.
The program is in java, and works from within a browser.

It seems very well thought of.
You can include/exclude files by extension or by directory.

I'll post more once I try it further.

patthecat, if you can do the same, that'd be great.
Title: Re: ideas for perfect backup/sync software
Post by: jdd on August 06, 2006, 08:07 AM
As a long time user of syncbackse, I will be very interested to hear your feedback.... :down: or :up:
Title: Re: ideas for perfect backup/sync software
Post by: Second Shadow on August 06, 2006, 04:18 PM
Currently I'm using syncBackSE (no compression) + locate 3.0 + webdrive.

Just curious ... what are you using webdrive for? Maybe for uploading backups to an offsite FTP server? I'm almost sure that SyncBackSE can do that without the need for Webdrive ...
Title: Re: ideas for perfect backup/sync software
Post by: urlwolf on August 06, 2006, 07:08 PM
can sbSE do that for SFTP (SSH?). Really?
Title: Re: ideas for perfect backup/sync software
Post by: Second Shadow on August 06, 2006, 10:55 PM
can sbSE do that for SFTP (SSH?). Really?

You're not being sarcastic on me, now, are you?  :D

To recap, I recall simply asking what you were using webdrive for. A possible answer could have been "I'm using webdrive for the SFTP connection because SyncbackSE doesn't support it", but you chose another ...  :huh:
Indeed, SyncbackSE does not support SFTP, but it does support FTPS  :)
Confusing? you bet. For those of us who don't remember the difference, here's Micky (the developper of syncback) explaining it: http://www.2brightsparks.com/help/index.php?pf=kb&page=index_v2&id=156&c=

That's not what I call self-evident, precisely

urlwolf: I'm assuming that you are using the commercial product Webdrive because none of the free solutions for using SFTP with Syncback worked for you. I'm referring to the alternatives mentioned here: http://www.2brightsparks.com/help/index.php?pf=kb&page=index_v2&id=193&c=

(Tunnelier did work for this guy, at least: http://dmihalik.com/articles/2006/03/22/using-ftp-applications-over-sftp)

Anyway, sarcasm or not, I wish you luck in your search of the most suitable backup solution.

Regards,
2ndS
Title: Re: ideas for perfect backup/sync software
Post by: imtrobin on August 10, 2006, 12:36 AM
Something I'm haven't evaluated, but looks good.

http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_page&PAGE_id=56&MMN_position=154:154
Title: Re: ideas for perfect backup/sync software
Post by: elpresi on August 12, 2006, 05:19 AM
Super Flexible File Synchronizer supports versioning:
http://www.superflexible.com/
So you may want to look into it.

:-)
Title: Re: ideas for perfect backup/sync software
Post by: urlwolf on August 27, 2006, 07:37 AM
can sbSE do that for SFTP (SSH?). Really?

You're not being sarcastic on me, now, are you?  :D
-Second Shadow (August 06, 2006, 10:55 PM)
Sorry, It was not sarcasm. I was unsure if SFTP was supported, I didn't know.