Author Topic: ideas for perfect backup/sync software (Read 15230 times)

urlwolf · « **on:** July 27, 2006, 11:59 AM »

Here are some discussions:
http://yabb.jriver.c...ex.php?topic=34807.0

http://www.lifehacke...rectories-163469.php

but in general the programs discussed are pretty weak.
Here are my requeriments, met by NONE of the programs:

(1) Incremental backups
(2) recovery from incremental backups to any point in time automatically (!). See https://www.donation...pic=4532.0;topicseen
(3) rar compression, (I'd be nice to have the 10%-20% redundancy as extra safety againts corruption, plus better encryption capabilities).
(4) If using compression, I want indexing (find all versions of a file) and fast. Otherwise, I'll trust locate 3.0
(5) reliability
(6) sftp
(7) Monitoring. I want to be able to say: everytime a file in this folder changes, make a copy.
(

versioning
(9) compare changes (a la beyond compare) of text files, highlighting syntax, and enabling live editing.

What are your thoughts? I know no program does all this. But, any combination that does all this?
Currently I'm using syncBackSE (no compression) + locate 3.0 + webdrive.

urlwolf · « **Reply #1 on:** July 27, 2006, 12:01 PM »

Also, Ideally I want a program that can keep a copy of EVERY FILE in use in the system. E.g., if any application crashes and no backup was made by the app. itself, this backup program should take care of things. Bye bye crappy MS studio, etc crashes, and "the computer ate my homework" excuses...

mukestar · « **Reply #2 on:** July 28, 2006, 02:56 PM »

As drives are cheap, why not just go for a raid 1 configuration.

f0dder · « **Reply #3 on:** July 28, 2006, 03:00 PM »

Please repeat the following 1.000 times after me:

RAID MIRRORING IS NOT BACKUP!
-f0dder

mukestar · « **Reply #4 on:** July 28, 2006, 03:08 PM »

Ahem

Also, Ideally I want a program that can keep a copy of EVERY FILE in use in the system.
-urlwolf (July 27, 2006, 12:01 PM)

Which sounds like a good use of Mirroring, dontcha think

Anyway, asking someone to repeat something 1.000 times is basically just repeating it once, you`d make a rubbish teacher

f0dder · « **Reply #5 on:** July 28, 2006, 03:41 PM »

Ahem

Also, Ideally I want a program that can keep a copy of EVERY FILE in use in the system.
-urlwolf (July 27, 2006, 12:01 PM)
-mukestar (July 28, 2006, 03:08 PM)

No, it is not.

If you accidentally delete or overwrite a file, or experience filesystem corruption, there's nothing a raid mirror can do to save your sorry ass. The only thing a mirror protects against is accidental death of one drive.

Syncing to some separate location means you have an "offline" copy that can be restored if you screw up.

mukestar · « **Reply #6 on:** July 28, 2006, 04:00 PM »

Ok, i see your point and stand corrected.

f0dder · « **Reply #7 on:** July 28, 2006, 04:05 PM »

Ok, i see your point and stand corrected.
-mukestar (July 28, 2006, 04:00 PM)

Sorry if I sounded a bit harsh, but many people forget those points - ending up with trashed data because you put your faith in mirroring is "sorta unfortunate"

mukestar · « **Reply #8 on:** July 28, 2006, 04:07 PM »

Woah, Id never put faith in Raid 1, I would in Raid 5.

And you werent being harsh, im just used to working with Huge files that are quite frankly impracticle to back up. Its just down to what your using your PC for. But your right , theres no escaping the fact if youve overwritten a file , youve overwritten a file, and unless your a dab hand with MFT records (or have something like r-studio installed) , your going to need a backup.

urlwolf · « **Reply #9 on:** July 28, 2006, 09:22 PM »

Also, Ideally I want a program that can keep a copy of EVERY FILE _in_ _use_
-urlwolf (July 27, 2006, 12:01 PM)

Maybe I should have said "opened". Some backup applications do not copy opened files, or do so only after coughing up for a pricey extension (hello, genie backup

).

The reason why I think this is important is that I have lost my working files serveral times while editing them due to applications that do not care enought to let you save a security copy automatically. Adding real-time monitoring (e.g., mark "myMostImportantWork.txt" for monitoring means that everytime I open it, an extra copy is saved in the backup, and in real time, every change I make is saved. No need to wait for the scheduled backup to kick in. That may be troublesome, and it may make for a lot of files with tiny differences... but it may be worth it.

Unfortunately a backup cannot force the application to do autosaves.If you use e.g. powerpoint with no autosave, and edit a lot before hitting ctrl+S, you may be in for trouble. I wonder if all the changes would stay in memory (just wait for the crash:) ) or there is some temporary file somewhere...

patthecat · « **Reply #10 on:** July 28, 2006, 10:44 PM »

urlwolf,

I think your requirements lists fall into the software category of "continuous data protection"
See the following article to get an overview of it's definition:
http://www.infostor....mp;ARTICLE_ID=239640

I've been doing some research on CDP for the past week and the most reasonably priced ones for personal use seem to be
1. IBM's Tivoli Continuous Data Protection for Files (http://www-306.ibm.c...ous-data-protection/)
It can be purchased for $35 via online download only from IBM; and Digital River through OfficeMax, Staples, and Circuit City Stores website.

2. Stardock's Keepsafe (http://www.stardock....m/products/keepsafe/)
It can be purchased for $30.

I'm thinking of using one of the above for my sister-in-law's medical practice (RAID 1 being setup and now trying to think about a "set it and forget it" backup solution) and for my own use. So anyone out there with experience on these products I'd appreciate thgouhts and comments.

patrick

patthecat · « **Reply #11 on:** July 28, 2006, 10:52 PM »

The only thing with CDP I'm not sure about is how they handle open files especially databases.

urlwolf - I, too, use syncbackse

urlwolf · « **Reply #12 on:** July 29, 2006, 04:59 AM »

patthecat, good find.
I tried downloading the ibm one, but they didn't let me register to dl the free code. No idea why (Try again later)

urlwolf · « **Reply #13 on:** August 06, 2006, 06:45 AM »

ok, I finally downloaded this IBM CDP for files thing.
The program is in java, and works from within a browser.

It seems very well thought of.
You can include/exclude files by extension or by directory.

I'll post more once I try it further.

patthecat, if you can do the same, that'd be great.

jdd · « **Reply #14 on:** August 06, 2006, 08:07 AM »

As a long time user of syncbackse, I will be very interested to hear your feedback....

or

Second Shadow · « **Reply #15 on:** August 06, 2006, 04:18 PM »

Currently I'm using syncBackSE (no compression) + locate 3.0 + webdrive.
-urlwolf (July 27, 2006, 11:59 AM)

Just curious ... what are you using webdrive for? Maybe for uploading backups to an offsite FTP server? I'm almost sure that SyncBackSE can do that without the need for Webdrive ...

urlwolf · « **Reply #16 on:** August 06, 2006, 07:08 PM »

can sbSE do that for SFTP (SSH?). Really?

Second Shadow · « **Reply #17 on:** August 06, 2006, 10:55 PM »

can sbSE do that for SFTP (SSH?). Really?
-urlwolf (August 06, 2006, 07:08 PM)

You're not being sarcastic on me, now, are you?

To recap, I recall simply asking what you were using webdrive for. A possible answer could have been "I'm using webdrive for the SFTP connection because SyncbackSE doesn't support it", but you chose another ...

Indeed, SyncbackSE does not support SFTP, but it does support FTPS

Confusing? you bet. For those of us who don't remember the difference, here's Micky (the developper of syncback) explaining it: http://www.2brightsp...v2&id=156&c=

That's not what I call self-evident, precisely

urlwolf: I'm assuming that you are using the commercial product Webdrive because none of the free solutions for using SFTP with Syncback worked for you. I'm referring to the alternatives mentioned here: http://www.2brightsp...v2&id=193&c=

(Tunnelier did work for this guy, at least: http://dmihalik.com/...plications-over-sftp)

Anyway, sarcasm or not, I wish you luck in your search of the most suitable backup solution.

Regards,
2ndS

imtrobin · « **Reply #18 on:** August 10, 2006, 12:36 AM »

Something I'm haven't evaluated, but looks good.

http://www.itefix.no...MMN_position=154:154

elpresi · « **Reply #19 on:** August 12, 2006, 05:19 AM »

Super Flexible File Synchronizer supports versioning:
http://www.superflexible.com/
So you may want to look into it.

:-)

urlwolf · « **Reply #20 on:** August 27, 2006, 07:37 AM »

can sbSE do that for SFTP (SSH?). Really?
-urlwolf (August 06, 2006, 07:08 PM)

You're not being sarcastic on me, now, are you?
-Second Shadow (August 06, 2006, 10:55 PM)

Sorry, It was not sarcasm. I was unsure if SFTP was supported, I didn't know.