topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Sunday October 6, 2024, 3:23 pm
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: file backup tools for linux  (Read 5990 times)

questor

  • Honorary Member
  • Joined in 2007
  • **
  • Posts: 3
    • View Profile
    • Donate to Member
file backup tools for linux
« on: April 08, 2021, 06:47 AM »
Hey Guys,
I'm looking for a toolset to create and manage file backups on linux. I'm looking for tools with the unix-workflow in mind, so in my mind the perfect solution would be multiple tools to:
- get a filelist with already scanned (and hashed) files and a directory to scan and create a list of files which need updates (because they were changed or not in the original filelist created by former scans)
- process this new filelist and do the updates (for example copy them to a different folder)
- optional: wrangle the files and recompress them (explained below)
- take the processed files (new output) and group them by a customized size (for example to burn them later to dvd/bluerays)
- update processed filelist with new content

recompression: currently used common files (zip, jpg, mp3, pdf) all use not optimal compression and can be recompressed with up-to-date algorithms to get an extra 20-30% compression factor (in case of jpg and mp3 without loss of quality because only a subset of the whole compression-scheme will be reprocessed). background: they use huffmann-compression which is not optimal but fast, current state-of-the-art compression is asymmetric-numeral-system compression which is as fast as huffmann but compresses better.

most linux backups tools I've found an the net most of the time copy files to networks, but can't handle bundles to burn to dvd.

any hints about existing solutions?

PS: I have already started with my own implementation for this concept, but I have not the time to really manage it and it has not all features I would hope for.

Shades

  • Member
  • Joined in 2006
  • **
  • Posts: 2,930
    • View Profile
    • Donate to Member
Re: file backup tools for linux
« Reply #1 on: April 08, 2021, 09:52 AM »
Bacula and BareOS are the first that come to mind.

BareOS is a fork from Bacula, so they share their versatility of backup methods and storage media. They also share a very unfriendly way of configuring the devices and/or backup scenarios, compression/de-duplication etc. Everything fully automated and you can add a web-interface to your setup, making it easy to have overviews from what has been backed up when. Once you get your head around their method of doing these things, it isn't that hard. Just takes a while to get your head around it.

Myself I have a Bacula setup and it has proven to be a rock solid solution for 10+ years.

questor

  • Honorary Member
  • Joined in 2007
  • **
  • Posts: 3
    • View Profile
    • Donate to Member
Re: file backup tools for linux
« Reply #2 on: April 12, 2021, 08:55 AM »
thanks for the tip, will check it out for sure!