Other Software > Announce Your Software/Service/Product

SeqBox - A file container that can be restored after total loss of FS structures

(1/3) > >>

Mark0:
https://github.com/MarcoPon/SeqBox

A SeqBox container have a blocksize sub/equal to that of a sector, so can survive any level of fragmentation. Each block have a minimal header that include a unique file identifier, block sequence number, checksum, version. Additional, non critical info/metadata are contained in block 0 (like name, file size, crypto-hash, other attributes, etc.).

If disaster strikes, recovery can be performed simply scanning a volume/image, reading sector sized slices and checking blocks signatures and then CRCs to detect valid SBX blocks. Then the blocks can be grouped by UIDs, sorted by sequence number and reassembled to form the original SeqBox containers.


--- End quote ---

Tools are in Python 3.x, so they should work just about anywhere. I tried on a server with Linux, Win 10 PC, Raspberry Pi, Android.

Mark0:
I have updated the readme adding a sort of guide tour / demo to illustrate how the tools can be used:

https://github.com/MarcoPon/SeqBox/blob/master/readme.md



Pretty nightmarish! Now on to SBXScan to search for pieces of SBX files around, and SBXReco to get a report of the collected data:



--- End quote ---

How is that for a fragmented floppy image?  ;D

Mark0:
Updated to v1.0.0.
Recovery tests have been done in various configurations:

Tests

Seqbox recoverability have been practically tested with a number of File Systems. The procedure involved using a Virtual Machine to format a small (about 100MB) disk image with a certain FS, filling it with a number of small files, then deleting some randomly to free enough space to copy a serie of SBX files. This way every SBX file results fragmented in a lot of smaller pieces. Then the image was quick-formatted, wipefs-ed and the VM shutdown.
After that, from the host OS, recovery of the SBX files was attempted using SBXScan & SBXReco on the disk image. 


* Working: BeFS, BTRFS, EXT2/3/4, FATnn/VFAT/exFAT, AFFS, HFS+, JFS, MINIX FS, NTFS, ProDOS, ReiserFS, XFS, ZFS.
* Not working: OFS (due to 488 bytes blocks)
Being written in Python 3, SeqBox tools are naturally multi-platform and have been tested successfully on various versions of Windows, on some Linux distros either on x86 or ARM, and on Android (via QPython). No test was done on OS X but it should works there as well (feedback welcome).

--- End quote ---

If someone can try it on a Mac (maybe with the new APFS), it will be much appreciated.  :Thmbsup:

IainB:
This looked interesting at the opening post.
Is now beginning to look even more interesting ... but I don't believe in magic.

Mark0:
 ;D :D

Navigation

[0] Message Index

[#] Next page