I'm still amazed at how primitive long term archival systems are at the moment.

Does anyone know a tool/solution that keeps two logically independent sets of archives, plus integrity checksums with the metadata?

Borgbackup is close, but it has no mechanism that I can see to detect changes in the source. Detecting changes in the archive is useless without a second valid copy

It's a bit like finding out that symmetric cryptography isn't[1] a robustly working thing.


What I mean by "two logically independent sets of archives + checksums" is the ability to store data in two independent systems, where the integrity checks are applied on BOTH (one system can be the original files on a desktop computer), so that when silent data corruption is detected there is at least one pristine copy to restore from.

Most backup tools just take bitrot induced changes from the source and propagate them to dest, eventually removing the good data once old snapshots are removed.

@szbalint LOCKSS (Lots of Copies Keep Stuff Safe) does a lot of automatic checksumming.

@chpietsch Yeah this is partly what I mean, this is a solution for a digital archive or a library - basically unusable for personal purposes (ok, I could make it work as I'm in IT, but it's not a solution I could recommend for anyone who just wants to keep their photos long term)

Seems like for personal cases the safest solution is still "make a glossy print of these selected pictures you don't want to lose".

@szbalint I hear integrity checking and I think ZFS.

could use snapshots and `zfs send` to ship them off to a (or multiple) backup pools. not really cold storage though, and seeing your follow-up toot, not really usable from non IT folks.

Sign in to participate in the conversation

Exclusive or something