Scaevolus 11 hours ago

Rsyncable goes further: instead of having fixed size blocks, it makes the block split points deterministically content-dependent. This means that you can edit/insert/delete bytes in the middle of the uncompressed input, and the compressed output will only have a few compressed blocks change.

Reply View 1 reply
  • andrewaylett 11 hours ago

    zstd also has an rsyncable option -- as an example of when it's useful, I take a dump of an SQLite database (my Home Assistant DB) using a command like this:

        sqlite3 -readonly "${i}" .dump | zstd --fast --rsyncable -v -o "${PART}" -
    The DB is 1.2G, the SQL dump is 1.4G, the compressed dump is 286M. And I still only have to sync the parts that have changed to take a backup.
    Reply View 0 replies