This is more of a loose idea than an actual feature request, so feel free to close if it's out of scope.
I'd like to use pixz as a kind of read-only key-value store, backed by a pixz-compressed tar file. The "keys" are filenames of archive entries, and "values" are contents of the files.
Currently, I'm just exec'ing a shell pipeline (pixz -x path/to/file < input.tpxz | tar x) for every key I need to retrieve. This is very slow; I haven't measured, but I expect much of the slowdown to be due to the overhead of launching two processes and pixz reading the index over and over again.
So I envision that pixz might run in a "server mode". You could say
pixz --server input.tpxz --port 8989
and pixz would launch a server on that port (HTTP? some simpler protocol?) that would keep running, listen for filenames and reply with the contents of those names.
I'm guessing this change, if implemented, would be big enough to warrant a separate piece of software. I intend to fork pixz and take a stab at it, but I'd like to gauge whether there's interest in merging it back upstream.
This is more of a loose idea than an actual feature request, so feel free to close if it's out of scope.
I'd like to use pixz as a kind of read-only key-value store, backed by a pixz-compressed tar file. The "keys" are filenames of archive entries, and "values" are contents of the files.
Currently, I'm just exec'ing a shell pipeline (
pixz -x path/to/file < input.tpxz | tar x) for every key I need to retrieve. This is very slow; I haven't measured, but I expect much of the slowdown to be due to the overhead of launching two processes and pixz reading the index over and over again.So I envision that pixz might run in a "server mode". You could say
and pixz would launch a server on that port (HTTP? some simpler protocol?) that would keep running, listen for filenames and reply with the contents of those names.
I'm guessing this change, if implemented, would be big enough to warrant a separate piece of software. I intend to fork pixz and take a stab at it, but I'd like to gauge whether there's interest in merging it back upstream.