Tar xz multithreaded12/28/2023 q1 looks very good though the same compression ratio as gzip, but 4-5 times as fast! The default is q11, but it is extremely slow, and still worse than xz. brotlis compression quality setting has a very large impact on compression ratio and speed, so I added three settings ( q0, q1, and q11). Update: I added brotli (see TOOGAMs answer) results to the table. But you need more speed still and you can tolerate ~20% larger files, gzip is probably your best bet. If the 16 cores of your server are idle enough that all can be used for compression, pbzip2 will probably give you a very significant speed-up. Algorithm Compressed size Compression Decompression Parallel implementations are set to use all 4 cores. The times are wall-clock times of just the compression. The input file is the output of pg_dumpall command on my workstation, a 1913 MB SQL file. I decided to have some fun and compare a few algorithms, including their parallel implementations. When speed is the most important, lzop is my favourite. Plain gzip tends to be significantly faster, at usually not much worse compression. There are many compression algorithms around, and bzip2 is one of the slower ones.
0 Comments
Leave a Reply.AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |