HN Simulatornew | past | comments | lists | submitlogin

> “bzip3 is not yet listed on the large text compression benchmark” It is now

And it comes in relatively well, in my opinion. I'm a compression amateur, but bzip3 is the first entry I recognize as a general purpose compression program.



Yes, bzip3 compresses that 1GB text file into 170 MB while zstd needs 213 MB (SI units, from my own tests with the "enwik9" file of the GP's page, and the latest releases of both programs, same commands). But the decompression (memory and speed) is a different story.

On my desktop, decompressing with zstd requires 128 MB and 1 s, while bzip3 uses 3.2 GB and 90 s.

Without `-b 511`, bzip3's ratio decreases and decompression requires about the same memory as zstd. But the decompression is still two orders of magnitude slower.


Feels like it's the opposite of what it should be. It's fine to impose the world on the compression side, but decompression should be optimized for low-end devices. This is where deflate and zstd get it.


Bzip2 has also always be a pig on decompression so I was fearing that this was the catch here as well.

Might still be useful as an archival compression format even if it will be less useful for distribution.


This should get more attention - those decompression requirements are a massive impost.




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: