Node Compression Test

A test of various compressions algorithms and packages in node.

Why

After experimenting with different zstd packages I wanted to compare their performance of taring and compressing a folder.

Packages

GZIP

zlib - https://nodejs.org/api/zlib.html

Brotli

zlib - https://nodejs.org/api/zlib.html

ZSTD

simple-zstd - https://www.npmjs.com/package/simple-zstd
https://www.npmjs.com/package/node-zstandard
@xingrz/cppzst - https://www.npmjs.com/package/@xingrz/cppzst (Appears to be the newest of cppzst heritage)

No Stream Interface

These packages did not offer a nodejs stream interface.

Uninstalled Packages

Several packages that rely on a nodejs binding failed to install.

zstd - https://www.npmjs.com/package/zstd (FAILED TO INSTALL)
node-zstd - https://www.npmjs.com/package/node-zstd (FAILED TO INSTALL)
node-zstd - https://www.npmjs.com/package/node-zstd2 (FAILED TO INSTALL)

Test

http://www.mattmahoney.net/dc/textdata.html enwiki8 was used.

Ubuntu 20.04 Node v18.7.0 AMD Ryzen 5 5600X

Results

Conclusions

simple-zstd sees at minimum ~20% reduction in total time in comparison to cppzst.
simple-zstd time improvement is during compression.
node-zstandard is not responding to different level requests.

License

MIT