Skip to main content

Search

Items tagged with: compression

Thanks to this tool I never have to remember the arguments to "tar" anymore ✨

🦀 **ouch**: Painless compression and decompression in the terminal - written in Rust.

⭐ GitHub: https://github.com/ouch-org/ouch

#rustlang #compression #commandline #opensource #tar

GitHub - ouch-org/ouch: Painless compression and decompression in the terminal

Painless compression and decompression in the terminal - GitHub - ouch-org/ouch: Painless compression and decompression in the terminal
GitHub
#opensource #RustLang #compression #commandline #tar

Feedback wanted: I made a drop-in JSON replacement that produces smaller payloads. It's for busy programmers who want a quick win. https://evanhahn.com/jsos-proof-of-concept/

It might be a bad idea! Please let me know what you think.

#JSON #compression #programming


Proof of concept: drop-in JSON replacement that produces smaller payloads

What if your JSON payloads got smaller by changing one line of code? I made a proof of concept.
evanhahn.com
#programming #compression #json

Repeated the #compression #benchmark with the same file on a beefier machine (AMD Ryzen 9 5950X), results are quite identical, except faster overall.

This plot is also interesting:

- #gzip and #lz4 have fixed (!) and very low RAM usage across levels and compression/decompression
- #xz RAM usage scales with the level from a couple of MBs (0) to nearly a GB (9)
- #zstd RAM usage scales weirdly with level but not as extreme as #xz

#Python #matplotlib
#python #compression #zstd #xz #matplotlib #gzip #lz4 #benchmark

First results of my #compression algorithm benchmark run on a 72MB CSV file. It seems #zstd really has something for everybody, though it can't reach #xz's insane (but slow) compression ratios at maximum settings.

This chart includes multithreaded runs for #zstd.

Very interesting! 🧐

https://gitlab.com/nobodyinperson/compression-algorithm-benchmark

#Python #matplotlib #Jupyter #JupyterLab

Yann Büchau / ⏱️ Compression Algorithm Benchmark · GitLab

A Python script to benchmark file compression algorithms 🗜️
GitLab
#python #compression #zstd #xz #matplotlib #jupyter #jupyterlab

My conclusion after all this is that I'll probably use #zstd level 1 (not the default level 3!) for #compression of my #CSV measurement data from now on:

- ultra fast compression and decompression, on par with #lz4
- nearly as good a compression ratio as #gzip level 9
- negligible RAM usage

When I need ultra small files though, e.g. for transfer over a slow connection, I'll keep using #xz level 9.
plot, emoji finger pointing to zstd level 1 being fast and nearly as good a ratio as gzip -9
plot, emoji finger pointing at zstd level 1 having reasonably low RAM usage
plot, emoji finger pointing at zstd level 1 being ultra fast
#csv #compression #zstd #xz #gzip #lz4

⇧