[–] 15 points 1 year ago (5 children)

haha. I spent so much time looking for an efficient compression algorithm for audio and movies ... until I finally understood there are already compressed X) However it allow me to discover zst, wich is uncredible with text :

 35M test.log
801K test.7z
  32 test.log.7z
  46 test.log.tar.bz2
  45 test.log.tar.gz
 108 test.log.tar.xz
  22 test.log.tar.zst
2,1M test.tar.bz2
8,1M test.tar.gz
724K test.tar.xz
1,1M test.tar.zst
8,1M test.zip
  • source
  • [–] 5 points 1 year ago (1 child)

    Media files can can benefit from a codec change. Going from h264 to h265/hevc can net a 30-50% reduction in size for almost no quality loss.

    The only trade off is increased cpu usage if the client doesnt have hardware h265 support and the time to do the transcoding.

  • source
  • parent
  • context
  • [–] 10 points 1 year ago (2 children)

    I actually just switched a backup script of mine from using a tar.gz to just a regular tar file. It's a little bigger but overall, the process is so much faster I don't even care about the tiny extra bit of compression (100gb vs 120gb transferred over a 1gbit connection). The entire reason I do this is, like you said, transferring files over the Internet is a billion times faster as one file, BUT you don't need the gzip step just for that

  • source
  • parent
  • context
  • [–] 19 points 1 year ago (5 children)

    Well, yeah. The real advantage is only having a single file to transfer, makes eg. SFTP a lot less annoying at the command line.

    Lossless compression works by storing redundant information more efficiently. If you've got 50 GB in a directory, it's going to be mostly pictures and videos, because that would be an incredible amount of text or source code. Those are already stored with lossy compression, so there's just not much more you can squeeze out.

    I suppose you might have 50 GB of logs, especially if you've a logserver for your network? But most modern logging stores in a binary format, since it's quicker to search and manipulate, and doesn't use up such a crazy amount of disk space.

  • source
  • view more: ‹ prev next ›