you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 2 months ago (1 child)

They're using domain-specific LLMs to compress narrow-domain data. Their text compression LLM was trained on, and then tested on, legal text and medical text.

There's no reason one couldn't apply the domain-specific-compressor idea to a conventional lossless text compressor, essentially moving much of the dictionary from the compressed file to the program itself. I don't know if anyone's tried that. I'd like to know how that compares.

  • source
  • parent
  • hideshow 1 child comment