you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 11 months ago* (5 children)

Could you crunch an LLM into 700Mb that was still functional? Cause this looks like a fun thing to actually do as a joke.

Edit, I bet I could get https://huggingface.co/distilbert/distilgpt2 to run off a CD. How many tps am I gonna get guys 🤣

  • source
  • hideshow 5 child comments
  • [–] 10 points 11 months ago (3 children)

    Qwen3-0.6B is about 400 MB at Q4 and is surprisingly coherent for what it is.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 6 points 11 months ago (1 child)

    That's so crazy that an LLM capable of doing anything at all can be that small! That's leaves room for like an entire .avi episode of family guy at dvd resolution on there, which is the natural choice for the remaining space of course

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 11 months ago

    a 4k episode of family guy using H265 (HEVC) and assuming not too many cutaway gags could produce a file about 240MB. You could probably fit a 480i episode of south park in the remaining 60MB

  • source
  • parent
  • [–] 4 points 11 months ago*

    there's also tinyllama, which is somewhere around 600MB. it's hilariously inept. it's like someone jpeg-compressed a robot.

    also you're only gonna load off of that cd once so it'll perform fine.

  • source
  • parent