3
Unsloth Qwen3.8-27B GGUF files (huggingface.co)
submitted 2 months ago by [B] to c/hackernews@lemmy.bestiver.se
comment fedilink hide all child comments
 

Comments

no comments (yet)

sorted by: hot top controversial new old
there doesn't seem to be anything here
9 comments in c/localllama@sh.itjust.works view that post
[–] 5 points 2 months ago

https://unsloth.ai/docs/basics/dynamic-3.0-ggufs

  • permalink
  • fedilink
  • source
    •
    [–] 3 points 2 months ago (3 children)

    There's no point in this if one runs Q8 right? I guess could save VRAM by dropping down from Q8 to say UD Q6.

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
    • [–] 2 points 2 months ago (3 children)

    Is a 35b-a3b planned for 3.8?

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] [S] 4 points 2 months ago (1 child)

    They don't tell us things lol. All they said was

    Which sounds like there's something "better" coming, but doesn't deny the possibility of 35b-a3b. Which is weird because "better" is subjective and depends on your hardware. It could be smaller and smarter than 3.6 35b, but then people are gonna ask for a 3.8 35b because it should be even smarter.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •