42
Qwen3.6-27B that you can run on a laptop outperforms Qwen3.5-397B which was a flagship model requiring a commercial grade server that was released in February (qwen.ai)
submitted 6 months ago by to c/technology@lemmy.ml
3 comments fedilink hide all child comments

all 4 comments

sorted by: hot top controversial new old
[–] 6 points 6 months ago (1 child)

How does it compare to gemma4?

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
    • [+] 0 points 6 months ago* (last edited 2 months ago) (1 child)
    [deleted]
  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [–] [S] 2 points 6 months ago

    It depends on what precision you run it at. For 4 bit, you need at least 16 GB VRAM and ideally 24 GB to be comfortable, for the full 16 bit you'd need at least 54gb. A RTX 4090 is minimum. I've got 64gb myself, so I can run 8 bit quant comfortably.

  • permalink
  • fedilink
  • source
  • parent
    • 2 comments in c/Aii@programming.dev view that post
    [–] 2 points 6 months ago

    On a laptop? Which specs did that laptop have?

  • permalink
  • fedilink
  • source
    •
    [–] 1 point 6 months ago

    Create something first. You always can make it smaller and better later.

  • permalink
  • fedilink
  • source
    •