12
Qwen3.6-27B that you can run on a laptop outperforms Qwen3.5-397B which was a flagship model requiring a commercial grade server that was released in February (qwen.ai)
submitted 6 months ago by to c/Aii@programming.dev
2 comments fedilink hide all child comments

all 2 comments

sorted by: hot top controversial new old
[–] 2 points 6 months ago

On a laptop? Which specs did that laptop have?

  • permalink
  • fedilink
  • source
    •
    [–] 1 point 6 months ago

    Create something first. You always can make it smaller and better later.

  • permalink
  • fedilink
  • source
    •
    3 comments in c/technology@lemmy.ml view that post
    [–] 6 points 6 months ago (1 child)

    How does it compare to gemma4?

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
    • [+] 0 points 6 months ago* (last edited 2 months ago) (1 child)
    [deleted]
  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [–] [S] 2 points 6 months ago

    It depends on what precision you run it at. For 4 bit, you need at least 16 GB VRAM and ideally 24 GB to be comfortable, for the full 16 bit you'd need at least 54gb. A RTX 4090 is minimum. I've got 64gb myself, so I can run 8 bit quant comfortably.

  • permalink
  • fedilink
  • source
  • parent