29
Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things (simonwillison.net)
submitted 2 months ago by to c/technology@lemmy.ml
16 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 25 points 2 months ago (3 children)

running a model on a reasonably specced laptop

my 128GB M5 Max MacBook Pro

TIL a $7000 laptop is "reasonably specced"

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] [S] 12 points 2 months ago (2 children)

    You can run it on smaller hardware too, people managed to get 3.6 to run with 16 gb ram with stuff like quants and MTP. But the fact that you can run a model that performs as well as a frontier model from half a year ago on any laptop is frankly mind blowing.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •