you are viewing a single comment's thread
view the rest of the comments
[–] -2 points 6 months ago* (3 children)

People should read the top comments on Hackernews instead of anyone here, they're more informed on the topic than Lemmy is

  • source
  • hideshow 3 child comments
  • [–] 3 points 6 months ago* (last edited 6 months ago)

    Better yet, download Qwen 3.5/3.6, with a "raw" notepad like Mikupad. Try it yourself:

    https://huggingface.co/ubergarm/Qwen3.6-27B-GGUF

    https://github.com/lmg-anon/mikupad

    One might observe:

    • Chat formating, and how janky the "thinking" block is.

    • How words are broken up into tokens, not characters.

    • How particularly funky that gets with numbers.

    • Precisely how sampling "randomizes" the answers by visualizing "all possible answers" with the logprobs display.

    • And, thus, precisely how and why carb counting in ChatGPT fails, yet a measly local LLM on a desktop/phone could get it right with a little tooling or adjustment.

    This is exactly what OpenAI/Anthropic don't want you to do. They want users dumb and tethered, like a cloud subscription or social media platform. Not cognizant of how tools they are peddling as magic lamps actually work. And why, and how, they're often stupid.

  • source
  • parent