423
DeepSeek ditches Nvidia for Huawei chips in V4 launch (cybernews.com)
submitted 6 months ago by to c/technology@lemmy.world
89 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 16 points 6 months ago (12 children)

Been using Qwen 3.x for a while now for local LLM with search capability. The 3.5 and 3.6 ones are great and run very fast.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 12 child comments
    •
  • [–] 8 points 6 months ago* (8 children)

    I got Qwen 3.5 running on a Steam Deck.

    It ain't exactly blazing fast, but it does actually work.

    (Reasonably fast if you go down to the 2B param model, I can get the 9B param variant working, though this makes Steam Decky very hot and bothered.)

    Yeah, you absolutely do not need Nvidia hardware to run an LLM, but we get blasted with their propoganda suggesting otherwise just all the time in the English speaking West.

    Because if you don't need Nvidia, well, then, this whole AI bubble looks a lot more bubbly.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 4 points 6 months ago (3 children)

    Take good care of your hw! It's not like 2 years ago when you could buy stuff off the shelf for reasonable prices. :D

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 6 months ago (2 children)

    My Steam Deck is my child.

    Maybe if I can get it to run a 'good enough' LLM, and also a robotics kinematics suite...

    I can just start building DOG, with a Steam Deck for a face, instead of a Combine scanner bot.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago* (last edited 6 months ago) (3 children)

    Amd have the best consumer grafic card to run llm on the market.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 6 months ago* (2 children)

    Sorry, I'm not entirely sure what you mean.

    Did you mean to say:

    "And need to have the best consumer GPU on the market, to run an LLM."

    ... likely alluding to an RTX 5090?

    So you would be saying that basically it is bullshit, the idea that everyone needs extremely expensive hardware, to run an LLM?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 6 months ago (1 child)

    3.6 27b is probably most powerful/efficient (to size) model out there. Qwen has a history of leveraging deepseek power as well. (deepseek creating small models with Qwen as the base), and Alibaba is main hosting service for deepseek. Alibaba/Qwen in talks to invest in Deepseek, atm.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •