tatoko556 comments on Is there any software that can use it that benefits average user or is it just a waste of silicon???

Is there any software that can use it that benefits average user or is it just a waste of silicon??? (i.redd.it)

submitted 9 months ago by tatoko556@reddthat.com to c/opensource@programming.dev

30 comments fedilink hide all child comments

cross-posted from: https://lemmit.online/post/4242386

This is an automated archive made by the Lemmit Bot.

The original was posted on /r/pcmasterrace by /u/trander6face on 2024-10-24 11:11:47+00:00.

you are viewing a single comment's thread
view the rest of the comments

[–] tatoko556@reddthat.com [S] 5 points 9 months ago (3 children)

I have heard of ollama before, is this the same thing?

permalink

fedilink

source

parent

hideshow 3 child comments

[–] dyathinkhesaurus@lemmy.world 6 points 9 months ago (1 child)

llama.cpp is not the same thing as ollama. It does a similar thing, but better imo. can multiplex/multithread sessions/conversations with llms (where ollama and lmstudio etc. have to queue them up), stuff like that.

permalink

fedilink

source

parent

hideshow 1 child comment

load more comments (1 reply)

[–] tatoko556@reddthat.com [S] 4 points 9 months ago

I checked, ollama does not use npu

permalink

fedilink

source

parent