259
Opensource AI Must Win (opensourceaimustwin.com)
submitted 4 months ago by to c/technology@lemmy.world
103 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 13 points 4 months ago (8 children)

Ollama.com

Install it and then "ollama run olmo-3:7b" gets you a local AI. If you want to run a smarter AI, then you're going to need a bigger parameter model, which is going to take more hardware to run.

  • permalink
  • fedilink
  • source
  • hideshow 8 child comments
    •
  • [+] 3 points 4 months ago (7 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 5 points 4 months ago (6 children)

    Not the big ones, no. But I think almost everybody can run one with seven billion parameters.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [+] 0 points 4 months ago (5 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 4 points 4 months ago (4 children)

    I ran it on my 8GB RAM desktop.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [+] 1 point 4 months ago (3 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 4 points 4 months ago (2 children)

    I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •