you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 4 months ago (6 children)

Not the big ones, no. But I think almost everybody can run one with seven billion parameters.

  • source
  • parent
  • hideshow 6 child comments
  • [+] 0 points 4 months ago (5 children)
  • [–] 4 points 4 months ago (4 children)

    I ran it on my 8GB RAM desktop.

  • source
  • parent
  • hideshow 4 child comments
  • [+] 1 point 4 months ago (3 children)
  • [–] 4 points 4 months ago (2 children)

    I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over

  • source
  • parent
  • hideshow 2 child comments