Glad they set a time rather than leaving it open

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 5 points 2 months ago

No you don't need a data center, this can run on any current gaming PC with a GPU that has 16GB+ VRAM.

Although to get good token generation speed and full context you need at least 24GB VRAM.

  • source
  • parent