you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 month ago*

You CAN run it locally on a regular mid level PC, but the big models require terabytes of high bandwidth memory and tons of compute. Most people do not run local models.

  • source
  • parent