You CAN run it locally on a regular mid level PC, but the big models require terabytes of high bandwidth memory and tons of compute. Most people do not run local models.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments