you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 2 months ago (3 children)

Can you reasonably train a local model? Inference is one thing and can be run on a decent gaming graphics card but training requires a lot more compute.

  • source
  • hideshow 3 child comments
  • [–] 4 points 2 months ago (1 child)

    You can absolutely train a nontrivial task model on a gaming gpu (image classifier, sound classifier, text model with a very structured input and output, etc). You can also post-train addon layers on top of existing open-weight models (LORA).

  • source
  • parent
  • hideshow 1 child comment