you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 months ago (1 child)

Because it costs a lot of money to train models, whether open or closed, so the people with money are in charge. Yes, local AI is awesome but we're not going to see newer versions without that money being spent by someone.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 4 months ago

    Actually, training a very big model on trillions of tokens using huge clusters is one way of doing that, but certainly not the only way.

    Communities have been fine-tuning models on much smaller machines and on a budget of hundreds of bucks.

    Right now, money is abundant and feeds even open on its models, so it would be stupid to not go in that direction. But when it dries up, it won't be the end of models improving.

  • source
  • parent