33
Will the AI boom ever 'cease' in the future? (fedia.io)
submitted 7 months ago by to c/asklemmy@lemmy.world
37 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 7 months ago (5 children)

Isn't it just the training that costs a lot in comparison to running it? So if they stopped training new models and just sold their current ones it might be able to run at a profit from year to year, after a huge initial investment that may or may not ever be recovered.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 1 point 7 months ago (4 children)

    Not really. The infrastructure to run language models is hardware wise demanding, consumes vast amounts of water (cooling) and electricity and requires frequent renewing and added capacity.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 7 months ago (3 children)

    My PC can run some LLMs

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 7 months ago (2 children)

    Ok, so all we need is your PC. Maybe you should contact Nvidia and tell that to them.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 7 months ago (1 child)

    This is the difference between running and training them. I can generate text output from an LLM faster than I can read it. But I am not training a new model any time soon.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 7 months ago* (last edited 7 months ago)

    Your PC is able to run comparatively small language models with limited number of parameters (a few billions). You can even do that on a modern mobile phone. Some of the more advanced models use hundreds of billions or even trillions of parameters. It's not just the training. It's more to do with model complexity.

    You can also do weather forecasting on a PC, but the result will not be comparable to a forecast made with a supercomputer.

    --Edit--

    Typo fixes, because while even the most whimsy LLMs can write, apparently I cannot.

  • permalink
  • fedilink
  • source
  • parent