you are viewing a single comment's thread
view the rest of the comments
[–] 11 points 1 year ago (1 child)

The future is very small models trained to work in a certain domain and able to run on devices.

Huge foundational models are nice and everything, but they are simply too heavy and expensive to run.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago* (last edited 1 year ago)

    Yeah. You are preaching to the choir here.

    …Still though, I just meant there’s no reason to use Gemma 3 27B (or 12? Whatever they used) unaugmented in AI Studio. The smallest flash seems to be more optimal for TPUs (hence it runs faster).

  • source
  • parent