It is sorta. Training is orders of magnitudes more intensive than inference, but we infer billions of times within a model generation.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It is sorta. Training is orders of magnitudes more intensive than inference, but we infer billions of times within a model generation.