This is my main issue with it. I think its useful enough but only if it uses about the same energy as you would use doing whatever without it. Most conversations I had with someone trying to convince me it does not use to much power end up being very much like crypto ones were it keeps on being apples to oranges and the energy consumption seems to much. Im hoping hardware can be made to get the power use lower the way graphics cards did. I want to see querying an llm using about the same as searching for the answer or lower.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments