you are viewing a single comment's thread
view the rest of the comments

I just benched it on my system and i was getting around 20 tokens/sec which feels as fast as remote AI and 2x faster than gemma-3-12b.

  • source
  • parent