It's out!

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 8 months ago* (last edited 8 months ago)

Interesting. 3B models run decently fast on my CPU and I have a lot of system RAM. 🤔

E: Just tried it on 100% CPU on AMD 7700 with DDR5 3600 and it does 6.5t/s. Not bad.

  • source
  • parent