you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 month ago* (last edited 1 month ago)

Now that is cool... it's a custom 64-core RISC-V implementation with its own matrix instructions that can run desktop inference at 30tok/s (with Qwen3.8-27B) without a GPU.

However, this is technically just an IP core. And even though it has been tested in hardware prototypes, there are no mass-produced products that are using it yet that we know of.

  • source