2
Orange Pi Unveils AI Station with Ascend 310 and 176 TOPS Compute - LinuxGizmos.com (linuxgizmos.com)
submitted 9 months ago by to c/llm@lemmy.world
2 comments fedilink hide all child comments
 

Orange Pi closes the year by unveiling new details about the Orange Pi AI Station, a compact board-level edge computing platform built around the Ascend 310 series processor. The system targets high-density inference workloads with large memory options, NVMe storage support, and extensive I/O in a small footprint.

The AI Station is powered by an Ascend 310 series processor integrating 16 CPU cores clocked at up to 1.9 GHz, along with 10 AI cores running at up to 1.08 GHz and 8 vector cores operating at up to 1 GHz.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 9 months ago

This is a review: I have the Orange PI AI studio thing, 96gb ram and two NPUs, using gpustack, the best I've gotten is qwen3-30b-a3b with around a 100k context window - runs at 25-28tps

There are some weird quirks with it, I've mostly been constrained to using MindIE as a backend which doesn't support all models. I've tried vLLM but it tends to crash and complain it can't talk to both NPUs.

Overall I'm pretty happy with it though

  • permalink
  • fedilink
  • source
    •