Arcane2077 comments on Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw)

Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw) (twitter.com)

submitted 2 weeks ago by rssbot@lemmy.bestiver.se [B] to c/hackernews@lemmy.bestiver.se

1 comment fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Arcane2077@sh.itjust.works 1 point 1 day ago

And a context window of one response?