Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw) : hackernews@lemmy.bestiver.se

Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw) (twitter.com)

submitted 3 weeks ago by rssbot@lemmy.bestiver.se [B] to c/hackernews@lemmy.bestiver.se

1 comment fedilink hide all child comments

1 comment

sorted by: hot top controversial new old

[–] Arcane2077@sh.itjust.works 1 point 6 days ago

And a context window of one response?