Key architectural details

Mixture of Experts (MoE): 128 experts, with 4 active per token, enabling efficient scaling and specialization.

119B total parameters, with 6B active parameters per token (8B including embedding and output layers).

256k context window, supporting long-form interactions and document analysis.

Configurable reasoning effort: Toggle between fast, low-latency responses and deep, reasoning-intensive outputs.

Native multimodality: Accepts both text and image inputs, unlocking use cases from document parsing to visual analysis.

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 7 months ago (1 child)

We are being gaslit. From the article:

Recommended setup: 4x NVIDIA HGX H100, 4x NVIDIA HGX H200, or 2x NVIDIA DGX B200 for optimal performance.

No big. Your typical homelab setup. 🙄

Also: https://github.com/jahrulnr/esp32-picoTTS

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)