Looks to be 35b MoE and 9b dense

top 2 comments

sorted by: hot top controversial new old
[–] 3 points 9 months ago

Holy crap they have momentum !

  • source
  • [–] 1 point 9 months ago

    Qwen has been the only models at such sizes with competence in programming, and so big deal.

  • source