Looks to be 35b MoE and 9b dense

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 9 months ago

Holy crap they have momentum !

  • source