Looks to be 35b MoE and 9b dense

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 5 months ago

Holy crap they have momentum !

  • source