Looks to be 35b MoE and 9b dense

all 3 comments

sorted by: hot top controversial new old
[–] 3 points 5 months ago

Holy crap they have momentum !

  • source
  • [+] 1 point 5 months ago* (last edited 2 months ago)
    [–] 1 point 5 months ago

    Qwen has been the only models at such sizes with competence in programming, and so big deal.

  • source