A new MoE model series from Microsoft. It has some architecture tweaks, such as SparseMixer-v2, but it isn't clear what the differentiator is (like Phi).
Adoption · Hugging Face
RAM score
Relative Adoption Metric not applicable.
Hugging Face Downloads
544
last 30d
76.4K
all time
HF Likes
206
Relative Adoption Metric not applicable.
Related Models