A 1T multimodal model by the relatively unknown Yuan Lab. They pre-trained a 1.5T model on 2.2T tokens and subsequently pruned experts with a new technique, outlined in the tech report.
Specs
Params1010B
LicenseYuan 3.0 Model License Agreement
Tags
modelsmodels/llmsmodels/llms/multi-modalmodels/llms/reasoningartifacts/20
Related Models
