Motif-Technologies

A preview of a 314B-A13B MoE by the Korean Motif. This is by far the company's most ambitious model, as it is considerably larger and introduces some architectural innovations like GDLA and mHC.

A bilingual (English, Korean) MoE under Apache 2.0 with good benchmark scores.

A small model trained on 2.4T tokens. It comes with a Llama-style license.