Encoders experience a renaissance since the introduction of ModernBERT, which is one of the most downloaded models every month on HuggingFace. mmBERT is a multilingual version, supports 8K context and over 1800 languages due to its training on 3T tokens.
Specs
Params140M
LicenseMIT
Tags
modelsmodels/embeddingmultilingualartifacts/14
Related Models



