nomic-embed-text-v2-moe

A truly open-source embedding model, including the data and code to train the model. It also is a MoE, something which is rare for an embedding model. Given that embedding models are an important part of modern information retrieval systems, it makes sense to use a MoE architecture to increase the speed and throughput of the model.