sed Contrastive Pre-training</a></p>
<p><a class="github reference external" href="https://github.com/microsoft/unilm/tree/master/nomic">microsoft/unilm</a></p>
<p><strong>Paper abstract</strong></p>
<p><em>This technical report describes the training
of nomic-embed-text-v1, the first fully reproducible,
open-source, open-weights, opendata, 8192 context length
English text embedding model that outperforms both OpenAI
Ada-002 and OpenAI text-embedding-3-small
on short and long-context tasks. We release
the t