## 🚀 Linq-Embed-Mistral
This document presents the performance metrics of the Linq-Embed-Mistral model on various natural language processing tasks, including classification, retrieval, clustering, reranking, and semantic text similarity (STS).
## 📚 Documentation
### Base Model
- Linq-AI-Research/Linq-Embed-Mistral
### Tags
- bnb-my-repo
- mteb
- transformers
- sentence-transformers
### Model Index
| Task Type | Dataset | Accuracy | AP | F1 | MAP@1 | MAP@10 | MAP@100 | MAP@1000 | MRR@1 | MRR@10 | MRR@100 | MRR@1000 | NDCG@1 | NDCG@10 | NDCG@100 | NDCG@1000 | Precision@1 | Precision@10 | Precision@100 | Precision@1000 | Recall@1 | Recall@10 | Recall@100 | Recall@1000 | V-Measure | MAP | MRR | Cosine Similarity (Pearson) | Cosine Similarity (Spearman) | Euclidean Distance (Pearson) | Euclidean Distance (Spearman) | Manhattan Distance (Pearson) | Manhattan Distance (Spearman) |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| Classification | MTEB AmazonCounterfactualClassification (en) | 84.43283582089552 | 50.39222584035829 | 78.47906270064071 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Classification | MTEB AmazonPolarityClassification | 95.70445 | 94.28273900595173 | 95.70048412173735 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Classification | MTEB AmazonReviewsClassification (en) | 57.644000000000005 | - | 56.993648296704876 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Retrieval | MTEB ArguAna | - | - | - | 45.804 | 61.742 | 62.07899999999999 | 62.08 | 47.226 | 62.256 | 62.601 | 62.601 | 45.804 | 69.649 | 70.902 | 70.91199999999999 | 45.804 | 9.452 | 0.996 | 0.1 | 45.804 | 94.523 | 99.57300000000001 | 99.644 | - | - | - | - | - | - | - | - |
| Clustering | MTEB ArxivClusteringP2P | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 51.47612678878609 | - | - | - | - | - | - | - |
| Clustering | MTEB ArxivClusteringS2S | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 47.2977392340418 | - | - | - | - | - | - | - |
| Reranking | MTEB AskUbuntuDupQuestions | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 66.82016765243456 | 79.55227982236292 | - | - | - | - | - | - |
| STS | MTEB BIOSSES | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 89.15068664186332 | 86.4013663041054 | 87.36391302921588 | 86.4013663041054 | 87.46116676558589 | 86.78149544753352 |
| Classification | MTEB Banking77Classification | 87.88311688311688 | - | 87.82368154811464 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Clustering | MTEB BiorxivClusteringP2P | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 42.72860396750569 | - | - | - | - | - | - | - |
| Clustering | MTEB BiorxivClusteringS2S | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 39.58412067938718 | - | - | - | - | - | - | - |
| Retrieval | MTEB CQADupstackRetrieval | - | - | - | 30.082666666666665 | 41.13875 | 42.45525 | 42.561249999999994 | 35.584 | 45.4675 | 46.31016666666667 | 46.35191666666666 | 35.584 | 47.26516666666667 | 52.49108333333332 | 54.24575 | 35.584 | 8.390333333333334 | 1.2941666666666667 | 0.16308333333333336 | 30.082666666666665 | 60.88875 | 83.35141666666667 | 95.0805 | - | - | - | - | - | - | - | - |
| Retrieval | MTEB ClimateFEVER | - | - | - | 16.747 | 29.168 | 31.304 | 31.496000000000002 | 37.524 | 50.588 | 51.28 | 51.29899999999999 | 37.524 | 39.11 | 46.373999999999995 | 49.370999999999995 | 37.524 | 12.137 | 1.9929999999999999 | 0.256 | 16.747 | 45.486 | 69.705 | 86.119 | - | - | - | - | - | - | - | - |
| Retrieval | MTEB DBPedia | - | - | - | 10.495000000000001 | 24.005000000000003 | 34.37 | 36.268 | 75.5 | 82.458 | 82.638 | 82.64 | 64.625 | 51.322 | 55.413999999999994 | 62.169 | 75.5 | 40.849999999999994 | 12.882 | 2.394 | 10.495000000000001 | 29.226000000000003 | 59.614 | 81.862 | - | - | - | - | - | - | - | - |
| Classification | MTEB EmotionClassification | 51.82 | - | 47.794956731921054 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Retrieval | MTEB FEVER | - | - | - | 82.52199999999999 | 89.794 | 89.962 | 89.972 | 88.809 | 93.554 | 93.577 | 93.577 | 88.809 | 92.419 | 92.95 | 93.10000000000001 | 88.809 | 10.911999999999999 | 1.143 | 0.117 | 82.52199999999999 | 96.59400000000001 | 98.55699999999999 | 99.413 | - | - | - | - | - | - | - | - |
| Retrieval | MTEB FiQA2018 | - | - | - | 32.842 | 53.147 | 55.265 | 55.37 | 61.574 | 68.426 | 68.935 | 68.95400000000001 | 61.574 | 61.205 | 67.25999999999999 | 68.657 | 61.574 | 16.852 | 2.33 | 0.256 | 32.842 | 68.157 | 89.5 | 97.68599999999999 | - | - | - | - | - | - | - | - |
| Retrieval | MTEB HotpotQA | - | - | - | 39.068000000000005 | 69.253 | 70.036 | 70.081 | 78.13600000000001 | 84.328 | 84.515 | 84.52300000000001 | 78.13600000000001 | 76.236 | 78.891 | 79.73400000000001 | 78.13600000000001 | 16.347 | 1.839 | 0.19499999999999998 | 39.068000000000005 | 81.735 | 91.945 | 97.44800000000001 | - | - | - | - | - | - | - | - |
| Classification | MTEB ImdbClassification | 94.7764 | 92.67841294818406 | 94.77375157383646 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Retrieval | MTEB MSMARCO | - | - | - | 24.624 | 37.861 | 39.011 | 39.052 | 25.358000000000004 | 38.5 | 39.572 | 39.607 | 25.358000000000004 | 45.214999999999996 | 50.56 | 51.507999999999996 | 25.358000000000004 | 7.090000000000001 | 0.9740000000000001 | 0.106 | 24.624 | 67.78699999999999 | 92.11200000000001 | 99.208 | - | - | - | - | - | - | - | - |
| Classification | MTEB MTOPDomainClassification (en) | 96.83310533515733 | - | 96.57069781347995 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Classification | MTEB MTOPIntentClassification (en) | 89.5690834473324 | - | 73.7275204564728 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Classification | MTEB MassiveIntentClassification (en) | 82.67316745124411 | - | 79.70626515721662 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Classification | MTEB MassiveScenarioClassification (en) | 85.01344989912575 | - | 84.45181022816965 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| Clustering | MTEB MedrxivClusteringP2P | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 37.843426126777295 | - | - | - | - | - | - | - |
| Clustering | MTEB MedrxivClusteringS2S | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 36.651728547241476 | - | - | - | - | - | - | - |
| Reranking | MTEB MindSmallReranking | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 32.05750522793288 | 33.28067556869468 | - | - | - | - | - | - |
| Retrieval | MTEB NFCorpus | - | - | - | 6.744 | 16.235 | 20.767 | 22.469 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
This README has been beautified according to the requirements. The original content is mainly about the performance metrics of the Linq-Embed-Mistral model on multiple NLP tasks. The beautified version organizes the information into a table for better readability.