%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
TW
NV Retriever V1
模型概述
該模型主要用於信息檢索任務，能夠高效地從大規模數據集中檢索相關文檔或答案。
模型特點
高效檢索
在多個標準數據集上表現出色，具備高效的檢索能力。
多數據集支持
在 MTEB ArguAna 和 CQADupstackAndroidRetrieval 等多個數據集上進行了評估。
模型能力
信息檢索
文檔匹配
使用案例
信息檢索
問答系統
用於構建問答系統，快速檢索相關答案。
在 MTEB ArguAna 數據集上達到 68.277 的主要得分。
文檔檢索
用於從大規模文檔庫中檢索相關文檔。
在 CQADupstackAndroidRetrieval 數據集上達到 57.025 的主要得分。
🚀 NV-Retriever-v1
NV-Retriever-v1 是一個專注於檢索任務的模型，在多個 MTEB 數據集上進行了評估，展現出了在信息檢索方面的性能表現。
📚 詳細文檔
MTEB ArguAna 數據集評估結果
| 指標類型 | 值 |
|---|---|
| main_score | 68.277 |
| map_at_1 | 44.666 |
| map_at_10 | 60.3 |
| map_at_100 | 60.692 |
| map_at_1000 | 60.693 |
| map_at_20 | 60.645 |
| map_at_3 | 56.472 |
| map_at_5 | 58.78 |
| mrr_at_1 | 45.092460881934564 |
| mrr_at_10 | 60.493378717063074 |
| mrr_at_100 | 60.87988588545791 |
| mrr_at_1000 | 60.88044591502747 |
| mrr_at_20 | 60.83224958805471 |
| mrr_at_3 | 56.53153153153162 |
| mrr_at_5 | 58.942626837363854 |
| nauc_map_at_1000_diff1 | 14.137909741937149 |
| nauc_map_at_1000_max | -13.946656236190021 |
| nauc_map_at_1000_std | -27.431659737602732 |
| nauc_map_at_100_diff1 | 14.136483238553824 |
| nauc_map_at_100_max | -13.946721068575075 |
| nauc_map_at_100_std | -27.43462339510713 |
| nauc_map_at_10_diff1 | 13.961240252441984 |
| nauc_map_at_10_max | -13.804526866049605 |
| nauc_map_at_10_std | -27.35573153559941 |
| nauc_map_at_1_diff1 | 16.257792463128126 |
| nauc_map_at_1_max | -16.164790771610072 |
| nauc_map_at_1_std | -27.84021734986689 |
| nauc_map_at_20_diff1 | 14.106499894575682 |
| nauc_map_at_20_max | -13.930699708027205 |
| nauc_map_at_20_std | -27.47446428876476 |
| nauc_map_at_3_diff1 | 15.018611065750246 |
| nauc_map_at_3_max | -12.659774043658842 |
| nauc_map_at_3_std | -27.186079034885598 |
| nauc_map_at_5_diff1 | 14.199306816408377 |
| nauc_map_at_5_max | -13.261282961741303 |
| nauc_map_at_5_std | -26.71739573072423 |
| nauc_mrr_at_1000_diff1 | 12.629073492081275 |
| nauc_mrr_at_1000_max | -14.666344334069448 |
| nauc_mrr_at_1000_std | -27.30760238816266 |
| nauc_mrr_at_100_diff1 | 12.627677268171094 |
| nauc_mrr_at_100_max | -14.66639461039424 |
| nauc_mrr_at_100_std | -27.310569102264846 |
| nauc_mrr_at_10_diff1 | 12.482407364331927 |
| nauc_mrr_at_10_max | -14.509649052862667 |
| nauc_mrr_at_10_std | -27.246235066954423 |
| nauc_mrr_at_1_diff1 | 15.084265144497373 |
| nauc_mrr_at_1_max | -16.312295398834625 |
| nauc_mrr_at_1_std | -27.686736137340894 |
| nauc_mrr_at_20_diff1 | 12.600281810712003 |
| nauc_mrr_at_20_max | -14.649133303237166 |
| nauc_mrr_at_20_std | -27.350630544847004 |
| nauc_mrr_at_3_diff1 | 13.081208137779557 |
| nauc_mrr_at_3_max | -13.91769455651833 |
| nauc_mrr_at_3_std | -27.42237181201488 |
| nauc_mrr_at_5_diff1 | 12.697412153053486 |
| nauc_mrr_at_5_max | -14.046815225580204 |
| nauc_mrr_at_5_std | -26.69417403787157 |
| nauc_ndcg_at_1000_diff1 | 13.984706619459738 |
| nauc_ndcg_at_1000_max | -13.48207980711916 |
| nauc_ndcg_at_1000_std | -27.16935912553381 |
| nauc_ndcg_at_100_diff1 | 13.951491624929446 |
| nauc_ndcg_at_100_max | -13.483812067015261 |
| nauc_ndcg_at_100_std | -27.238639718923814 |
| nauc_ndcg_at_10_diff1 | 13.16429886726646 |
| nauc_ndcg_at_10_max | -12.816570276390305 |
| nauc_ndcg_at_10_std | -27.13129457560619 |
| nauc_ndcg_at_1_diff1 | 16.257792463128126 |
| nauc_ndcg_at_1_max | -16.164790771610072 |
| nauc_ndcg_at_1_std | -27.84021734986689 |
| nauc_ndcg_at_20_diff1 | 13.767660163849325 |
| nauc_ndcg_at_20_max | -13.330392545127982 |
| nauc_ndcg_at_20_std | -27.655874185287637 |
| nauc_ndcg_at_3_diff1 | 15.379454570465107 |
| nauc_ndcg_at_3_max | -10.682369832384417 |
| nauc_ndcg_at_3_std | -26.61546503103021 |
| nauc_ndcg_at_5_diff1 | 13.857194107241847 |
| nauc_ndcg_at_5_max | -11.585582001386438 |
| nauc_ndcg_at_5_std | -25.60318972329879 |
| nauc_precision_at_1000_diff1 | 25.196544697410012 |
| nauc_precision_at_1000_max | 20.85546049013785 |
| nauc_precision_at_1000_std | 56.11900085120013 |
| nauc_precision_at_100_diff1 | 11.605921153386918 |
| nauc_precision_at_100_max | 14.521201087528956 |
| nauc_precision_at_100_std | 17.78762614096395 |
| nauc_precision_at_10_diff1 | 2.9073450747110328 |
| nauc_precision_at_10_max | -1.7706065742373982 |
| nauc_precision_at_10_std | -25.127721917434958 |
| nauc_precision_at_1_diff1 | 16.257792463128126 |
| nauc_precision_at_1_max | -16.164790771610072 |
| nauc_precision_at_1_std | -27.84021734986689 |
| nauc_precision_at_20_diff1 | 4.945029151806525 |
| nauc_precision_at_20_max | 1.299254371223885 |
| nauc_precision_at_20_std | -42.34878406902393 |
| nauc_precision_at_3_diff1 | 17.02535492673917 |
| nauc_precision_at_3_max | -3.160620615377462 |
| nauc_precision_at_3_std | -24.392959569235646 |
| nauc_precision_at_5_diff1 | 12.283704585525927 |
| nauc_precision_at_5_max | -2.860819740357931 |
| nauc_precision_at_5_std | -19.497494992596568 |
| nauc_recall_at_1000_diff1 | 25.196544697407973 |
| nauc_recall_at_1000_max | 20.855460490135933 |
| nauc_recall_at_1000_std | 56.119000851196496 |
| nauc_recall_at_100_diff1 | 11.60592115338627 |
| nauc_recall_at_100_max | 14.5212010875248 |
| nauc_recall_at_100_std | 17.787626140957425 |
| nauc_recall_at_10_diff1 | 2.9073450747112304 |
| nauc_recall_at_10_max | -1.7706065742371515 |
| nauc_recall_at_10_std | -25.12772191743481 |
| nauc_recall_at_1_diff1 | 16.257792463128126 |
| nauc_recall_at_1_max | -16.164790771610072 |
| nauc_recall_at_1_std | -27.84021734986689 |
| nauc_recall_at_20_diff1 | 4.9450291518064935 |
| nauc_recall_at_20_max | 1.2992543712237186 |
| nauc_recall_at_20_std | -42.34878406902303 |
| nauc_recall_at_3_diff1 | 17.025354926739237 |
| nauc_recall_at_3_max | -3.1606206153775016 |
| nauc_recall_at_3_std | -24.39295956923558 |
| nauc_recall_at_5_diff1 | 12.283704585525939 |
| nauc_recall_at_5_max | -2.8608197403578512 |
| nauc_recall_at_5_std | -19.497494992596575 |
| ndcg_at_1 | 44.666 |
| ndcg_at_10 | 68.277 |
| ndcg_at_100 | 69.78 |
| ndcg_at_1000 | 69.78999999999999 |
| ndcg_at_20 | 69.464 |
| ndcg_at_3 | 60.462 |
| ndcg_at_5 | 64.651 |
| precision_at_1 | 44.666 |
| precision_at_10 | 9.339 |
| precision_at_100 | 0.996 |
| precision_at_1000 | 0.1 |
| precision_at_20 | 4.897 |
| precision_at_3 | 24.016000000000002 |
| precision_at_5 | 16.458000000000002 |
| recall_at_1 | 44.666 |
| recall_at_10 | 93.38499999999999 |
| recall_at_100 | 99.57300000000001 |
| recall_at_1000 | 99.644 |
| recall_at_20 | 97.937 |
| recall_at_3 | 72.048 |
| recall_at_5 | 82.28999999999999 |
MTEB CQADupstackAndroidRetrieval 數據集評估結果
| 指標類型 | 值 |
|---|---|
| main_score | 57.025000000000006 |
| map_at_1 | 35.67 |
| map_at_10 | 49.816 |
| map_at_100 | 51.465 |
| map_at_1000 | 51.559 |
| map_at_20 | 50.843 |
| map_at_3 | 45.462 |
| map_at_5 | 47.789 |
| mrr_at_1 | 44.77825464949928 |
| mrr_at_10 | 55.787576356245886 |
| mrr_at_100 | 56.4488799265231 |
| mrr_at_1000 | 56.47353697784773 |
| mrr_at_20 | 56.21107253216036 |
| mrr_at_3 | 52.885073915116834 |
| mrr_at_5 | 54.58035288507389 |
| nauc_map_at_1000_diff1 | 50.45823101819382 |
| nauc_map_at_1000_max | 36.49053295534483 |
| nauc_map_at_1000_std | -18.526304321886187 |
| nauc_map_at_100_diff1 | 50.4260834410578 |
| nauc_map_at_100_max | 36.5085073099934 |
| nauc_map_at_100_std | -18.46644794935817 |
| nauc_map_at_10_diff1 | 50.89883450942742 |
| nauc_map_at_10_max | 36.04067774200049 |
| nauc_map_at_10_std | -20.056347095828695 |
| nauc_map_at_1_diff1 | 56.834567406767775 |
| nauc_map_at_1_max | 32.806861016490686 |
| nauc_map_at_1_std | -17.50758527738866 |
| nauc_map_at_20_diff1 | 50.5042164434519 |
| nauc_map_at_20_max | 36.50186920758872 |
| nauc_map_at_20_std | -18.739559098645316 |
| nauc_map_at_3_diff1 | 51.47192911647498 |
| nauc_map_at_3_max | 35.30704707609017 |
| nauc_map_at_3_std | -20.29632792705977 |
| nauc_map_at_5_diff1 | 51.12306422908822 |
| nauc_map_at_5_max | 35.89975376917192 |
| nauc_map_at_5_std | -19.828384476366086 |
| nauc_mrr_at_1000_diff1 | 48.849919708933356 |
| nauc_mrr_at_1000_max | 37.551368642516984 |
| nauc_mrr_at_1000_std | -17.829333495571873 |
| nauc_mrr_at_100_diff1 | 48.84124005822968 |
| nauc_mrr_at_100_max | 37.55507214788527 |
| nauc_mrr_at_100_std | -17.829902708031735 |
| nauc_mrr_at_10_diff1 | 48.75998469903627 |
| nauc_mrr_at_10_max | 37.38578492482243 |
| nauc_mrr_at_10_std | -18.49027309110136 |
| nauc_mrr_at_1_diff1 | 52.82147548271261 |
| nauc_mrr_at_1_max | 38.52107406488729 |
| nauc_mrr_at_1_std | -15.557810119211657 |
| nauc_mrr_at_20_diff1 | 48.786516207985585 |
| nauc_mrr_at_20_max | 37.53134866494839 |
| nauc_mrr_at_20_std | -17.78055242023104 |
| nauc_mrr_at_3_diff1 | 48.72848733815437 |
| nauc_mrr_at_3_max | 37.62564116429598 |
| nauc_mrr_at_3_std | -18.63098278761354 |
| nauc_mrr_at_5_diff1 | 48.67198763487669 |
| nauc_mrr_at_5_max | 37.46200111234106 |
| nauc_mrr_at_5_std | -18.592288612712576 |
| nauc_ndcg_at_1000_diff1 | 48.75201809702225 |
| nauc_ndcg_at_1000_max | 37.04967809462886 |
| nauc_ndcg_at_1000_std | -16.948540945875216 |
| nauc_ndcg_at_100_diff1 | 48.213857924243804 |
| nauc_ndcg_at_100_max | 36.99860703887876 |
| nauc_ndcg_at_100_std | -16.420746045271017 |
| nauc_ndcg_at_10_diff1 | 48.7590345342662 |
| nauc_ndcg_at_10_max | 36.087304891668495 |
| nauc_ndcg_at_10_std | -20.677784655001727 |
| nauc_ndcg_at_1_diff1 | 52.82147548271261 |
| nauc_ndcg_at_1_max | 38.52107406488729 |
| nauc_ndcg_at_1_std | -15.557810119211657 |
| nauc_ndcg_at_20_diff1 | 48.119759046742004 |
| nauc_ndcg_at_20_max | 36.91858601052183 |
| nauc_ndcg_at_20_std | -17.315588991460316 |
| nauc_ndcg_at_3_diff1 | 48.35879771694856 |
| nauc_ndcg_at_3_max | 36.59333419427929 |
| nauc_ndcg_at_3_std | -19.646763729930917 |
| nauc_ndcg_at_5_diff1 | 48.73702053100838 |
| nauc_ndcg_at_5_max | 36.2032422359128 |
| nauc_ndcg_at_5_std | -19.81761218645642 |
| nauc_precision_at_1000_diff1 | -19.23879401783259 |
| nauc_precision_at_1000_max | -10.334669548312661 |
| nauc_precision_at_1000_std | 1.8528999887213935 |
| nauc_precision_at_100_diff1 | -17.061064047641576 |
| nauc_precision_at_100_max | -2.2318557604173557 |
| nauc_precision_at_100_std | 9.453864069155783 |
| nauc_precision_at_10_diff1 | -0.0250981142012463 |
| nauc_precision_at_10_max | 15.000297351883034 |
| nauc_precision_at_10_std | -1.6209044879293661 |
| nauc_precision_at_1_diff1 | 52.82147548271261 |
| nauc_precision_at_1_max | 38.52107406488729 |
| nauc_precision_at_1_std | -15.557810119211657 |
| nauc_precision_at_20_diff1 | -9.566950286920978 |
| nauc_precision_at_20_max | 9.865702753901365 |
| nauc_precision_at_20_std | 8.87854086185741 |
| nauc_precision_at_3_diff1 | 19.978926078471915 |
| nauc_precision_at_3_max | 29.135402513527524 |
| nauc_precision_at_3_std | -12.410877361712942 |
| nauc_precision_at_5_diff1 | 11.602459698883452 |
| nauc_precision_at_5_max | 24.44724344216036 |
| nauc_precision_at_5_std | -6.23012846505485 |
| nauc_recall_at_1000_diff1 | 30.5620107082901 |
| nauc_recall_at_1000_max | 57.90393858174957 |
| nauc_recall_at_1000_std | 50.27827169570347 |
| nauc_recall_at_100_diff1 | 30.37443399479563 |
| nauc_recall_at_100_max | 37.75874353752331 |
| nauc_recall_at_100_std | 10.331635217724585 |
| nauc_recall_at_10_diff1 | 42.50804834678793 |
| nauc_recall_at_10_max | 32.01676571227172 |
| nauc_recall_at_10_std | -24.707266416874376 |
| nauc_recall_at_1_diff1 | 56.834567406767775 |
| nauc_recall_at_1_max | 32.806861016490686 |
| nauc_recall_at_1_std | -17.50758527738866 |
| nauc_recall_at_20_diff1 | 38.7222771840029 |
| nauc_recall_at_20_max | 35.62991559107865 |
| nauc_recall_at_20_std | -8.672399835082256 |
| nauc_recall_at_3_diff1 | 44.63989156943874 |
| nauc_recall_at_3_max | 32.924250725683954 |
| nauc_recall_at_3_std | -22.031517542434386 |
| nauc_recall_at_5_diff1 | 43.52398344993421 |
| nauc_recall_at_5_max | 32.68140834172185 |
| nauc_recall_at_5_std | -22.07867437121263 |
| ndcg_at_1 | 44.778 |
| ndcg_at_10 | 57.025000000000006 |
| ndcg_at_100 | 62.007 |
| ndcg_at_1000 | 63.11 |
| ndcg_at_20 | 59.301 |
| ndcg_at_3 | 51.162 |
| ndcg_at_5 | 53.684 |
| precision_at_1 | 44.778 |
| precision_at_10 | 11.173 |
| precision_at_100 | 1.7080000000000002 |
| precision_at_1000 | 0.20600000000000002 |
| precision_at_20 | 6.651999999999999 |
| precision_at_3 | 25.130999999999997 |
| precision_at_5 | 18.026 |
| recall_at_1 | 35.67 |
| recall_at_10 | 71.006 |
| recall_at_100 | 91.24 |
| recall_at_1000 | 97.68599999999999 |
| recall_at_20 | 78.869 |
| recall_at_3 | 53.616 |
| recall_at_5 | 61.046 |
MTEB CQADupstackEnglishRetrieval 數據集評估結果
| 指標類型 | 值 |
|---|---|
| main_score | 56.93 |
| map_at_1 | 37.869 |
| map_at_10 | 50.651999999999994 |
| map_at_100 | 52.099 |
| map_at_1000 | 52.229000000000006 |
| map_at_20 | 51.471000000000004 |
| map_at_3 | 46.900999999999996 |
| map_at_5 | 49.163000000000004 |
| mrr_at_1 | 48.152866242038215 |
| mrr_at_10 | 57.048781720756324 |
| mrr_at_100 | 57.61447046748723 |
| mrr_at_1000 | 57.64904742638159 |
| mrr_at_20 | 57.39780918212383 |
| mrr_at_3 | 54.80891719745229 |
| mrr_at_5 | 56.28343949044594 |
| nauc_map_at_1000_diff1 | 58.85279432139136 |
| nauc_map_at_1000_max | 44.27751637558559 |
| nauc_map_at_1000_std | -15.750083199667806 |
| nauc_map_at_100_diff1 | 58.86033676691407 |
| nauc_map_at_100_max | 44.19456055171921 |
| nauc_map_at_100_std | -15.866235670948466 |
| nauc_map_at_10_diff1 | 59.15850189168124 |
| nauc_map_at_10_max | 43.11472836391707 |
| nauc_map_at_10_std | -17.744478993375527 |
| nauc_map_at_1_diff1 | 64.04942461321761 |
| nauc_map_at_1_max | 36.02760504360551 |
| nauc_map_at_1_std | -20.916663614576407 |
| nauc_map_at_20_diff1 | 58.98751913649348 |
| nauc_map_at_20_max | 43.747358339703325 |
| nauc_map_at_20_std | -16.73926017048612 |
| nauc_map_at_3_diff1 | 60.545139674280094 |
| nauc_map_at_3_max | 41.30484092754499 |
| nauc_map_at_3_std | -20.449249818528614 |
| nauc_map_at_5_diff1 | 59.60326322666997 |
| nauc_map_at_5_max | 42.108701221797 |
| nauc_map_at_5_std | -18.957986608087435 |
| nauc_mrr_at_1000_diff1 | 56.30127401697153 |
| nauc_mrr_at_1000_max | 47.08483234515321 |
| nauc_mrr_at_1000_std | -10.314335018294779 |
| nauc_mrr_at_100_diff1 | 56.28727998516319 |
| nauc_mrr_at_100_max | 47.08137119553827 |
| nauc_mrr_at_100_std | -10.295734439040498 |
| nauc_mrr_at_10_diff1 | 56.25229630851168 |
| nauc_mrr_at_10_max | 47.149329681676 |
| nauc_mrr_at_10_std | -10.598837356654567 |
| nauc_mrr_at_1_diff1 | 59.098651501966394 |
| nauc_mrr_at_1_max | 46.60615627466452 |
| nauc_mrr_at_1_std | -10.475650807142516 |
| nauc_mrr_at_20_diff1 | 56.2453798649222 |
| nauc_mrr_at_20_max | 47.09346599217677 |
| nauc_mrr_at_20_std | -10.386425082322834 |
| nauc_mrr_at_3_diff1 | 56.75733035936052 |
| nauc_mrr_at_3_max | 46.94088551304416 |
| nauc_mrr_at_3_std | -11.483866905681051 |
| nauc_mrr_at_5_diff1 | 56.40006056789708 |
| nauc_mrr_at_5_max | 46.808130364381846 |
| nauc_mrr_at_5_std | -11.050122560712222 |
| nauc_ndcg_at_1000_diff1 | 56.60974899528984 |
| nauc_ndcg_at_1000_max | 46.20688890501171 |
| nauc_ndcg_at_1000_std | -11.14222381973439 |
| nauc_ndcg_at_100_diff1 | 56.677945515470675 |
| nauc_ndcg_at_100_max | 46.001596072553404 |
| nauc_ndcg_at_100_std | -11.229044974791337 |
| nauc_ndcg_at_10_diff1 | 57.1066442501231 |
| nauc_ndcg_at_10_max | 45.542982262967776 |
| nauc_ndcg_at_10_std | -14.273638238311195 |
| nauc_ndcg_at_1_diff1 | 59.098651501966394 |
| nauc_ndcg_at_1_max | 46.60615627466452 |
| nauc_ndcg_at_1_std | -10.475650807142516 |
| nauc_ndcg_at_20_diff1 | 56.851307181340694 |
| nauc_ndcg_at_20_max | 45.84417755460993 |
| nauc_ndcg_at_20_std | -12.926633494308371 |
| nauc_ndcg_at_3_diff1 | 57.423753276241754 |
| nauc_ndcg_at_3_max | 45.1658528352273 |
| nauc_ndcg_at_3_std | -15.041500407672178 |
| nauc_ndcg_at_5_diff1 | 57.366735747016584 |
| nauc_ndcg_at_5_max | 44.754486357586316 |
| nauc_ndcg_at_5_std | -15.100632526050441 |
| nauc_precision_at_1000_diff1 | -23.32973690238293 |
| nauc_precision_at_1000_max | 9.122165441089374 |
| nauc_precision_at_1000_std | 32.082444098667565 |
| nauc_precision_at_100_diff1 | -16.218615616263428 |
| nauc_precision_at_100_max | 19.44437302773441 |
| nauc_precision_at_100_std | 35.248811470691166 |
| nauc_precision_at_10_diff1 | 1.0766468144861965 |
| nauc_precision_at_10_max | 30.491892916282236 |
| nauc_precision_at_10_std | 18.538876410079585 |
| nauc_precision_at_1_diff1 | 59.098651501966394 |
| nauc_precision_at_1_max | 46.60615627466452 |
| nauc_precision_at_1_std | -10.475650807142516 |
| nauc_precision_at_20_diff1 | -6.769874545877082 |
| nauc_precision_at_20_max | 26.352774891191004 |
| nauc_precision_at_20_std | 26.150734923942952 |
| nauc_precision_at_3_diff1 | 23.74601942735032 |
| nauc_precision_at_3_max | 39.71043044078846 |
| nauc_precision_at_3_std | 3.161463247727185 |
| nauc_precision_at_5_diff1 | 11.589849872978208 |
| nauc_precision_at_5_max | 34.355473407777296 |
| nauc_precision_at_5_std | 10.0662074493734 |
| nauc_recall_at_1000_diff1 | 44.20612579552725 |
| nauc_recall_at_1000_max | 54.50563586814392 |
| nauc_recall_at_1000_std | 29.37098358130919 |
| nauc_recall_at_100_diff1 | 46.991905821496225 |
| nauc_recall_at_100_max | 45.677355517440446 |
| nauc_recall_at_100_std | 8.193115293674246 |
| nauc_recall_at_10_diff1 | 51.021956806545575 |
| nauc_recall_at_10_max | 42.39780880270869 |
| nauc_recall_at_10_std | -14.372872090525025 |
| nauc_recall_at_1_diff1 | 64.04942461321761 |
| nauc_recall_at_1_max | 36.02760504360551 |
| nauc_recall_at_1_std | -20.916663614576407 |
| nauc_recall_at_20_diff1 | 49.330317036362736 |
| nauc_recall_at_20_max | 43.82370541895915 |
| nauc_recall_at_20_std | -7.676142813819095 |
| nauc_recall_at_3_diff1 | 56.15563158128648 |
| nauc_recall_at_3_max | 39.776800175069496 |
| nauc_recall_at_3_std | -21.67535047518367 |
| nauc_recall_at_5_diff1 | 53.55725212243435 |
| nauc_recall_at_5_max | 39.639229625237746 |
| nauc_recall_at_5_std | -18.537472489671433 |
| ndcg_at_1 | 48.153 |
| ndcg_at_10 | 56.93 |
| ndcg_at_100 | 61.041999999999994 |
| ndcg_at_1000 | 62.71600000000001 |
| ndcg_at_20 | 58.626999999999995 |
| ndcg_at_3 | 52.437999999999995 |
| ndcg_at_5 | 54.774 |
| precision_at_1 | 48.153 |
| precision_at_10 | 10.93 |
| precision_at_100 | 1.669 |
| precision_at_1000 | 0.213 |
| precision_at_20 | 6.382000000000001 |
| precision_at_3 | 25.796000000000003 |
| precision_at_5 | 18.407999999999998 |
| recall_at_1 | 37.869 |
| recall_at_10 | 67.514 |
| recall_at_100 | 84.454 |
| recall_at_1000 | 94.356 |
| recall_at_20 | 73.558 |
| recall_at_3 | 53.559 |
| recall_at_5 | 60.475 |
MTEB CQADupstackGamingRetrieval 數據集評估結果
| 指標類型 | 值 |
|---|---|
| main_score | 67.253 |
| map_at_1 | 46.905 |
| map_at_10 | 61.332 |
| map_at_100 | 62.304 |
| map_at_1000 | 62.334 |
| map_at_20 | 61.964 |
| map_at_3 | 58.042 |
| map_at_5 | 59.882000000000005 |
| mrr_at_1 | 53.47962382445141 |
| mrr_at_10 | 64.39956212370015 |
| mrr_at_100 | 64.95557189125634 |
| mrr_at_1000 | 64.96848596592983 |
| mrr_at_20 | 64.77428822572568 |
| mrr_at_3 | 62.309299895506896 |
| mrr_at_5 | 63.54440961337527 |
| nauc_map_at_1000_diff1 | 56.74686837364893 |
| nauc_map_at_1000_max | 37.37480368876817 |
| nauc_map_at_1000_std | -10.049421617657124 |
| nauc_map_at_100_diff1 | 56.72313143831275 |
| nauc_map_at_100_max | 37.35797555204418 |
| nauc_map_at_100_std | -10.049812301974452 |
| nauc_map_at_10_diff1 | 56.68397120600094 |
| nauc_map_at_10_max | 36.59842978269273 |
| nauc_map_at_10_std | -11.174804244499098 |
| nauc_map_at_1_diff1 | 61.94214953873164 |
| nauc_map_at_1_max | 28.119092174242382 |
| nauc_map_at_1_std | -14.419629681905278 |
| nauc_map_at_20_diff1 | 56.66822667045707 |
| nauc_map_at_20_max | 37.19179210659321 |
| nauc_map_at_20_std | -10.36424574922098 |
| nauc_map_at_3_diff1 | 56.786004222951966 |
| nauc_map_at_3_max | 34.409125163057354 |
| nauc_map_at_3_std | -12.308681065089702 |
| nauc_map_at_5_diff1 | 56.837122717249855 |
| nauc_map_at_5_max | 35.70069180549282 |
| nauc_map_at_5_std | -12.19154238352126 |
| nauc_mrr_at_1000_diff1 | 57.03608286201278 |
| nauc_mrr_at_1000_max | 39.15777651816965 |
| nauc_mrr_at_1000_std | -8.45524348928121 |
| nauc_mrr_at_100_diff1 | 57.03051889095766 |
| nauc_mrr_at_100_max | 39.168900323859 |
| nauc_mrr_at_100_std | -8.439862972545644 |
| nauc_mrr_at_10_diff1 | 56.848642658414775 |
| nauc_mrr_at_10_max | 39.11801407771557 |
| nauc_mrr_at_10_std | -8.678625365653245 |
| nauc_mrr_at_1_diff1 | 61.1124527741601 |
| nauc_mrr_at_1_max | 36.080048505155865 |
| nauc_mrr_at_1_std | -10.584194474752584 |
| nauc_mrr_at_20_diff1 | 56.878714270983146 |
| nauc_mrr_at_20_max | 39.16569382719707 |
| nauc_mrr_at_20_std | -8.447245465078893 |
| nauc_mrr_at_3_diff1 | 56.87172734333986 |
| nauc_mrr_at_3_max | 39.07882270376788 |
| nauc_mrr_at_3_std | -9.069457598400062 |
| nauc_mrr_at_5_diff1 | 56.82487051170517 |
| nauc_mrr_at_5_max | 39.030878651662796 |
| nauc_mrr_at_5_std | -9.076518259406917 |
| nauc_ndcg_at_1000_diff1 | 56.082240909091695 |
| nauc_ndcg_at_1000_max | 39.699264232007025 |
| nauc_ndcg_at_1000_std | -7.502941002933741 |
| nauc_ndcg_at_100_diff1 | 55.887513398861955 |
| nauc_ndcg_at_100_max | 39.847450141736395 |
| nauc_ndcg_at_100_std | -7.146894645593031 |
| nauc_ndcg_at_10_diff1 | 55.15467572394677 |
| nauc_ndcg_at_10_max | 38.97265748975791 |
| nauc_ndcg_at_10_std | -9.4670794339538 |
| nauc_ndcg_at_1_diff1 | 61.1124527741601 |
| nauc_ndcg_at_1_max | 36.080048505155865 |
| nauc_ndcg_at_1_std | -10.584194474752584 |
| nauc_ndcg_at_20_diff1 | 55.15513104937557 |
| nauc_ndcg_at_20_max | 39.66296704562037 |
| nauc_ndcg_at_20_std | -7.847800655967109 |
| nauc_ndcg_at_3_diff1 | 54.96185776120714 |
| nauc_ndcg_at_3_max | 37.00790660301803 |
| nauc_ndcg_at_3_std | -10.547349631779593 |
| nauc_ndcg_at_5_diff1 | 55.292986134183764 |
| nauc_ndcg_at_5_max | 38.12541620211435 |
| nauc_ndcg_at_5_std | -10.961954651898877 |
| nauc_precision_at_1000_diff1 | -17.737775083152922 |
| nauc_precision_at_1000_max | 21.575992446429407 |
| nauc_precision_at_1000_std | 30.76555260404715 |
| nauc_precision_at_100_diff1 | -17.3761536797116 |
| nauc_precision_at_100_max | 23.455151994000513 |
| nauc_precision_at_100_std | 30.66476060812044 |
| nauc_precision_at_10_diff1 | 0.37712699076668355 |
| nauc_precision_at_10_max | 31.298133911984248 |
| nauc_precision_at_10_std | 16.134374567323214 |
| nauc_precision_at_1_diff1 | 61.1124527741601 |
| nauc_precision_at_1_max | 36.080048505155865 |
| nauc_precision_at_1_std | -10.584194474752584 |
| nauc_precision_at_20_diff1 | -7.697609516072893 |
| nauc_precision_at_20_max | 30.392978129152638 |
| nauc_precision_at_20_std | 25.297979676649902 |
| nauc_precision_at_3_diff1 | 21.920115701694172 |
| nauc_precision_at_3_max | 35.916002988740644 |
| nauc_precision_at_3_std | 3.192816307982428 |
| nauc_precision_at_5_diff1 | 12.416994377124743 |
| nauc_precision_at_5_max | 34.60793433800759 |
| nauc_precision_at_5_std | 7.681539417199799 |
| nauc_recall_at_1000_diff1 | 45.05841406616179 |
| nauc_recall_at_1000_max | 84.01729859779441 |
| nauc_recall_at_1000_std | 70.81952441677544 |
| nauc_recall_at_100_diff1 | 47.82912442332592 |
| nauc_recall_at_100_max | 61.538854248032905 |
| nauc_recall_at_100_std | 31.507749555394742 |
| nauc_recall_at_10_diff1 | 46.23707108341979 |
| nauc_recall_at_10_max | 40.14549188124033 |
| nauc_recall_at_10_std | -8.418378388855976 |
| nauc_recall_at_1_diff1 | 61.94214953873164 |
| nauc_recall_at_1_max | 28.119092174242382 |
| nauc_recall_at_1_std | -14.419629681905278 |
| nauc_recall_at_20_diff1 | 43.5874302201068 |
| nauc_recall_at_20_max | 46.94504592203577 |
| nauc_recall_at_20_std | 3.913410811827146 |
| nauc_recall_at_3_diff1 | 49.63064701945406 |
| nauc_recall_at_3_max | 35.295722264143 |
Jina Embeddings V3
Jina Embeddings V3 是一個多語言句子嵌入模型，支持超過100種語言，專注於句子相似度和特徵提取任務。
文本嵌入
Transformers 支持多種語言
Transformers 支持多種語言J
jinaai
3.7M
911
Ms Marco MiniLM L6 V2
Apache-2.0
基於MS Marco段落排序任務訓練的交叉編碼器模型，用於信息檢索中的查詢-段落相關性評分
文本嵌入 英語
M
cross-encoder
2.5M
86
Opensearch Neural Sparse Encoding Doc V2 Distill
Apache-2.0
基於蒸餾技術的稀疏檢索模型，專為OpenSearch優化，支持免推理文檔編碼，在搜索相關性和效率上優於V1版本
文本嵌入 Transformers 英語
Transformers 英語O
opensearch-project
1.8M
7
Sapbert From PubMedBERT Fulltext
Apache-2.0
基於PubMedBERT的生物醫學實體表徵模型，通過自對齊預訓練優化語義關係捕捉
文本嵌入 英語
S
cambridgeltl
1.7M
49
Gte Large
MIT
GTE-Large 是一個強大的句子轉換器模型，專注於句子相似度和文本嵌入任務，在多個基準測試中表現出色。
文本嵌入 英語
G
thenlper
1.5M
278
Gte Base En V1.5
Apache-2.0
GTE-base-en-v1.5 是一個英文句子轉換器模型，專注於句子相似度任務，在多個文本嵌入基準測試中表現優異。
文本嵌入 Transformers 支持多種語言
Transformers 支持多種語言G
Alibaba-NLP
1.5M
63
Gte Multilingual Base
Apache-2.0
GTE Multilingual Base 是一個多語言的句子嵌入模型，支持超過50種語言，適用於句子相似度計算等任務。
文本嵌入 Transformers 支持多種語言
Transformers 支持多種語言G
Alibaba-NLP
1.2M
246
Polybert
polyBERT是一個化學語言模型，旨在實現完全由機器驅動的超快聚合物信息學。它將PSMILES字符串映射為600維密集指紋，以數值形式表示聚合物化學結構。
文本嵌入 Transformers
TransformersP
kuelumbus
1.0M
5
Bert Base Turkish Cased Mean Nli Stsb Tr
Apache-2.0
基於土耳其語BERT的句子嵌入模型，專為語義相似度任務優化
文本嵌入 Transformers 其他
Transformers 其他B
emrecan
1.0M
40
GIST Small Embedding V0
MIT
基於BAAI/bge-small-en-v1.5模型微調的文本嵌入模型，通過MEDI數據集與MTEB分類任務數據集訓練，優化了檢索任務的查詢編碼能力。
文本嵌入
Safetensors 英語
Safetensors 英語G
avsolatorio
945.68k
29
精選推薦AI模型
Llama 3 Typhoon V1.5x 8b Instruct
專為泰語設計的80億參數指令模型，性能媲美GPT-3.5-turbo，優化了應用場景、檢索增強生成、受限生成和推理任務
大型語言模型 Transformers 支持多種語言
Transformers 支持多種語言L
scb10x
3,269
16
Cadet Tiny
Openrail
Cadet-Tiny是一個基於SODA數據集訓練的超小型對話模型，專為邊緣設備推理設計，體積僅為Cosmo-3B模型的2%左右。
對話系統 Transformers 英語
Transformers 英語C
ToddGoldfarb
2,691
6
Roberta Base Chinese Extractive Qa
基於RoBERTa架構的中文抽取式問答模型，適用於從給定文本中提取答案的任務。
問答系統 中文
R
uer
2,694
98