🚀 PyLateモデル（Alibaba-NLP/gte-modernbert-baseベース）
このモデルは、Alibaba-NLP/gte-modernbert-baseをベースに構築されたPyLateモデルで、文章の類似度を測定するために使用されます。
📚 詳細ドキュメント
モデル情報
| 属性 |
詳情 |
| モデルタイプ |
sentence-similarity |
| 生成元 |
generated_from_trainer |
| データセットサイズ |
640000 |
| 損失関数 |
Distillation |
| ベースモデル |
Alibaba-NLP/gte-modernbert-base |
| ライブラリ名 |
PyLate |
評価指標
- MaxSim_accuracy@1
- MaxSim_accuracy@3
- MaxSim_accuracy@5
- MaxSim_accuracy@10
- MaxSim_precision@1
- MaxSim_precision@3
- MaxSim_precision@5
- MaxSim_precision@10
- MaxSim_recall@1
- MaxSim_recall@3
- MaxSim_recall@5
- MaxSim_recall@10
- MaxSim_ndcg@10
- MaxSim_mrr@10
- MaxSim_map@100
各データセットでの評価結果
NanoClimateFEVERデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.36 |
| Maxsim Accuracy@3 |
0.62 |
| Maxsim Accuracy@5 |
0.78 |
| Maxsim Accuracy@10 |
0.86 |
| Maxsim Precision@1 |
0.36 |
| Maxsim Precision@3 |
0.2333333333333333 |
| Maxsim Precision@5 |
0.20799999999999996 |
| Maxsim Precision@10 |
0.12799999999999997 |
| Maxsim Recall@1 |
0.18333333333333332 |
| Maxsim Recall@3 |
0.289 |
| Maxsim Recall@5 |
0.41566666666666663 |
| Maxsim Recall@10 |
0.49566666666666664 |
| Maxsim Ndcg@10 |
0.41477895139843374 |
| Maxsim Mrr@10 |
0.526579365079365 |
| Maxsim Map@100 |
0.33473812643311207 |
NanoDBPediaデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.88 |
| Maxsim Accuracy@3 |
0.94 |
| Maxsim Accuracy@5 |
0.96 |
| Maxsim Accuracy@10 |
0.98 |
| Maxsim Precision@1 |
0.88 |
| Maxsim Precision@3 |
0.7133333333333334 |
| Maxsim Precision@5 |
0.6560000000000001 |
| Maxsim Precision@10 |
0.572 |
| Maxsim Recall@1 |
0.11798996781634019 |
| Maxsim Recall@3 |
0.23074158968531658 |
| Maxsim Recall@5 |
0.2961618059276896 |
| Maxsim Recall@10 |
0.4145532152487909 |
| Maxsim Ndcg@10 |
0.7295518860528665 |
| Maxsim Mrr@10 |
0.9168571428571428 |
| Maxsim Map@100 |
0.5883869727264871 |
NanoFEVERデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.92 |
| Maxsim Accuracy@3 |
0.98 |
| Maxsim Accuracy@5 |
0.98 |
| Maxsim Accuracy@10 |
1.0 |
| Maxsim Precision@1 |
0.92 |
| Maxsim Precision@3 |
0.35999999999999993 |
| Maxsim Precision@5 |
0.21599999999999994 |
| Maxsim Precision@10 |
0.10999999999999999 |
| Maxsim Recall@1 |
0.8566666666666667 |
| Maxsim Recall@3 |
0.96 |
| Maxsim Recall@5 |
0.96 |
| Maxsim Recall@10 |
0.98 |
| Maxsim Ndcg@10 |
0.9451911044041129 |
| Maxsim Mrr@10 |
0.9522222222222223 |
| Maxsim Map@100 |
0.9270501207729468 |
NanoFiQA2018データセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.56 |
| Maxsim Accuracy@3 |
0.66 |
| Maxsim Accuracy@5 |
0.74 |
| Maxsim Accuracy@10 |
0.8 |
| Maxsim Precision@1 |
0.56 |
| Maxsim Precision@3 |
0.32666666666666666 |
| Maxsim Precision@5 |
0.25599999999999995 |
| Maxsim Precision@10 |
0.15199999999999997 |
| Maxsim Recall@1 |
0.30924603174603177 |
| Maxsim Recall@3 |
0.47840476190476194 |
| Maxsim Recall@5 |
0.5751746031746031 |
| Maxsim Recall@10 |
0.6411984126984127 |
| Maxsim Ndcg@10 |
0.5669909336903424 |
| Maxsim Mrr@10 |
0.6359444444444444 |
| Maxsim Map@100 |
0.5031998196513616 |
NanoHotpotQAデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.92 |
| Maxsim Accuracy@3 |
1.0 |
| Maxsim Accuracy@5 |
1.0 |
| Maxsim Accuracy@10 |
1.0 |
| Maxsim Precision@1 |
0.92 |
| Maxsim Precision@3 |
0.58 |
| Maxsim Precision@5 |
0.35999999999999993 |
| Maxsim Precision@10 |
0.18599999999999994 |
| Maxsim Recall@1 |
0.46 |
| Maxsim Recall@3 |
0.87 |
| Maxsim Recall@5 |
0.9 |
| Maxsim Recall@10 |
0.93 |
| Maxsim Ndcg@10 |
0.9011747095216048 |
| Maxsim Mrr@10 |
0.96 |
| Maxsim Map@100 |
0.8591508921772081 |
NanoMSMARCOデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.54 |
| Maxsim Accuracy@3 |
0.68 |
| Maxsim Accuracy@5 |
0.74 |
| Maxsim Accuracy@10 |
0.92 |
| Maxsim Precision@1 |
0.54 |
| Maxsim Precision@3 |
0.22666666666666666 |
| Maxsim Precision@5 |
0.14800000000000002 |
| Maxsim Precision@10 |
0.092 |
| Maxsim Recall@1 |
0.54 |
| Maxsim Recall@3 |
0.68 |
| Maxsim Recall@5 |
0.74 |
| Maxsim Recall@10 |
0.92 |
| Maxsim Ndcg@10 |
0.7088869908160952 |
| Maxsim Mrr@10 |
0.6446507936507936 |
| Maxsim Map@100 |
0.6496349206349206 |
NanoNFCorpusデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.56 |
| Maxsim Accuracy@3 |
0.68 |
| Maxsim Accuracy@5 |
0.74 |
| Maxsim Accuracy@10 |
0.76 |
| Maxsim Precision@1 |
0.56 |
| Maxsim Precision@3 |
0.43333333333333335 |
| Maxsim Precision@5 |
0.39199999999999996 |
| Maxsim Precision@10 |
0.304 |
| Maxsim Recall@1 |
0.06640185752724687 |
| Maxsim Recall@3 |
0.10198877096622012 |
| Maxsim Recall@5 |
0.12839743828750172 |
| Maxsim Recall@10 |
0.15658989769166 |
| Maxsim Ndcg@10 |
0.3957047406068243 |
| Maxsim Mrr@10 |
0.627 |
| Maxsim Map@100 |
0.1917924344366858 |
NanoNQデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.64 |
| Maxsim Accuracy@3 |
0.82 |
| Maxsim Accuracy@5 |
0.86 |
| Maxsim Accuracy@10 |
0.9 |
| Maxsim Precision@1 |
0.64 |
| Maxsim Precision@3 |
0.2866666666666666 |
| Maxsim Precision@5 |
0.17999999999999997 |
| Maxsim Precision@10 |
0.1 |
| Maxsim Recall@1 |
0.61 |
| Maxsim Recall@3 |
0.78 |
| Maxsim Recall@5 |
0.82 |
| Maxsim Recall@10 |
0.88 |
| Maxsim Ndcg@10 |
0.7645227466201794 |
| Maxsim Mrr@10 |
0.7390000000000001 |
| Maxsim Map@100 |
0.7239323294755705 |
NanoQuoraRetrievalデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.96 |
| Maxsim Accuracy@3 |
1.0 |
| Maxsim Accuracy@5 |
1.0 |
| Maxsim Accuracy@10 |
1.0 |
| Maxsim Precision@1 |
0.96 |
| Maxsim Precision@3 |
0.4 |
| Maxsim Precision@5 |
0.25599999999999995 |
| Maxsim Precision@10 |
0.13399999999999998 |
| Maxsim Recall@1 |
0.8473333333333334 |
| Maxsim Recall@3 |
0.9453333333333334 |
| Maxsim Recall@5 |
0.9693333333333334 |
| Maxsim Recall@10 |
0.9893333333333334 |
| Maxsim Ndcg@10 |
0.9691448095973965 |
| Maxsim Mrr@10 |
0.9766666666666667 |
| Maxsim Map@100 |
0.9551871794871795 |
NanoSCIDOCSデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.48 |
| Maxsim Accuracy@3 |
0.74 |
| Maxsim Accuracy@5 |
0.78 |
| Maxsim Accuracy@10 |
0.84 |
| Maxsim Precision@1 |
0.48 |
| Maxsim Precision@3 |
0.3999999999999999 |
| Maxsim Precision@5 |
0.292 |
| Maxsim Precision@10 |
0.19399999999999995 |
| Maxsim Recall@1 |
0.10066666666666667 |
| Maxsim Recall@3 |
0.24666666666666665 |
| Maxsim Recall@5 |
0.29966666666666664 |
| Maxsim Recall@10 |
0.39666666666666667 |
| Maxsim Ndcg@10 |
0.3986767701602276 |
| Maxsim Mrr@10 |
0.6137222222222222 |
| Maxsim Map@100 |
0.3163385555719993 |
NanoArguAnaデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.3 |
| Maxsim Accuracy@3 |
0.62 |
| Maxsim Accuracy@5 |
0.7 |
| Maxsim Accuracy@10 |
0.82 |
| Maxsim Precision@1 |
0.3 |
| Maxsim Precision@3 |
0.20666666666666667 |
| Maxsim Precision@5 |
0.14 |
| Maxsim Precision@10 |
0.08199999999999999 |
| Maxsim Recall@1 |
0.3 |
| Maxsim Recall@3 |
0.62 |
| Maxsim Recall@5 |
0.7 |
| Maxsim Recall@10 |
0.82 |
| Maxsim Ndcg@10 |
0.5609089627577635 |
| Maxsim Mrr@10 |
0.4774603174603175 |
| Maxsim Map@100 |
0.4824361431413148 |
NanoSciFactデータセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.74 |
| Maxsim Accuracy@3 |
0.86 |
| Maxsim Accuracy@5 |
0.9 |
| Maxsim Accuracy@10 |
0.94 |
| Maxsim Precision@1 |
0.74 |
| Maxsim Precision@3 |
0.3 |
| Maxsim Precision@5 |
0.19599999999999995 |
| Maxsim Precision@10 |
0.10399999999999998 |
| Maxsim Recall@1 |
0.715 |
| Maxsim Recall@3 |
0.83 |
| Maxsim Recall@5 |
0.885 |
| Maxsim Recall@10 |
0.93 |
| Maxsim Ndcg@10 |
0.8371556505161787 |
| Maxsim Mrr@10 |
0.8116666666666668 |
| Maxsim Map@100 |
0.8048798701298702 |
NanoTouche2020データセット
| 指標 |
値 |
| Maxsim Accuracy@1 |
0.7755102040816326 |
| Maxsim Accuracy@3 |
0.9387755102040817 |
| Maxsim Accuracy@5 |
0.9795918367346939 |
| Maxsim Accuracy@10 |
0.9795918367346939 |
| Maxsim Precision@1 |
0.7755102040816326 |
| Maxsim Precision@3 |
0.6598639455782314 |
| Maxsim Precision@5 |
0.6571428571428573 |
| Maxsim Precision@10 |
0.5183673469387755 |
| Maxsim Recall@1 |
0.05176652252904378 |
| Maxsim Recall@3 |
0.13618168510556633 |
| Maxsim Recall@5 |
0.2193408037582337 |
| Maxsim Recall@10 |
0.33397423594107617 |
| Maxsim Ndcg@10 |
0.5926586898856947 |
| Maxsim Mrr@10 |
0.8629251700680272 |
| Maxsim Map@100 |
0.42574993112112997 |
ライセンス
このモデルは、Apache 2.0ライセンスの下で提供されています。
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
Transformers Supports Multiple Languages