Langcache Crossencoder V1 Ms Marco MiniLM L12 V2

🚀 Redis語義緩存CrossEncoder模型（在Quora問題對上微調）

本模型是基於Transformer架構的CrossEncoder模型，在Quora問題對數據集上進行了微調。它可以為文本對計算得分，適用於句子對分類任務，在語義相似度和語義搜索等場景中具有重要價值。

🚀 快速開始

直接使用（Sentence Transformers）

首先，安裝Sentence Transformers庫：

pip install -U sentence-transformers

然後，你可以加載此模型並進行推理：

from sentence_transformers import CrossEncoder

# 從🤗 Hub下載
model = CrossEncoder("aditeyabaral-redis/langcache-crossencoder-v1-ms-marco-MiniLM-L12-v2")
# 獲取文本對的得分
pairs = [
    ['How can I get a list of my Gmail accounts?', 'How can I find all my old Gmail accounts?'],
    ['How can I stop Quora from modifying and editing other people’s questions on Quora?', 'Can I prevent a Quora user from editing my question on Quora?'],
    ['How much does it cost to design a logo in india?', 'How much does it cost to design a logo?'],
    ['What is screenedrenters.com?', 'What is allmyapps.com?'],
    ['What are the best colleges for an MBA in Australia?', 'What are the top MBA schools in Australia?'],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)

# 或者根據與單個文本的相似度對不同文本進行排序
ranks = model.rank(
    'How can I get a list of my Gmail accounts?',
    [
        'How can I find all my old Gmail accounts?',
        'Can I prevent a Quora user from editing my question on Quora?',
        'How much does it cost to design a logo?',
        'What is allmyapps.com?',
        'What are the top MBA schools in Australia?',
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

✨ 主要特性

• 微調模型：基於cross-encoder/ms-marco-MiniLM-L12-v2模型在Quora問題對數據集上進行微調。
• 多任務支持：適用於文本排名、句子對分類、語義相似度計算等多種任務。
• 指標豐富：在評估中使用了準確率、F1值、召回率等多種指標。

📦 安裝指南

安裝Sentence Transformers庫：

pip install -U sentence-transformers

📚 詳細文檔

模型詳情

模型描述

模型資源

• 文檔：Sentence Transformers文檔
• 文檔：Cross Encoder文檔
• 倉庫：GitHub上的Sentence Transformers
• Hugging Face：Hugging Face上的Cross Encoders

評估

指標

Cross Encoder分類

• 數據集：quora-eval
• 使用CrossEncoderClassificationEvaluator進行評估

訓練詳情

訓練數據集

Quora Question Pairs LangCache Train Set

• 數據集：Quora Question Pairs LangCache Train Set
• 大小：363,861個訓練樣本
• 列：sentence1、sentence2和label
• 基於前1000個樣本的近似統計信息：

  	sentence1	sentence2	label
  類型	字符串	字符串	整數
  詳情	最小：15個字符 平均：60.22個字符 最大：229個字符	最小：14個字符 平均：60.0個字符 最大：274個字符	0：約63.50% 1：約36.50%

• 樣本：

  sentence1	sentence2	label
  Why do people believe in God and how can they say he/she exists?	Why do we kill each other in the name of God?	0
  What are the chances of a bee sting when a bee buzzes around you?	How can I tell if my bees are agitated/likely to sting?	0
  If a man from Syro Malankara church marries a Syro-Malabar girl, can they join a Syro-Malabar parish?	Is Malabar Hills of Mumbai anyhow related to Malabar of Kerala?	0

• 損失函數：BinaryCrossEntropyLoss，參數如下：

{
    "activation_fn": "torch.nn.modules.linear.Identity",
    "pos_weight": null
}

評估數據集

Quora Question Pairs LangCache Validation Set

• 數據集：Quora Question Pairs LangCache Validation Set
• 大小：40,429個評估樣本
• 列：sentence1、sentence2和label
• 基於前1000個樣本的近似統計信息：

  	sentence1	sentence2	label
  類型	字符串	字符串	整數
  詳情	最小：13個字符 平均：59.91個字符 最大：266個字符	最小：13個字符 平均：59.51個字符 最大：293個字符	0：約63.80% 1：約36.20%

• 樣本：

  sentence1	sentence2	label
  How can I get a list of my Gmail accounts?	How can I find all my old Gmail accounts?	1
  How can I stop Quora from modifying and editing other people’s questions on Quora?	Can I prevent a Quora user from editing my question on Quora?	1
  How much does it cost to design a logo in india?	How much does it cost to design a logo?	0

• 損失函數：BinaryCrossEntropyLoss，參數如下：

{
    "activation_fn": "torch.nn.modules.linear.Identity",
    "pos_weight": null
}

訓練超參數

非默認超參數

• eval_strategy：steps
• per_device_train_batch_size：64
• per_device_eval_batch_size：64
• learning_rate：0.0002
• num_train_epochs：15
• load_best_model_at_end：True
• push_to_hub：True
• hub_model_id：aditeyabaral-redis/langcache-crossencoder-v1-ms-marco-MiniLM-L12-v2

所有超參數

訓練日誌

📄 許可證

本模型採用apache-2.0許可證。