Langcache Crossencoder V1 Ms Marco MiniLM L12 V2

🚀 Redis语义缓存CrossEncoder模型（在Quora问题对上微调）

本模型是基于Transformer架构的CrossEncoder模型，在Quora问题对数据集上进行了微调。它可以为文本对计算得分，适用于句子对分类任务，在语义相似度和语义搜索等场景中具有重要价值。

🚀 快速开始

直接使用（Sentence Transformers）

首先，安装Sentence Transformers库：

pip install -U sentence-transformers

然后，你可以加载此模型并进行推理：

from sentence_transformers import CrossEncoder

# 从🤗 Hub下载
model = CrossEncoder("aditeyabaral-redis/langcache-crossencoder-v1-ms-marco-MiniLM-L12-v2")
# 获取文本对的得分
pairs = [
    ['How can I get a list of my Gmail accounts?', 'How can I find all my old Gmail accounts?'],
    ['How can I stop Quora from modifying and editing other people’s questions on Quora?', 'Can I prevent a Quora user from editing my question on Quora?'],
    ['How much does it cost to design a logo in india?', 'How much does it cost to design a logo?'],
    ['What is screenedrenters.com?', 'What is allmyapps.com?'],
    ['What are the best colleges for an MBA in Australia?', 'What are the top MBA schools in Australia?'],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)

# 或者根据与单个文本的相似度对不同文本进行排序
ranks = model.rank(
    'How can I get a list of my Gmail accounts?',
    [
        'How can I find all my old Gmail accounts?',
        'Can I prevent a Quora user from editing my question on Quora?',
        'How much does it cost to design a logo?',
        'What is allmyapps.com?',
        'What are the top MBA schools in Australia?',
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

✨ 主要特性

• 微调模型：基于cross-encoder/ms-marco-MiniLM-L12-v2模型在Quora问题对数据集上进行微调。
• 多任务支持：适用于文本排名、句子对分类、语义相似度计算等多种任务。
• 指标丰富：在评估中使用了准确率、F1值、召回率等多种指标。

📦 安装指南

安装Sentence Transformers库：

pip install -U sentence-transformers

📚 详细文档

模型详情

模型描述

模型资源

• 文档：Sentence Transformers文档
• 文档：Cross Encoder文档
• 仓库：GitHub上的Sentence Transformers
• Hugging Face：Hugging Face上的Cross Encoders

评估

指标

Cross Encoder分类

• 数据集：quora-eval
• 使用CrossEncoderClassificationEvaluator进行评估

训练详情

训练数据集

Quora Question Pairs LangCache Train Set

• 数据集：Quora Question Pairs LangCache Train Set
• 大小：363,861个训练样本
• 列：sentence1、sentence2和label
• 基于前1000个样本的近似统计信息：

  	sentence1	sentence2	label
  类型	字符串	字符串	整数
  详情	最小：15个字符 平均：60.22个字符 最大：229个字符	最小：14个字符 平均：60.0个字符 最大：274个字符	0：约63.50% 1：约36.50%

• 样本：

  sentence1	sentence2	label
  Why do people believe in God and how can they say he/she exists?	Why do we kill each other in the name of God?	0
  What are the chances of a bee sting when a bee buzzes around you?	How can I tell if my bees are agitated/likely to sting?	0
  If a man from Syro Malankara church marries a Syro-Malabar girl, can they join a Syro-Malabar parish?	Is Malabar Hills of Mumbai anyhow related to Malabar of Kerala?	0

• 损失函数：BinaryCrossEntropyLoss，参数如下：

{
    "activation_fn": "torch.nn.modules.linear.Identity",
    "pos_weight": null
}

评估数据集

Quora Question Pairs LangCache Validation Set

• 数据集：Quora Question Pairs LangCache Validation Set
• 大小：40,429个评估样本
• 列：sentence1、sentence2和label
• 基于前1000个样本的近似统计信息：

  	sentence1	sentence2	label
  类型	字符串	字符串	整数
  详情	最小：13个字符 平均：59.91个字符 最大：266个字符	最小：13个字符 平均：59.51个字符 最大：293个字符	0：约63.80% 1：约36.20%

• 样本：

  sentence1	sentence2	label
  How can I get a list of my Gmail accounts?	How can I find all my old Gmail accounts?	1
  How can I stop Quora from modifying and editing other people’s questions on Quora?	Can I prevent a Quora user from editing my question on Quora?	1
  How much does it cost to design a logo in india?	How much does it cost to design a logo?	0

• 损失函数：BinaryCrossEntropyLoss，参数如下：

{
    "activation_fn": "torch.nn.modules.linear.Identity",
    "pos_weight": null
}

训练超参数

非默认超参数

• eval_strategy：steps
• per_device_train_batch_size：64
• per_device_eval_batch_size：64
• learning_rate：0.0002
• num_train_epochs：15
• load_best_model_at_end：True
• push_to_hub：True
• hub_model_id：aditeyabaral-redis/langcache-crossencoder-v1-ms-marco-MiniLM-L12-v2

所有超参数

训练日志

📄 许可证

本模型采用apache-2.0许可证。