Reranker ModernBERT Base Gooaq Bce

🚀 在GooAQ上訓練的ModernBERT-base

這是一個基於answerdotai/ModernBERT-base，使用sentence-transformers庫微調得到的交叉編碼器模型。它可以為文本對計算得分，這些得分可用於文本重排序和語義搜索。

訓練腳本請參考training_gooaq_bce.py。該腳本也在交叉編碼器 > 訓練概述文檔和使用Sentence Transformers v4訓練和微調重排序模型博客文章中有所描述。

🚀 快速開始

本模型是一個基於answerdotai/ModernBERT-base微調的交叉編碼器模型，可用於文本對得分計算，適用於文本重排序和語義搜索任務。

✨ 主要特性

• 基於預訓練的answerdotai/ModernBERT-base模型進行微調，能有效計算文本對的得分。
• 可用於文本重排序和語義搜索，為相關任務提供支持。

📦 安裝指南

首先安裝Sentence Transformers庫：

pip install -U sentence-transformers

💻 使用示例

基礎用法

from sentence_transformers import CrossEncoder

# 從🤗 Hub下載模型
model = CrossEncoder("tomaarsen/reranker-ModernBERT-base-gooaq-bce")
# 獲取文本對的得分
pairs = [
    ['why are rye chips so good?', "It makes them taste that much better! The rye chips are tasty because they stand out--they're the saltiest thing in the bag. It's not because rye bread is inherently awesome. ... You could just buy a bag of rye chips."],
    ['why are rye chips so good?', 'There are no substantial technical, nutritional or performance issues associated with rye that would limit its use for pets. Rye is a fairly common ingredient in human foods and beverages. The most prevalent occurrence is in crackers and breads.'],
    ['why are rye chips so good?', 'Bread made wholly from rye flour is made in Germany and called pumpernickel. Rye is unique among grains for having a high level of fibre in its endosperm – not just in its bran. As such, the glycemic index (GI) of rye products is generally lower than products made from wheat and most other grains.'],
    ['why are rye chips so good?', 'KFC Chips – The salt mix on the seasoned chips and the actual chips do not contain any animal products. Our supplier/s of chips and seasoning have confirmed they are suitable for vegans.'],
    ['why are rye chips so good?', 'A study in the American Journal of Clinical Nutrition found that eating rye leads to better blood-sugar control compared to wheat. Rye bread is packed with magnesium, which helps control blood pressure and optimize heart health. Its high levels of soluble fibre can also reduce cholesterol.'],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)

# 或者根據與單個文本的相似度對不同文本進行排序
ranks = model.rank(
    'why are rye chips so good?',
    [
        "It makes them taste that much better! The rye chips are tasty because they stand out--they're the saltiest thing in the bag. It's not because rye bread is inherently awesome. ... You could just buy a bag of rye chips.",
        'There are no substantial technical, nutritional or performance issues associated with rye that would limit its use for pets. Rye is a fairly common ingredient in human foods and beverages. The most prevalent occurrence is in crackers and breads.',
        'Bread made wholly from rye flour is made in Germany and called pumpernickel. Rye is unique among grains for having a high level of fibre in its endosperm – not just in its bran. As such, the glycemic index (GI) of rye products is generally lower than products made from wheat and most other grains.',
        'KFC Chips – The salt mix on the seasoned chips and the actual chips do not contain any animal products. Our supplier/s of chips and seasoning have confirmed they are suitable for vegans.',
        'A study in the American Journal of Clinical Nutrition found that eating rye leads to better blood-sugar control compared to wheat. Rye bread is packed with magnesium, which helps control blood pressure and optimize heart health. Its high levels of soluble fibre can also reduce cholesterol.',
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

📚 詳細文檔

模型詳情

模型描述

模型來源

• 文檔：Sentence Transformers文檔
• 文檔：交叉編碼器文檔
• 倉庫：GitHub上的Sentence Transformers
• Hugging Face：Hugging Face上的交叉編碼器

評估

交叉編碼器重排序

• 數據集：gooaq-dev
• 評估方法：使用CrossEncoderRerankingEvaluator，參數如下：

  {
      "at_k": 10,
      "always_rerank_positives": false
  }
  

• 數據集：gooaq-dev
• 評估方法：使用CrossEncoderRerankingEvaluator，參數如下：

  {
      "at_k": 10,
      "always_rerank_positives": true
  }
  

• 數據集：NanoMSMARCO_R100、NanoNFCorpus_R100和NanoNQ_R100
• 評估方法：使用CrossEncoderRerankingEvaluator，參數如下：

  {
      "at_k": 10,
      "always_rerank_positives": true
  }
  

交叉編碼器Nano BEIR

• 數據集：NanoBEIR_R100_mean
• 評估方法：使用CrossEncoderNanoBEIREvaluator，參數如下：

  {
      "dataset_names": [
          "msmarco",
          "nfcorpus",
          "nq"
      ],
      "rerank_k": 100,
      "at_k": 10,
      "always_rerank_positives": true
  }
  

訓練詳情

訓練數據集

未命名數據集

• 大小：578,402個訓練樣本
• 列：question、answer和label
• 基於前1000個樣本的近似統計信息： | | 問題 | 答案 | 標籤 | |------|------|------|------| | 類型 | 字符串 | 字符串 | 整數 | | 詳情 |
  • 最小：19個字符
  • 平均：45.14個字符
  • 最大：85個字符
  |
  • 最小：65個字符
  • 平均：254.8個字符
  • 最大：379個字符
  |
  • 0：~82.90%
  • 1：~17.10%
  |
• 樣本： | 問題 | 答案 | 標籤 | |------|------|------| | why are rye chips so good? | It makes them taste that much better! The rye chips are tasty because they stand out--they're the saltiest thing in the bag. It's not because rye bread is inherently awesome. ... You could just buy a bag of rye chips. | 1 | | why are rye chips so good? | There are no substantial technical, nutritional or performance issues associated with rye that would limit its use for pets. Rye is a fairly common ingredient in human foods and beverages. The most prevalent occurrence is in crackers and breads. | 0 | | why are rye chips so good? | Bread made wholly from rye flour is made in Germany and called pumpernickel. Rye is unique among grains for having a high level of fibre in its endosperm – not just in its bran. As such, the glycemic index (GI) of rye products is generally lower than products made from wheat and most other grains. | 0 |
• 損失函數：BinaryCrossEntropyLoss，參數如下：

  {
      "activation_fct": "torch.nn.modules.linear.Identity",
      "pos_weight": 5
  }
  

訓練超參數

非默認超參數

• eval_strategy：steps
• per_device_train_batch_size：64
• per_device_eval_batch_size：64
• learning_rate：2e-05
• num_train_epochs：1
• warmup_ratio：0.1
• seed：12
• bf16：True
• dataloader_num_workers：4
• load_best_model_at_end：True

訓練日誌

注：加粗行表示保存的檢查點。

框架版本

• Python：3.11.10
• Sentence Transformers：3.5.0.dev0
• Transformers：4.49.0
• PyTorch：2.5.1+cu124
• Accelerate：1.5.2
• Datasets：2.21.0
• Tokenizers：0.21.0

📄 許可證

本模型使用apache-2.0許可證。

📚 引用

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}