🚀 research-backup/bart-large-squad-qg-no-paragraph
模型卡片
本模型是 facebook/bart-large 的微调版本,用于在 lmqg/qg_squad(数据集名称:default)上进行问题生成任务,微调借助了 lmqg
工具。该模型在微调时不使用段落信息,仅使用包含答案的句子。
🚀 快速开始
模型基本信息
许可证
本模型使用 CC BY 4.0 许可证。
评估指标
- BLEU4
- METEOR
- ROUGE-L
- BERTScore
- MoverScore
数据集
模型标签
示例展示
- 输入文本:" Beyonce further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records."
示例标题:"问题生成示例 1"
- 输入文本:"Beyonce further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records."
示例标题:"问题生成示例 2"
- 输入文本:"Beyonce further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records ."
示例标题:"问题生成示例 3"
💻 使用示例
基础用法
使用 lmqg
库
from lmqg import TransformersQG
model = TransformersQG(language="en", model="research-backup/bart-large-squad-qg-no-paragraph")
questions = model.generate_q(list_context="William Turner was an English painter who specialised in watercolour landscapes", list_answer="William Turner")
使用 transformers
库
from transformers import pipeline
pipe = pipeline("text2text-generation", "research-backup/bart-large-squad-qg-no-paragraph")
output = pipe("<hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.")
📚 详细文档
评估
训练超参数
以下超参数在微调过程中使用:
- 数据集路径:lmqg/qg_squad
- 数据集名称:default
- 输入类型:['sentence_answer']
- 输出类型:['question']
- 前缀类型:None
- 模型:facebook/bart-large
- 最大长度:128
- 最大输出长度:32
- 训练轮数:8
- 批次大小:32
- 学习率:5e-05
- 是否使用混合精度:False
- 随机种子:1
- 梯度累积步数:16
- 标签平滑系数:0.15
完整配置可在 微调配置文件 中查看。
引用
@inproceedings{ushio-etal-2022-generative,
title = "{G}enerative {L}anguage {M}odels for {P}aragraph-{L}evel {Q}uestion {G}eneration",
author = "Ushio, Asahi and
Alva-Manchego, Fernando and
Camacho-Collados, Jose",
booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
month = dec,
year = "2022",
address = "Abu Dhabi, U.A.E.",
publisher = "Association for Computational Linguistics",
}