Flan T5 Base Samsum

🚀 flan-t5-base-samsum

该模型是 google/flan-t5-base 在 samsum 数据集上的微调版本。它在评估集上取得了以下成果：

• 损失值（Loss）：1.3709
• ROUGE-1：46.8876
• ROUGE-2：23.2689
• ROUGE-L：39.5369
• ROUGE-LSUM：43.1602
• 生成长度（Gen Len）：17.2027

🚀 快速开始

此模型基于 google/flan-t5-base 在 samsum 数据集上微调而来，可用于特定的文本生成和摘要任务。

📚 详细文档

模型描述

更多信息待补充。

预期用途与限制

更多信息待补充。

训练和评估数据

更多信息待补充。

训练过程

训练超参数

训练过程中使用了以下超参数：

• 学习率（learning_rate）：5e-05
• 训练批次大小（train_batch_size）：8
• 评估批次大小（eval_batch_size）：8
• 随机种子（seed）：42
• 优化器（optimizer）：Adam，β1=0.9，β2=0.999，ε=1e-08
• 学习率调度器类型（lr_scheduler_type）：线性
• 训练轮数（num_epochs）：5

训练结果

框架版本

• Transformers 4.26.1
• Pytorch 1.13.1+cu116
• Datasets 2.9.0
• Tokenizers 0.13.2

📄 许可证

该模型使用 Apache-2.0 许可证。

🔍 标签

• 由训练器生成（generated_from_trainer）
• 摘要（summarization）

📊 数据集

• samsum

📈 评估指标

• ROUGE

🧪 示例

对话示例 1

Olivia: Hey Carter, are you still developing that restaurant business? Carter:
    Hi Olivia Carter: Yes, we want to launch next month :) Olivia: Next month? That's
    soon! Congrats :) Carter: thanks, I'm a bit nervous but I seriously believe we're
    delivering something innovative and needed Olivia: I think it's a great concept
    and I am sure you'll do great! Olivia: I am currently involved with a new restaurant
    in the city centre Carter: Which one? Olivia: Spicy and chilled Carter: I heard
    about it :) Is it any good? ;) Olivia: I love the restaurant and really like working
    there Carter: good for you! Olivia: and here's the question - are you still looking
    for restaurant to include in your discount app? Carter: sure, but I think it would
    be better to discuss it in person - would you like to meet up? Olivia: That would
    be great!

对话示例 2

Chad: Elton John is goat Eva: what do you mean by goat? Frank: greatest of
    all time Chad: indeed Eva: ahh... it makes sense now :P

维基百科文章示例

Astonishing X-Men is the name of four X-Men comic book series from Marvel
    Comics, the first two of which were limited series. The third volume, an ongoing
    series, began in 2004, with its first run written by Joss Whedon and art by John
    Cassaday. It was then written by Warren Ellis with art by Simone Bianchi and Phil
    Jimenez.[1] Daniel Way and Christos Gage then took over the title writing alternating
    stories. They were followed by James Asmus who wrote one issue, then Greg Pak,
    who took over for four issues in November 2011.[2] Marjorie Liu wrote the final
    21 issues of the series until its end at issue #68 in 2013. The title's fourth
    volume and second ongoing series launched in 2017 during the "ResurrXion" storyline.[3]
    The first run was written by Charles Soule and illustrated by a rotating cast
    of artists. Matthew Rosenberg and artist Greg Land would then take over the series
    before its end in 2018. The original Astonishing X-Men was a four-issue limited
    series that replaced Uncanny X-Men during the 1995 alternate universe storyline
    "Age of Apocalypse", in which all X-titles were given new names and issue numbers.
    In the storyline, Professor X was murdered 20 years in the past by his own son,
    Legion. Magneto, witnessing his friend's death, committed himself to Xavier's
    dream and created his own team of X-Men. However, he was unable to prevent the
    rise of the despotic Apocalypse and hence the series primarily dealt with the
    X-Men's battle against him. Astonishing X-Men, written by Scott Lobdell and illustrated
    by Joe Madureira, featured a team of X-Men led by Rogue and consisted of Sunfire,
    Blink, Morph, Sabretooth and Wildchild. source: https://en.wikipedia.org/wiki/Astonishing_X-Men