Flan T5 Base Samsum

🚀 flan-t5-base-samsum

該模型是 google/flan-t5-base 在 samsum 數據集上的微調版本。它在評估集上取得了以下成果：

• 損失值（Loss）：1.3709
• ROUGE-1：46.8876
• ROUGE-2：23.2689
• ROUGE-L：39.5369
• ROUGE-LSUM：43.1602
• 生成長度（Gen Len）：17.2027

🚀 快速開始

此模型基於 google/flan-t5-base 在 samsum 數據集上微調而來，可用於特定的文本生成和摘要任務。

📚 詳細文檔

模型描述

更多信息待補充。

預期用途與限制

更多信息待補充。

訓練和評估數據

更多信息待補充。

訓練過程

訓練超參數

訓練過程中使用了以下超參數：

• 學習率（learning_rate）：5e-05
• 訓練批次大小（train_batch_size）：8
• 評估批次大小（eval_batch_size）：8
• 隨機種子（seed）：42
• 優化器（optimizer）：Adam，β1=0.9，β2=0.999，ε=1e-08
• 學習率調度器類型（lr_scheduler_type）：線性
• 訓練輪數（num_epochs）：5

訓練結果

框架版本

• Transformers 4.26.1
• Pytorch 1.13.1+cu116
• Datasets 2.9.0
• Tokenizers 0.13.2

📄 許可證

該模型使用 Apache-2.0 許可證。

🔍 標籤

• 由訓練器生成（generated_from_trainer）
• 摘要（summarization）

📊 數據集

• samsum

📈 評估指標

• ROUGE

🧪 示例

對話示例 1

Olivia: Hey Carter, are you still developing that restaurant business? Carter:
    Hi Olivia Carter: Yes, we want to launch next month :) Olivia: Next month? That's
    soon! Congrats :) Carter: thanks, I'm a bit nervous but I seriously believe we're
    delivering something innovative and needed Olivia: I think it's a great concept
    and I am sure you'll do great! Olivia: I am currently involved with a new restaurant
    in the city centre Carter: Which one? Olivia: Spicy and chilled Carter: I heard
    about it :) Is it any good? ;) Olivia: I love the restaurant and really like working
    there Carter: good for you! Olivia: and here's the question - are you still looking
    for restaurant to include in your discount app? Carter: sure, but I think it would
    be better to discuss it in person - would you like to meet up? Olivia: That would
    be great!

對話示例 2

Chad: Elton John is goat Eva: what do you mean by goat? Frank: greatest of
    all time Chad: indeed Eva: ahh... it makes sense now :P

維基百科文章示例

Astonishing X-Men is the name of four X-Men comic book series from Marvel
    Comics, the first two of which were limited series. The third volume, an ongoing
    series, began in 2004, with its first run written by Joss Whedon and art by John
    Cassaday. It was then written by Warren Ellis with art by Simone Bianchi and Phil
    Jimenez.[1] Daniel Way and Christos Gage then took over the title writing alternating
    stories. They were followed by James Asmus who wrote one issue, then Greg Pak,
    who took over for four issues in November 2011.[2] Marjorie Liu wrote the final
    21 issues of the series until its end at issue #68 in 2013. The title's fourth
    volume and second ongoing series launched in 2017 during the "ResurrXion" storyline.[3]
    The first run was written by Charles Soule and illustrated by a rotating cast
    of artists. Matthew Rosenberg and artist Greg Land would then take over the series
    before its end in 2018. The original Astonishing X-Men was a four-issue limited
    series that replaced Uncanny X-Men during the 1995 alternate universe storyline
    "Age of Apocalypse", in which all X-titles were given new names and issue numbers.
    In the storyline, Professor X was murdered 20 years in the past by his own son,
    Legion. Magneto, witnessing his friend's death, committed himself to Xavier's
    dream and created his own team of X-Men. However, he was unable to prevent the
    rise of the despotic Apocalypse and hence the series primarily dealt with the
    X-Men's battle against him. Astonishing X-Men, written by Scott Lobdell and illustrated
    by Joe Madureira, featured a team of X-Men led by Rogue and consisted of Sunfire,
    Blink, Morph, Sabretooth and Wildchild. source: https://en.wikipedia.org/wiki/Astonishing_X-Men