Pegasus X Sumstew

🚀 Pegasus-x-sumstew

Pegasus-x-sumstew是基於Pegasus-x-large模型微調得到的，可對長文本進行抽象概括，生成簡潔且準確的摘要。

🚀 快速開始

你可以使用transformers庫中的pipeline函數來使用此模型：

from transformers import pipeline

summarizer = pipeline("summarization", "joemgu/pegasus-x-sumstew")
text = "Alice was beginning to get very tired of sitting by her sister on the bank, and of having nothing to do: once or twice she had peeped into the book her sister was reading, but it had no pictures or conversations in it, 'and what is the use of a book,' thought Alice 'without pictures or conversations?' So she was considering in her own mind (as well as she could, for the hot day made her feel very sleepy and stupid), whether the pleasure of making a daisy-chain would be worth the trouble of getting up and picking the daisies, when suddenly a White Rabbit with pink eyes ran close by her. There was nothing so very remarkable in that; nor did Alice think it so very much out of the way to hear the Rabbit say to itself, 'Oh dear! Oh dear! I shall be late!' (when she thought it over afterwards, it occurred to her that she ought to have wondered at this, but at the time it all seemed quite natural); but when the Rabbit actually took a watch out of its waistcoat-pocket, and looked at it, and then hurried on, Alice started to her feet, for it flashed across her mind that she had never before seen a rabbit with either a waistcoat-pocket, or a watch to take out of it, and burning with curiosity, she ran across the field after it, and fortunately was just in time to see it pop down a large rabbit-hole under the hedge. In another moment down went Alice after it, never once considering how in the world she was to get out again."
summary = summarizer(text,
                     num_beams=8,
                     repetition_penalty=3.5,
                     no_repeat_ngram_size=4,
                     encoder_no_repeat_ngram_size=4
    )[0]["summary_text"]
print(summary)

輸出：

Alice is a bored and curious girl who follows a White Rabbit with a watch into a rabbit-hole. She enters a strange world where she has many adventures and meets many peculiar creatures.

✨ 主要特性

• 可對英文長文本進行抽象概括，生成摘要。
• 適用於學術記錄、會議紀要、文學作品等長文本的摘要生成。

📦 安裝指南

文檔未提及安裝步驟，故跳過此章節。

💻 使用示例

基礎用法

from transformers import pipeline

summarizer = pipeline("summarization", "joemgu/pegasus-x-sumstew")
text = "Alice was beginning to get very tired of sitting by her sister on the bank, and of having nothing to do: once or twice she had peeped into the book her sister was reading, but it had no pictures or conversations in it, 'and what is the use of a book,' thought Alice 'without pictures or conversations?' So she was considering in her own mind (as well as she could, for the hot day made her feel very sleepy and stupid), whether the pleasure of making a daisy-chain would be worth the trouble of getting up and picking the daisies, when suddenly a White Rabbit with pink eyes ran close by her. There was nothing so very remarkable in that; nor did Alice think it so very much out of the way to hear the Rabbit say to itself, 'Oh dear! Oh dear! I shall be late!' (when she thought it over afterwards, it occurred to her that she ought to have wondered at this, but at the time it all seemed quite natural); but when the Rabbit actually took a watch out of its waistcoat-pocket, and looked at it, and then hurried on, Alice started to her feet, for it flashed across her mind that she had never before seen a rabbit with either a waistcoat-pocket, or a watch to take out of it, and burning with curiosity, she ran across the field after it, and fortunately was just in time to see it pop down a large rabbit-hole under the hedge. In another moment down went Alice after it, never once considering how in the world she was to get out again."
summary = summarizer(text,
                     num_beams=8,
                     repetition_penalty=3.5,
                     no_repeat_ngram_size=4,
                     encoder_no_repeat_ngram_size=4
    )[0]["summary_text"]
print(summary)

高級用法

文檔未提及高級用法代碼示例，故跳過此部分。

📚 詳細文檔

模型描述

此模型是Pegasus-x-large模型在CNN-Dailymail、Samsum、Booksum和Laysum數據集的過濾子集上進行微調得到的版本。它可以生成長文本的抽象摘要。

預期用途與限制

該模型可用於對英文長文本進行摘要生成，例如學術記錄、會議紀要或文學作品。但它不適用於對短文本（如推文、標題或說明文字）進行摘要。如果輸入文本包含事實錯誤、俚語或冒犯性語言，模型可能會生成不準確或有偏差的摘要。

訓練數據

該模型在CNN-Dailymail、Samsum、Booksum和Laysum數據集的過濾子集上進行了微調。這些數據集包含各種類型的文本及其抽象摘要。篩選出的子集僅包含長度超過1000個單詞且摘要長度少於100個單詞的文本。該子集的總大小約為15萬個示例。

侷限性和偏差

該模型可能繼承了預訓練的Pegasus-x-large模型和微調數據集的一些侷限性和偏差。一些可能的偏差來源包括：

• 預訓練的Pegasus-x-large模型是在來自各種來源的大量英文文本語料庫上進行訓練的，這可能無法反映不同語言和文化的多樣性和細微差別。
• 微調數據集是從不同的領域和體裁收集的，它們可能有自己的文體慣例以及對某些主題和事件的觀點。
• 微調數據集僅包含抽象摘要，這可能無法捕捉原始文本的所有重要信息和細微差別。
• 微調數據集僅涵蓋了特定時間段和來源的文本，這可能無法反映當前的情況和趨勢。

因此，用戶在使用此模型時應意識到這些侷限性和偏差，並評估其性能和對特定用例的適用性。

🔧 技術細節

文檔未提供具體技術細節（說明內容少於50字），故跳過此章節。

📄 許可證

該模型使用Apache-2.0許可證。