Bart Large Cnn Samsum
模型概述
該模型用於生成英語對話的簡潔摘要,基於BART-large-cnn架構在Samsung/samsum數據集上微調
模型特點
高質量對話摘要
能夠從對話中提取關鍵信息生成簡潔準確的摘要
特定領域優化
針對日常對話場景特別優化,在Samsung/samsum數據集上表現優異
預訓練模型微調
基於強大的BART-large-cnn預訓練模型進行微調
模型能力
英語對話理解
關鍵信息提取
文本摘要生成
使用案例
對話分析
客服對話摘要
自動生成客服對話的關鍵內容摘要
提高客服效率,便於後續分析
會議記錄摘要
從會議對話中提取決策和行動項
節省會議記錄整理時間
🚀 英文對話摘要模型
本模型用於英文對話的摘要提取,基於BART - large - cnn進行預訓練。它能有效總結英文對話內容,為用戶提供簡潔的對話概要。
🚀 快速開始
安裝與使用
你可以通過以下代碼加載模型和分詞器:
tokenizer = BartTokenizer.from_pretrained('facebook/bart-large-cnn')
model = BartForConditionalGeneration.from_pretrained('jngan/bart-large-cnn-samsum')
實現和微調腳本可在以下鏈接找到:https://github.com/joceyngan/conversation_summarization
✨ 主要特性
- 基於BART - large - cnn預訓練,在英文對話摘要任務上表現良好。
- 提供了詳細的評估結果,展示模型的實際表現。
📚 詳細文檔
評估結果
參考摘要為數據集中的真實摘要,生成摘要為該模型生成的摘要。
示例1
- 原文
- A: Hi Tom, are you busy tomorrow’s afternoon?
- B: I’m pretty sure I am. What’s up?
- A: Can you go with me to the animal shelter?.
- B: What do you want to do?
- A: I want to get a puppy for my son.
- B: That will make him so happy.
- A: Yeah, we’ve discussed it many times. I think he’s ready now.
- B: That’s good. Raising a dog is a tough issue. Like having a baby ;-)
- A: I'll get him one of those little dogs.
- B: One that won't grow up too big;-)
- A: And eat too much;-))
- B: Do you know which one he would like?
- A: Oh, yes, I took him there last Monday. He showed me one that he really liked.
- B: I bet you had to drag him away.
- A: He wanted to take it home right away ;-).
- B: I wonder what he'll name it.
- A: He said he’d name it after his dead hamster – Lemmy - he's a great Motorhead fan :-)))
- 參考摘要:A will go to the animal shelter tomorrow to get a puppy for her son. They already visited the shelter last Monday and the son chose the puppy.
- 生成摘要:A wants to get a puppy for his son. B will go with him to the animal shelter tomorrow. A will get him one of those little dogs. A took him there last Monday and he liked it a lot. A wants to name it Lemmy.
示例2
- 原文
- Emma: I’ve just fallen in love with this advent calendar! Awesome! I wanna one for my kids!
- Rob: I used to get one every year as a child! Loved them!
- Emma: Yeah, i remember! they were filled with chocolates!
- Lauren: they are different these days! much more sophisticated! Haha!
- Rob: yeah, they can be fabric/ wooden, shop bought/ homemade, filled with various stuff
- Emma: what do you fit inside?
- Lauren: small toys, Christmas decorations, creative stuff, hair bands & clips, stickers, pencils & rubbers, small puzzles, sweets
- Emma: WOW! That’s brill! X
- Lauren: i add one more very special thing as well- little notes asking my children to do something nice for someone else
- Rob: i like that! My sister adds notes asking her kids questions about christmas such as What did the 3 wise men bring? etc
- Lauren: i reckon it prepares them for Christmas
- Emma: and makes it more about traditions and being kind to other people
- Lauren: my children get very excited every time they get one!
- Emma: i can see why! :)
- 參考摘要:Emma and Rob love the advent calendar. Lauren fits inside calendar various items, for instance, small toys and Christmas decorations. Her children are excited whenever they get the calendar.
- 生成摘要:Emma loves the advent calendar. Rob used to get one every year as a child. Emma would like to buy one for her kids. Rob's sister asks her kids questions about Christmas. Lauren's children get very excited every time they get one.
示例3
- 原文
- Jackie: Madison is pregnant
- Jackie: but she doesn't wanna talk about it
- Iggy: why
- Jackie: I don't know why because she doesn't wanna talk about it
- Iggy: ok
- Jackie: I wanted to prepare you for it because people get super excited and ask lots of questions
- Jackie: and she looked way more anxious than excited
- Iggy: she's probably worrying about it
- Iggy: she's taking every commitment really seriously
- Jackie: it could be money problems or relationship problems
- Iggy: or maybe she wants an abortion
- Jackie: it could be all of the above
- Iggy: but you know what?
- Iggy: once my friend was pregnant and I couldn't bring myself to be happy about it
- Jackie: why?
- Iggy: I felt they were immature and I couldn't picture this couple as parents
- Jackie: I felt similar way on Patricia's wedding
- Iggy: Patricia Stevens?
- Jackie: yes
- Iggy: so we're talking about the same person
- Jackie: what a coincidence
- Jackie: so she's pregnant?
- Iggy: she thought she was
- Jackie: damn...
- 參考摘要:Madison is pregnant but she doesn't want to talk about it. Patricia Stevens got married and she thought she was pregnant.
- 生成摘要:Madison is pregnant. She doesn't want to talk about it. Iggy's friend Patricia Stevens was pregnant with Patricia Stevens and she didn't like it much. She felt they were immature and she couldn't picture them as parents.
示例4
- 原文
- Marla: <file_photo>
- Marla: look what I found under my bed
- Kiki: lol
- Tamara: is that someone's underwear?
- Marla: it certainly isn't mine, my ass is big but it isn't huge
- Kiki: it looks like male underwear
- Tamara: not necessarily, maybe some butch had fun in your room while you were gone
- Marla: ok but how can you leave your underwear after hooking up? wtf is wrong with people
- Kiki: she or he could be too wasted to notice
- Tamara: or maybe someone put their pants there to piss you off
- Marla: that makes no sense
- Marla: it's so fucking childish
- Kiki: if it's childish then it must have been your sister's idea
- Marla: she's 13, she doesn't have underwear that isn't pink
- Tamara: maybe it belonged to one of your exes?
- Kiki: she would have recognized it
- Marla: lol we're doing total CSI investigation on one pair of boxers :D
- Kiki: <file_gif>
- Tamara: lol
- Tamara: I think your sister convinced someone to put their underwear in your room as a dare
- Marla: sounds legit
- Kiki: Tamara, you just cracked the case!
- Tamara: <file_gif>
- Tamara: always happy to help
- 參考摘要:Marla found a pair of boxers under her bed.
- 生成摘要:Marla found a pair of boxers under her bed. Kiki, Tamara, Marla and Tamara are laughing at the fact that someone left their underwear under Marla's bed after hooking up. Marla is convinced that her sister convinced someone to put their underwear in her room.
示例5
- 原文
- Robert: Hey give me the address of this music shop you mentioned before
- Robert: I have to buy guitar cable
- Fred: <file_other>
- Fred: Catch it on google maps
- Robert: thx m8
- Fred: ur welcome
- 參考摘要:Robert wants Fred to send him the address of the music shop as he needs to buy guitar cable.
- 生成摘要:Fred gives Robert the address of the music shop where he needs to buy guitar cable. Robert can find it on google maps. Robert has to buy a guitar cable at the shop. Fred sends him a link to the address.
微調參數
{
output_dir=str(results_path),
evaluation_strategy="epoch",
save_strategy="epoch",
logging_steps=10,
learning_rate=2e-5,
per_device_train_batch_size=2,
per_device_eval_batch_size=2,
num_train_epochs=3,
weight_decay=0.01,
report_to="tensorboard",
save_total_limit=3,
load_best_model_at_end=True,
metric_for_best_model="eval_loss",
greater_is_better=False,
logging_dir=str(results_path),
}
📄 許可證
本項目採用MIT許可證。
Bart Large Cnn
MIT
基於英語語料預訓練的BART模型,專門針對CNN每日郵報數據集進行微調,適用於文本摘要任務
文本生成 英語
B
facebook
3.8M
1,364
Parrot Paraphraser On T5
Parrot是一個基於T5的釋義框架,專為加速訓練自然語言理解(NLU)模型而設計,通過生成高質量釋義實現數據增強。
文本生成
Transformers

P
prithivida
910.07k
152
Distilbart Cnn 12 6
Apache-2.0
DistilBART是BART模型的蒸餾版本,專門針對文本摘要任務進行了優化,在保持較高性能的同時顯著提升了推理速度。
文本生成 英語
D
sshleifer
783.96k
278
T5 Base Summarization Claim Extractor
基於T5架構的模型,專門用於從摘要文本中提取原子聲明,是摘要事實性評估流程的關鍵組件。
文本生成
Transformers 英語

T
Babelscape
666.36k
9
Unieval Sum
UniEval是一個統一的多維評估器,用於自然語言生成任務的自動評估,支持多個可解釋維度的評估。
文本生成
Transformers

U
MingZhong
318.08k
3
Pegasus Paraphrase
Apache-2.0
基於PEGASUS架構微調的文本複述模型,能夠生成語義相同但表達不同的句子。
文本生成
Transformers 英語

P
tuner007
209.03k
185
T5 Base Korean Summarization
這是一個基於T5架構的韓語文本摘要模型,專為韓語文本摘要任務設計,通過微調paust/pko-t5-base模型在多個韓語數據集上訓練而成。
文本生成
Transformers 韓語

T
eenzeenee
148.32k
25
Pegasus Xsum
PEGASUS是一種基於Transformer的預訓練模型,專門用於抽象文本摘要任務。
文本生成 英語
P
google
144.72k
198
Bart Large Cnn Samsum
MIT
基於BART-large架構的對話摘要模型,專為SAMSum語料庫微調,適用於生成對話摘要。
文本生成
Transformers 英語

B
philschmid
141.28k
258
Kobart Summarization
MIT
基於KoBART架構的韓語文本摘要模型,能夠生成韓語新聞文章的簡潔摘要。
文本生成
Transformers 韓語

K
gogamza
119.18k
12
精選推薦AI模型
Llama 3 Typhoon V1.5x 8b Instruct
專為泰語設計的80億參數指令模型,性能媲美GPT-3.5-turbo,優化了應用場景、檢索增強生成、受限生成和推理任務
大型語言模型
Transformers 支持多種語言

L
scb10x
3,269
16
Cadet Tiny
Openrail
Cadet-Tiny是一個基於SODA數據集訓練的超小型對話模型,專為邊緣設備推理設計,體積僅為Cosmo-3B模型的2%左右。
對話系統
Transformers 英語

C
ToddGoldfarb
2,691
6
Roberta Base Chinese Extractive Qa
基於RoBERTa架構的中文抽取式問答模型,適用於從給定文本中提取答案的任務。
問答系統 中文
R
uer
2,694
98