T5 Finetuned Test

🚀 维基指南T5小模型

这是一个基于T5小模型架构，在维基指南（Wikihow）全数据集上训练的模型。它可以有效对文本进行摘要处理，帮助用户快速获取关键信息。

✨ 主要特性

• 标签信息：该模型与多个标签相关，包括wikihow、t5 - small、pytorch、lm - head、seq2seq、t5、pipeline:summarization、summarization等，表明其在文本摘要领域的专业性和适用性。
• 数据集：使用Wikihow数据集进行训练，该数据集涵盖丰富的知识和多样的文本类型，使得模型具有广泛的适用性。
• 评估指标：模型在Rouge1指标上得分为31.2，RougeL指标上得分为24.5，显示出较好的摘要生成效果。

📦 安装指南

暂未提供相关安装步骤，若有需要可根据模型使用的框架（如transformers库）进行常规安装。

💻 使用示例

基础用法

from transformers import AutoTokenizer, AutoModelWithLMHead

tokenizer = AutoTokenizer.from_pretrained("deep-learning-analytics/wikihow-t5-small")
model = AutoModelWithLMHead.from_pretrained("deep-learning-analytics/wikihow-t5-small")

device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
model = model.to(device)

text = """
Lack of fluids can lead to dry mouth, which is a leading cause of bad breath. Water
can also dilute any chemicals in your mouth or gut that are causing bad breath., Studies show that
eating 6 ounces of yogurt a day reduces the level of odor-causing compounds in the mouth. In
particular, look for yogurt containing the active bacteria Streptococcus thermophilus or
Lactobacillus bulgaricus., The abrasive nature of fibrous fruits and vegetables helps to clean
teeth, while the vitamins, antioxidants, and acids they contain improve dental health.Foods that can
be particularly helpful include:Apples — Apples contain vitamin C, which is necessary for health
gums, as well as malic acid, which helps to whiten teeth.Carrots — Carrots are rich in vitamin A,
which strengthens tooth enamel.Celery — Chewing celery produces a lot of saliva, which helps to
neutralize bacteria that cause bad breath.Pineapples — Pineapples contain bromelain, an enzyme that
cleans the mouth., These teas have been shown to kill the bacteria that cause bad breath and
plaque., An upset stomach can lead to burping, which contributes to bad breath. Don’t eat foods that
upset your stomach, or if you do, use antacids. If you are lactose intolerant, try lactase tablets.,
They can all cause bad breath. If you do eat them, bring sugar-free gum or a toothbrush and
toothpaste to freshen your mouth afterwards., Diets low in carbohydrates lead to ketosis — a state
in which the body burns primarily fat instead of carbohydrates for energy. This may be good for your
waistline, but it also produces chemicals called ketones, which contribute to bad breath.To stop the
problem, you must change your diet. Or, you can combat the smell in one of these ways:Drink lots of
water to dilute the ketones.Chew sugarless gum or suck on sugarless mints.Chew mint leaves.
"""

preprocess_text = text.strip().replace("\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\", "")
tokenized_text = tokenizer.encode(preprocess_text, return_tensors="pt").to(device)

summary_ids = model.generate(
    tokenized_text,
    max_length=150, 
    num_beams=2,
    repetition_penalty=2.5, 
    length_penalty=1.0, 
    early_stopping=True
)

output = tokenizer.decode(summary_ids[0], skip_special_tokens=True)

print("Summarized text: ", output)

高级用法

# 这里可根据具体需求调整生成摘要的参数，如改变max_length、num_beams等，以满足不同的摘要长度和质量要求。
# 例如，增加max_length可以得到更长的摘要，调整num_beams可以优化搜索策略。
# 以下是一个调整参数的示例：

from transformers import AutoTokenizer, AutoModelWithLMHead

tokenizer = AutoTokenizer.from_pretrained("deep-learning-analytics/wikihow-t5-small")
model = AutoModelWithLMHead.from_pretrained("deep-learning-analytics/wikihow-t5-small")

device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
model = model.to(device)

text = """
Bring 1/2 cup water to the boil.Add the fresh or dried rosemary to the water.Remove
from the heat. Set aside for 1/2 an hour to infuse. Added flavour can be released by pressing down
on the rosemary leaves with a spoon. Add the pieces to the blender or food processor with the
elderflower cordial. Blend or process to a purée.,, Add the lemon or lime juice and stir to
combine., Add a cover and place in the freezer.After 2 hours, remove from the freezer and break up
with a fork. This helps the ice crystals to form properly.Continue doing this every hour until the
granita freezes properly. Scoop the granita into dessert bowls and serve. Garnish with a cucumber
curl or a small sprig of rosemary.
"""

preprocess_text = text.strip().replace("\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\", "")
tokenized_text = tokenizer.encode(preprocess_text, return_tensors="pt").to(device)

# 调整参数
summary_ids = model.generate(
    tokenized_text,
    max_length=200,  # 增加最大长度
    num_beams=4,     # 增加束搜索的束数
    repetition_penalty=3.0, 
    length_penalty=1.2, 
    early_stopping=True
)

output = tokenizer.decode(summary_ids[0], skip_special_tokens=True)

print("Summarized text: ", output)

📚 详细文档

该模型是在Wikihow全数据集上进行训练的T5小模型。训练过程持续了3个轮次，使用的批量大小为16，学习率为3e - 4。最大输入长度设置为512，最大输出长度为150。你可以参考此博客文章了解详细的训练过程。

🔧 技术细节

该模型基于T5小模型架构，在Wikihow数据集上进行微调。训练过程中，使用了特定的批量大小和学习率，以优化模型的性能。通过设置最大输入和输出长度，确保模型能够处理合适长度的文本并生成合理的摘要。在评估方面，采用了Rouge1和RougeL指标来衡量模型的摘要质量，最终模型在Rouge1指标上达到31.2分，RougeL指标上达到24.5分。

📄 许可证

暂未提供相关许可证信息。