Reformer Crime And Punishment

🚀 基於《罪與罰》訓練的Reformer模型

本項目基於費奧多爾·陀思妥耶夫斯基所著的小說《罪與罰》（已被翻譯成英文）訓練了Reformer模型。該模型在自然語言處理領域具有一定的應用價值，能夠基於訓練數據生成相關文本內容。

🚀 快速開始

模型信息

模型訓練與轉換

ReformerLM 模型使用 flax 框架，藉助作者提供的 Colab 筆記本進行訓練：點擊查看。訓練完成後，模型權重被轉換為 Hugging Face 的 PyTorch ReformerLM 模型 ReformerModelWithLMHead。

文本生成示例

本模型是一個基於小的子詞單元的語言模型，可按以下方式生成文本：

model = ReformerModelWithLMHead.from_pretrained("google/reformer-crime-and-punishment")
tok = ReformerTokenizer.from_pretrained("google/reformer-crime-and-punishment")
tok.decode(model.generate(tok.encode("A few months later", return_tensors="pt"), do_sample=True,temperature=0.7, max_length=100)[0])

# 輸出示例: 'A few months later on was more than anything in the flat. 
# “I have already.” “That’s not my notion that he had forgotten him. 
# What does that matter? And why do you mean? It’s only another fellow,” he said as he went out, as though he want'