Fava Model

🚀 FAVA - 驗證模型

FAVA 是一個驗證模型，可用於識別文本中的錯誤並根據提供的參考信息建議編輯內容。

🚀 快速開始

以下是使用 FAVA 模型的基本步驟和示例代碼：

import torch
import vllm
from transformers import AutoTokenizer, AutoModelForSequenceClassification

model = vllm.LLM(model="fava-uw/fava-model")
sampling_params = vllm.SamplingParams(
  temperature=0,
  top_p=1.0,
  max_tokens=1024,
)

INPUT = "Read the following references:\n{evidence}\nPlease identify all the errors in the following text using the information in the references provided and suggest edits if necessary:\n[Text] {output}\n[Edited] "

output = "" # add your passage to verify
evidence = "" # add a piece of evidence
prompts = [INPUT.format_map({"evidence": evidence, "output": output})]
outputs = model.generate(prompts, sampling_params)
outputs = [it.outputs[0].text for it in outputs]
print(outputs[0])

📄 許可證

本項目採用 MIT 許可證。