Longformer Base Plagiarism Detection

🚀 Longformer-base for Machine-Paraphrase Detection

このモデルは、機械的な改述による剽窃検出を行うためのモデルです。研究においてこのモデルを使用する場合は、適切に引用してください。

🚀 クイックスタート

このモデルを使用するには、以下のようにコードを記述します。

from transformers import AutoModelForSequenceClassification, AutoTokenizer

AutoModelForSequenceClassification("jpelhaw/longformer-base-plagiarism-detection")
AutoTokenizer.from_pretrained("jpelhaw/longformer-base-plagiarism-detection")

input = "Plagiarism is the representation of another author's writing, \
thoughts, ideas, or expressions as one's own work."


example = tokenizer.tokenize(input, add_special_tokens=True)

answer = model(**example)
                                
# "plagiarised"

📚 ドキュメント

引用情報

もしあなたがこのモデルを研究で使用する場合は、以下の文献を引用してください。

@InProceedings{10.1007/978-3-030-96957-8_34,
    author="Wahle, Jan Philip and Ruas, Terry and Folt{\'y}nek, Tom{\'a}{\v{s}} and Meuschke, Norman and Gipp, Bela",
    title="Identifying Machine-Paraphrased Plagiarism",
    booktitle="Information for a Better World: Shaping the Global Future",
    year="2022",
    publisher="Springer International Publishing",
    address="Cham",
    pages="393--413",
    abstract="Employing paraphrasing tools to conceal plagiarized text is a severe threat to academic integrity. To enable the detection of machine-paraphrased text, we     evaluate the effectiveness of five pre-trained word embedding models combined with machine learning classifiers and state-of-the-art neural language models. We analyze preprints of research papers, graduation theses, and Wikipedia articles, which we paraphrased using different configurations of the tools SpinBot and SpinnerChief. The best performing technique, Longformer, achieved an average F1 score of 80.99{\%} (F1=99.68{\%} for SpinBot and F1=71.64{\%} for SpinnerChief cases), while human evaluators achieved F1=78.4{\%} for SpinBot and F1=65.6{\%} for SpinnerChief cases. We show that the automated classification alleviates shortcomings of widely-used text-matching systems, such as Turnitin and PlagScan.",
    isbn="978-3-030-96957-8"
}

追加情報

このモデルに関する追加情報は以下の通りです。

• The longformer-base-4096 model page
• Longformer: The Long-Document Transformer
• Official implementation by AllenAI

データセット

このモデルは、Machine-Paraphrased Plagiarism Dataset で学習されたチェックポイントです。

タグ

• array
• of
• tags

ウィジェット

• text: Plagiarism is the representation of another author's writing, thoughts, ideas, or expressions as one's own work.

サムネイル

• url to a thumbnail used in social sharing