Xlmr Formality Classifier

🚀 文本正式程度分類模型

本模型用於文本正式程度分類，基於XLM - Roberta架構，在多語言數據集上訓練，能有效識別不同語言文本的正式或非正式程度，為自然語言處理相關任務提供支持。

🚀 快速開始

本模型是論文 "Detecting Text Formality: A Study of Text Classification Approaches" 中所提出的模型。它是一個基於XLM - Roberta的分類器，在 XFORMAL 多語言正式程度分類數據集上進行訓練。

✨ 主要特性

• 多語言支持：支持英語（en）、法語（fr）、意大利語（it）和葡萄牙語（pt）等多種語言。
• 正式程度分類：能夠對文本進行正式或非正式的分類。

📦 安裝指南

使用本模型前，需要安裝transformers庫，可使用以下命令進行安裝：

pip install transformers

💻 使用示例

基礎用法

from transformers import XLMRobertaTokenizerFast, XLMRobertaForSequenceClassification

# 加載分詞器和模型權重
tokenizer = XLMRobertaTokenizerFast.from_pretrained('s-nlp/xlmr_formality_classifier')
model = XLMRobertaForSequenceClassification.from_pretrained('s-nlp/xlmr_formality_classifier')

id2formality = {0: "formal", 1: "informal"}
texts = [
    "I like you. I love you",
    "Hey, what's up?",
    "Siema, co porabiasz?",
    "I feel deep regret and sadness about the situation in international politics.",
]

# 準備輸入
encoding = tokenizer(
    texts,
    add_special_tokens=True,
    return_token_type_ids=True,
    truncation=True,
    padding="max_length",
    return_tensors="pt",
)

# 推理
output = model(**encoding)

formality_scores = [
    {id2formality[idx]: score for idx, score in enumerate(text_scores.tolist())}
    for text_scores in output.logits.softmax(dim=1)
]
print(formality_scores)

運行上述代碼後，輸出結果如下：

[{'formal': 0.993225634098053, 'informal': 0.006774314679205418},
 {'formal': 0.8807966113090515, 'informal': 0.1192033663392067},
 {'formal': 0.936184287071228, 'informal': 0.06381577253341675},
 {'formal': 0.9986615180969238, 'informal': 0.0013385231141000986}]

📚 詳細文檔

模型評估結果

所有語言

英語（EN）

法語（FR）

意大利語（IT）

葡萄牙語（PT）

📄 許可證

本模型採用OpenRAIL++許可證，該許可證支持開發服務於公共利益的各類技術，包括工業和學術領域的技術。

📖 引用信息

如果您使用了本模型，請引用以下論文：

@inproceedings{dementieva-etal-2023-detecting,
    title = "Detecting Text Formality: A Study of Text Classification Approaches",
    author = "Dementieva, Daryna  and
      Babakov, Nikolay  and
      Panchenko, Alexander",
    editor = "Mitkov, Ruslan  and
      Angelova, Galia",
    booktitle = "Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing",
    month = sep,
    year = "2023",
    address = "Varna, Bulgaria",
    publisher = "INCOMA Ltd., Shoumen, Bulgaria",
    url = "https://aclanthology.org/2023.ranlp-1.31",
    pages = "274--284",
    abstract = "Formality is one of the important characteristics of text documents. The automatic detection of the formality level of a text is potentially beneficial for various natural language processing tasks. Before, two large-scale datasets were introduced for multiple languages featuring formality annotation{---}GYAFC and X-FORMAL. However, they were primarily used for the training of style transfer models. At the same time, the detection of text formality on its own may also be a useful application. This work proposes the first to our knowledge systematic study of formality detection methods based on statistical, neural-based, and Transformer-based machine learning methods and delivers the best-performing models for public usage. We conducted three types of experiments {--} monolingual, multilingual, and cross-lingual. The study shows the overcome of Char BiLSTM model over Transformer-based ones for the monolingual and multilingual formality classification task, while Transformer-based classifiers are more stable to cross-lingual knowledge transfer.",
}