Roberta Small Japanese Luw Upos

🚀 roberta-small-japanese-luw-upos

A RoBERTa model pre - trained on 青空文庫 texts for POS - tagging and dependency - parsing, tagging each long - unit - word with UPOS.

🚀 Quick Start

This model is designed for POS - tagging and dependency - parsing of Japanese texts. It is derived from [roberta - small - japanese - aozora](https://huggingface.co/KoichiYasuoka/roberta - small - japanese - aozora) and tags every long - unit - word using UPOS (Universal Part - Of - Speech).

✨ Features

• Pre - trained on 青空文庫 texts.
• Capable of POS - tagging and dependency - parsing.
• Tags long - unit - words with UPOS.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

from transformers import AutoTokenizer,AutoModelForTokenClassification,TokenClassificationPipeline
tokenizer=AutoTokenizer.from_pretrained("KoichiYasuoka/roberta-small-japanese-luw-upos")
model=AutoModelForTokenClassification.from_pretrained("KoichiYasuoka/roberta-small-japanese-luw-upos")
pipeline=TokenClassificationPipeline(tokenizer=tokenizer,model=model,aggregation_strategy="simple")
nlp=lambda x:[(x[t["start"]:t["end"]],t["entity_group"]) for t in pipeline(x)]
print(nlp("国境の長いトンネルを抜けると雪国であった。"))

Advanced Usage

import esupar
nlp=esupar.load("KoichiYasuoka/roberta-small-japanese-luw-upos")
print(nlp("国境の長いトンネルを抜けると雪国であった。"))

📚 Documentation

esupar is a Tokenizer POS - tagger and Dependency - parser with BERT/RoBERTa/DeBERTa models.

📄 License

This model is released under the "cc - by - sa - 4.0" license.

Information Table