Zenz V1

🚀 zenz-v1

Zenz-v1 is a language model specialized for kana-kanji conversion tasks based on the GPT-2 architecture. It is intended for use in the neural kana-kanji conversion system "Zenzai".

✨ Features

• 90M parameters
• Character-level + byte-level BPE tokenizer
• High performance using the greedy algorithm in kana-kanji conversion tasks

📚 Documentation

Model Description

This model uses ku-nlp/gpt2-small-japanese-char, which is provided under CC-BY-SA 4.0, as the base model.

This model is provided under CC-BY-SA 4.0.

• Developed by: Keita Miwa (𝕏)
• Model type: GPT-2
• Language(s) (NLP): Japanese
• License: CC-BY-SA 4.0
• Finetuned from model: ku-nlp/gpt2-small-japanese-char

Model Sources

This model is designed to be used together with Zenzai (AzooKeyKanaKanjiConverter).

• Repository: https://github.com/ensan-hcl/AzooKeyKanaKanjiConverter

🔧 Technical Details

The following libraries, tools, and language resources were used to build this model:

• MeCab (https://taku910.github.io/mecab/)
• ipadic-NEologd (https://github.com/neologd/mecab-ipadic-neologd)
• torch (https://pypi.org/project/torch/)
• transformers (https://pypi.org/project/transformers/)
• datasets (https://pypi.org/project/datasets/)
• jaconv (https://pypi.org/project/jaconv/)
• llama.cpp (https://github.com/ggerganov/llama.cpp)

📄 License

This model is licensed under CC-BY-SA 4.0.