BERT Large Japanese Char Extended Open-Source Model - Enhanced Embedding Function Supports More Japanese Kanji Processing

Bert Large Japanese Char Extended

Developed by KoichiYasuoka

This is a BERT model pre-trained on Japanese Wikipedia text, derived from bert-large-japanese-char, with enhanced character embedding capabilities to support more Kanji characters.

Large Language Model

Transformers

Japanese#Japanese character-level BERT #Wikipedia pre-training #Kanji-enhanced embeddings

Downloads 18

Release Time : 3/2/2022

Model Overview

This model is a Japanese BERT model that enhances Kanji processing capabilities through extended character embeddings, suitable for various Japanese natural language processing tasks.

Model Features

Extended character embeddings

Enhanced character embedding functionality supports all commonly used Kanji/Jinmeiyo Kanji characters

Wikipedia-based pre-training

Pre-trained using Japanese Wikipedia text, possessing rich linguistic knowledge

Suitable for downstream tasks

Can be fine-tuned for tasks such as part-of-speech tagging and dependency parsing

Model Capabilities

Japanese text understanding

Masked language modeling

Character-level processing

Use Cases

Natural Language Processing

Part-of-speech tagging

Can be used for part-of-speech tagging tasks in Japanese text

Dependency parsing

Can be used to analyze the grammatical structure of Japanese sentences

Text filling

Predicts words replaced by the [MASK] token

Property	Details
Language	Japanese
Tags	japanese, masked - lm, wikipedia
Base Model	tohoku-nlp/bert-large-japanese-char
Pipeline Tag	fill - mask
Mask Token	[MASK]
Widget Example	text: "酸素ボンベを充[MASK]する。"

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Bert Large Japanese Char Extended

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 bert-large-japanese-char-extended

🚀 Quick Start

💻 Usage Examples

Basic Usage

📄 License

📋 Model Information