Chinese-Legal-Electra-Base-Generator: An Open-Source Chinese Pretrained Model with Compact Structure and Excellent Performance

Chinese Legal Electra Base Generator

Developed by hfl

Chinese ELECTRA is a Chinese pre-trained model based on Google's ELECTRA, released by the HIT & iFLYTEK Joint Lab (HFL), featuring a compact structure and superior performance.

Large Language Model

Transformers

ChineseOpen Source License:Apache-2.0 #Legal Domain Specialized #Compact and Efficient #Chinese Pre-trained

Downloads 18

Release Time : 3/2/2022

Model Overview

Chinese ELECTRA is a pre-trained model specifically designed for Chinese natural language processing. Compared to models like BERT, it has fewer parameters but similar or even better performance, making it suitable for various NLP tasks.

Model Features

Efficient and Compact

ELECTRA-small requires only 1/10 the parameters of BERT and its variants while achieving similar or even higher performance metrics.

Superior Performance

Excels in multiple NLP tasks, with performance comparable to large models like BERT.

Chinese Optimization

Specifically optimized for Chinese language characteristics, making it ideal for Chinese NLP tasks.

Model Capabilities

Text Classification

Named Entity Recognition

Question Answering System

Text Generation

Semantic Understanding

Use Cases

Legal Domain

Legal Document Analysis

Used to analyze legal documents and extract key information.

Efficiently and accurately extracts key information from legal documents.

Contract Review

Automatically reviews contract texts to identify potential issues.

Quickly identifies potential risk points in contracts.

General NLP Tasks

Text Classification

Classifies Chinese texts.

High-accuracy text classification performance.

Question Answering System

Builds Chinese question-answering systems.

Provides accurate question-answering responses.

🚀 Chinese ELECTRA for Legal Domain

This model is specifically designed for the legal domain, leveraging the power of Chinese ELECTRA to provide efficient and effective natural language processing capabilities.

🚀 Quick Start

This project is based on the official code of ELECTRA: https://github.com/google-research/electra.

✨ Features

Google and Stanford University released a new pre - trained model called ELECTRA, which has a much compact model size and relatively competitive performance compared to BERT and its variants.
For further accelerating the research of the Chinese pre - trained model, the Joint Laboratory of HIT and iFLYTEK Research (HFL) has released the Chinese ELECTRA models based on the official code of ELECTRA.
ELECTRA - small could reach similar or even higher scores on several NLP tasks with only 1/10 parameters compared to BERT and its variants.

📚 Documentation

📄 License

This project is licensed under the Apache - 2.0 license.

📚 Citation

If you find our resource or paper is useful, please consider including the following citation in your paper.

https://arxiv.org/abs/2004.13922

@inproceedings{cui-etal-2020-revisiting,
    title = "Revisiting Pre-Trained Models for {C}hinese Natural Language Processing",
    author = "Cui, Yiming  and
      Che, Wanxiang  and
      Liu, Ting  and
      Qin, Bing  and
      Wang, Shijin  and
      Hu, Guoping",
    booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings",
    month = nov,
    year = "2020",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://www.aclweb.org/anthology/2020.findings-emnlp.58",
    pages = "657--668",
}

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご