DistilBERT Base Uncased Fine-tuned NER Open-source Model - A Free and Lightweight Named Entity Recognition Tool

Home

Distilbert Base Uncased Finetuned Ner

Developed by hossay

A lightweight named entity recognition model based on DistilBERT, fine-tuned on the conll2003 dataset

Sequence Labeling

Transformers

Open Source License:Apache-2.0 #Named Entity Recognition #High-precision NER #Lightweight BERT

Downloads 16

Release Time : 6/10/2022

Model Overview

This model is a lightweight version based on DistilBERT, specifically designed for named entity recognition tasks. After fine-tuning on the conll2003 dataset, it can efficiently identify named entities in text.

Model Features

Efficient and Lightweight

Based on the DistilBERT architecture, it is more lightweight than standard BERT models while maintaining high performance.

High Accuracy

Achieves an F1 score of 93.2% on the conll2003 test set, demonstrating excellent performance.

Fast Training

Only requires 3 training epochs to achieve good results, with high training efficiency.

Model Capabilities

Named Entity Recognition

Text Token Classification

Use Cases

Information Extraction

News Entity Extraction

Extract entities such as person names, locations, and organization names from news text.

Accurately identifies 93.2% of entities.

Document Analysis

Process legal or medical documents to identify key entity information.

Data Preprocessing

NLP Preprocessing

Provide entity recognition preprocessing for downstream NLP tasks.

Property	Details
Model Type	distilbert-base-uncased-finetuned-ner
Training Data	conll2003
Metrics	Precision, Recall, F1, Accuracy

Task Type	Dataset	Precision	Recall	F1	Accuracy
Token Classification	conll2003	0.9263064854712186	0.9379125181787672	0.9320733740967203	0.9838117781625813

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
0.2418	1.0	878	0.0709	0.9168	0.9242	0.9204	0.9806
0.0514	2.0	1756	0.0622	0.9175	0.9338	0.9255	0.9826
0.0306	3.0	2634	0.0614	0.9263	0.9379	0.9321	0.9838

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Distilbert Base Uncased Finetuned Ner

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 distilbert-base-uncased-finetuned-ner

📚 Documentation

Model Information Table

Model Performance Results

🔧 Technical Details

Training Hyperparameters

Training Results

Framework Versions

📄 License