DistilBERT-CORD-NER Open-Source Named Entity Recognition Model - Fine-Tuning Optimizes and Performs Excellent on Evaluation Sets

Distilbert Cord Ner

Developed by renjithks

Named entity recognition model fine-tuned based on Geotrend/distilbert-base-en-fr-de-no-da-cased, demonstrating outstanding performance on evaluation datasets

Sequence Labeling

Transformers

Open Source License:Apache-2.0 #Multilingual NER #High-precision entity recognition #Lightweight BERT

Downloads 15

Release Time : 5/21/2022

Model Overview

This model is a DistilBERT variant for named entity recognition tasks, fine-tuned on a multilingual foundation, suitable for entity recognition tasks in text

Model Features

Multilingual Support

Fine-tuned on a multilingual base model, supporting English, French, German, Norwegian, and Danish

Efficient Performance

As a DistilBERT variant, it reduces model complexity while maintaining high accuracy

Excellent Evaluation Metrics

Achieves an F1 score of 0.9185 and accuracy of 0.9656 on evaluation datasets

Model Capabilities

Text entity recognition

Multilingual text processing

Sequence labeling

Use Cases

Information Extraction

Document Analysis

Extracting key entity information from business documents

High-accuracy entity recognition

Content Classification

Identifying and classifying named entities in text

Supports recognition of multiple entity types

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
No log	1.0	113	0.1814	0.8480	0.8618	0.8548	0.9393
No log	2.0	226	0.1755	0.8669	0.9002	0.8832	0.9427
No log	3.0	339	0.1499	0.8800	0.8935	0.8867	0.9533
No log	4.0	452	0.1340	0.8975	0.9079	0.9027	0.9596
0.1812	5.0	565	0.1553	0.8999	0.9146	0.9072	0.9592
0.1812	6.0	678	0.1474	0.8961	0.9021	0.8991	0.9562
0.1812	7.0	791	0.1682	0.9135	0.9223	0.9179	0.9622
0.1812	8.0	904	0.1663	0.8960	0.9175	0.9066	0.9613
0.0199	9.0	1017	0.1753	0.9061	0.9261	0.9160	0.9635
0.0199	10.0	1130	0.1670	0.9128	0.9242	0.9185	0.9656

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Distilbert Cord Ner

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 distilbert-cord-ner

🚀 Quick Start

📚 Documentation

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

📄 License