Open-source Clinical Text Processing Model: clinical_bert_ft - Outstanding Performance in Fine-tuning Optimization of F1 Score

Home

Clinical Bert Ft

Developed by ericntay

A clinical text processing model fine-tuned based on Bio_ClinicalBERT, performing well in F1 score

Text Classification

Transformers

Open Source License:MIT #Clinical Text Analysis #High Precision F1 #Medical NLP

Downloads 20

Release Time : 7/11/2022

Model Overview

This model is a fine-tuned version of Bio_ClinicalBERT on clinical text data, primarily used for clinical text classification tasks

Model Features

Clinical Text Optimization

Fine-tuned based on Bio_ClinicalBERT, specifically optimized for clinical text processing

High-Performance F1 Score

Achieves an F1 score of 0.8252 on the evaluation set

Efficient Fine-tuning

Only requires 10 training epochs to achieve good performance

Model Capabilities

Clinical Text Classification

Medical Text Analysis

Natural Language Processing

Use Cases

Healthcare

Clinical Record Classification

Classify and label clinical medical records

F1 score reaches 0.8252

Medical Text Analysis

Analyze medical reports and clinical notes

Training Loss	Epoch	Step	Validation Loss	F1
0.5938	1.0	95	0.2480	0.7084
0.1567	2.0	190	0.2035	0.7855
0.083	3.0	285	0.2002	0.8026
0.0482	4.0	380	0.2046	0.8118
0.0269	5.0	475	0.2230	0.8143
0.0185	6.0	570	0.2178	0.8175
0.0123	7.0	665	0.2269	0.8253
0.0093	8.0	760	0.2421	0.8227
0.0072	9.0	855	0.2446	0.8267
0.006	10.0	950	0.2439	0.8252

Property	Details
Model Type	clinical_bert_ft
Metrics	F1
License	MIT

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Clinical Bert Ft

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 clinical_bert_ft

🚀 Quick Start

📚 Documentation

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

📄 License