Bio_BERT_FT Open-Source Biomedical Fine-Tuned Model - Free Deployment to Aid Precise Analysis of Specific Tasks

Bio Bert Ft

Developed by ericntay

A fine-tuned model based on BioBERT for the biomedical domain, achieving an F1 score of 0.8621 on specific tasks

Downloads 15

Release Time : 6/22/2022

Model Overview

This model is a fine-tuned version based on BioBERT-v1.1, suitable for biomedical text processing tasks

Biomedical Domain Optimization

Fine-tuned based on BioBERT, particularly suitable for processing biomedical texts

High-Performance F1 Score

Achieved an F1 score of 0.8621 on the evaluation set

Stable Training Process

Training loss steadily decreased from 0.0879 to 0.0002, with validation F1 score progressively improving

Biomedical Text Processing

Text Classification

Natural Language Understanding

Biomedical Research

Medical Literature Classification

Automated classification of medical research literature

Achieved an F1 score of 0.8621

Clinical Record Analysis

Processing and analyzing clinical medical record texts

Training Loss	Epoch	Step	Validation Loss	F1
0.0879	1.0	170	0.0400	0.8312
0.0211	2.0	340	0.0454	0.8413
0.0105	3.0	510	0.0503	0.8603
0.0045	4.0	680	0.0497	0.8496
0.0028	5.0	850	0.0759	0.8387
0.0019	6.0	1020	0.0654	0.8598
0.0011	7.0	1190	0.0667	0.8654
0.0005	8.0	1360	0.0702	0.8621
0.0003	9.0	1530	0.0739	0.8596
0.0002	10.0	1700	0.0747	0.8621

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base