bert-base-uncased-multi-128 Open Source Model - Free Deployment for Cloze Completion Tasks

Home

Bert Base Uncased Multi 128

Developed by xxr

A model fine-tuned based on bert-base-uncased, primarily used for fill-in-the-blank tasks

Large Language Model

Transformers

Open Source License:Apache-2.0 #English Text Filling #Fine-tuned BERT Version #Mini-batch Optimization

Downloads 16

Release Time : 4/1/2022

Model Overview

This model is a fine-tuned version of bert-base-uncased on an unspecified dataset, mainly used for masked language modeling (fill-in-the-blank) tasks.

Model Features

Based on BERT Architecture

Adopts the classic BERT architecture with strong contextual understanding capabilities

Fine-tuning Optimization

Fine-tuned on the original bert-base-uncased, potentially optimized for specific tasks

Masked Language Modeling

Specifically trained for fill-in-the-blank tasks

Model Capabilities

Text Fill-in-the-Blank

Contextual Understanding

Masked Prediction

Use Cases

Text Processing

Text Auto-Completion

Predicts the masked parts in the text

Grammar Correction

Identifies and corrects grammatical errors in text

Training Loss	Epoch	Step	Validation Loss
3.6636	1.0	812	3.2325
3.2963	2.0	1624	3.1937
3.1132	3.0	2436	3.2984
2.9386	4.0	3248	3.2430
2.7742	5.0	4060	3.1272
2.5954	6.0	4872	3.1778
2.501	7.0	5684	3.1649
2.4073	8.0	6496	2.9395
2.2933	9.0	7308	3.1262
2.2218	10.0	8120	2.9994
2.1558	11.0	8932	2.9922
2.0873	12.0	9744	2.8414
2.0104	13.0	10556	2.9351
1.9364	14.0	11368	2.9253
1.9045	15.0	12180	2.8701
1.9152	16.0	12992	2.7101

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Bert Base Uncased Multi 128

Model Overview

Model Features

Model Capabilities

Use Cases

bert-base-uncased-multi-128

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions