BERT-base-uncased-pretrained-mlm-coqa-stories Open-source Language Model

Home

Bert Base Uncased Pretrained Mlm Coqa Stories

Developed by alistvt

Pre-trained language model based on BERT architecture, supporting masked language modeling tasks

Large Language Model

Transformers

#Question Answering Generation #Story Comprehension #Contextual Modeling

Downloads 23

Release Time : 3/2/2022

Model Overview

This model is a pre-trained model based on the BERT-base architecture, trained through masked language modeling (MLM) tasks, potentially suitable for story comprehension and question answering scenarios

Model Features

Based on BERT Architecture

Utilizes the proven BERT-base architecture with strong language understanding capabilities

Pre-trained for Masked Language Modeling

Specifically optimized for MLM tasks, suitable for language understanding and generation tasks

Potential Support for Story Comprehension

The model name includes 'stories', suggesting it may have been specially trained for story texts

Model Capabilities

Text Understanding

Masked Prediction

Language Modeling

Use Cases

Natural Language Processing

Story Comprehension

Understand story text content and answer related questions

Question Answering System

Build text-based question answering systems

Training Loss	Epoch	Step	Validation Loss
2.0573	1.0	2479	1.8805
1.9517	2.0	4958	1.8377
1.9048	3.0	7437	1.8310

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Bert Base Uncased Pretrained Mlm Coqa Stories

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 bert-base-uncased-pretrained-mlm-coqa-stories

🚀 Quick Start

📚 Documentation

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions