Distilbert Base Uncased Finetuned Cola
A lightweight text classification model based on DistilBERT, fine-tuned on the GLUE CoLA task for grammatical acceptability judgment
Downloads 18
Release Time : 3/2/2022
Model Overview
This model is a fine-tuned version of DistilBERT, specifically designed for grammatical acceptability classification tasks, capable of judging the grammatical correctness of English sentences.
Model Features
Lightweight and efficient
Uses DistilBERT architecture, 40% smaller than original BERT while retaining 97% of its performance
Grammar analysis
Specifically optimized for English grammatical acceptability judgment tasks
Fast inference
Distilled architecture provides faster inference speed, suitable for production deployment
Model Capabilities
English grammar checking
Text classification
Sentence acceptability judgment
Use Cases
Educational technology
English learning assistance
Automatically detects grammatical errors in students' English writing
Accuracy with Matthews correlation coefficient of 0.523
Content moderation
Grammar quality filtering
Filters texts with non-standard grammar in user-generated content
Featured Recommended AI Models
Š 2025AIbase