Norbert3 Xs
NorBERT 3 xs is a BERT model optimized for Norwegian, the smallest version in the new generation NorBERT language model series with 15M parameters.
Downloads 228
Release Time : 3/28/2023
Model Overview
This model is a Norwegian pre-trained language model based on the BERT architecture, specifically optimized for Norwegian text processing tasks and supports various downstream NLP tasks.
Model Features
Norwegian optimization
Specifically pre-trained and optimized for Norwegian (including both bokmål and nynorsk written forms)
Lightweight design
As the smallest model (15M parameters) in the NorBERT 3 series, suitable for resource-constrained environments
Multi-functional support
Supports various downstream NLP tasks, including text classification, named entity recognition, etc.
Remote code support
Requires a custom wrapper, loaded via trust_remote_code=True
Model Capabilities
Masked language modeling
Sequence classification
Token classification
Question answering
Multiple choice
Use Cases
Text understanding
Text completion
Predict masked words, such as predicting '[MASK]' as 'ny' in the example
Can accurately predict Norwegian vocabulary that fits the context
Text classification
Sentiment analysis
Classify sentiment tendencies in Norwegian texts
Featured Recommended AI Models