Bert Base Multilingual Cased Sentence
B
Bert Base Multilingual Cased Sentence
Developed by DeepPavlov
A 101-language sentence representation model based on multilingual BERT, generating sentence representations through mean-pooling of word embeddings
Downloads 56
Release Time : 3/2/2022
Model Overview
This model is based on multilingual BERT, fine-tuned on English MultiNLI and multilingual XNLI development sets for generating multilingual sentence representations
Model Features
Multilingual support
Supports sentence representation generation for 101 languages
BERT-based architecture
Uses 12-layer BERT architecture with 768 hidden units and 12 attention heads
Sentence representation optimization
Optimizes sentence representation generation through mean-pooling of word embeddings
Cross-lingual fine-tuning
Fine-tuned on English MultiNLI and multilingual XNLI development sets
Model Capabilities
Multilingual sentence embedding
Cross-lingual semantic similarity calculation
Sentence-level feature extraction
Use Cases
Natural Language Processing
Cross-lingual semantic search
Retrieve semantically similar sentences across different languages
Multilingual text classification
Perform multilingual text classification tasks using sentence representations
Cross-lingual information retrieval
Retrieve relevant information from documents in different languages
Featured Recommended AI Models