Minilmv2 L6 H384 RoBERTa Large
MiniLM v2 is a lightweight language model distilled by Microsoft from RoBERTa-Large, featuring high efficiency and compactness.
Downloads 15
Release Time : 3/15/2022
Model Overview
MiniLM v2 is a lightweight language model that extracts knowledge from RoBERTa-Large through knowledge distillation, suitable for various natural language processing tasks.
Model Features
Lightweight and Efficient
Through knowledge distillation, the model significantly reduces parameters and computational costs while maintaining high performance.
Versatility
Suitable for various natural language processing tasks, including text classification, question answering, semantic similarity, etc.
High Performance
Performs excellently on multiple benchmarks, approaching or even surpassing the performance of the original RoBERTa-Large model.
Model Capabilities
Text classification
Question answering system
Semantic similarity calculation
Text embedding
Sentence representation learning
Use Cases
Text classification
Sentiment analysis
Used to analyze the sentiment tendency of text, such as positive, negative, or neutral.
Performs excellently on multiple sentiment analysis datasets.
Question answering system
Open-domain question answering
Used to answer open-domain questions posed by users.
Performs well on question answering datasets such as SQuAD.
Semantic similarity
Sentence similarity calculation
Used to calculate the semantic similarity between two sentences.
Performs excellently on semantic similarity datasets such as STS-B.
Featured Recommended AI Models