M

Minilmv2 L6 H384 RoBERTa Large

Developed by torbenal
MiniLM v2 is a lightweight language model distilled by Microsoft from RoBERTa-Large, featuring high efficiency and compactness.
Downloads 15
Release Time : 3/15/2022

Model Overview

MiniLM v2 is a lightweight language model that extracts knowledge from RoBERTa-Large through knowledge distillation, suitable for various natural language processing tasks.

Model Features

Lightweight and Efficient
Through knowledge distillation, the model significantly reduces parameters and computational costs while maintaining high performance.
Versatility
Suitable for various natural language processing tasks, including text classification, question answering, semantic similarity, etc.
High Performance
Performs excellently on multiple benchmarks, approaching or even surpassing the performance of the original RoBERTa-Large model.

Model Capabilities

Text classification
Question answering system
Semantic similarity calculation
Text embedding
Sentence representation learning

Use Cases

Text classification
Sentiment analysis
Used to analyze the sentiment tendency of text, such as positive, negative, or neutral.
Performs excellently on multiple sentiment analysis datasets.
Question answering system
Open-domain question answering
Used to answer open-domain questions posed by users.
Performs well on question answering datasets such as SQuAD.
Semantic similarity
Sentence similarity calculation
Used to calculate the semantic similarity between two sentences.
Performs excellently on semantic similarity datasets such as STS-B.
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase