%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
Minilmv2 L6 H384 Distilled From BERT Large
MiniLMv2 is a lightweight language representation model developed by Microsoft, achieving efficient inference through knowledge distillation techniques, suitable for various natural language processing tasks.
Downloads 14.21k
Release Time : 3/2/2022
Model Overview
MiniLMv2 is a lightweight language model based on the Transformer architecture, extracting key knowledge from large models via knowledge distillation. It significantly reduces model size while maintaining high performance, making it suitable for natural language processing tasks in resource-constrained environments.
Model Features
Efficient Knowledge Distillation
Extracts key knowledge from large models through innovative distillation techniques, significantly reducing model size
Lightweight Design
Significantly reduced model parameters, suitable for deployment in resource-constrained environments
High Performance Retention
Maintains performance close to the original large model while significantly reducing model size
General Representation Capability
Learns general language representations that can be transferred to various downstream tasks
Model Capabilities
Text representation learning
Text classification
Question answering systems
Semantic similarity computation
Information retrieval
Use Cases
Natural Language Processing
Mobile Text Classification
Deploy lightweight text classification applications on mobile devices
Efficient operation while maintaining high accuracy
Edge Computing Question Answering System
Implement question answering functionality on resource-constrained edge devices
Low-latency response with minimal memory usage
Educational Technology
Intelligent Learning Assistant
Provides students with lightweight language understanding and question answering capabilities
Can run smoothly on ordinary computing devices
Featured Recommended AI Models