D

Drama Large

Developed by facebook
DRAMA-large (0.3B) is a dense retrieval model built upon a pruned large language model architecture, optimized for efficient and generalizable multilingual text retrieval tasks.
Downloads 55
Release Time : 2/25/2025

Model Overview

This model is obtained by pruning a large language model and fine-tuning it for efficient and generalizable multilingual text retrieval tasks. By leveraging the large language model for high-quality data augmentation, despite its non-embedding parameter size of only 0.3B, DRAMA-large demonstrates strong performance in both English and multilingual retrieval tasks.

Model Features

Large Language Model Augmentation
Enhances retrieval performance through high-quality data augmentation using large language models.
Multilingual Support
Supports text retrieval tasks in 20 languages.
Nested Representation Learning
Supports flexible dimension adjustment, allowing truncation of embedding dimensions as needed.
Efficient Retrieval
Despite its smaller parameter size, it performs excellently in multilingual retrieval tasks.

Model Capabilities

Multilingual Text Retrieval
Sentence Similarity Calculation
Efficient Vector Encoding

Use Cases

Information Retrieval
Cross-language Document Retrieval
Retrieves relevant documents from document libraries in different languages.
Performs excellently on multilingual datasets such as MIRACL.
Question Answering Systems
Used for retrieving relevant passages in question-answering systems.
Performs well on benchmarks like BEIR.
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase