Simcse Dist Mpnet Czeng Cs En

🚀 SimCSE

SimCSE-Dist-MPNet-CzEng is a fine - tuned model based on Seznam/Seznam/dist-mpnet-czeng-cs-en with the SimCSE objective. It aims to create high - quality small Czech semantic embedding models, performing well in various NLP tasks.

🚀 Quick Start

SimCSE-Dist-MPNet-CzEng is the result of fine - tuning the Seznam/Seznam/dist-mpnet-czeng-cs-en model with the SimCSE objective.

This model was developed at Seznam.cz as part of a project focused on creating high - quality small Czech semantic embedding models. These models demonstrate excellent performance across a range of natural language processing tasks, such as similarity search, retrieval, clustering, and classification. For more detailed information or evaluation results, please refer to the associated paper or GitHub repository.

💻 Usage Examples

Basic Usage

import torch
from transformers import AutoModel, AutoTokenizer

model_name = "Seznam/retromae-small-cs"  # Hugging Face link
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModel.from_pretrained(model_name)

input_texts = [
    "Dnes je výborné počasí na procházku po parku.",
    "Večer si oblíbím dobrý film a uvařím si čaj."
]

# Tokenize the input texts
batch_dict = tokenizer(input_texts, max_length=512, padding=True, truncation=True, return_tensors='pt')

outputs = model(**batch_dict)
embeddings = outputs.last_hidden_state[:, 0]  # Extract CLS token embeddings

similarity = torch.nn.functional.cosine_similarity(embeddings[0], embeddings[1], dim=0)

📄 License

This model is released under the CC BY - NC - SA 4.0 license.