Gliclass Base V1.0

🚀 ⭐ GLiClass: Generalist and Lightweight Model for Sequence Classification

GLiClass is an efficient zero - shot classifier inspired by the GLiNER work. It achieves performance comparable to a cross - encoder while being more compute - efficient, as classification is completed in a single forward pass. It can be applied to topic classification, sentiment analysis, and used as a reranker in RAG pipelines. The model is trained on synthetic data and is suitable for commercial applications.

🚀 Quick Start

📦 Installation

First, you need to install the GLiClass library:

pip install gliclass

💻 Usage Examples

Basic Usage

Then, you need to initialize a model and a pipeline:

from gliclass import GLiClassModel, ZeroShotClassificationPipeline
from transformers import AutoTokenizer

model = GLiClassModel.from_pretrained("knowledgator/gliclass-base-v1.0")
tokenizer = AutoTokenizer.from_pretrained("knowledgator/gliclass-base-v1.0")

pipeline = ZeroShotClassificationPipeline(model, tokenizer, classification_type='multi-label', device='cuda:0')

text = "One day I will see the world!"
labels = ["travel", "dreams", "sport", "science", "politics"]
results = pipeline(text, labels, threshold=0.5)[0] #because we have one text

for result in results:
 print(result["label"], "=>", result["score"])

📚 Documentation

Benchmarks

Below, you can see the F1 score on several text classification datasets. All tested models were not fine - tuned on those datasets and were tested in a zero - shot setting.

Below you can find a comparison with other GLiClass models:

Here you can see how the performance of the model grows providing more examples:

📄 License

The model is licensed under the Apache - 2.0 license.

✨ Features

• Efficient Zero - Shot Classification: Achieves comparable performance to cross - encoders with lower computational cost.
• Multiple Applications: Can be used for topic classification, sentiment analysis, and as a reranker in RAG pipelines.
• Commercial Use: Trained on synthetic data, suitable for commercial applications.

📦 Information Table