Multilingual-e5-large-instruct-Q3_K_S-GGUF Open-source Model - Support Multilingual Classification, Retrieval, and Clustering Tasks

Multilingual E5 Large Instruct Q3 K S GGUF

Developed by yoeven

Multilingual E5 large instruction model, supporting multiple languages and tasks including classification, retrieval, clustering, etc.

Large Language Model Supports Multiple LanguagesOpen Source License:MIT #Multilingual Text Embedding #High-Precision Classification #Cross-Language Retrieval

Downloads 14

Release Time : 1/6/2025

Model Overview

This model is a multilingual embedding model based on intfloat/multilingual-e5-large-instruct, supporting a wide range of natural language processing tasks such as text classification, information retrieval, and text clustering.

Model Features

Multilingual Support

Supports text embedding and classification tasks in multiple languages.

High Performance

Outstanding performance in multiple benchmarks, such as the MTEB dataset.

Versatile

Suitable for various natural language processing tasks, including classification, retrieval, and clustering.

Model Capabilities

Text classification

Information retrieval

Text clustering

Bilingual mining

Sentence similarity calculation

Use Cases

E-commerce

Product Review Classification

Sentiment classification of Amazon product reviews.

Achieved 96.29% accuracy in the MTEB AmazonPolarityClassification task.

Information Retrieval

Document Retrieval

Retrieving relevant information from a large collection of documents.

Achieved map_at_100 of 49.88 in the MTEB ArguAna task.

Academic Research

Paper Clustering

Topic clustering of academic papers.

Achieved v_measure of 46.40 in the MTEB ArxivClusteringP2P task.

🚀 multilingual-e5-large-instruct

This is a multilingual model based on intfloat/multilingual-e5-large-instruct, which has been tested on multiple tasks in the MTEB benchmark, showing excellent performance in various tasks such as classification, retrieval, clustering, etc.

📚 Documentation

Model Information

Property	Details
Model Type	multilingual-e5-large-instruct
Base Model	intfloat/multilingual-e5-large-instruct
License	MIT
Supported Languages	multilingual, af, am, ar, as, az, be, bg, bn, br, bs, ca, cs, cy, da, de, el, en, eo, es, et, eu, fa, fi, fr, fy, ga, gd, gl, gu, ha, he, hi, hr, hu, hy, id, is, it, ja, jv, ka, kk, km, kn, ko, ku, ky, la, lo, lt, lv, mg, mk, ml, mn, mr, ms, my, ne, nl, 'no', om, or, pa, pl, ps, pt, ro, ru, sa, sd, si, sk, sl, so, sq, sr, su, sv, sw, ta, te, th, tl, tr, ug, uk, ur, uz, vi, xh, yi, zh

Model Performance

The model has been evaluated on various tasks and datasets, here are some of the results:

Classification Tasks

Dataset	Accuracy	AP	F1
MTEB AmazonCounterfactualClassification (en)	76.23880597014924	39.07351965022687	70.04836733862683
MTEB AmazonCounterfactualClassification (de)	66.71306209850107	79.01499914759529	64.81951817560703
MTEB AmazonPolarityClassification	96.28742500000001	94.8449918887462	96.28680923610432
MTEB AmazonReviewsClassification (en)	56.716	-	55.76510398266401
MTEB AmazonReviewsClassification (de)	52.99999999999999	-	52.00829994765178
MTEB AmazonReviewsClassification (es)	48.806000000000004	-	48.082345914983634
MTEB AmazonReviewsClassification (fr)	48.507999999999996	-	47.68752844642045
MTEB AmazonReviewsClassification (ja)	47.709999999999994	-	47.05870376637181
MTEB AmazonReviewsClassification (zh)	44.662000000000006	-	43.42371965372771
MTEB Banking77Classification	85.73376623376623	-	85.68480707214599
MTEB EmotionClassification	51.51	-	47.632159862049896

Retrieval Tasks

Dataset	MAP@1	MAP@10	MAP@100	MAP@1000	MRR@1	MRR@10	MRR@100	MRR@1000	NDCG@1	NDCG@10	NDCG@100	NDCG@1000	Precision@1	Precision@10	Precision@100	Precision@1000	Recall@1	Recall@10	Recall@100	Recall@1000
MTEB ArguAna	31.721	49.221	49.884	49.888	32.432	49.5	50.163000000000004	50.166	31.721	58.384	61.111000000000004	61.187999999999995	31.721	8.741	0.991	0.1	31.721	87.411	99.075	99.644
MTEB CQADupstackRetrieval	27.764166666666668	37.298166666666674	38.530166666666666	38.64416666666667	32.93558333333333	41.589749999999995	42.425333333333334	42.476333333333336	32.93558333333333	42.706583333333334	47.82483333333333	49.95733333333334	32.93558333333333	7.459833333333334	1.1830833333333335	0.15608333333333332	27.764166666666668	54.31775	76.74350000000001	91.45208333333332
MTEB ClimateFEVER	12.969	21.584999999999997	23.3	23.5	29.316	40.033	40.96	41.001	29.316	29.858	36.756	40.245999999999995	29.316	9.186	1.6549999999999998	0.22999999999999998	12.969	35.142	59.143	78.594
MTEB DBPedia	8.527999999999999	17.974999999999998	25.665	27.406000000000002	62.5	71.891	72.294	72.296	50.875	38.36	44.235	52.154	62.5	30.0	10.038	2.0869999999999997	8.527999999999999	23.828	52.322	77.143
MTEB FEVER	60.734	72.442	72.735	72.75	65.212	76.613	76.79899999999999	76.801	65.212	77.988	79.167	79.452	65.212	10.003	1.077	0.11199999999999999	60.734	90.824	95.71600000000001	97.577
MTEB FiQA2018	23.845	39.281	41.422	41.593	47.531	56.204	56.928999999999995	56.962999999999994	47.531	47.711999999999996	54.510999999999996	57.103	47.531	13.194	2.045	0.249	23.845	54.967	79.11399999999999	94.56700000000001
MTEB HotpotQA	37.819	60.889	61.717999999999996	61.778	75.638	82.173	82.362	82.37	75.638	69.317	72.221	73.382	75.638	14.704999999999998	1.698	0.185	37.819	54.967	79.11399999999999	94.56700000000001

Clustering Tasks

Dataset	V-Measure
MTEB ArxivClusteringP2P	46.40419580759799
MTEB ArxivClusteringS2S	40.48593255007969
MTEB BiorxivClusteringP2P	40.935218072113855
MTEB BiorxivClusteringS2S	36.276389017675264

Reranking Tasks

Dataset	MAP	MRR
MTEB AskUbuntuDupQuestions	63.889179122289995	77.61146286769556

STS Tasks

Dataset	Cosine Similarity Pearson	Cosine Similarity Spearman	Euclidean Pearson	Euclidean Spearman	Manhattan Pearson	Manhattan Spearman
MTEB BIOSSES	88.15075203727929	86.9622224570873	86.70473853624121	86.9622224570873	86.21089380980065	86.75318154937008

Bitext Mining Tasks

Dataset	Accuracy	F1	Precision	Recall
MTEB BUCC (de-en)	99.65553235908142	99.60681976339595	99.58246346555325	99.65553235908142
MTEB BUCC (fr-en)	99.26260180497468	99.14520507740848	99.08650671362535	99.26260180497468
MTEB BUCC (ru-en)	98.07412538967787	97.86629719431936	97.76238309664012	98.07412538967787
MTEB BUCC (zh-en)	99.42074776197998	99.38564156573635	99.36808846761454	99.42074776197998

📄 License

This model is released under the MIT license.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご