MADLAD-400 3B Open-Source Multilingual Translation Model - Free Deployment, Supports Translation of Over 400 Languages

Madlad400 3b Mt Q8 0 GGUF

Developed by mtsdurica

MADLAD-400 3B multilingual translation model, supporting translation tasks for over 400 languages, optimized in GGUF format.

Machine Translation Supports Multiple LanguagesOpen Source License:Apache-2.0 #Multilingual Translation #Lightweight Deployment #GGUF Format

Downloads 47

Release Time : 7/13/2024

Model Overview

This model is a multilingual translation model trained on the MADLAD-400 dataset, supporting mutual translation between over 400 languages, with special optimization for low-resource language translation capabilities.

Model Features

Extensive Language Support

Supports translation for over 400 languages, including many low-resource languages

Efficient Inference

Optimized with GGUF format, suitable for efficient operation on various hardware

Multilingual Mutual Translation

Supports direct translation between any two supported languages

Model Capabilities

Text Generation

Multilingual Translation

Text Generation Inference

Use Cases

Translation Services

Multilingual Document Translation

Translate documents from one language to another

High-quality translation for 400+ languages

Cross-Language Communication

Real-time translation of conversation content

Seamless communication between users of different languages

Language Learning

Language Learning Assistance

Provide translation references for language learners

Help understand foreign language texts

🚀 mtsdurica/madlad400-3b-mt-Q8_0-GGUF

This model is converted to GGUF format, enabling efficient inference and compatibility with various applications.

🚀 Quick Start

This model was converted to GGUF format from jbochi/madlad400-3b-mt using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

📦 Installation

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

💻 Usage Examples

CLI:

llama-cli --hf-repo mtsdurica/madlad400-3b-mt-Q8_0-GGUF --hf-file madlad400-3b-mt-q8_0.gguf -p "The meaning to life and the universe is"

Server:

llama-server --hf-repo mtsdurica/madlad400-3b-mt-Q8_0-GGUF --hf-file madlad400-3b-mt-q8_0.gguf -c 2048

Alternative Usage Steps

Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggerganov/llama.cpp

Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: `LLAMA_CUDA=1` for Nvidia GPUs on Linux).

cd llama.cpp && LLAMA_CURL=1 make

Step 3: Run inference through the main binary.

./llama-cli --hf-repo mtsdurica/madlad400-3b-mt-Q8_0-GGUF --hf-file madlad400-3b-mt-q8_0.gguf -p "The meaning to life and the universe is"

./llama-server --hf-repo mtsdurica/madlad400-3b-mt-Q8_0-GGUF --hf-file madlad400-3b-mt-q8_0.gguf -c 2048

📚 Documentation

Model Information

Property	Details
Base Model	jbochi/madlad400-3b-mt
Datasets	allenai/MADLAD-400
Languages	multilingual, en, ru, es, fr, de, it, pt, pl, nl, vi, tr, sv, id, ro, cs, zh, hu, ja, th, fi, fa, uk, da, el, 'no', bg, sk, ko, ar, lt, ca, sl, he, et, lv, hi, sq, ms, az, sr, ta, hr, kk, is, ml, mr, te, af, gl, fil, be, mk, eu, bn, ka, mn, bs, uz, ur, sw, yue, ne, kn, kaa, gu, si, cy, eo, la, hy, ky, tg, ga, mt, my, km, tt, so, ku, ps, pa, rw, lo, ha, dv, fy, lb, ckb, mg, gd, am, ug, ht, grc, hmn, sd, jv, mi, tk, ceb, yi, ba, fo, or, xh, su, kl, ny, sm, sn, co, zu, ig, yo, pap, st, haw, as, oc, cv, lus, tet, gsw, sah, br, rm, sa, bo, om, se, ce, cnh, ilo, hil, udm, os, lg, ti, vec, ts, tyv, kbd, ee, iba, av, kha, to, tn, nso, fj, zza, ak, ada, otq, dz, bua, cfm, ln, chm, gn, krc, wa, hif, yua, srn, war, rom, bik, pam, sg, lu, ady, kbp, syr, ltg, myv, iso, kac, bho, ay, kum, qu, za, pag, ngu, ve, pck, zap, tyz, hui, bbc, tzo, tiv, ksd, gom, min, ang, nhe, bgp, nzi, nnb, nv, zxx, bci, kv, new, mps, alt, meu, bew, fon, iu, abt, mgh, mnw, tvl, dov, tlh, ho, kw, mrj, meo, crh, mbt, emp, ace, ium, mam, gym, mai, crs, pon, ubu, fip, quc, gv, kj, btx, ape, chk, rcf, shn, tzh, mdf, ppk, ss, gag, cab, kri, seh, ibb, tbz, bru, enq, ach, cuk, kmb, wo, kek, qub, tab, bts, kos, rwo, cak, tuc, bum, cjk, gil, stq, tsg, quh, mak, arn, ban, jiv, sja, yap, tcy, toj, twu, xal, amu, rmc, hus, nia, kjh, bm, guh, mas, acf, dtp, ksw, bzj, din, zne, mad, msi, mag, mkn, kg, lhu, ch, qvi, mh, djk, sus, mfe, srm, dyu, ctu, gui, pau, inb, bi, mni, guc, jam, wal, jac, bas, gor, skr, nyu, noa, sda, gub, nog, cni, teo, tdx, sxn, rki, nr, frp, alz, taj, lrc, cce, rn, jvn, hvn, nij, dwr, izz, msm, bus, ktu, chr, maz, tzj, suz, knj, bim, gvl, bqc, tca, pis, prk, laj, mel, qxr, niq, ahk, shp, hne, spp, koi, krj, quf, luz, agr, tsc, mqy, gof, gbm, miq, dje, awa, bjj, qvz, sjp, tll, raj, kjg, bgz, quy, cbk, akb, oj, ify, mey, ks, cac, brx, qup, syl, jax, ff, ber, tks, trp, mrw, adh, smt, srr, ffm, qvc, mtr, ann, kaa, aa, noe, nut, gyn, kwi, xmm, msb
Library Name	transformers
License	apache-2.0
Pipeline Tag	translation
Tags	text2text-generation, text-generation-inference, llama-cpp, gguf-my-repo

Widget Examples

Example Title	Input Text
Translation to English	<2en> Como vai, amigo?
Translation to German	<2de> Do you speak German?

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご