🚀 Bloomz-p3 Model Introduction
This is a text - generation model that supports multiple languages and programming languages. It has been tested on various datasets and tasks, showing different performance metrics.
📚 Documentation
Datasets
The model uses the following dataset:
Supported Languages
The model supports a wide range of languages, including:
- ak, ar, as, bm, bn, ca, code, en, es, eu, fon, fr, gu, hi, id, ig, ki, kn, lg, ln, ml, mr, ne, nso, ny, or, pa, pt, rn, rw, sn, st, sw, ta, te, tn, ts, tum, tw, ur, vi, wo, xh, yo, zh, zu
Programming Languages
The model can handle the following programming languages:
- C, C++, C#, Go, Java, JavaScript, Lua, PHP, Python, Ruby, Rust, Scala, TypeScript
Pipeline Tag
The pipeline tag of the model is text - generation.
Widget Examples
The model provides several widget examples for different tasks:
| Example Title |
Text |
| zh - en sentiment |
"A legendary beginning, an immortal myth. This is not just a movie, but a label to enter a new era, forever inscribed in the annals of history. Would you rate the previous review as positive, neutral or negative?" |
| zh - zh sentiment |
"一个传奇的开端，一个不灭的神话，这不仅仅是一部电影，而是作为一个走进新时代的标签，永远彪炳史册。你认为这句话的立场是赞扬、中立还是批评？" |
| vi - en query |
"Suggest at least five related search terms to "Mạng neural nhân tạo"." |
| fr - fr query |
"Proposez au moins cinq mots clés concernant «Réseau de neurones artificiels»." |
| te - en qa |
"Explain in a sentence in Telugu what is backpropagation in neural networks." |
| en - en qa |
"Why is the sky blue?" |
| es - en fable |
"Write a fairy tale about a troll saving a princess from a dangerous dragon. The fairy tale is a masterpiece that has achieved praise worldwide and its moral is "Heroes Come in All Shapes and Sizes". Story (in Spanish):" |
| hi - en fable |
"Write a fable about wood elves living in a forest that is suddenly invaded by ogres. The fable is a masterpiece that has achieved praise worldwide and its moral is "Violence is the last refuge of the incompetent". Fable (in Hindi):" |
Inference
Inference is set to false.
Model Index
The model named bloomz - p3 has the following results on different tasks and datasets:
Coreference Resolution
| Dataset |
Name |
Config |
Split |
Revision |
Accuracy |
| winogrande |
Winogrande XL (xl) |
xl |
validation |
a80f460359d1e9a67c006011c94de42a8759430c |
57.06 |
| Muennighoff/xwinograd |
XWinograd (en) |
en |
test |
9dd5ea5505fad86b7bedad667955577815300cee |
60.65 |
| Muennighoff/xwinograd |
XWinograd (fr) |
fr |
test |
9dd5ea5505fad86b7bedad667955577815300cee |
59.04 |
| Muennighoff/xwinograd |
XWinograd (jp) |
jp |
test |
9dd5ea5505fad86b7bedad667955577815300cee |
56.0 |
| Muennighoff/xwinograd |
XWinograd (pt) |
pt |
test |
9dd5ea5505fad86b7bedad667955577815300cee |
60.46 |
| Muennighoff/xwinograd |
XWinograd (ru) |
ru |
test |
9dd5ea5505fad86b7bedad667955577815300cee |
57.14 |
| Muennighoff/xwinograd |
XWinograd (zh) |
zh |
test |
9dd5ea5505fad86b7bedad667955577815300cee |
60.71 |
Natural Language Inference
| Dataset |
Name |
Config |
Split |
Revision |
Accuracy |
| anli |
ANLI (r1) |
r1 |
validation |
9dbd830a06fea8b1c49d6e5ef2004a08d9f45094 |
41.7 |
| anli |
ANLI (r2) |
r2 |
validation |
9dbd830a06fea8b1c49d6e5ef2004a08d9f45094 |
39.3 |
| anli |
ANLI (r3) |
r3 |
validation |
9dbd830a06fea8b1c49d6e5ef2004a08d9f45094 |
42.83 |
| super_glue |
SuperGLUE (cb) |
cb |
validation |
9e12063561e7e6c79099feb6d5a493142584e9e2 |
85.71 |
| super_glue |
SuperGLUE (rte) |
rte |
validation |
9e12063561e7e6c79099feb6d5a493142584e9e2 |
85.2 |
| xnli |
XNLI (ar) |
ar |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
56.71 |
| xnli |
XNLI (bg) |
bg |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
46.63 |
| xnli |
XNLI (de) |
de |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
50.16 |
| xnli |
XNLI (el) |
el |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
43.05 |
| xnli |
XNLI (en) |
en |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
59.72 |
| xnli |
XNLI (es) |
es |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
59.32 |
| xnli |
XNLI (fr) |
fr |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
57.99 |
| xnli |
XNLI (hi) |
hi |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
55.02 |
| xnli |
XNLI (ru) |
ru |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
50.12 |
| xnli |
XNLI (sw) |
sw |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
50.04 |
| xnli |
XNLI (th) |
th |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
42.29 |
| xnli |
XNLI (tr) |
tr |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
43.78 |
| xnli |
XNLI (ur) |
ur |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
51.81 |
| xnli |
XNLI (vi) |
vi |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
57.27 |
| xnli |
XNLI (zh) |
zh |
validation |
a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16 |
56.95 |
Program Synthesis
| Dataset |
Name |
Config |
Split |
Revision |
Pass@1 |
Pass@10 |
Pass@100 |
| openai_humaneval |
HumanEval |
None |
test |
e8dc562f5de170c54b5481011dd9f4fa04845771 |
6.13 |
11.79 |
18.73 |
Sentence Completion
| Dataset |
Name |
Config |
Split |
Revision |
Accuracy |
| story_cloze |
StoryCloze (2016) |
"2016" |
validation |
e724c6f8cdf7c7a2fb229d862226e15b023ee4db |
94.66 |
| super_glue |
SuperGLUE (copa) |
copa |
validation |
9e12063561e7e6c79099feb6d5a493142584e9e2 |
91.0 |
| xcopa |
XCOPA (et) |
et |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
53.0 |
| xcopa |
XCOPA (ht) |
ht |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
58.0 |
| xcopa |
XCOPA (id) |
id |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
87.0 |
| xcopa |
XCOPA (it) |
it |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
74.0 |
| xcopa |
XCOPA (qu) |
qu |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
57.0 |
| xcopa |
XCOPA (sw) |
sw |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
61.0 |
| xcopa |
XCOPA (ta) |
ta |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
69.0 |
| xcopa |
XCOPA (th) |
th |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
61.0 |
| xcopa |
XCOPA (tr) |
tr |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
56.0 |
| xcopa |
XCOPA (vi) |
vi |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
81.0 |
| xcopa |
XCOPA (zh) |
zh |
validation |
37f73c60fb123111fa5af5f9b705d0b3747fd187 |
83.0 |
| Muennighoff/xstory_cloze |
XStoryCloze (ar) |
ar |
validation |
8bb76e594b68147f1a430e86829d07189622b90d |
92.46 |
| Muennighoff/xstory_cloze |
XStoryCloze (es) |
es |
validation |
8bb76e594b68147f1a430e86829d07189622b90d |
94.44 |
| Muennighoff/xstory_cloze |
XStoryCloze (eu) |
eu |
validation |
8bb76e594b68147f1a430e86829d07189622b90d |
... |
📄 License
The model is under the bigscience - bloom - rail - 1.0 license.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
