%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
EN
Refact 1 6B Fim
R
Refact 1 6B Fim
Developed by smallcloudai
Refact-1.6B is a large language model with 1.6B parameters focused on code generation, excelling in multiple programming languages.
Downloads 9,703
Release Time : 8/29/2023
Model Overview
This model is primarily used for code generation tasks, supporting various programming languages and demonstrating excellent performance in benchmarks like HumanEval.
Model Features
Multilingual code generation
Supports code generation in multiple programming languages including Python, JavaScript, Java, and C++.
High performance
Demonstrates outstanding performance in the HumanEval benchmark, achieving a Python pass@1 rate of 32%.
Extensive training data
Utilizes diverse training data sources including GitHub code, technical forums, and Wikipedia.
Model Capabilities
Code autocompletion
Function generation
Multilingual code conversion
Code explanation
Use Cases
Development assistance
Code autocompletion
Provides intelligent code completion suggestions in IDEs
Improves development efficiency
Code generation
Generates complete code implementations based on function signatures or comments
Achieves a HumanEval Python pass@1 rate of 32%
Education
Programming learning aid
Provides learners with code examples and explanations
đ Refact-1.6B
This is a text generation model. After fine - tuning on generated data, it outperforms many other models such as Replit 3b and Stability Code 3b, and almost rivals StarCoder which is ten times its size. It's likely the best model for practical code completion use in your IDE due to its intelligence and speed.
⨠Features
- Capable of text generation, especially useful for code - related tasks.
- Outperforms several models in terms of HumanEval pass@1 and pass@10 metrics despite its relatively small size.
đ Documentation
Model Information
| Property | Details |
|---|---|
| Pipeline Tag | text - generation |
| Inference | true |
| Library Name | transformers |
| Tags | code |
Datasets
Pretrain Datasets
- books
- arxiv
- c4
- falcon - refinedweb
- wiki
- github - issues
- stack_markdown
- self - made dataset of permissive github code
Training Datasets
- bigcode/the - stack - dedup
- rombodawg/2XUNCENSORED_MegaCodeTraining188k
- bigcode/commitpackft
Metrics
The model is evaluated using the code_eval metric.
Model Index
The model named Refact - 1.6B has the following evaluation results on different tasks and datasets:
HumanEval
| Task | Dataset | Metric | Value | Verified |
|---|---|---|---|---|
| text - generation | openai_humaneval (HumanEval) | pass@1 (T = 0.01) | 32.0 | false |
| text - generation | openai_humaneval (HumanEval) | pass@1 (T = 0.2) | 31.5 | false |
| text - generation | openai_humaneval (HumanEval) | pass@10 (T = 0.8) | 53.0 | false |
| text - generation | openai_humaneval (HumanEval) | pass@100 (T = 0.8) | 76.9 | false |
HumanEvalSynthesize
| Task | Dataset | Metric | Value | Verified |
|---|---|---|---|---|
| text - generation | bigcode/humanevalpack (HumanEvalSynthesize Python) | pass@1 (T = 0.2) | 35.8 | false |
| text - generation | bigcode/humanevalpack (HumanEvalSynthesize JavaScript) | pass@1 (T = 0.2) | 31.6 | false |
| text - generation | bigcode/humanevalpack (HumanEvalSynthesize Java) | pass@1 (T = 0.2) | 29.1 | false |
| text - generation | bigcode/humanevalpack (HumanEvalSynthesize Go) | pass@1 (T = 0.2) | -1 | false |
| text - generation | bigcode/humanevalpack (HumanEvalSynthesize C++) | pass@1 (T = 0.2) | 26.3 | false |
| text - generation | bigcode/humanevalpack (HumanEvalSynthesize Rust) | pass@1 (T = 0.2) | -1 | false |
| text - generation | bigcode/humanevalpack (HumanEvalSynthesize Average) | pass@1 (T = 0.2) | -1 | false |
HumanEvalFixTests
| Task | Dataset | Metric | Value | Verified |
|---|---|---|---|---|
| text - generation | bigcode/humanevalpack (HumanEvalFixTests Python) | pass@1 (T = 0.2) | 18.38 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixTests JavaScript) | pass@1 (T = 0.2) | 12.28 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixTests Java) | pass@1 (T = 0.2) | 15.12 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixTests Go) | pass@1 (T = 0.2) | -1 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixTests C++) | pass@1 (T = 0.2) | 13.17 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixTests Rust) | pass@1 (T = 0.2) | 2.8 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixTests Average) | pass@1 (T = 0.2) | -1 | false |
HumanEvalFixDocs
| Task | Dataset | Metric | Value | Verified |
|---|---|---|---|---|
| text - generation | bigcode/humanevalpack (HumanEvalFixDocs Python) | pass@1 (T = 0.2) | 26.92 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixDocs JavaScript) | pass@1 (T = 0.2) | 26.85 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixDocs Java) | pass@1 (T = 0.2) | 30.76 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixDocs Go) | pass@1 (T = 0.2) | -1 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixDocs C++) | pass@1 (T = 0.2) | 25.94 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixDocs Rust) | pass@1 (T = 0.2) | 8.44 | false |
| text - generation | bigcode/humanevalpack (HumanEvalFixDocs Average) | pass@1 (T = 0.2) | -1 | false |
HumanEvalExplain
| Task | Dataset | Metric | Value | Verified |
|---|---|---|---|---|
| text - generation | bigcode/humanevalpack (HumanEvalExplain Python) | pass@1 (T = 0.2) | 26.46 | false |
| text - generation | bigcode/humanevalpack (HumanEvalExplain JavaScript) | pass@1 (T = 0.2) | 17.86 | false |
| text - generation | bigcode/humanevalpack (HumanEvalExplain Java) | pass@1 (T = 0.2) | 20.94 | false |
| text - generation | bigcode/humanevalpack (HumanEvalExplain Go) | pass@1 (T = 0.2) | -1 | false |
| text - generation | bigcode/humanevalpack (HumanEvalExplain C++) | pass@1 (T = 0.2) | 18.78 | false |
| text - generation | bigcode/humanevalpack (HumanEvalExplain Rust) | pass@1 (T = 0.2) | -1 | false |
| text - generation | bigcode/humanevalpack (HumanEvalExplain Average) | pass@1 (T = 0.2) | -1 | false |
Other Datasets
| Task | Dataset | Metric | Value | Verified |
|---|---|---|---|---|
| text - generation | mbpp (MBPP) | pass@1 (T = 0.01) | 31.15 | false |
| text - generation | ds1000 (DS - 1000 (Overall Completion)) | pass@1 (T = 0.2) | 10.1 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (C++)) | pass@1 (T = 0.2) | 21.61 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (C#)) | pass@1 (T = 0.2) | 13.91 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (D)) | pass@1 (T = 0.2) | 9.5 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Go)) | pass@1 (T = 0.2) | 53.57 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Java)) | pass@1 (T = 0.2) | 21.58 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Julia)) | pass@1 (T = 0.2) | 13.75 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (JavaScript)) | pass@1 (T = 0.2) | 26.88 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Lua)) | pass@1 (T = 0.2) | 15.26 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (PHP)) | pass@1 (T = 0.2) | 23.04 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Perl)) | pass@1 (T = 0.2) | 12.1 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Python)) | pass@1 (T = 0.2) | 29.6 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (R)) | pass@1 (T = 0.2) | 13.77 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Ruby)) | pass@1 (T = 0.2) | 12.68 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Racket)) | pass@1 (T = 0.2) | 4.29 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Rust)) | pass@1 (T = 0.2) | 19.54 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Scala)) | pass@1 (T = 0.2) | 18.33 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Bash)) | pass@1 (T = 0.2) | 5.7 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (Swift)) | pass@1 (T = 0.2) | 17.68 | false |
| text - generation | nuprl/MultiPL - E (MultiPL - HumanEval (TypeScript)) | pass@1 (T = 0.2) | 25 | false |
Model Comparison
| Model | Size | HumanEval pass@1 | HumanEval pass@10 |
|---|---|---|---|
| DeciCoder - 1b | 1b | 19.1% | |
| Refact - 1.6 - fim | 1.6b | 32.0% | 53.0% |
| StableCode | 3b | 20.2% | 33.8% |
| ReplitCode v1 | 3b | 21.9% | |
| CodeGen2.5 - multi | 7b | 28.4% | 47.5% |
| CodeLlama | 7b | 33.5% | 59.6% |
| StarCoder | 15b | 33.6% |
đ License
The model is licensed under the bigscience - openrail - m license.
Finally, the model we started training with our blog post is ready đ
After fine - tuning on generated data, it beats Replit 3b, Stability Code 3b and many other models. It almost beats StarCoder ten times the size!
It's likely the best model for practical use in your IDE for code completion because it's smart and fast! You can start using it right now.
Phi 2 GGUF
Other
Phi-2 is a small yet powerful language model developed by Microsoft, featuring 2.7 billion parameters, focusing on efficient inference and high-quality text generation.
Large Language Model Supports Multiple Languages
P
TheBloke
41.5M
205
Roberta Large
MIT
A large English language model pre-trained with masked language modeling objectives, using improved BERT training methods
Large Language Model English
R
FacebookAI
19.4M
212
Distilbert Base Uncased
Apache-2.0
DistilBERT is a distilled version of the BERT base model, maintaining similar performance while being more lightweight and efficient, suitable for natural language processing tasks such as sequence classification and token classification.
Large Language Model English
D
distilbert
11.1M
669
Llama 3.1 8B Instruct GGUF
Meta Llama 3.1 8B Instruct is a multilingual large language model optimized for multilingual dialogue use cases, excelling in common industry benchmarks.
Large Language Model English
L
modularai
9.7M
4
Xlm Roberta Base
MIT
XLM-RoBERTa is a multilingual model pretrained on 2.5TB of filtered CommonCrawl data across 100 languages, using masked language modeling as the training objective.
Large Language Model Supports Multiple Languages
X
FacebookAI
9.6M
664
Roberta Base
MIT
An English pre-trained model based on Transformer architecture, trained on massive text through masked language modeling objectives, supporting text feature extraction and downstream task fine-tuning
Large Language Model English
R
FacebookAI
9.3M
488
Opt 125m
Other
OPT is an open pre-trained Transformer language model suite released by Meta AI, with parameter sizes ranging from 125 million to 175 billion, designed to match the performance of the GPT-3 series while promoting open research in large-scale language models.
Large Language Model English
O
facebook
6.3M
198
1
A pretrained model based on the transformers library, suitable for various NLP tasks
Large Language Model
Transformers
Transformers1
unslothai
6.2M
1
Llama 3.1 8B Instruct
Llama 3.1 is Meta's multilingual large language model series, featuring 8B, 70B, and 405B parameter scales, supporting 8 languages and code generation, with optimized multilingual dialogue scenarios.
Large Language Model Transformers Supports Multiple Languages
Transformers Supports Multiple LanguagesL
meta-llama
5.7M
3,898
T5 Base
Apache-2.0
The T5 Base Version is a text-to-text Transformer model developed by Google with 220 million parameters, supporting multilingual NLP tasks.
Large Language Model Supports Multiple Languages
T
google-t5
5.4M
702
Featured Recommended AI Models
Š 2025AIbase