Polycoder 2.7B

🚀 PolyCoder Model

A PolyCoder model with 2.7B parameters, which provides code-related capabilities and is evaluated in a specific research paper.

🚀 Quick Start

This is a PolyCoder model with 2.7B parameters, presented in the paper "A Systematic Evaluation of Large Language Models of Code" (MAPS'2022 and ICLR'2022 Workshop Deep Learning 4 Code). The model was trained on 249 GB of code across 12 programming languages.

📦 Installation

Note - this model requires transformers version of at least 4.23.0:

pip install transformers==4.23.0

📚 Documentation

For more information, see: https://github.com/VHellendoorn/Code-LMs

📄 License

If you use this model, please cite:

@inproceedings{
  xu2022polycoder,
  title={A Systematic Evaluation of Large Language Models of Code},
  author={Frank F. Xu and Uri Alon and Graham Neubig and Vincent Josua Hellendoorn},
  booktitle={Deep Learning for Code Workshop},
  year={2022},
  url={https://openreview.net/forum?id=SLcEnoObJZq}
}