C

Codet5 Large Ntp Py

Developed by Salesforce
CodeT5 is a large-scale encoder-decoder model pre-trained with NTP objectives for Python language, focusing on code understanding and generation tasks
Downloads 217
Release Time : 7/6/2022

Model Overview

CodeT5 is an identifier-aware unified pre-trained encoder-decoder model specifically designed for code understanding and generation tasks. This version is a large-scale model fine-tuned with NTP (Next Token Prediction) objectives on Python code.

Model Features

Multi-stage pre-training
The model underwent MSP (Masked Span Prediction) and NTP (Next Token Prediction) two-phase training, optimizing its code understanding and generation capabilities
Large-scale parameters
A large-scale model with 770M parameters capable of handling complex code generation tasks
Python language specialization
Specially optimized and trained for Python code, excelling in Python code generation tasks

Model Capabilities

Code auto-completion
Code generation
Code understanding
Function-level code generation

Use Cases

Software development assistance
Code auto-completion
Automatically generates complete functions or methods based on partial code snippets
Performs well on the APPS benchmark
Educational purposes
Helps programming learners understand code structure and generate example code
Featured Recommended AI Models
ยฉ 2025AIbase