IBM Granite 34B Open Source Code Instruction Model - Free Support for Multi-language Code Generation and Explanation

Granite 34b Code Instruct 8k GGUF

Developed by ibm-granite

The IBM Granite 34B Code Instruction Model is a large language model focused on code generation and explanation, based on a 34B parameter architecture and supporting multiple programming languages.

Large Language Model OtherOpen Source License:Apache-2.0 #Multilingual Code Generation #Programming Task Explanation #Code Fixing and Optimization

Downloads 40

Release Time : 5/20/2024

Model Overview

This model is specifically optimized for code generation, code explanation, and code fixing tasks, demonstrating excellent performance in HumanEval evaluations across various programming languages.

Model Features

Multilingual Code Support

Supports code generation and explanation for multiple programming languages including Python, JavaScript, Java, Go, C++, Rust, and more

High-performance Code Generation

Achieves 62.2% pass@1 in Python code generation on HumanEvalSynthesis evaluation

Code Explanation Capability

Capable of explaining code functionality across multiple programming languages, with 53.0% pass@1 in Python explanation

Code Fixing Capability

Features code error fixing capability, achieving 54.9% pass@1 in Python code fixing

Model Capabilities

Code Generation

Code Explanation

Code Fixing

Multilingual Programming Support

Text Generation

Use Cases

Software Development

Code Auto-completion

Automatically generates complete code implementations based on function signatures or comments

Demonstrates excellent performance in HumanEvalSynthesis evaluations

Code Documentation Generation

Generates explanatory documentation for existing code

HumanEvalExplain evaluations show strong explanatory capabilities

Code Error Fixing

Identifies and fixes errors in code

HumanEvalFix evaluations demonstrate effective fixing capabilities

Programming Education

Programming Learning Assistance

Helps students understand programming concepts and code examples

🚀 ibm-granite/granite-34b-code-instruct-8k-GGUF

This is a Q4_K_M converted model for code generation, based on the original ibm-granite/granite-34b-code-instruct-8k.

image/png

This is the Q4_K_M converted version of the original ibm-granite/granite-34b-code-instruct-8k. Refer to the original model card for more details.

🚀 Quick Start

Use with llama.cpp

git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp

# install
make

# run generation
./main -m granite-34b-code-instruct-8k-GGUF/granite-34b-code-instruct.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color

📚 Documentation

Model Information

Property	Details
Pipeline Tag	text-generation
Base Model	ibm-granite/granite-34b-code-base-8k
Inference	false
Library Name	transformers
Tags	code, granite

Datasets

bigcode/commitpackft
TIGER-Lab/MathInstruct
meta-math/MetaMathQA
glaiveai/glaive-code-assistant-v3
glaive-function-calling-v2
bugdaryan/sql-create-context-instruction
garage-bAInd/Open-Platypus
nvidia/HelpSteer

Metrics

code_eval

Model Index

The model granite-34b-code-instruct-8k has the following results on various tasks:

Task	Dataset	Metrics (pass@1)
Text Generation (Synthesis - Python)	bigcode/humanevalpack (HumanEvalSynthesis(Python))	62.2
Text Generation (Synthesis - JavaScript)	bigcode/humanevalpack (HumanEvalSynthesis(JavaScript))	56.7
Text Generation (Synthesis - Java)	bigcode/humanevalpack (HumanEvalSynthesis(Java))	62.8
Text Generation (Synthesis - Go)	bigcode/humanevalpack (HumanEvalSynthesis(Go))	47.6
Text Generation (Synthesis - C++)	bigcode/humanevalpack (HumanEvalSynthesis(C++))	57.9
Text Generation (Synthesis - Rust)	bigcode/humanevalpack (HumanEvalSynthesis(Rust))	41.5
Text Generation (Explain - Python)	bigcode/humanevalpack (HumanEvalExplain(Python))	53.0
Text Generation (Explain - JavaScript)	bigcode/humanevalpack (HumanEvalExplain(JavaScript))	45.1
Text Generation (Explain - Java)	bigcode/humanevalpack (HumanEvalExplain(Java))	50.6
Text Generation (Explain - Go)	bigcode/humanevalpack (HumanEvalExplain(Go))	36.0
Text Generation (Explain - C++)	bigcode/humanevalpack (HumanEvalExplain(C++))	42.7
Text Generation (Explain - Rust)	bigcode/humanevalpack (HumanEvalExplain(Rust))	23.8
Text Generation (Fix - Python)	bigcode/humanevalpack (HumanEvalFix(Python))	54.9
Text Generation (Fix - JavaScript)	bigcode/humanevalpack (HumanEvalFix(JavaScript))	47.6
Text Generation (Fix - Java)	bigcode/humanevalpack (HumanEvalFix(Java))	55.5
Text Generation (Fix - Go)	bigcode/humanevalpack (HumanEvalFix(Go))	51.2
Text Generation (Fix - C++)	bigcode/humanevalpack (HumanEvalFix(C++))	47.0
Text Generation (Fix - Rust)	bigcode/humanevalpack (HumanEvalFix(Rust))	45.1

📄 License

This model is released under the apache-2.0 license.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご