Diffullama Open-Source Diffusion Language Model - Achieve Diverse Text Applications Based on Llama-2-7b Fine-Tuning

Diffullama

Developed by diffusionfamily

Diffusion language model fine-tuned based on Llama-2-7b

Downloads 10.88k

Release Time : 10/21/2024

Model Overview

diffullama is a diffusion language model fine-tuned on Llama-2-7b, primarily used for text generation tasks.

Diffusion Language Model

Extends diffusion language models through autoregressive model adaptation, enhancing text generation capabilities

Efficient Fine-tuning

Efficiently fine-tuned based on Llama-2-7b, preserving the original model's advantages

Text Generation

Language Modeling

Text Generation

Creative Writing

Used for generating creative textual content

Code Generation

Generates code based on the code content in the training data

Property	Details
Library Name	transformers
Base Model	meta - llama/Llama - 2 - 7b - hf
Tags	llama - factory, full, diffusion
Model Name	diffullama
Datasets	bigcode/starcoderdata, cerebras/SlimPajama - 627B

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base