Tiny Llama Miniguanaco 1.5T

🚀 TinyLlama 1.5T Checkpoint

TinyLlama 1.5T checkpoint trained to answer questions.

🚀 Quick Start

The TinyLlama 1.5T checkpoint is designed to answer questions. There's no special formatting required. Simply present a question, then start the answer on a new line.

💻 Usage Examples

Basic Usage

f"{'prompt'}\n{'completion'}\n<END>"

Advanced Usage

from transformers import pipeline, AutoTokenizer, AutoModelForCausalLM

pipe = pipeline("text-generation", model="Corianas/tiny-llama-miniguanaco-1.5T")# Load model directly

tokenizer = AutoTokenizer.from_pretrained("Corianas/tiny-llama-miniguanaco-1.5T")
model = AutoModelForCausalLM.from_pretrained("Corianas/tiny-llama-miniguanaco-1.5T")

# Run text generation pipeline with our next model
prompt = "What is a large language model?"
pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=500)
result = pipe(f"<s>{prompt}")
print(result[0]['generated_text'])

The result will contain the answer, ending with <END> on a new line.

📄 License

This project is licensed under the apache-2.0 license.

📦 Information