Backward Cosmos Gpt2 V1

🚀 Backward GPT-2 Model

A GPT-2 model fine-tuned for backward generation (answers → questions) in Turkish.

🚀 Quick Start

This is a GPT-2 model that has been fine - tuned for backward generation in Turkish, converting answers into questions.

✨ Features

• Backward Generation: Specifically designed for backward generation from answers to questions in Turkish.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

tokenizer = AutoTokenizer.from_pretrained("ytu-ce-cosmos/backward-cosmos-gpt2-v1", trust_remote_code=True)
tokenizer.pad_token = tokenizer.eos_token
model = AutoModelForCausalLM.from_pretrained("ytu-ce-cosmos/backward-cosmos-gpt2-v1")

# Turkish answer
answer = "İstanbul, Türkiye'nin en kalabalık şehridir ve tarihi, kültürel zenginliği ile ünlüdür."
prompt = f"\n### Response:\n{answer}"
inputs = tokenizer(prompt, return_tensors="pt")

outputs = model.generate(
    **inputs,
    max_new_tokens=40,
    temperature=1.4,
    top_p=0.95,
    top_k=20,
    repetition_penalty=1.5,
    eos_token_id=[36320, tokenizer.eos_token_id],
    pad_token_id=tokenizer.eos_token_id
)

generated_tokens = outputs[0][inputs.input_ids.shape[1]:]
reversed_tokens = generated_tokens.flip(dims=[0])
generated_text = tokenizer.decode(reversed_tokens, skip_special_tokens=True)

parts = generated_text.split("### Input:")
instruction = parts[0].replace("### Instruction:", "").strip()
input_text = parts[1].strip() if len(parts) > 1 else None

Advanced Usage

The basic usage example already demonstrates a relatively complete process. For more advanced usage, you can adjust the generation parameters according to your specific needs.

📚 Documentation

Input Format

### Response:
[answer text in Turkish]

Output Format

Generated text must be reversed to obtain:

### Instruction:
[instruction text in Turkish]
### Input:
[optional input text in Turkish]

Generation Parameters