Mahamarathi 7B V24.01 Base

🚀 MahaMarathi 7B

MahaMarathi 7B is a domain - adapted, continually pre - trained, and instruction fine - tuned native Marathi large language model (LLM) with 7 billion parameters. It is based on Llama2 + Mistral and trained on a large corpus of Marathi text. This AI - based technology is designed for over 83 lakh local speakers and can easily handle complex Marathi conversations and instructions. The released model is a base model and is not intended for direct use. It is recommended to first fine - tune it on downstream tasks that you are interested in.

🚀 Quick Start

The released model is a base model and not meant to be used as is. It is recommended to first finetune it on downstream tasks that you are interested in.

💻 Usage Examples

Basic Usage

# Usage
import torch
from transformers import LlamaTokenizer, LlamaForCausalLM

tokenizer = LlamaTokenizer.from_pretrained('marathi-llm/MahaMarathi-7B-v24.01-Base')
model = LlamaForCausalLM.from_pretrained('marathi-llm/MahaMarathi-7B-v24.01-Base', torch_dtype=torch.bfloat16)

prompt = "मी एक ए. आय. द्वारा तयार केलेले महाभाषा समीकरण संच आहे."
inputs = tokenizer(prompt, return_tensors="pt")

# Generate
generate_ids = model.generate(inputs.input_ids, max_length=30)
tokenizer.batch_decode(generate_ids, skip_special_tokens=True, clean_up_tokenization_spaces=False)[0]

Examples Display

Example 1	Example 2

📄 License

This project is licensed under the MIT License.