Qaari 0.1 Urdu OCR VL 2B Instruct

🚀 Qaari 0.1 Urdu: OCR Model for Urdu Language

Qaari 0.1 Urdu is an OCR model specifically optimized for Urdu text, significantly outperforming the base model and traditional solutions.

🚀 Quick Start

You can try Qaari 0.1 Urdu on Google Colab: Try Qaari - Google Colab

Load this model using the transformers and qwen_vl_utils library:

!pip install transformers qwen_vl_utils accelerate>=0.26.0 PEFT -U
!pip install -U bitsandbytes

from PIL import Image
from transformers import Qwen2VLForConditionalGeneration, AutoProcessor
import torch
import os
from qwen_vl_utils import process_vision_info

model_name = "oddadmix/Qaari-0.1-Urdu-OCR-VL-2B-Instruct"
model = Qwen2VLForConditionalGeneration.from_pretrained(
                model_name,
                torch_dtype="auto",
                device_map="auto"
            )
processor = AutoProcessor.from_pretrained(model_name)
max_tokens = 2000

prompt = "Below is the image of one page of a document, as well as some raw textual content that was previously extracted for it. Just return the plain text representation of this document as if you were reading it naturally. Do not hallucinate."
image.save("image.png")

messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "image": f"file://{src}"},
            {"type": "text", "text": prompt},
        ],
    }
]
text = processor.apply_chat_template(
    messages, tokenize=False, add_generation_prompt=True
)
image_inputs, video_inputs = process_vision_info(messages)
inputs = processor(
    text=[text],
    images=image_inputs,
    videos=video_inputs,
    padding=True,
    return_tensors="pt",
)
inputs = inputs.to("cuda")
generated_ids = model.generate(**inputs, max_new_tokens=max_tokens)
generated_ids_trimmed = [
    out_ids[len(in_ids) :] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
]
output_text = processor.batch_decode(
    generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
)[0]
os.remove(src)
print(output_text)

✨ Features

• Specialized for Urdu OCR: Optimized for recognizing Urdu script with high accuracy
• Superior Performance: Achieves 97.35% reduction in Word Error Rate compared to the base model
• High Accuracy: 0.048 WER and 0.029 CER, with a BLEU score of 0.916
• Balanced Output Length: Near-perfect length ratio of 0.978 (ideal is 1.0)

📚 Documentation

Model Description

Qaari 0.1 Urdu is a fine-tuned version of Qwen/Qwen2-VL-2B specifically optimized for Optical Character Recognition (OCR) of Urdu text. It represents a significant advancement in Urdu language OCR capabilities, dramatically outperforming both the base model and traditional OCR solutions like Tesseract.

Performance Metrics

Improvement Percentages

Supported Fonts

The model was fine-tuned on the following fonts:

• AlQalam Taj Nastaleeq Regular
• Alvi Nastaleeq Regular
• Gandhara Suls Regular
• Jameel Noori Nastaleeq Regular
• NotoNastaliqUrdu-Regular

Supported Font Sizes

The model has been tested and optimized for the following font sizes:

• 14pt
• 16pt
• 18pt
• 20pt
• 24pt
• 32pt
• 40pt

Limitations

• Performance may degrade when using fonts not included in the fine-tuning dataset
• Font sizes outside the supported range may result in suboptimal rendering
• The model may not handle complex ligatures in non-Nastaleeq scripts effectively
• Performance on digital-only displays has not been fully optimized
• Low-resolution print environments might experience quality degradation
• Custom font modifications or non-standard Nastaleeq variants might not render as expected

Training Details

This model was fine-tuned from Qwen2-VL-2B using a dataset of Urdu text images with paired transcriptions. The training process focused on optimizing for accurate Urdu character recognition and natural language understanding.

Training Dataset

Training Configuration

Citation

If you use this model in your research, please cite:

@misc{qaari-0.1-urdu,
  author = {Ahmed Wasfy},
  title = {Qaari 0.1 Urdu: OCR Model for Urdu Language},
  year = {2025},
  publisher = {HuggingFace},
  howpublished = {\url{https://huggingface.co/oddadmix/Qaari-0.1-Urdu-OCR-VL-2B-Instruct}}
}

📄 License

This model is subject to the license terms of the base Qwen2-VL-2B model.