Llava MORE Llama 3 1 8B Finetuning

🚀 Model Card: LLaVA_MORE-llama_3_1-8B-finetuning

LLaVA-MORE enhances the LLaVA architecture by integrating LLaMA 3.1 as the language model, and publicly releases the 8B parameter model's stage one and two checkpoints.

📦 Installation

🚀 Quick Start

LLaVA-MORE enhances the well-known LLaVA architecture by integrating the use of LLaMA 3.1 as the language model. We are publicly releasing the checkpoints for stages one and two for the first model with 8B parameters.

In this model space, you will find the stage two (finetuning) weights of LLaVA-MORE LLaMA 3.1 8B, as described in this paper.

For more information, visit our LLaVA-MORE repository.

💻 Usage Examples

Basic Usage

You can try our LLaVA-MORE in the Image-To-Text task by cloning our repository and running the following script.

python -u llava/eval/run_llava.py

📄 License

This project is licensed under the apache-2.0 license.

📚 Documentation

If you make use of our work, please cite our repo:

@article{cocchi2025llava,
      title={{LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning}},
      author={Cocchi, Federico and Moratelli, Nicholas and Caffagni, Davide and Sarto, Sara and Baraldi, Lorenzo and Cornia, Marcella and Cucchiara, Rita},
      journal={arXiv preprint arXiv:2503.15621},
      year={2025}
}