# Efficient Small Model

Falcon-H1 is an efficient hybrid architecture language model developed by TII, combining Transformer and Mamba architectures to support multilingual tasks

TinyLLaVA is a compact large-scale multimodal model framework focused on vision-language tasks, featuring small parameter size yet excellent performance.

Rocket-3B is a 3-billion-parameter large language model trained on public datasets through Direct Preference Optimization (DPO), outperforming many larger-scale models.

Italian news summarization model based on IT5 Efficient Small EL32 architecture, fine-tuned on Fanpage and Il Post datasets

An efficient small neural language model benchmarking platform designed for single-GPU training