# Attention Distillation

X2I is a multimodal diffusion Transformer model capable of converting various input modalities (text, images, videos, audio, speech) into image outputs.

DeiT is a more efficiently trained Vision Transformer model, pre-trained and fine-tuned on the ImageNet-1k dataset at 224x224 resolution, suitable for image classification tasks.