Cvt 21 384

🚀 Convolutional Vision Transformer (CvT)

The CvT-21 model is pre-trained on ImageNet-1k at a resolution of 384x384. It offers a novel approach by integrating convolutions into vision transformers, enhancing image classification capabilities.

🚀 Quick Start

The CvT-21 model was introduced in the paper CvT: Introducing Convolutions to Vision Transformers by Wu et al. and first released in this repository.

Disclaimer: The team releasing CvT did not write a model card for this model, so this model card has been written by the Hugging Face team.

💻 Usage Examples

Basic Usage

from transformers import AutoFeatureExtractor, CvtForImageClassification
from PIL import Image
import requests

url = 'http://images.cocodataset.org/val2017/000000039769.jpg'
image = Image.open(requests.get(url, stream=True).raw)

feature_extractor = AutoFeatureExtractor.from_pretrained('microsoft/cvt-21-384')
model = CvtForImageClassification.from_pretrained('microsoft/cvt-21-384')

inputs = feature_extractor(images=image, return_tensors="pt")
outputs = model(**inputs)
logits = outputs.logits
# model predicts one of the 1000 ImageNet classes
predicted_class_idx = logits.argmax(-1).item()
print("Predicted class:", model.config.id2label[predicted_class_idx])

⚠️ Important Note

The model card is written by the Hugging Face team as the original releasing team did not provide one.

📄 License

This project is licensed under the Apache-2.0 license.