Clip Vit Base Patch32

🚀 ONNX-compatible CLIP-ViT-Base-Patch32 for Transformers.js

This project provides ONNX weights for the openai/clip-vit-base-patch32 model, making it compatible with the Transformers.js library.

🚀 Quick Start

This repository contains the ONNX weights of the openai/clip-vit-base-patch32 model from Hugging Face, which are designed to be compatible with the Transformers.js library.

📦 Installation

If you haven't already, you can install the Transformers.js JavaScript library from NPM using the following command:

npm i @huggingface/transformers

💻 Usage Examples

Basic Usage

Perform zero-shot image classification with the pipeline API.

import { pipeline } from '@huggingface/transformers';

const classifier = await pipeline('zero-shot-image-classification', 'Xenova/clip-vit-base-patch32');
const url = 'https://huggingface.co/datasets/Xenova/transformers.js-docs/resolve/main/tiger.jpg';
const output = await classifier(url, ['tiger', 'horse', 'dog']);
// [
//   { score: 0.9993917942047119, label: 'tiger' },
//   { score: 0.0003519294841680676, label: 'horse' },
//   { score: 0.0002562698791734874, label: 'dog' }
// ]

⚠️ Important Note

Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).