Teapotai Teapotllm Onnx

🚀 TeapotAI TeapotLLM ONNX

The ONNX version of teapotai/teapotllm for use with Transformers.js. It also includes a JavaScript version of the teapotai python package to interact with the model via the Transformers.js library.

🚀 Quick Start

The ONNX version of teapotai/teapotllm can be used in conjunction with Transformers.js. There's also a JavaScript version of the teapotai python package for interacting with the model using the Transformers.js library. You can view the example script index.js.

Check the WebGPU ONNX Playground.

📦 Installation

yarn install

💻 Usage Examples

Basic Usage

This library provides a TeapotAI class that helps you interact with language models. Here's a basic example:

import TeapotAI from './TeapotAI.js';

const ai = new TeapotAI({
  pipelineOptions: {
    dtype: 'q4'
  }
});

// Query with context
const response = await ai.query(
  "What is the capital?",
  "France is a country in Western Europe."
);

📄 License

This project is licensed under the MIT license.