Whisper Tiny.en

🚀 Whisper

Whisper是一個語音識別模型，本項目使用 openai/whisper-tiny.en 的ONNX權重，以兼容 Transformers.js，可用於在Web環境中進行英文語音轉錄。

🚀 快速開始

本項目使用 openai/whisper-tiny.en 的ONNX權重，以兼容 Transformers.js。

💻 使用示例

基礎用法

以下示例展示瞭如何使用該模型進行英文語音轉錄：

// npm i @xenova/transformers
import { pipeline } from '@xenova/transformers';

let url = 'https://huggingface.co/datasets/Xenova/transformers.js-docs/resolve/main/jfk.wav';

// Create translation pipeline
let transcriber = await pipeline('automatic-speech-recognition', 'Xenova/whisper-tiny.en');
let output = await transcriber(url);
// { text: " And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }

高級用法

帶時間戳轉錄

以下示例展示瞭如何在轉錄結果中包含時間戳：

// npm i @xenova/transformers
import { pipeline } from '@xenova/transformers';

let url = 'https://huggingface.co/datasets/Xenova/transformers.js-docs/resolve/main/jfk.wav';

// Create translation pipeline
let transcriber = await pipeline('automatic-speech-recognition', 'Xenova/whisper-tiny.en');
let output = await transcriber(url, { return_timestamps: true });
// {
//   text: " And so my fellow Americans ask not what your country can do for you, ask what you can do for your country."
//   chunks: [
//     { timestamp: [0, 8],  text: " And so my fellow Americans ask not what your country can do for you" }
//     { timestamp: [8, 11], text: " ask what you can do for your country." }
//   ]
// }

帶單詞級時間戳轉錄

以下示例展示瞭如何在轉錄結果中包含單詞級別的時間戳：

// npm i @xenova/transformers
import { pipeline } from '@xenova/transformers';

let url = 'https://huggingface.co/datasets/Xenova/transformers.js-docs/resolve/main/jfk.wav';

// Create translation pipeline
let transcriber = await pipeline('automatic-speech-recognition', 'Xenova/whisper-tiny.en');
let output = await transcriber(url, { return_timestamps: 'word' });
// {
//   "text": " And so my fellow Americans ask not what your country can do for you ask what you can do for your country.",
//   "chunks": [
//     { "text": " And", "timestamp": [0, 0.78] },
//     { "text": " so", "timestamp": [0.78, 1.06] },
//     { "text": " my", "timestamp": [1.06, 1.46] },
//     ...
//     { "text": " for", "timestamp": [9.72, 9.92] },
//     { "text": " your", "timestamp": [9.92, 10.22] },
//     { "text": " country.", "timestamp": [10.22, 13.5] }
//   ]
// }

📚 詳細文檔

⚠️ 重要提示

為ONNX權重創建單獨的倉庫是一個臨時解決方案，直到WebML獲得更多關注。如果你想讓你的模型適用於Web環境，我們建議使用 🤗 Optimum 將其轉換為ONNX格式，並像本倉庫一樣組織你的倉庫結構（將ONNX權重放在名為 onnx 的子文件夾中）。

📦 模型信息