whisper-large-v3

by openai

Robust speech recognition trained on 680K hours of multilingual audio

6.1Mdl/month

5,445likes

1.55Bparams

HuggingFace Use in Pipeline

Identifiers

Model ID

openai/whisper-large-v3

Feature URI

mixpeek://transcription@v1/openai_whisper_large_v3

Overview

Whisper is a general-purpose speech recognition model trained on a massive dataset of diverse audio. It supports multilingual transcription, translation, and language identification. The large-v3 variant achieves near-human accuracy on many benchmarks.

On Mixpeek, Whisper powers audio transcription for video and audio content, generating timestamped text that enables full-text search across spoken content.

Architecture

Encoder-decoder Transformer with 32 encoder layers and 32 decoder layers. Processes 30-second audio segments as 80-channel log-mel spectrograms. Uses multi-task training format with special tokens for timestamps, language, and task type.

Mixpeek SDK Integration

import { Mixpeek } from "mixpeek";

const mx = new Mixpeek({ apiKey: "API_KEY" });

await mx.collections.ingest({
  collection_id: "my-collection",
  source: { url: "https://example.com/video.mp4" },
  feature_extractors: [{
    name: "audio_transcription",
    version: "v1",
    params: {
      model_id: "openai/whisper-large-v3"
    }
  }]
});