VibeVoice-ASR-HF

by microsoft

Unified ASR + diarization + timestamps in one 9B model — 60 min single-pass

295Kdl/month

9Bparams

HuggingFace Use in Pipeline

Identifiers

Model ID

microsoft/VibeVoice-ASR-HF

Feature URI

mixpeek://transcription@v1/microsoft_vibevoice_asr_v1

Overview

VibeVoice-ASR is Microsoft's unified speech recognition model that produces structured rich transcriptions — speaker labels, word-level timestamps, and content — from up to 60 minutes of audio in a single forward pass. It replaces the traditional pipeline of separate ASR, diarization, and alignment models with one 9B parameter model.

Supporting 50+ languages with native code-switching (no language flag required), it handles meetings, interviews, podcasts, and call center recordings where knowing who said what matters as much as what was said. On Mixpeek, it powers speaker-attributed transcription for video and audio assets.

Architecture

Encoder-decoder transformer (9B parameters) with multi-task training for simultaneous ASR, speaker diarization, and timestamp alignment. Processes up to 60 minutes of audio in a single pass without sliding window chunking.

Mixpeek SDK Integration

import { Mixpeek } from "mixpeek";

const mx = new Mixpeek({ apiKey: "API_KEY" });

await mx.collections.ingest({
  collection_id: "my-collection",
  source: { url: "https://example.com/meeting.mp4" },
  feature_extractors: [{
    name: "transcription",
    version: "v1",
    params: {
      model_id: "microsoft/VibeVoice-ASR-HF",
      enable_diarization: true
    }
  }]
});