NEWVectors or files. Pick a path.Start →
    Models/Speech & Audio/mistralai/Voxtral-Mini-4B-Realtime-2602
    HFTranscriptionapache-2.0

    Voxtral-Mini-4B-Realtime-2602

    by mistralai

    Open-source realtime streaming speech-to-text with sub-500ms latency across 13 languages

    2.4Mdl/month
    952likes
    4.4Bparams
    Identifiers
    Model ID
    mistralai/Voxtral-Mini-4B-Realtime-2602
    Feature URI
    mixpeek://transcription@v1/mistral_voxtral_mini_4b_v1

    Deploy Voxtral-Mini-4B-Realtime-2602

    Single-tenant

    Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

    Overview

    Voxtral Mini 4B Realtime is among the first open-source speech models to achieve offline-comparable accuracy with sub-500ms latency. Its natively streaming architecture pairs a causal audio encoder (~0.6B params) with a Ministral-3-based LLM decoder (~3.4B params), both using sliding window attention for constant-memory streaming inference.

    On Mixpeek, Voxtral powers realtime and near-realtime transcription of audio and video content across 13 languages, with configurable latency from 240ms to 2.4s to balance speed against accuracy for live subtitling or batch processing.

    Architecture

    Two-component streaming architecture: (1) causal transformer audio encoder (0.6B params, 32 layers, causal attention) and (2) Ministral-3-based LLM decoder (3.4B params, 26 layers). Both use sliding window attention for streaming. Configurable transcription delay from 240ms to 2.4s.

    Mixpeek SDK Integration

    // No extractor parameter takes a Hugging Face model id (checked against
    // GET /v1/discovery/extractors, which returns 13), so Voxtral-Mini-4B-Realtime-2602 runs
    // on your side and the output is upserted through POST
    // /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
    // path is to upload the weights instead: POST /v1/namespaces/{id}/models
    // accepts the huggingface format and a custom plugin loads them.
    const res = await fetch(
      "https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
      {
        method: "POST",
        headers: {
          Authorization: "Bearer API_KEY",
          "Content-Type": "application/json",
        },
        body: JSON.stringify({
          collection_id: "col_your_collection",
          documents: [
            {
              document_id: "asset-00412",
              // The model produces text, so it lands in payload. Give the
              // collection a text vector index and embed that text to make it
              // searchable rather than only filterable.
              payload: { extracted_text: modelOutput, source_key: "archive/2026/asset-00412" },
              vectors: { "text-embedding": embeddingOfModelOutput },
            },
          ],
        }),
      },
    );
    
    // Managed alternative, if this exact model is not the requirement:
    // universal_extractor@v1 runs google/gemini-embedding-2
    // (3072-d) over a bucket, with no inference of your own.

    Capabilities

    • Realtime streaming transcription with <500ms latency
    • 13 language support including English, Spanish, French, German
    • Configurable latency/accuracy tradeoff (240ms-2.4s delay)
    • Natively streaming architecture (no chunking workarounds)
    • Apache 2.0 open-source

    Use Cases on Mixpeek

    Live subtitling and closed captioning for video streams
    Voice assistant transcription with low-latency requirements
    Multilingual meeting transcription with realtime output

    Benchmarks

    DatasetMetricScoreSource
    FLEURS (13 languages, 480ms)Average WER8.72%Mistral AI, Feb 2026: Voxtral Realtime paper
    FLEURS English (480ms)WER4.90%Mistral AI, Feb 2026: Voxtral Realtime paper
    FLEURS (13 languages, 2.4s)Average WER6.73%Mistral AI, Feb 2026: Voxtral Realtime paper

    Performance

    Input SizeStreaming audio (16kHz)
    GPU Latency240ms-2.4s configurable delay (A100)
    GPU ThroughputRealtime factor >1x (streaming)
    GPU Memory~8.5 GB

    Specification

    FrameworkHF
    Organizationmistralai
    FeatureTranscription
    Outputtext + timestamps
    Modalitiesvideo, audio
    RetrieverTranscript Search
    Parameters4.4B
    Licenseapache-2.0
    Downloads/mo2.4M
    Likes952

    Research Paper

    Voxtral Realtime

    arxiv.org

    Build a pipeline with Voxtral-Mini-4B-Realtime-2602

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free