NEWVectors or files. Pick a path.Start →
    Models/Speech & Audio/mistralai/Voxtral-Mini-4B-Realtime-2602
    HFTranscriptionapache-2.0

    Voxtral-Mini-4B-Realtime-2602

    by mistralai

    Open-source realtime streaming speech-to-text with sub-500ms latency across 13 languages

    2.4Mdl/month
    952likes
    4.4Bparams
    Identifiers
    Model ID
    mistralai/Voxtral-Mini-4B-Realtime-2602
    Feature URI
    mixpeek://transcription@v1/mistral_voxtral_mini_4b_v1

    Deploy Voxtral-Mini-4B-Realtime-2602

    Single-tenant

    Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

    Overview

    Voxtral Mini 4B Realtime is among the first open-source speech models to achieve offline-comparable accuracy with sub-500ms latency. Its natively streaming architecture pairs a causal audio encoder (~0.6B params) with a Ministral-3-based LLM decoder (~3.4B params), both using sliding window attention for constant-memory streaming inference.

    On Mixpeek, Voxtral powers realtime and near-realtime transcription of audio and video content across 13 languages, with configurable latency from 240ms to 2.4s to balance speed against accuracy for live subtitling or batch processing.

    Architecture

    Two-component streaming architecture: (1) causal transformer audio encoder (0.6B params, 32 layers, causal attention) and (2) Ministral-3-based LLM decoder (3.4B params, 26 layers). Both use sliding window attention for streaming. Configurable transcription delay from 240ms to 2.4s.

    How it runs

    Inference INPUT MODEL OUTPUT Audio object Voxtral-Mini-4B-Realtime-2602 mp.inference Transcript vector Vector store MVS Voxtral-Mini-4B-Realtime-2602 → embeddings, indexed for search
    Voxtral-Mini-4B-Realtime-2602 takes audio, and Mixpeek indexes what it emits.

    Mixpeek SDK Integration

    // No extractor parameter takes a Hugging Face model id (checked against
    // GET /v1/discovery/extractors, which returns 13), so Voxtral-Mini-4B-Realtime-2602 runs
    // on your side and the output is upserted through POST
    // /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
    // path is to upload the weights instead: POST /v1/namespaces/{id}/models
    // accepts the huggingface format and a custom plugin loads them.
    const res = await fetch(
      "https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
      {
        method: "POST",
        headers: {
          Authorization: "Bearer API_KEY",
          "Content-Type": "application/json",
        },
        body: JSON.stringify({
          collection_id: "col_your_collection",
          documents: [
            {
              document_id: "asset-00412",
              // The model produces text, so it lands in payload. Give the
              // collection a text vector index and embed that text to make it
              // searchable rather than only filterable.
              payload: { extracted_text: modelOutput, source_key: "archive/2026/asset-00412" },
              vectors: { "text-embedding": embeddingOfModelOutput },
            },
          ],
        }),
      },
    );
    
    // Managed alternative, if this exact model is not the requirement:
    // universal_extractor@v1 runs google/gemini-embedding-2
    // (3072-d) over a bucket, with no inference of your own.

    Capabilities

    • Realtime streaming transcription with <500ms latency
    • 13 language support including English, Spanish, French, German
    • Configurable latency/accuracy tradeoff (240ms-2.4s delay)
    • Natively streaming architecture (no chunking workarounds)
    • Apache 2.0 open-source

    Use Cases on Mixpeek

    Live subtitling and closed captioning for video streams
    Voice assistant transcription with low-latency requirements
    Multilingual meeting transcription with realtime output

    Benchmarks

    DatasetMetricScoreSource
    FLEURS (13 languages, 480ms)Average WER8.72%Mistral AI, Feb 2026: Voxtral Realtime paper
    FLEURS English (480ms)WER4.90%Mistral AI, Feb 2026: Voxtral Realtime paper
    FLEURS (13 languages, 2.4s)Average WER6.73%Mistral AI, Feb 2026: Voxtral Realtime paper

    Performance

    Input SizeStreaming audio (16kHz)
    GPU Latency240ms-2.4s configurable delay (A100)
    GPU ThroughputRealtime factor >1x (streaming)
    GPU Memory~8.5 GB

    Specification

    FrameworkHF
    Organizationmistralai
    FeatureTranscription
    Outputtext + timestamps
    Modalitiesvideo, audio
    RetrieverTranscript Search
    Parameters4.4B
    Licenseapache-2.0
    Downloads/mo2.4M
    Likes952

    Research Paper

    Voxtral Realtime

    arxiv.org

    Build a pipeline with Voxtral-Mini-4B-Realtime-2602

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free