NEWVectors or files. Pick a path.Start →
    Models/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
    OpenMDW-1.1

    NVIDIA-Nemotron-3.5-Transcribe-30B-A4B

    by nvidia

    Open-weight speech model that transcribes hour-long recordings in 40 languages, with speakers and word timestamps

    34B total (4.3B active, MoE)params
    Identifiers
    Model ID
    nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B

    Deploy NVIDIA-Nemotron-3.5-Transcribe-30B-A4B

    Single-tenant

    Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

    Overview

    Nemotron 3.5 Transcribe is NVIDIA's open-weight offline speech and audio model, published on Hugging Face on 7 October 2026 under the OpenMDW-1.1 license, which NVIDIA marks as ready for commercial use. It takes a recording of up to one hour plus a text instruction and returns text: a verbatim or cleaned-up transcript, a transcript attributed by speaker, word timestamps, a translation, the spoken language, or an answer to a question about the audio. On NVIDIA's model card it posts a mean WER of 4.71 on the English Open ASR Leaderboard and 10.98 on its long-form sets, the best open-weight results it reports.

    Architecture

    Speech-Augmented Language Model: a Mamba-2 and Transformer hybrid Mixture-of-Experts language model fed by a Parallel Expert Encoder (a Transformer ASR encoder and a speaker encoder). 34B total parameters with about 4.3B active, audio encoder included. 65,536-token context, native multi-token prediction for speculative decoding, and a reasoning mode switched in the chat template. Released in BF16, FP8 and NVFP4.

    Mixpeek SDK Integration

    # Nemotron 3.5 Transcribe runs on your side (here behind vLLM with the NeMo Speech
    # plugin, one H100 80 GB per the model card). Its transcript is upserted into a
    # collection whose text vector index makes the recording searchable.
    import base64
    from openai import OpenAI
    import requests
    
    asr = OpenAI(base_url="http://127.0.0.1:8000/v1", api_key="EMPTY")
    audio = base64.b64encode(open("standup-2026-11-06.wav", "rb").read()).decode()
    transcript = asr.chat.completions.create(
        model="nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B",
        messages=[{"role": "user", "content": [
            {"type": "text", "text": "Audio transcription. Language: as spoken. Wording: omit fillers and accidental repetitions; keep the remaining spoken wording unchanged. Formatting: punctuation and capitalization. Output: transcript only."},
            {"type": "audio_url", "audio_url": {"url": f"data:audio/wav;base64,{audio}"}},
        ]}],
        temperature=0,
        extra_body={"chat_template_kwargs": {"enable_thinking": False}, "skip_special_tokens": False},
    ).choices[0].message.content
    
    requests.post(
        "https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
        headers={"Authorization": "Bearer API_KEY"},
        json={"collection_id": "col_your_collection",
              "documents": [{"document_id": "standup-2026-11-06",
                             "vectors": {"text-embedding": your_embedding_of(transcript)},
                             "payload": {"transcript": transcript, "source": "s3://recordings/standup-2026-11-06.wav"}}]},
    )

    Capabilities

    • Transcription in 40 languages, verbatim or as readable text, chosen by the instruction
    • Recordings up to one hour in a single request
    • Speaker-attributed transcripts and word timestamps
    • Speech translation, language identification and code-switching
    • Audio question answering with reasoning mode on

    Use Cases on Mixpeek

    Transcribing meeting, call and podcast archives so a text index can find the moment something was said
    Speaker-attributed transcripts of multi-person recordings for search by who said it
    Captions with word timestamps for a video library

    Benchmarks

    DatasetMetricScoreSource
    Open ASR Leaderboard, English (9 sets)Mean WER (lower is better)4.71NVIDIA model card, October 2026
    Open ASR Leaderboard, long-formMean WER (lower is better)10.98NVIDIA model card, October 2026
    Multilingual Open ASR Leaderboard (7 languages)Mean WER (lower is better)4.62NVIDIA model card, October 2026
    AMI, CALLHOME, Mixer 6, NOTSOFAR-1 full sessionsMean cpWER (lower is better)15.80NVIDIA model card, October 2026

    Specification

    Organizationnvidia
    Retriever-
    Parameters34B total (4.3B active, MoE)
    LicenseOpenMDW-1.1
    Downloads/moN/A

    Research Paper

    Model paper or technical report

    arxiv.org

    Build a pipeline with NVIDIA-Nemotron-3.5-Transcribe-30B-A4B

    Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

    Run it on your own data, free