NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
by nvidia
Open-weight speech model that transcribes hour-long recordings in 40 languages, with speakers and word timestamps
nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4BDeploy NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Single-tenantMixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.
Overview
Nemotron 3.5 Transcribe is NVIDIA's open-weight offline speech and audio model, published on Hugging Face on 7 October 2026 under the OpenMDW-1.1 license, which NVIDIA marks as ready for commercial use. It takes a recording of up to one hour plus a text instruction and returns text: a verbatim or cleaned-up transcript, a transcript attributed by speaker, word timestamps, a translation, the spoken language, or an answer to a question about the audio. On NVIDIA's model card it posts a mean WER of 4.71 on the English Open ASR Leaderboard and 10.98 on its long-form sets, the best open-weight results it reports.
Architecture
Speech-Augmented Language Model: a Mamba-2 and Transformer hybrid Mixture-of-Experts language model fed by a Parallel Expert Encoder (a Transformer ASR encoder and a speaker encoder). 34B total parameters with about 4.3B active, audio encoder included. 65,536-token context, native multi-token prediction for speculative decoding, and a reasoning mode switched in the chat template. Released in BF16, FP8 and NVFP4.
Mixpeek SDK Integration
# Nemotron 3.5 Transcribe runs on your side (here behind vLLM with the NeMo Speech
# plugin, one H100 80 GB per the model card). Its transcript is upserted into a
# collection whose text vector index makes the recording searchable.
import base64
from openai import OpenAI
import requests
asr = OpenAI(base_url="http://127.0.0.1:8000/v1", api_key="EMPTY")
audio = base64.b64encode(open("standup-2026-11-06.wav", "rb").read()).decode()
transcript = asr.chat.completions.create(
model="nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B",
messages=[{"role": "user", "content": [
{"type": "text", "text": "Audio transcription. Language: as spoken. Wording: omit fillers and accidental repetitions; keep the remaining spoken wording unchanged. Formatting: punctuation and capitalization. Output: transcript only."},
{"type": "audio_url", "audio_url": {"url": f"data:audio/wav;base64,{audio}"}},
]}],
temperature=0,
extra_body={"chat_template_kwargs": {"enable_thinking": False}, "skip_special_tokens": False},
).choices[0].message.content
requests.post(
"https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
headers={"Authorization": "Bearer API_KEY"},
json={"collection_id": "col_your_collection",
"documents": [{"document_id": "standup-2026-11-06",
"vectors": {"text-embedding": your_embedding_of(transcript)},
"payload": {"transcript": transcript, "source": "s3://recordings/standup-2026-11-06.wav"}}]},
)Capabilities
- Transcription in 40 languages, verbatim or as readable text, chosen by the instruction
- Recordings up to one hour in a single request
- Speaker-attributed transcripts and word timestamps
- Speech translation, language identification and code-switching
- Audio question answering with reasoning mode on
Use Cases on Mixpeek
Benchmarks
| Dataset | Metric | Score | Source |
|---|---|---|---|
| Open ASR Leaderboard, English (9 sets) | Mean WER (lower is better) | 4.71 | NVIDIA model card, October 2026 |
| Open ASR Leaderboard, long-form | Mean WER (lower is better) | 10.98 | NVIDIA model card, October 2026 |
| Multilingual Open ASR Leaderboard (7 languages) | Mean WER (lower is better) | 4.62 | NVIDIA model card, October 2026 |
| AMI, CALLHOME, Mixer 6, NOTSOFAR-1 full sessions | Mean cpWER (lower is better) | 15.80 | NVIDIA model card, October 2026 |
Common Pipeline Companions
Specification
Research Paper
Model paper or technical report
arxiv.orgBuild a pipeline with NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.
Run it on your own data, free