AudioEmbeddingsConverter
Convert audio files into dense vector embeddings that capture spoken content, tone, and acoustic features. Use embeddings for audio search, speaker verification, and content-based recommendation.
How It Works
Upload an audio file or provide a URL.
Audio is segmented into fixed or variable-length chunks.
Each chunk is processed through an audio embedding model.
Embeddings are returned as float arrays with timestamps.
Optionally, embeddings are stored in your Mixpeek namespace.
Code Examples
import os, requests
API = "https://api.mixpeek.com"
H = {"Authorization": f"Bearer {os.environ['MIXPEEK_API_KEY']}",
"X-Namespace": os.environ["NAMESPACE_ID"]}
# 1. a bucket, with a schema that declares the field you will send
bucket = requests.post(f"{API}/v1/buckets", headers=H, json={
"bucket_name": "audio-inputs",
"bucket_schema": {"properties": {"audio": {"type": "audio"}}},
}).json()
# 2. land the file as an object. the URL goes in data, on the blob
requests.post(f"{API}/v1/buckets/{bucket['bucket_id']}/objects", headers=H, json={
"key_prefix": "run-1",
"blobs": [{"property": "audio", "type": "audio",
"data": "https://example.com/call.mp3"}],
})
# 3. a collection over that bucket, running the extractor
collection = requests.post(f"{API}/v1/collections", headers=H, json={
"collection_name": "audio-to-embeddings",
"source": {"type": "bucket", "bucket_ids": [bucket["bucket_id"]]},
"feature_extractor": {"feature_extractor_name": "multimodal_extractor", "version": "v1"},
}).json()
# 4. run extraction over the bucket
requests.post(f"{API}/v1/buckets/{bucket['bucket_id']}/batches", headers=H, json={
"collection_ids": [collection["collection_id"]],
"auto_submit": True,
})
# 5. read the output
docs = requests.get(
f"{API}/v1/collections/{collection['collection_id']}/documents", headers=H
).json()
print(docs)Use Cases
Supported Input Formats
Quick Info
Run it over a library
Mixpeek runs this conversion as a pipeline over a whole library in your object storage, with the output landing as queryable documents. It is not a single-file converter.
Frequently Asked Questions
Related Converters
Video to Embeddings
Generate dense vector embeddings for video content using multimodal models. Embeddings capture visual, audio, and temporal features, enabling semantic search and similarity matching across video collections.
Audio to Text
Transcribe audio files into text with high accuracy. Supports speaker diarization, punctuation restoration, timestamps, and over 50 languages. Handles podcasts, calls, meetings, and broadcast audio.
Audio to Summary
Generate concise summaries from audio recordings by transcribing speech and synthesizing key points. Supports meeting minutes, podcast summaries, and interview highlights with configurable length and format.
Text to Embeddings
Convert text strings, paragraphs, or documents into dense vector embeddings using state-of-the-art language models. Supports batching, chunking, and multiple model options for optimal retrieval performance.
Ready to convert audio to embeddings?
Start using the Mixpeek Audio to Embeddings in minutes. Sign up for a free API key and follow the documentation to get started.