Your AI agent can read text. It cannot watch a video, scan a photo for faces, or search audio by what was said. Mixpeek is the infrastructure layer that gives agents access to video, images, audio, and documents through a single API.Documentation Index
Fetch the complete documentation index at: https://docs.mixpeek.com/docs/llms.txt
Use this file to discover all available pages before exploring further.
How It Works
Index
Upload video, images, audio, and documents to Buckets. Mixpeek runs feature extraction automatically — faces, objects, transcripts, embeddings, and structured metadata all get indexed into searchable Collections.
Search
Build retrieval pipelines that your agent calls. Semantic search, face search, object search, transcript search — chain them together into multi-stage Retrievers and expose them as a single endpoint.
Integrate
Wire Mixpeek into your agent as a LangChain tool, an MCP server, or a direct REST call. Your agent sends a query, gets structured results back, and acts on them.
Quickstart
Get Started
Index multimodal content and search it in under 10 minutes — LangChain, MCP, or REST
What Gets Extracted
| File Type | Extracted Features |
|---|---|
| Video | Face embeddings (ArcFace 512D), scene descriptions (Gemini), visual embeddings (Vertex AI 1408D), transcripts (Whisper), transcript embeddings (E5-Large 1024D), keyframes |
| Images | Visual embeddings (SigLIP 768D or Vertex AI 1408D), face embeddings (ArcFace 512D), OCR text, descriptions, structured extraction |
| Audio | Transcripts (Whisper), transcript embeddings (E5-Large 1024D), multimodal audio embeddings (Vertex AI 1408D) |
| Documents | Text chunks, text embeddings (E5-Large 1024D), OCR for scanned PDFs, structured extraction |
Key Concepts
- Namespaces isolate data between tenants, environments, or projects. Every API request includes a namespace header.
- Buckets hold your raw files. Upload once, process many ways.
- Collections define what gets extracted. Each collection runs a feature extractor (CLIP, Whisper, LayoutLM, etc.) against objects in a bucket.
- Retrievers are search pipelines you configure in JSON. Chain stages together — vector search, face matching, filters, re-ranking — and expose the result as one endpoint your agent calls.
Next Steps
Core Concepts
Understand namespaces, buckets, collections, and retrievers in depth
Data Model
See how namespaces, buckets, collections, objects, and features fit together
Feature Extractors
Learn what each extractor does and how to configure it
Tutorials
Step-by-step guides for common use cases