Semantic Join
Bridge extracted content features with business reference data. Join video clips to product catalogs, detected faces to employee directories, or documents to compliance frameworks-all via embedding similarity.
"Find marketing videos featuring products from our electronics catalog with matched SKUs"
Why This Matters
Better search isn't about better embeddings-it's about connecting extracted content to existing business systems. Query by product taxonomy, not embedding distance.
import requestsAPI_URL = "https://api.mixpeek.com"headers = {"Authorization": "Bearer YOUR_API_KEY", "X-Namespace": "your-namespace"}# Create taxonomy to join video content with product catalogtaxonomy = requests.post(f"{API_URL}/v1/taxonomies", headers=headers, json={"taxonomy_name": "product_matcher","taxonomy_type": "flat","retriever_id": "ret_product_search","input_mappings": {"query_embedding": "mixpeek://multimodal_extractor@v1/embedding"},"source_collection": {"collection_id": "col_product_catalog","enrichment_fields": [{"field_path": "metadata.sku", "merge_mode": "enrich"},{"field_path": "metadata.category", "merge_mode": "enrich"}]}}).json()# Apply taxonomy to video collection (semantic join)requests.post(f"{API_URL}/v1/collections/col_marketing_videos/apply-taxonomy",headers=headers,json={"taxonomy_id": taxonomy["taxonomy_id"]})# Search videos - results now include matched product dataresults = requests.post(f"{API_URL}/v1/retrievers/video-search/execute",headers=headers,json={"query": {"text": "product demos"}}).json()for doc in results["documents"]:print(f"Video: {doc['document_id']}")print(f" Matched SKU: {doc.get('metadata.sku', 'N/A')}")print(f" Category: {doc.get('metadata.category', 'N/A')}")
Feature Extractors
Video Embedding
Generate vector embeddings for video content
Retriever Stages
feature search
Search and filter documents by vector similarity using feature embeddings
attribute filter
Filter documents by metadata attribute values using boolean logic
Related Blog Posts
Documentation
Related Recipes & Resources
Explore these related resources to deepen your understanding and discover more powerful features
Video Embedding
Generate vector embeddings for video content
Video Embedding
Dense vector representations of video content
Face Embedding
Vector representations of facial identity features
Image Embedding
Dense vector representations of image content
Multimodal RAG
Retrieval-augmented generation across video, images, and text. Retrieve relevant multimodal context, then pass to your LLM with citations back to source timestamps and frames.
Semantic Multimodal Search
Unified semantic search across all content types. Query by natural language and retrieve relevant video clips, images, audio segments, and documents based on meaning-not keywords or manual tags.