Visual Similarity Search
Unified visual similarity search across both images and video frames. Query with a photo, screenshot, or frame to discover visually related content regardless of format, with MMR diversification to ensure variety in results.
from mixpeek import Mixpeekclient = Mixpeek(api_key="YOUR_API_KEY")# Create collections for images and videosimage_col = client.collections.create(namespace_id="ns_your_namespace",name="image_assets",extractors=["multimodal-extractor"])video_col = client.collections.create(namespace_id="ns_your_namespace",name="video_assets",extractors=["multimodal-extractor"])# Build retriever spanning both collectionsretriever = client.retrievers.create(namespace_id="ns_your_namespace",name="visual_similarity",collection_ids=["col_image_assets", "col_video_assets"],stages=[{"type": "feature_search", "top_k": 50},{"type": "mmr", "lambda": 0.7, "top_k": 20}])# Search with an imageresults = client.retrievers.execute(retriever_id=retriever["retriever_id"],query={"image_url": "https://example.com/reference.jpg"})for doc in results["results"]:print(f"{doc['document_id']} ({doc['modality']}): {doc['score']:.3f}")
Feature Extractors
Retriever Stages
mmr
Reorder results using Maximal Marginal Relevance for diversity
