Automatic Image Tagging Pipeline
Automatically tag images with objects, scenes, colors, and custom labels using computer vision models. Perfect for DAM systems and media libraries.
from mixpeek import Mixpeekclient = Mixpeek(api_key="YOUR_API_KEY", namespace="image-tags")# 1. A bucket for the photos, and a collection whose Gemini description step# returns tags as structured JSON. There is no separate object detector or# color extractor; one structured answer per image carries all three.bucket = client.buckets.create(bucket_name="product-photos",bucket_schema={"properties": {"photo": {"type": "image"}}},)collection = client.collections.create(collection_name="product-photos",source={"type": "bucket", "bucket_ids": [bucket["bucket_id"]]},feature_extractor={"feature_extractor_name": "multimodal_extractor","version": "v1","parameters": {"run_video_description": True,"description_prompt": "Tag this photo for a media library.","response_shape": {"type": "object","properties": {"tags": {"type": "array", "items": {"type": "string"}},"objects": {"type": "array", "items": {"type": "string"}},"dominant_colors": {"type": "array", "items": {"type": "string"}},},},},},)# 2. Upload and processclient.buckets.upload(bucket["bucket_id"],blobs=[{"property": "photo", "type": "image", "data": "s3://your-bucket/photos/IMG_0001.jpg"}],)client.collections.trigger(collection["collection_id"])# 3. Read the tags backdocs = client.documents.list(collection["collection_id"], page_size=50)for doc in docs["results"]:print(doc["document_id"], doc.get("json_output"))
Feature Extractors
Multimodal Extractor
Unified embeddings for video, audio, image, and text: scene/silence chunking, Whisper transcription, thumbnails, and Gemini vision.
Retriever Stages
Frequently asked questions
Can I add custom tags?
Yes. You can define custom taxonomies to classify images into your own categories using Mixpeek taxonomies.
How accurate is object detection?
Mixpeek uses state-of-the-art models with 90%+ accuracy on common objects. Custom fine-tuning is available for specialized domains.
Does it extract EXIF metadata?
Yes. Camera settings, GPS coordinates, timestamps, and other EXIF data are extracted alongside visual features.
Related code examples and resources
Pages on the same stages, extractors and patterns.
Multimodal Extractor
Unified embeddings for video, audio, image, and text: scene/silence chunking, Whisper transcription, thumbnails, and Gemini vision.
Image Embedding
Generate visual embeddings for similarity search and clustering
Face Identity Extractor
Detect, align, and embed faces to 512-D ArcFace vectors across image, video and PDF, using SCRFD for detection.
Image Similarity Search Pipeline
Deploy a visual search engine that finds similar images using state-of-the-art embedding models. Perfect for product catalogs, stock photo libraries, and visual discovery.
E-commerce Product Image Analytics
Analyze product images across your catalog to extract visual attributes, identify trends, detect quality issues, and benchmark against competitors.
Reverse Image Search
Build a reverse image search engine that accepts an image as input and returns visually similar results from your indexed collection. Uses multimodal embeddings to match visual features like color, shape, composition, and semantic content.