Automated Video Tagging
Automatically generate descriptive tags for video content using scene analysis, object detection, and taxonomy classification. Each video receives structured labels for scenes, objects, actions, and custom business categories without manual annotation.
from mixpeek import Mixpeekclient = Mixpeek(api_key="YOUR_API_KEY")# Define tagging taxonomy with category exemplarstaxonomy = client.taxonomies.create(namespace_id="ns_your_namespace",name="video_tags",taxonomy_type="hierarchical",hierarchy=[{"node_id": "sports", "collection_id": "col_sports_examples"},{"node_id": "cooking", "collection_id": "col_cooking_examples"},{"node_id": "technology", "collection_id": "col_tech_examples"},{"node_id": "outdoors", "collection_id": "col_outdoors_examples"},])# Apply taxonomy to video collectionclient.collections.apply_taxonomy(collection_id="col_videos",taxonomy_id=taxonomy["taxonomy_id"])# Retrieve tagged documentsdocs = client.documents.list(collection_id="col_videos",filters={"taxonomy_enrichment.category": "sports"})for doc in docs["results"]:tags = doc.get("taxonomy_enrichment", {})print(f"Video: {doc['root_object_id']}, Tags: {tags}")
Feature Extractors
Retriever Stages
aggregate
Compute aggregations (COUNT, SUM, AVG, etc.) on pipeline results
Use Cases Using This Recipe
Sports Highlights
Auto-generate highlight reels from full-length sports footage
24x faster
Highlight generation time
Sports broadcasters, media companies, and content teams processing 100+ hours of live footage weekly
Media Archive Intelligence
Transform decades of media archives into searchable, monetizable assets
12x more content findable
Archive discoverability
Broadcasters, news organizations, film studios, music labels, and cultural institutions managing archives of 10,000+ hours of video, millions of photographs, or extensive audio collections
Related Recipes & Resources
Explore these related resources to deepen your understanding and discover more powerful features
Hierarchical Classification
Assign content to multi-level category hierarchies using embedding-based classification. Define your taxonomy once, then classify new content automatically with confidence scores.
Brand Safety & Ad Verification Pipeline
GARM-compliant brand safety pipeline for ad networks. Analyze video and image creatives for brand safety violations before serving.
Video Scene Search
Find specific scenes within videos using natural language descriptions. The pipeline detects scene boundaries, generates embeddings for each scene, and enables precise timestamp-level search across an entire video library. Query for visual content, actions, or spoken dialogue.
Semantic Multimodal Search
Unified semantic search across all content types. Query by natural language and retrieve relevant video clips, images, audio segments, and documents based on meaning-not keywords or manual tags.
Feature Extraction
Multi-tier feature extraction that decomposes content into searchable components: embeddings, transcripts, detected objects, OCR text, scene boundaries, and more. The foundation for all downstream retrieval and analysis.
Clustering & Theme Discovery
Unsupervised clustering that groups content into semantic themes using HDBSCAN. Surfaces hidden patterns, content variants, and outliers without requiring predefined labels.