Clips with a specific object and a related spoken keyword

Search for clips where a specific object is visible while a related keyword is spoken. This combines object detection with speech-to-text and keyword analysis.

video

audio

7.9K runs

Deploy Recipe

"Clips where a specific object appears while a related keyword is spoken"

from mixpeek import Mixpeek

client = Mixpeek("your-api-key")

# Create a collection for finding objects appearing with spoken keywords
client.collections.create(
    feature_extractors=[
        "object-detection",
        "video-transcription",
        "keyword-extraction"
    ]
)

Feature Extractors

Object Detection

Identify and locate objects within images with bounding boxes

631K runs

Video Transcription

Convert speech to text with timestamps for video content

385K runs

Keyword Extraction

Identify and extract key phrases and important terms from text

615K runs

Retrievers

Hybrid KNN Search

Combines vector similarity with keyword matching for improved retrieval accuracy

325K runs