Moments where a person gestures while speaking a command word
Pinpoint interactive moments by detecting specific physical gestures alongside key spoken command words using action recognition and speech-to-text.
video
audio
3.5K runs
Deploy Recipe"Moments where someone gestures and says a command word"
from mixpeek import Mixpeekclient = Mixpeek("your-api-key")# Create a collection for grouping moments with gestures and command wordsclient.collections.create(feature_extractors=["action-recognition","video-transcription"])
Feature Extractors
Action Recognition
Identify and classify human actions in video
412K runs
Video Transcription
Convert speech to text with timestamps for video content
385K runs
Retrievers
Hybrid KNN Search
Combines vector similarity with keyword matching for improved retrieval accuracy
325K runs