NEWVectors or files. Pick a path.Start →
    Multimodal

    Multimodal Extractor

    Unified embeddings for video, audio, image, and text: scene/silence chunking, Whisper transcription, thumbnails, and Gemini vision.

    v2 · 50 cr/minute, 5 cr/image, 2 cr/1k_tokens
    Read Docs
    Integrate Now
    View on GitHub
    Note: This playground provides simulated output to showcase functionality. No input data is processed or stored on our servers. Use this demo to explore the feature extractor's capabilities before integrating it into your application.

    Input

    Enter a URL to a video file

    Drag and drop a video file here, or click to browse

    Output

    {
  "start_time": "Start time of the segment in seconds",
  "end_time": "End time of the segment in seconds",
  "start_frame": "Start frame number of the segment (start_time * fps)",
  "end_frame": "End frame number of the segment (end_time * fps)",
  "fps": "Frame rate of the video at the time of splitting",
  "source_fps": "Original source video frame rate before preprocessing (e.g. 29.97, 30, 23.976)",
  "duration": "Total source video duration in seconds",
  "transcription": "Transcription of audio",
  "description": "Generated segment description",
  "ocr_text": "OCR text from video frames",
  "json_output": "Raw JSON from underlying models",
  "thumbnail_url": "Thumbnail image URL",
  "source_video_url": "Original source video URL",
  "video_segment_url": "Video segment URL",
  "multimodal_extractor_v2_multimodal_embedding": "Dense vector embeddings (3072D) via Gemini Embedding 2 for multimodal content.",
  "multimodal_extractor_v2_transcription_embedding": "Dense vector embeddings (1024D) for transcription text via E5-Large.",
  "internal_metadata": "Internal processing metadata"
}

    Ready to run Multimodal Extractor on your data? Spin it up in Studio: no infra to host.

    Run this in Studio

    Multimodal Extractor: common questions

    What is the Multimodal Video/Audio/Image (Vertex v1 · Gemini v2) extractor used for?
    Unified multimodal search with higher-dimensional embeddings and native multimodal understanding.
    How much does the Multimodal Video/Audio/Image (Vertex v1 · Gemini v2) extractor cost?
    50 cr/minute, 5 cr/image, 2 cr/1k_tokens. Credits are billed per unit processed; see mixpeek.com/pricing for the credit rate.
    What file types does Multimodal Video/Audio/Image (Vertex v1 · Gemini v2) support?
    Video, Image, Audio, Text. It produces embeddings from gemini-embedding-2, multilingual_e5_large_instruct_v1.

    Already have embeddings? Skip extraction: search your own vectors with MVS, from $25/mo for up to 1M vectors.

    Try MVS →

    Recent updates

    Full changelog