NEWVectors or files. Pick a path.Start →
    Not runnable todayEmbeddingVerified 2026-11-05

    VideoPrism LvT Base (video-text, 16 frames, 288px)

    google/videoprism-lvt-base-f16r288

    VideoPrism LvT Base (video-text, 16 frames, 288px) is a video and text embedding model (Apache-2.0). Not runnable on Mixpeek today.

    Something blocks it today, such as the license, remote code or a GPU-only runtime. The reason is below.

    No demo for VideoPrism LvT Base (video-text, 16 frames, 288px) yet

    A video, image, slideshow or playground goes here once we record one on our own data.

    What it is good and bad at

    Best at
    Video-text retrieval and zero-shot classification with a paired text encoder.
    Worst at
    JAX/Flax only; text tower is English.
    Task
    Embedding
    Input
    Video, Text
    Output
    Vector
    Use cases
    Video understanding, Action recognition

    Templates that use it

    No template uses this model yet. Browse templates.

    Input and output

    Input

    video
    frames
    16
    resolution
    288x288
    text

    Output

    vector
    dims
    per model config (not verified here)
    distance
    cosine
    type
    dense

    How Mixpeek wires it

    Extractors
    None today
    Feature URIs
    None today
    Vector indexes
    None
    Retriever stages
    None
    Combines with
    • scene splits (transcoding/multimodal extractor) -> clip-level vectors -> feature_search with a text query

    How it runs

    Status
    Not runnable today Weights are Flax .npz arrays loaded by the videoprism JAX package; Mixpeek's runtime is PyTorch, so it needs JAX in the image or a port. Weights-only arrays, Apache-2.0, so no license block.
    Serve apps
    None
    Runtime
    videoprism (JAX/Flax)
    Weights
    JAX, no remote code
    Parameters
    Not recorded
    Size on disk
    991 MB
    Preprocessing
    Sample 16 frames, resize to 288, scale to 0..1.
    Postprocessing
    Global pooled embedding; L2-normalize for retrieval.
    Serving
    batch
    Hardware
    Runs on CPU (slower without a GPU)

    Scale to zero

    Minimum replicas
    0
    Maximum replicas
    1
    Idle timeout
    600 s
    Memory
    6 GB
    CPUs
    2
    GPUs
    0
    Cold start, node warm
    Not recorded
    Cold start, new node
    Not recorded

    Measured cost

    Unmeasured

    No committed measurement; plan row 3 measures it in the standalone image.

    Our evaluations

    Unmeasured

    We have not evaluated this model on our own data yet. Publisher results are in the sources below.

    Questions

    What is VideoPrism LvT Base (video-text, 16 frames, 288px) best at?
    Video-text retrieval and zero-shot classification with a paired text encoder.
    What are the limits of VideoPrism LvT Base (video-text, 16 frames, 288px)?
    JAX/Flax only; text tower is English.
    Can VideoPrism LvT Base (video-text, 16 frames, 288px) be used commercially?
    Yes. Apache-2.0 per the hub tag and repo.
    How does VideoPrism LvT Base (video-text, 16 frames, 288px) run on Mixpeek?
    Weights are Flax .npz arrays loaded by the videoprism JAX package; Mixpeek's runtime is PyTorch, so it needs JAX in the image or a port. Weights-only arrays, Apache-2.0, so no license block.