NEWVectors or files. Pick a path.Start →

    Models

    Every model Mixpeek runs, calls or can load: what it is good and bad at, its inputs and outputs, how it runs with scale to zero, its license, and the templates that use it. Ordered by use. Filter by anything on the record; the address bar keeps the filter so you can share it.

    91 models

    91 models

    Hardware, cost and evidence come from each record. "Unmeasured" means we have not measured it on our own image yet.

    • Served on Mixpeek

      Embedding · intfloat/multilingual-e5-large-instruct

      Default text vector for search over transcripts, OCR text, descriptions, documents and web pages in 100+ languages; one space for query and passage text.

      • In/out Text to Vector
      • 1024 dims
      • 4 templates
      License
      MIT
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Provider API

      Embedding · gemini-embedding-2

      One vector space for video segments, images, PDFs, audio and text queries; the default for object-level multimodal extractors (multimodal_extractor v2, universal_extractor).

      • In/out Text, Image, Video, Audio, Document to Vector
      • 3072 dims
      • 2 templates
      License
      Google Gemini API / Vertex AI ...
      Hardware
      Provider API
      View modelJSON
    • Served on Mixpeek

      Embedding · sentence-transformers/all-MiniLM-L6-v2

      Small, fast English sentence vectors on CPU (22M params, 384 dims) for short text, dedup and clustering.

      • In/out Text to Vector
      • 384 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Provider API

      Embedding · multimodalembedding@001

      Category-level text-to-video and text-to-image search in one 1408-d space (committed mAP 0.855 on a 10-video text eval).

      • In/out Image, Video, Text to Vector
      • 1408 dims
      • 5 templates
      License
      Google Cloud Vertex AI terms o...
      Hardware
      Provider API
      View modelJSON
    • Served on Mixpeek

      Embedding · google/siglip-base-patch16-224

      Text-to-image and image-to-image search over photos, products and video frames in one shared space.

      • In/out Image, Text to Vector
      • 768 dims
      • 1 template
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Face · insightface/buffalo_l

      Face detection, 5-point alignment and 512-d face identity vectors for finding the same person across images and video frames.

      • In/out Image, Video to Boxes, Keypoints, Vector
      • 512 dims
      License
      InsightFace pretrained models
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · lukewys/laion_clap

      Sound-alike search over short audio windows (jingles, music beds, effects) and text-to-audio search ("upbeat jingle with bells") in one 512-d space.

      • In/out Audio, Text to Vector
      • 512 dims
      License
      CC0-1.0
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · facebook/dinov2-base

      Image-to-image similarity on visual structure (layout, near-duplicates, the same object or scene) with no text in the loop.

      • In/out Image to Vector
      • 768 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · jinaai/jina-embeddings-v2-base-code

      Code snippets and natural-language-to-code search across about 30 programming languages, with up to 8192-token inputs (ALiBi).

      • In/out Text to Vector
      • 768 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Provider API

      Generation · gemini-2.5-flash

      The extractors' default for structured extraction and vision work: video description and OCR in multimodal_extractor v2, web page extraction, PDF layout (document_graph), scrolling-text OCR.

      • In/out Text, Image, Video, Document to Text, Structured data
      • 1 template
      License
      Google Gemini API / Vertex AI ...
      Hardware
      Provider API
      View modelJSON
    • Provider API

      Video and image Q&A · gemini-3.6-flash

      High-quality video QA and structured tagging.

      • In/out Video, Audio, Image, Text, Document to Text, Structured data
      License
      Proprietary
      Hardware
      Provider API
      View modelJSON
    • Runs as a custom plugin

      Embedding · google/siglip-so400m-patch14-384

      Strongest SigLIP v1 image-text model; the vision tower behind many VLMs (PaliGemma).

      • In/out Image, Text to Vector
      • 1152 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · colbert-ir/colbertv2.0

      Late-interaction text retrieval and reranking (MaxSim over one 128-d vector per token); strong on out-of-domain and term-heavy queries.

      • In/out Text to Multi-vector
      • 128 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Provider API

      Classification · jev-latest

      Typed decisions with calibrated probabilities over a JSON state: yes/no relevance for rerank, label probabilities for classify, closed-set schema fields for text_extractor; the platform's DECISION_MODEL_DEFAULT.

      • In/out Text, Structured data to Labels, Scores, Structured data
      License
      TypeSafe AI API terms
      Hardware
      Provider API
      View modelJSON
    • Provider API

      Video and image Q&A · gemini-3.1-flash-lite

      Low-cost bulk tagging of scenes and frames.

      • In/out Video, Audio, Image, Text, Document to Text, Structured data
      License
      Proprietary
      Hardware
      Provider API
      View modelJSON
    • Served on Mixpeek

      Reranking · BAAI/bge-reranker-v2-m3

      Re-ordering a short candidate list of text documents against a query (cross-encoder, multilingual), most useful where the dense ordering is weak.

      • In/out Text to Scores
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Embedding · vidore/colqwen2-v1.0-merged

      Text search over document page images (PDF pages, slides, infographics, tables) by late interaction, with no OCR step.

      • In/out Image, Document, Text to Multi-vector
      • 128 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Classification · Falconsai/nsfw_image_detection

      Fast binary normal/nsfw screening of images, and of video by the max score over sparse sampled frames.

      • In/out Image, Video to Labels, Scores
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Transcription · openai/whisper-large-v3-turbo

      Multilingual speech-to-text on GPU at large-v3 quality with the decoder cut from 32 to 4 layers, so decoding is much faster than large-v3.

      • In/out Audio, Video to Text
      License
      MIT
      Hardware
      Needs a GPU
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Classification · eliasalbouzidi/distilbert-nsfw-text-classifier

      Cheap binary safe/nsfw screening of English text such as captions, titles and transcripts.

      • In/out Text to Labels, Scores
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Provider API

      Generation · gemini-3.5-flash-lite

      The platform's default LLM (DEFAULT_GEMINI_MODEL) for cheap per-document work in retriever stages (enrich, filter, summarize) and for video-segment description and OCR in multimodal_extractor v1.

      • In/out Text, Image, Video, Document to Text, Structured data
      License
      Google Gemini API / Vertex AI ...
      Hardware
      Provider API
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Embedding · laion/CLIP-ViT-L-14-laion2B-s32B-b82K

      Image-to-image similarity from a large web-trained ViT-L/14 image tower.

      • In/out Image to Vector
      • 768 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · google/siglip2-so400m-patch14-384

      Logos, signage, brands and venue shots in concert footage (the visual arm of an internal eval); strongest SigLIP 2 below giant.

      • In/out Image, Text to Vector
      • 1152 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON

    Questions

    Which of these models does Mixpeek run today?
    15 are served on Mixpeek as Ray Serve apps that start at zero replicas and wake on first use (Multilingual E5 Large Instruct, all-MiniLM-L6-v2, SigLIP Base patch16 224, InsightFace buffalo_l (SCRFD-10GF + ArcFace ResNet50 WebFace600K), InsightFace buffalo_sc (SCRFD-500MF + MobileFaceNet WebFace600K) and others). 13 are provider APIs Mixpeek calls by name. 34 can run as a custom plugin and do not run yet. 29 are blocked today; each page says why.
    How is the default order decided?
    By usage, the namespaces and collections that use each model, counted on 2026-11-06T13:42:25Z, then by how many templates use it, whether it runs today and whether we have our own evaluation.
    What does unmeasured mean on a model?
    We have not measured that model's cost or quality on our own image and data yet. Publisher benchmarks are linked from the model's sources and are not copied into the measured fields.
    Can an agent read this catalog?
    Yes. /models.json holds every record and /models/<id>.json holds one. They are the same records this page renders, generated from the catalog the Mixpeek server is built from.
    How do I use a model in a namespace?
    Open the model and deploy a template that already uses it, or add it to a new or existing namespace from the Designer in Studio. Every served model starts at zero replicas, so an idle namespace costs nothing for inference.

    Hugging Face model directory

    Directory pages for 423 public models. They are not in the catalog above, and Mixpeek does not run them as listed.