NEWVectors or files. Pick a path.Start →

    Models

    Every model Mixpeek runs, calls or can load: what it is good and bad at, its inputs and outputs, how it runs with scale to zero, its license, and the templates that use it. Ordered by use. Filter by anything on the record; the address bar keeps the filter so you can share it.

    91 models

    Task: Embedding

    48 of 91 models

    Hardware, cost and evidence come from each record. "Unmeasured" means we have not measured it on our own image yet.

    • Served on Mixpeek

      Embedding · intfloat/multilingual-e5-large-instruct

      Default text vector for search over transcripts, OCR text, descriptions, documents and web pages in 100+ languages; one space for query and passage text.

      • In/out Text to Vector
      • 1024 dims
      • 4 templates
      License
      MIT
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Provider API

      Embedding · gemini-embedding-2

      One vector space for video segments, images, PDFs, audio and text queries; the default for object-level multimodal extractors (multimodal_extractor v2, universal_extractor).

      • In/out Text, Image, Video, Audio, Document to Vector
      • 3072 dims
      • 2 templates
      License
      Google Gemini API / Vertex AI ...
      Hardware
      Provider API
      View modelJSON
    • Served on Mixpeek

      Embedding · sentence-transformers/all-MiniLM-L6-v2

      Small, fast English sentence vectors on CPU (22M params, 384 dims) for short text, dedup and clustering.

      • In/out Text to Vector
      • 384 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Provider API

      Embedding · multimodalembedding@001

      Category-level text-to-video and text-to-image search in one 1408-d space (committed mAP 0.855 on a 10-video text eval).

      • In/out Image, Video, Text to Vector
      • 1408 dims
      • 5 templates
      License
      Google Cloud Vertex AI terms o...
      Hardware
      Provider API
      View modelJSON
    • Served on Mixpeek

      Embedding · google/siglip-base-patch16-224

      Text-to-image and image-to-image search over photos, products and video frames in one shared space.

      • In/out Image, Text to Vector
      • 768 dims
      • 1 template
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Embedding · lukewys/laion_clap

      Sound-alike search over short audio windows (jingles, music beds, effects) and text-to-audio search ("upbeat jingle with bells") in one 512-d space.

      • In/out Audio, Text to Vector
      • 512 dims
      License
      CC0-1.0
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · facebook/dinov2-base

      Image-to-image similarity on visual structure (layout, near-duplicates, the same object or scene) with no text in the loop.

      • In/out Image to Vector
      • 768 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · jinaai/jina-embeddings-v2-base-code

      Code snippets and natural-language-to-code search across about 30 programming languages, with up to 8192-token inputs (ALiBi).

      • In/out Text to Vector
      • 768 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · google/siglip-so400m-patch14-384

      Strongest SigLIP v1 image-text model; the vision tower behind many VLMs (PaliGemma).

      • In/out Image, Text to Vector
      • 1152 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · colbert-ir/colbertv2.0

      Late-interaction text retrieval and reranking (MaxSim over one 128-d vector per token); strong on out-of-domain and term-heavy queries.

      • In/out Text to Multi-vector
      • 128 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Served on Mixpeek

      Embedding · vidore/colqwen2-v1.0-merged

      Text search over document page images (PDF pages, slides, infographics, tables) by late interaction, with no OCR step.

      • In/out Image, Document, Text to Multi-vector
      • 128 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Served on Mixpeek

      Embedding · laion/CLIP-ViT-L-14-laion2B-s32B-b82K

      Image-to-image similarity from a large web-trained ViT-L/14 image tower.

      • In/out Image to Vector
      • 768 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · google/siglip2-so400m-patch14-384

      Logos, signage, brands and venue shots in concert footage (the visual arm of an internal eval); strongest SigLIP 2 below giant.

      • In/out Image, Text to Vector
      • 1152 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      Recommended
      Yes
      View modelJSON
    • Runs as a custom plugin

      Embedding · Qwen/Qwen3-Embedding-0.6B

      Instruction-aware multilingual text vectors from a small model (0.6B, 1024 dims) on CPU; in a custom plugin it embeds Gemini tags plus the words spoken over each shot.

      • In/out Text to Vector
      • 1024 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · patrickjohncyh/fashion-clip

      Product attributes in fashion catalogs: garment type, color, pattern, material, style words.

      • In/out Image, Text to Vector
      • 512 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · Marqo/marqo-fashionCLIP

      Fashion product search from text or image (ViT-B/16 CLIP fine-tuned with generalized contrastive learning on product titles, categories and attributes); Marqo reports gains over FashionCLIP 2.0 on its fashion benchmarks.

      • In/out Image, Text to Vector
      • 512 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · Marqo/marqo-fashionSigLIP

      Fashion product search from text or image (ViT-B/16 SigLIP fine-tuned with generalized contrastive learning on product titles, categories and attributes); Marqo reports gains over FashionCLIP 2.0 on its fashion benchmarks.

      • In/out Image, Text to Vector
      • 768 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · openai/clip-vit-base-patch32

      General zero-shot labels and text-to-image search; the reference baseline most papers report against.

      • In/out Image, Text to Vector
      • 512 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · openai/clip-vit-large-patch14

      General zero-shot labels and text-to-image search; the reference baseline most papers report against.

      • In/out Image, Text to Vector
      • 768 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · laion/CLIP-ViT-B-16-laion2B-s34B-b88K

      Better than B/32 on fine detail at modest cost.

      • In/out Image, Text to Vector
      • 512 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · laion/CLIP-ViT-B-32-laion2B-s34B-b79K

      Cheapest strong CLIP for CPU bulk frame embedding.

      • In/out Image, Text to Vector
      • 512 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · laion/CLIP-ViT-bigG-14-laion2B-39B-b160k

      Largest LAION CLIP; best zero-shot accuracy in the LAION family.

      • In/out Image, Text to Vector
      • 1280 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · laion/CLIP-ViT-H-14-laion2B-s32B-b79K

      High-accuracy CLIP for offline catalogs (the text encoder family used by Stable Diffusion 2).

      • In/out Image, Text to Vector
      • 1024 dims
      License
      MIT
      Hardware
      Runs on CPU
      View modelJSON
    • Runs as a custom plugin

      Embedding · google/siglip2-base-patch16-224

      Drop-in upgrade over SigLIP base: multilingual text, better localization and dense features at the same 768-d.

      • In/out Image, Text to Vector
      • 768 dims
      License
      Apache-2.0
      Hardware
      Runs on CPU
      View modelJSON

    Questions

    Which of these models does Mixpeek run today?
    15 are served on Mixpeek as Ray Serve apps that start at zero replicas and wake on first use (Multilingual E5 Large Instruct, all-MiniLM-L6-v2, SigLIP Base patch16 224, InsightFace buffalo_l (SCRFD-10GF + ArcFace ResNet50 WebFace600K), InsightFace buffalo_sc (SCRFD-500MF + MobileFaceNet WebFace600K) and others). 13 are provider APIs Mixpeek calls by name. 34 can run as a custom plugin and do not run yet. 29 are blocked today; each page says why.
    How is the default order decided?
    By usage, the namespaces and collections that use each model, counted on 2026-11-06T13:42:25Z, then by how many templates use it, whether it runs today and whether we have our own evaluation.
    What does unmeasured mean on a model?
    We have not measured that model's cost or quality on our own image and data yet. Publisher benchmarks are linked from the model's sources and are not copied into the measured fields.
    Can an agent read this catalog?
    Yes. /models.json holds every record and /models/<id>.json holds one. They are the same records this page renders, generated from the catalog the Mixpeek server is built from.
    How do I use a model in a namespace?
    Open the model and deploy a template that already uses it, or add it to a new or existing namespace from the Designer in Studio. Every served model starts at zero replicas, so an idle namespace costs nothing for inference.

    Hugging Face model directory

    Directory pages for 422 public models. They are not in the catalog above, and Mixpeek does not run them as listed.