NEWVectors or files. Pick a path.Start →
    Not runnable todaySegmentationVerified 2026-11-05

    YOLOE-11 (text, visual and prompt-free)

    yoloe-11s-seg.pt

    YOLOE-11 (text, visual and prompt-free) is a image and text segmentation model (AGPL-3.0). Not runnable on Mixpeek today.

    Something blocks it today, such as the license, remote code or a GPU-only runtime. The reason is below.

    No demo for YOLOE-11 (text, visual and prompt-free) yet

    A video, image, slideshow or playground goes here once we record one on our own data.

    What it is good and bad at

    Best at
    Open-vocabulary detection and segmentation from text, an example image, or no prompt (prompt-free variant names objects from a built-in vocabulary).
    Worst at
    License blocks closed commercial use; masks coarser than SAM.
    Task
    Segmentation
    Input
    Image, Text
    Output
    Boxes, Masks, Labels, Scores
    Use cases
    Segmentation, Object detection

    Templates that use it

    No template uses this model yet. Browse templates.

    Input and output

    Input

    image
    resolution
    640x640 letterboxed
    prompts
    text class names, visual prompt (boxes on a reference image), or none (-pf)

    Output

    boxes
    xyxy pixels
    masks
    per-instance bitmaps
    labels
    open vocabulary
    scores
    0..1

    How Mixpeek wires it

    Extractors
    None today
    Feature URIs
    None today
    Vector indexes
    None
    Retriever stages
    None
    Combines with
    • masks -> masked crops -> SigLIP vectors
    • detector boxes -> crops -> SigLIP vectors per object (one document per object, or a multi-vector per frame)

    How it runs

    Status
    Not runnable today Blocked by AGPL-3.0 and pickle .pt weights. Would run as a custom extractor plugin that exports the checkpoint to ONNX once (ultralytics export format=onnx) and serves it with onnxruntime on CPU, emitting boxes, labels and crops.
    Serve apps
    None
    Runtime
    ultralytics YOLOE
    Weights
    Pickle, no remote code
    Parameters
    Not recorded
    Size on disk
    Not recorded
    Preprocessing
    Letterbox to 640x640 (stride-aligned padding), RGB, scale to 0..1.
    Postprocessing
    Confidence threshold, NMS, mask decode.
    Serving
    both
    Hardware
    Runs on CPU (slower without a GPU)

    Scale to zero

    Minimum replicas
    0
    Maximum replicas
    1
    Idle timeout
    600 s
    Memory
    2 GB
    CPUs
    1
    GPUs
    0
    Cold start, node warm
    Not recorded
    Cold start, new node
    Not recorded

    Measured cost

    Unmeasured

    No committed measurement; plan row 3 measures it in the standalone image.

    Our evaluations

    Unmeasured

    We have not evaluated this model on our own data yet. Publisher results are in the sources below.

    Questions

    What is YOLOE-11 (text, visual and prompt-free) best at?
    Open-vocabulary detection and segmentation from text, an example image, or no prompt (prompt-free variant names objects from a built-in vocabulary).
    What are the limits of YOLOE-11 (text, visual and prompt-free)?
    License blocks closed commercial use; masks coarser than SAM.
    Can YOLOE-11 (text, visual and prompt-free) be used commercially?
    No. AGPL-3.0: offering it over a network obliges publishing the whole application's source under AGPL; closed commercial use needs an Ultralytics Enterprise license.
    How does YOLOE-11 (text, visual and prompt-free) run on Mixpeek?
    Blocked by AGPL-3.0 and pickle .pt weights. Would run as a custom extractor plugin that exports the checkpoint to ONNX once (ultralytics export format=onnx) and serves it with onnxruntime on CPU, emitting boxes, labels and crops.