NEWVectors or files. Pick a path.Start →
    Models/Text Generation/JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0
    Text Generationggufapache-2.0

    Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0

    by JetBrains

    Identifier
    Model ID
    JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0

    Deploy Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0

    Single-tenant

    Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

    Tags

    ggufmellumllama.cppquantizedmoeinstructtext-generationenbase_model:JetBrains/Mellum2-12B-A2.5B-Instructbase_model:quantized:JetBrains/Mellum2-12B-A2.5B-Instructlicense:apache-2.0endpoints_compatibleregion:usconversational

    Use Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0 on Mixpeek

    Build multimodal processing pipelines with this model and others. Extract features, run inference, and set up retrieval in Mixpeek Studio.

    Open Studio

    How It Runs on Mixpeek

    On Mixpeek, Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0 runs as a managed extractor inside a processing pipeline. Point a bucket of text generation data at it, and Mixpeek handles GPU provisioning, batching, retries, and writing the outputs into a vector store you can query.

    Extractor outputs land in the Mixpeek Vector Store (MVS), where you can combine them with retrieval, reranking, and filter stages to build end-to-end search and agent-perception pipelines, no model-serving infrastructure to maintain.