NEWVectors or files. Pick a path.Start →
    Models/Fill Mask/AIMH/mental-longformer-base-4096
    Fill Masktransformerscc-by-nc-4.0

    mental-longformer-base-4096

    by AIMH

    Identifier
    Model ID
    AIMH/mental-longformer-base-4096

    Tags

    transformerspytorchlongformerfill-maskarxiv:2004.05150arxiv:2304.10447license:cc-by-nc-4.0endpoints_compatibleregion:us

    Use mental-longformer-base-4096 on Mixpeek

    Build multimodal processing pipelines with this model and others. Extract features, run inference, and set up retrieval in Mixpeek Studio.

    Open Studio

    How It Runs on Mixpeek

    On Mixpeek, mental-longformer-base-4096 runs as a managed extractor inside a processing pipeline. Point a bucket of fill mask data at it, and Mixpeek handles GPU provisioning, batching, retries, and writing the outputs into a vector store you can query.

    Extractor outputs land in the Mixpeek Vector Store (MVS), where you can combine them with retrieval, reranking, and filter stages to build end-to-end search and agent-perception pipelines, no model-serving infrastructure to maintain.