[Models](/models)/[Document Analysis](/models?category=document)/microsoft/layoutlmv3-base

HFDocument Structurecc-by-nc-sa-4.0

# layoutlmv3-base

by microsoft

Pre-trained multimodal transformer for document AI

1.2Mdl/month

508likes

125Mparams

[HuggingFace](https://huggingface.co/microsoft/layoutlmv3-base)[Run it on your own data, free](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=model_page&utm_campaign=mvs_onramp)

Identifiers

Model ID

`microsoft/layoutlmv3-base`

## Deploy layoutlmv3-base

Single-tenant

Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

[Read the customer-hosted guide](https://mixpeek.com/docs/customer-hosted/overview) [Talk to us about single-tenant](/demo)

## Overview

LayoutLMv3 is a pre-trained multimodal transformer that jointly models text, layout (bounding boxes), and image information for document understanding. It achieves state-of-the-art on form understanding, receipt extraction, and document classification.

On Mixpeek, LayoutLMv3 extracts document structure, identifying headings, paragraphs, tables, and their spatial relationships for structured retrieval.

## Architecture

Unified multimodal transformer that takes text tokens, spatial layout coordinates, and image patches as input. Pre-trained with Masked Language Modeling, Masked Image Modeling, and Word-Patch Alignment objectives.

## Mixpeek SDK Integration

IngestRetrieve

// No extractor parameter takes a Hugging Face model id (checked against
// GET /v1/discovery/extractors, which returns 13), so layoutlmv3-base runs
// on your side and the output is upserted through POST
// /v1/namespaces/{namespace\_id}/documents/upsert. On Enterprise the other
// path is to upload the weights instead: POST /v1/namespaces/{id}/models
// accepts the huggingface format and a custom plugin loads them.
const res = await fetch(
  "https://api.mixpeek.com/v1/namespaces/ns\_your\_namespace/documents/upsert",
  {
    method: "POST",
    headers: {
      Authorization: "Bearer API\_KEY",
      "Content-Type": "application/json",
    },
    body: JSON.stringify({
      collection\_id: "col\_your\_collection",
      documents: \[
        {
          document\_id: "asset-00412",
          // The model produces text, so it lands in payload. Give the
          // collection a text vector index and embed that text to make it
          // searchable rather than only filterable.
          payload: { extracted\_text: modelOutput, source\_key: "archive/2026/asset-00412" },
          vectors: { "text-embedding": embeddingOfModelOutput },
        },
      \],
    }),
  },
);

// Managed alternative, if this exact model is not the requirement:
// document\_graph\_extractor@v1 runs intfloat/multilingual-e5-large-instruct
// (1024-d) over a bucket, with no inference of your own.

## Capabilities

*   Document layout understanding
*   Form and receipt key-value extraction
*   Document classification
*   Named entity recognition on documents

## Use Cases on Mixpeek

Intelligent document processing, extract fields from forms

Financial document analysis, parse invoices and statements

Legal document structure extraction

## Benchmarks

Dataset

Metric

Score

Source

FUNSD

F1

92.1%

Huang et al., 2022: Table 2

CORD

F1

96.6%

Huang et al., 2022: Table 3

DocVQA (test)

ANLS

83.4

Huang et al., 2022: Table 5

## Performance

Input Size224×224 px + 512 tokens

GPU Latency~15ms / page (A100)

CPU Latency~180ms / page

GPU Throughput~65 pages/sec (A100)

GPU Memory~1.1 GB

## Common Pipeline Companions

[

PaddlePaddle/paddleocr

OCR text extraction (upstream)

](/model/PaddlePaddle/paddleocr)[

microsoft/table-transformer-detection

Table detection within documents

](/model/microsoft/table-transformer-detection)[

BAAI/bge-large-en-v1.5

Embed structured text for search

](/model/BAAI/bge-large-en-v1.5)

## Explore on Mixpeek

[

More Document Analysis models

Compare alternatives in this category

](/models?category=document)[

Best Document AI Platforms

Hand-picked tools & platforms compared

](/curated-lists/best-document-ai-platforms)[

OCR & Document AI Internals

Deep-dive technical guide

](/guides/ocr-document-ai-internals)[

Feature Extractors

See how Mixpeek runs models as extractors

](/extractors)[

Mixpeek Vector Store

Store & search embeddings at scale

](/mvs)[

Pricing

Usage-based pricing for pipelines

](/pricing)[

All Curated Lists

Compare models, APIs & infrastructure

](/curated-lists)

### Specification

FrameworkHF

Organizationmicrosoft

FeatureDocument Structure

Outputstructure tokens

Modalitiesdocument

RetrieverSection Filter

Parameters125M

Licensecc-by-nc-sa-4.0

Downloads/mo1.2M

Likes508

[

### Research Paper

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

arxiv.org](https://arxiv.org/abs/2204.08387)

### Build a pipeline with layoutlmv3-base

Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

[Run it on your own data, free](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=model_page&utm_campaign=mvs_onramp)

### Alternative Models

[

naver-clova-ix/donut-base

Document Structure

](/model/naver-clova-ix/donut-base)[

ibm-granite/granite-docling-258M

Document Structure

](/model/ibm-granite/granite-docling-258M)[

fastino/gliner2-base-v1

Document Structure

](/model/fastino/gliner2-base-v1)[

docling-project/SmolDocling-256M-preview

Document Structure

](/model/docling-project/SmolDocling-256M-preview)

### Related in Document Analysis

[

microsoft/table-transformer-detection

Table Extraction

](/model/microsoft/table-transformer-detection)[

microsoft/table-transformer-structure-recognition-v1.1-all

Table Extraction

](/model/microsoft/table-transformer-structure-recognition-v1.1-all)[

poloclub/UniTable

Table Extraction

](/model/poloclub/UniTable)[

microsoft/table-transformer-structure-recognition-v1.1-pub

Table Extraction

](/model/microsoft/table-transformer-structure-recognition-v1.1-pub)