SmolVLM2-2.2B-Instruct
by HuggingFaceTB
2.2B video-native VLM fitting in 5.2 GB VRAM with strong document and science understanding
HuggingFaceTB/SmolVLM2-2.2B-Instructmixpeek://image_extractor@v1/hf_smolvlm2_22b_v1Deploy SmolVLM2-2.2B-Instruct
Single-tenantMixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.
Overview
SmolVLM2 is Hugging Face's lightweight multimodal model designed for efficient video, image, and text analysis at only 2.2B parameters. Built on a SigLIP vision encoder and SmolLM2 text decoder, it processes videos natively while fitting in just 5.2 GB of GPU RAM: small enough for consumer GPUs and edge devices.
On Mixpeek, SmolVLM2 enables cost-efficient visual captioning and understanding for high-volume video pipelines where larger VLMs would be prohibitively expensive. It scores 72.9% on OCRBench and 90% on ScienceQA, making it effective for document understanding and structured content analysis at a fraction of the compute cost of 7B+ models.
Architecture
SigLIP vision encoder with SmolLM2 text decoder in a Llama-style architecture. 2.2B parameters. Supports native video frame processing with temporal understanding. Only 5.2 GB GPU RAM for video inference. Apache 2.0 license.
Mixpeek SDK Integration
// No extractor parameter takes a Hugging Face model id (checked against
// GET /v1/discovery/extractors, which returns 13), so SmolVLM2-2.2B-Instruct runs
// on your side and the output is upserted through POST
// /v1/namespaces/{namespace_id}/documents/upsert. On Enterprise the other
// path is to upload the weights instead: POST /v1/namespaces/{id}/models
// accepts the huggingface format and a custom plugin loads them.
const res = await fetch(
"https://api.mixpeek.com/v1/namespaces/ns_your_namespace/documents/upsert",
{
method: "POST",
headers: {
Authorization: "Bearer API_KEY",
"Content-Type": "application/json",
},
body: JSON.stringify({
collection_id: "col_your_collection",
documents: [
{
document_id: "asset-00412",
// The model produces text, so it lands in payload. Give the
// collection a text vector index and embed that text to make it
// searchable rather than only filterable.
payload: { extracted_text: modelOutput, source_key: "archive/2026/asset-00412" },
vectors: { "multimodal-embedding": embeddingOfModelOutput },
},
],
}),
},
);
// Managed alternative, if this exact model is not the requirement:
// universal_extractor@v1 runs google/gemini-embedding-2
// (3072-d) over a bucket, with no inference of your own.Capabilities
- Native video understanding (Video-MME: 52.1%, MLVU: 55.2%)
- OCR and document understanding (OCRBench: 72.9%, DocVQA: 80.0%)
- Science reasoning (ScienceQA: 90%)
- Only 5.2 GB GPU RAM for video inference
- Apache 2.0 open-source license
Use Cases on Mixpeek
Benchmarks
| Dataset | Metric | Score | Source |
|---|---|---|---|
| Video-MME | Accuracy | 52.1% | Hugging Face, 2025: Model Card |
| OCRBench | Accuracy | 72.9% | Hugging Face, 2025: Model Card |
| ScienceQA | Accuracy | 90.0% | Hugging Face, 2025: Model Card |
Performance
Common Pipeline Companions
Explore on Mixpeek
Compare alternatives in this category
Hand-picked tools & platforms compared
Deep-dive technical guide
See how Mixpeek runs models as extractors
Store & search embeddings at scale
Usage-based pricing for pipelines
Compare models, APIs & infrastructure
Specification
Research Paper
SmolVLM2 Model Card
arxiv.orgBuild a pipeline with SmolVLM2-2.2B-Instruct
Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.
Run it on your own data, free