[Models](/models)/[Captioning](/models?category=captioning)/Qwen/Qwen3.6-35B-A3B

HFScene CaptioningApache 2.0

# Qwen3.6-35B-A3B

by Qwen

35B MoE with only 3B active params: 73.4% SWE-bench, runs on a laptop

310Kdl/month

35B (3B active)params

[HuggingFace](https://huggingface.co/Qwen/Qwen3.6-35B-A3B)[Run it on your own data, free](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=model_page&utm_campaign=mvs_onramp)

Identifiers

Model ID

`Qwen/Qwen3.6-35B-A3B`

## Deploy Qwen3.6-35B-A3B

Single-tenant

Mixpeek has no managed extractor for this model. On a single-tenant deployment you upload the weights and a custom plugin serves them next to the rest of your pipeline.

[Read the customer-hosted guide](https://mixpeek.com/docs/customer-hosted/overview) [Talk to us about single-tenant](/demo)

## Overview

Qwen3.6-35B-A3B is Alibaba's hybrid Mixture-of-Experts model with 35 billion total parameters but only 3 billion active per token, delivering frontier-class reasoning and coding at laptop-deployable cost. It combines Gated DeltaNet linear attention with standard Gated Attention and sparse MoE (256 experts, 8 routed + 1 shared) to achieve 73.4% on SWE-bench Verified and 92.6% on AIME 2026.

On Mixpeek, Qwen3.6-35B-A3B serves as a powerful reasoning backbone for agentic pipelines, complex metadata generation, and code-driven content analysis. Its 262K native context (extensible to 1M via YaRN) handles full-length documents and long video transcripts, while the 3B active parameter footprint keeps inference costs manageable.

## Architecture

Hybrid MoE with 40 layers in a repeating pattern: 10 x (3 x (Gated DeltaNet -> MoE) -> 1 x (Gated Attention -> MoE)). 256 experts per MoE layer, 8 routed + 1 shared active. Hidden dimension 2048. 35B total, 3B active per token. 262K native context with YaRN extension to 1M.

## Mixpeek SDK Integration

IngestRetrieve

// No extractor parameter takes a Hugging Face model id (checked against
// GET /v1/discovery/extractors, which returns 13), so Qwen3.6-35B-A3B runs
// on your side and the output is upserted through POST
// /v1/namespaces/{namespace\_id}/documents/upsert. On Enterprise the other
// path is to upload the weights instead: POST /v1/namespaces/{id}/models
// accepts the huggingface format and a custom plugin loads them.
const res = await fetch(
  "https://api.mixpeek.com/v1/namespaces/ns\_your\_namespace/documents/upsert",
  {
    method: "POST",
    headers: {
      Authorization: "Bearer API\_KEY",
      "Content-Type": "application/json",
    },
    body: JSON.stringify({
      collection\_id: "col\_your\_collection",
      documents: \[
        {
          document\_id: "asset-00412",
          // The model produces text, so it lands in payload. Give the
          // collection a text vector index and embed that text to make it
          // searchable rather than only filterable.
          payload: { extracted\_text: modelOutput, source\_key: "archive/2026/asset-00412" },
          vectors: { "multimodal-embedding": embeddingOfModelOutput },
        },
      \],
    }),
  },
);

// Managed alternative, if this exact model is not the requirement:
// universal\_extractor@v1 runs google/gemini-embedding-2
// (3072-d) over a bucket, with no inference of your own.

## Capabilities

*   73.4% on SWE-bench Verified (code generation)
*   92.6% on AIME 2026 (mathematical reasoning)
*   262K native context, extensible to 1M via YaRN
*   Only 3B active parameters per token from 35B total
*   Vision capabilities included

## Use Cases on Mixpeek

Complex metadata generation from long documents and video transcripts using full 262K context

Agentic content analysis pipelines with multi-step reasoning over extracted features

Code-driven structured extraction from multimodal content at low inference cost

## Benchmarks

Dataset

Metric

Score

Source

SWE-bench Verified

Pass Rate

73.4%

Alibaba, Apr 2026: Model Card

AIME 2026

Accuracy

92.6%

Alibaba, Apr 2026: Model Card

Terminal-Bench 2.0

Pass Rate

51.5%

Alibaba, Apr 2026: Model Card

## Performance

Input SizeText: 262K tokens (1M with YaRN); Vision: variable

GPU Latency~35ms / token (A100, 3B active)

GPU Throughput~80 tokens/sec on 12GB VRAM with MTP speculative decoding

GPU Memory~12 GB (quantized), ~70 GB (FP16 full)

## Common Pipeline Companions

[

Qwen/Qwen3-Embedding-8B

Embed generated metadata for semantic retrieval

](/model/Qwen/Qwen3-Embedding-8B)[

Qwen/Qwen3-ASR-1.7B

Transcription feeding into reasoning pipeline

](/model/Qwen/Qwen3-ASR-1.7B)

## Explore on Mixpeek

[

More Captioning models

Compare alternatives in this category

](/models?category=captioning)[

Best Document AI Platforms

Hand-picked tools & platforms compared

](/curated-lists/best-document-ai-platforms)[

OCR & Document AI Internals

Deep-dive technical guide

](/guides/ocr-document-ai-internals)[

Feature Extractors

See how Mixpeek runs models as extractors

](/extractors)[

Mixpeek Vector Store

Store & search embeddings at scale

](/mvs)[

Pricing

Usage-based pricing for pipelines

](/pricing)[

All Curated Lists

Compare models, APIs & infrastructure

](/curated-lists)

### Specification

FrameworkHF

OrganizationQwen

FeatureScene Captioning

Outputtext

Modalitiesvideo, image

RetrieverSemantic Search

Parameters35B (3B active)

LicenseApache 2.0

Downloads/mo310K

[

### Research Paper

Qwen3.6 Technical Report

arxiv.org](https://huggingface.co/Qwen/Qwen3.6-35B-A3B)

### Build a pipeline with Qwen3.6-35B-A3B

Add this model to a processing pipeline alongside other extractors. Combine with retrieval stages for end-to-end search.

[Run it on your own data, free](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=model_page&utm_campaign=mvs_onramp)

### Alternative Models

[

Salesforce/blip2-opt-2.7b

Scene Captioning

](/model/Salesforce/blip2-opt-2.7b)[

microsoft/Florence-2-large

Scene Captioning

](/model/microsoft/Florence-2-large)[

google/paligemma2-3b-mix-448

Scene Captioning

](/model/google/paligemma2-3b-mix-448)[

Qwen/Qwen3-VL-8B-Instruct

Scene Captioning

](/model/Qwen/Qwen3-VL-8B-Instruct)