Lance

by bytedance-research

Unified 3B model for image and video understanding, generation, and editing

32Kdl/month

3Bparams

HuggingFace Use in Pipeline

Identifiers

Model ID

bytedance-research/Lance

Feature URI

mixpeek://video_extractor@v1/bytedance_lance_3b_v1

Overview

Lance is ByteDance's 3B-parameter unified vision model that handles image understanding, video understanding, image generation, video generation, and image/video editing in a single architecture. It uses a vision tokenizer to convert between continuous pixel space and discrete token space, enabling a shared transformer to reason across both modalities.

On Mixpeek, Lance is relevant as a compact video understanding model that can caption, describe, and answer questions about both images and video content. Its unified architecture means a single model can power scene description, visual Q&A, and content analysis pipelines.

Architecture

Unified autoregressive transformer with a learned vision tokenizer. 3B parameters. Supports text-to-image, text-to-video, image/video understanding, and editing through a shared token space.

Mixpeek SDK Integration

from mixpeek import Mixpeek

mixpeek = Mixpeek(api_key="YOUR_API_KEY")

mixpeek.ingest.videos(
    collection="media_library",
    source={"type": "s3", "bucket": "video-assets"},
    pipeline={
        "captioning": {
            "model": "mixpeek://video_extractor@v1/bytedance_lance_3b_v1"
        }
    }
)