What is Mixpeek?

[Back to Blog](/blog)

[](https://twitter.com/intent/tweet?text=Multimodal%20Monday%20%2329%3A%20Sampling%20Smarts%2C%20Composable%20Control&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fmultimodal-monday-29)[](https://www.linkedin.com/shareArticle?mini=true&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fmultimodal-monday-29&title=Multimodal%20Monday%20%2329%3A%20Sampling%20Smarts%2C%20Composable%20Control)[](https://www.reddit.com/submit?url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fmultimodal-monday-29&title=Multimodal%20Monday%20%2329%3A%20Sampling%20Smarts%2C%20Composable%20Control)

This was originally in our newsletter.

Get Updates

Oct 20, 2025•6 min read

# Multimodal Monday #29: Sampling Smarts, Composable Control

Multimodal Monday #29: Claude Haiku 4.5 runs twice as fast at one-third cost, Trace Anything maps videos to 3D trajectories for motion search, and VIST3A stitches text-to-3D without retraining.

![Multimodal Monday #29: Sampling Smarts, Composable Control](https://blog.mixpeek.com/content/images/2025/10/mm_29.png)

Multimodal Monday

TABLE OF CONTENTS

Multimodal Monday 29

0:00

/951.716281

1×

## Quick Hits (TL;DR)

**Small models match last year’s best** - Claude Haiku 4.5, PaddleOCR VL 0.9B, Qwen3-VL 4B deliver frontier performance at fraction of the size.

**Better sampling can beat bigger training** - Harvard proves your base model already has the intelligence.

**Control is composable now** - Ctrl-VI and Veo 3.1 mix text, images, trajectories, and camera paths in one shot.

## Research Highlights

#### **Reasoning with Sampling: Your Base Model is Smarter Than You Think**

Harvard researchers developed power sampling, an MCMC-based method that unlocks latent reasoning in base models without any training. Their approach matches or beats RL-finetuned models on MATH500, HumanEval, and GPQA while maintaining generation diversity.

 Your browser does not support the video tag.

**Links:** [Project Page](https://aakaran.github.io/reasoning_with_sampling/?ref=blog.mixpeek.com) | [Paper](https://arxiv.org/abs/2510.14901?ref=blog.mixpeek.com) | [Twitter](https://x.com/aakaran31/status/1979194052697280712?ref=blog.mixpeek.com)

#### **Ctrl-VI: Controllable Video Synthesis via Variational Inference**

Stanford and MIT built Ctrl-VI, a video synthesis system that handles everything from text prompts to precise 4D object trajectories and camera paths. The framework uses variational inference with step-wise KL divergence minimization to produce controllable, diverse videos with 3D consistency.

**Why It Matters:** You get unified control from broad descriptions to pixel-perfect manipulation in a single system.

 Your browser does not support the video tag.

**Links:** [Paper](https://arxiv.org/abs/2510.07670?ref=blog.mixpeek.com) | [Twitter](https://x.com/zhang_yunzhi/status/1978995191718564312?ref=blog.mixpeek.com)

#### **FlashWorld: High-quality 3D Scene Generation within Seconds**

Tencent, Xiamen University, and Fudan created FlashWorld, which generates high-quality 3D scenes from text or image prompts in 5-10 seconds. The model produces 3D Gaussian representations directly instead of going through multi-view intermediates, combining 2D diffusion quality with 3D geometric consistency.

**Why It Matters:** You can now generate production-quality 3D assets faster than you can describe them.

 Your browser does not support the video tag.

**Links:** [Project Page](https://imlixinyang.github.io/FlashWorld-Project-Page/?ref=blog.mixpeek.com) | [Paper](https://arxiv.org/abs/2510.13678?ref=blog.mixpeek.com) | [GitHub](https://github.com/imlixinyang/FlashWorld?ref=blog.mixpeek.com) | [Announcement](https://x.com/TencentHunyuan/status/1979087059198324805?ref=blog.mixpeek.com)

#### **Trace Anything: Representing Any Video in 4D via Trajectory Fields**

ByteDance SEED released Trace Anything, which maps every pixel in a video to a continuous 3D trajectory using B-splines in a single forward pass. The model achieves state-of-the-art performance on trajectory estimation and point-tracking while being significantly faster than iterative methods.

**Why It Matters:** You can search videos by motion patterns instead of just visual features.

 Your browser does not support the video tag.

**Links:** [Project Page](https://trace-anything.github.io/?ref=blog.mixpeek.com) | [Paper](https://huggingface.co/papers/2510.13802?ref=blog.mixpeek.com) | [Code](https://github.com/ByteDance-Seed/TraceAnything?ref=blog.mixpeek.com) | [Model](https://huggingface.co/depth-anything/trace-anything?ref=blog.mixpeek.com) | [Twitter](https://x.com/xinhangliu123/status/1978861908632412547?ref=blog.mixpeek.com)

#### **VIST3A: Text-to-3D by Stitching a Multi-View Reconstruction Network to a Video Generator**

ETH Zurich and Google unified a video generator with a 3D reconstruction model through model stitching, connecting a pretrained 3D foundation model into the video VAE’s latent space via lightweight linear mapping. The system generates 3D representations directly from text without needing 3D training labels.

**Why It Matters:** You can plug in new 3D models as they improve without retraining everything from scratch.

 Your browser does not support the video tag.

**Links:** [Project Page](https://gohyojun15.github.io/VIST3A/?ref=blog.mixpeek.com) | [Paper](https://arxiv.org/abs/2510.13454?ref=blog.mixpeek.com)

#### **Virtually Being: Customizing Camera-Controllable Video Diffusion Models with Multi-View Performance Captures**

Eyeline Labs enables multi-view character consistency and 3D camera control in video diffusion using 4D Gaussian Splatting and video relighting.

**Why It Matters:** You get consistent characters across camera angles for virtual production workflows.

 Your browser does not support the video tag.

**Links:** [Project Page](https://eyeline-labs.github.io/Virtually-Being/?ref=blog.mixpeek.com) | [Paper](https://arxiv.org/pdf/2510.14081?ref=blog.mixpeek.com)

#### **LabOS: The AI-XR Co-Scientist That Sees and Works With Humans**

LabOS combines computational reasoning with physical experimentation through multimodal perception and XR-enabled human-AI collaboration.

**Why It Matters:** AI agents can now work alongside humans in physical lab environments.

## Run this on your own content

Point Mixpeek at the storage you already have and search your video, images, audio, and documents the way this post describes. Build starts at $25/mo for up to 1M vectors.

[Search your own files](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=blog_onramp_mid&utm_campaign=mvs_onramp)[Talk to us](/demo)

![Diagram panel A shows lab OS planning analysis self-evolving AI with sections for data manager down streaming agent design coding experiment protocol and tool agent self tool chain critic in end-to-end loop. Panel B displays real-time guidance live via XR for AI collaboration with images of a person in lab coat viewing screens experiment setup 20x faster lab time data stream guide and real-time data stream overview.](https://substackcdn.com/image/fetch/$s_!Ylxo!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b55ce63-1490-4d84-bd5d-a8358109f0e7_1200x600.jpeg "Diagram panel A shows lab OS planning analysis self-evolving AI with sections for data manager down streaming agent design coding experiment protocol and tool agent self tool chain critic in end-to-end loop. Panel B displays real-time guidance live via XR for AI collaboration with images of a person in lab coat viewing screens experiment setup 20x faster lab time data stream guide and real-time data stream overview.")

**Links:** [Paper](https://arxiv.org/abs/2510.14861?ref=blog.mixpeek.com) | [Twitter](https://x.com/MengdiWang10/status/1979238459605922117?ref=blog.mixpeek.com)

#### **VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents**

VAGEN enhances multi-turn VLM agents by integrating explicit visual state reasoning into the model’s thinking process.

**Why It Matters:** Agents maintain better state awareness across multiple interaction turns.

 Your browser does not support the video tag.

**Links:** [Project Page](https://vagen-ai.github.io/?ref=blog.mixpeek.com) | [Paper](https://vagen-ai.github.io/vagen_paper.pdf?ref=blog.mixpeek.com) | [Announcement](https://x.com/ManlingLi_/status/1979229245919629391?ref=blog.mixpeek.com)

#### **LAKAN: Landmark-Assisted Adaptive Kolmogorov-Arnold Network for Face Forgery Detection**

LAKAN introduces a new network architecture for detecting face forgeries. [Paper](https://arxiv.org/pdf/2510.00634?ref=blog.mixpeek.com)

![](https://substackcdn.com/image/fetch/$s_!LxhP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f5f5b41-ce8e-4697-84b1-44e73257892f_2076x906.jpeg)

The LAKAN module leverages facial landmarks to generate adaptive parameters for KAN and is applied to downsampled features from four different stages of the image encoder through gating mechanisms.

#### **Simple Projection Variants Improve ColBERT Performance**

Mixedbread AI investigated architectural improvements to ColBERT’s projection layer for late-interaction models. [Paper](https://arxiv.org/abs/2510.12327?ref=blog.mixpeek.com)

## Tools & Techniques

#### **Google Veo 3.1**

Google released Veo 3.1 and Veo 3.1 Fast through the Gemini API with richer native audio, better cinematic style understanding, and enhanced image-to-video. New features include ingredient-based generation with up to 3 reference images, scene extension for longer videos, and first-and-last frame interpolation.

**Why It Matters:** Reference image guidance and scene extension move video generation into production workflows.

 Your browser does not support the video tag.

**Links:** [Announcement](https://x.com/GoogleDeepMind/status/1978491999029219364?ref=blog.mixpeek.com) | [Blog Post](https://developers.googleblog.com/en/introducing-veo-3-1-and-new-creative-capabilities-in-the-gemini-api/?ref=blog.mixpeek.com)

#### **Anthropic Claude Haiku 4.5**

Anthropic released Claude Haiku 4.5, delivering near-frontier performance at one-third the cost and twice the speed of models from five months ago. The model handles real-time, low-latency tasks and is available on Claude API, Amazon Bedrock, and Google Cloud’s Vertex AI.

**Why It Matters:** Frontier capabilities from earlier this year now run fast and cheap enough for production use.  
**Links:** [Announcement](https://www.anthropic.com/news/claude-haiku-4-5?ref=blog.mixpeek.com)

#### **Baidu PaddleOCR VL 0.9B**

Baidu released a 0.9B parameter multilingual VLM for OCR tasks.

![Image](https://substackcdn.com/image/fetch/$s_!jckW!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F50a461f8-c9f7-459d-b67d-c85f23e49d4d_1200x675.jpeg "Image")

**Links:** [Hugging Face](https://huggingface.co/PaddlePaddle/PaddleOCR-VL?ref=blog.mixpeek.com) | [Paper](https://arxiv.org/pdf/2510.14528?ref=blog.mixpeek.com)

#### **Alibaba Qwen3-VL-4B/8B**

Alibaba released Qwen3-VL models in Instruct and Thinking variants. More options in the 4B-8B parameter range for vision-language tasks.  
**Links:** [Announcement](https://x.com/Alibaba_Qwen/status/1978150959621734624?ref=blog.mixpeek.com) | [Models](https://huggingface.co/collections/Qwen/qwen3-vl-68d2a7c1b8a8afce4ebd2dbe?ref=blog.mixpeek.com) | [Cookbooks](https://github.com/QwenLM/Qwen3-VL/tree/main/cookbooks?ref=blog.mixpeek.com)

![Table comparing Qwen3-VL model variants including 4B 8B pairs across benchmarks like MMLU MMMU MathVista DocVQA VideoMME ChartQA AI2D TextVQA OCRBench MMVet RealWorldQA AgentBench with scores for Base Instruct Thinking versions in formats such as BF16 and FP8 showing high performance metrics in categories including general VQA document understanding video multi-discipline and agent tasks.](https://pbs.twimg.com/media/G3PNl5LaIAALYav?format=jpg&name=large)

#### **ImagenWorld**

Google released ImagenWorld, a large-scale benchmark for image generation and editing that makes model failures more visible. Better benchmarks expose where generation models actually break.

## Trends & Predictions

#### **1\. Continuous Representations Replace Discrete Ones**

Trace Anything doesn’t compute frame-to-frame correspondences. It learns continuous 3D trajectories. FlashWorld doesn’t generate multiple views. It produces 3D Gaussians directly. Veo 3.1 doesn’t concatenate clips. It interpolates smooth transitions. The shift from discrete to continuous representations runs through every major paper this week.

This matters because continuous representations are more compact, more queryable, and more composable. You can sample at any resolution. You can query based on derivatives and integrals. You can blend and interpolate smoothly. Discrete representations lock you into fixed sampling rates and make interpolation messy. Continuous ones give you infinite resolution and natural interpolation. The move to continuous isn’t just cleaner math. It’s fundamentally more powerful.

#### **2\. Composable Control Wins**

Ctrl-VI lets you combine text prompts with 4D trajectories and camera paths. Veo 3.1 adds reference images and scene extension. VIST3A stitches models together with linear mappings. The pattern is clear: systems that combine multiple control signals beat single-mode approaches. You don’t choose between high-level creativity and low-level precision anymore. You get both. This matters because creative workflows are messy. You need broad strokes and fine details at different stages. Composable control means you can start with a text prompt, refine with reference images, adjust specific object paths, and modify camera movement without switching tools.

## Community + Shoutouts

**Builder of the week:** Real-time head pose estimation for perspective correction. Clean implementation, practical use case.  
**Links:** [Reddit](https://www.reddit.com/r/computervision/comments/1o9bt0d/realtime_head_pose_estimation_for_perspective/?ref=blog.mixpeek.com)

 Your browser does not support the video tag.

**ComfyUI-QwenVL** brings seamless multimodal AI to ComfyUI workflows with text generation and image understanding.  
**Links:** [GitHub](https://github.com/1038lab/ComfyUI-QwenVL?ref=blog.mixpeek.com)

![QwenVL\_V1.0.0r](https://substackcdn.com/image/fetch/$s_!VQnO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed7383f4-3666-4cfc-b977-aa38f33f7189_2056x942.jpeg "QwenVL_V1.0.0r")

* * *

That’s a wrap for Multimodal Monday #29! Claude Haiku 4.5 brings high performance to low-latency edge scenarios, LabOS facilitates human-AI collaboration in physical lab settings via XR, and Ctrl-VI provides flexible control over video synthesis from prompts to trajectories, this week illustrates how refinements in efficiency, state management, and controllability are helping multimodal systems integrate more reliably into collaborative and creative processes.

_Ready to build multimodal solutions that actually work?_ [_Let's talk._](https://mixpeek.com/contact?ref=blog.mixpeek.com)

[PB

Philip Bankier

Philip’s expertise in RAG, data engineering, and AI agents makes him a natural fit to write about scaling multimodal data warehousing systems.



](/blog/authors/philip)

## Run this on your own content

Point Mixpeek at the storage you already have and search your video, images, audio, and documents the way this post describes. Build starts at $25/mo for up to 1M vectors.

[Search your own files](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=blog_onramp_end&utm_campaign=mvs_onramp)[Talk to us](/demo)

## Continue Learning

[

![Multimodal Monday #45: Birds, Whales, and the End of Latency](https://blog.mixpeek.com/content/images/2026/02/mm_45.png)

### Multimodal Monday #45: Birds, Whales, and the End of Latency

Your Weekly Multimodal AI Roundup (Feb 9 - Feb 16)

Read More





](/blog/multimodal-monday-45)[

![Multimodal Monday #44: Agents Ship Code, Robots Skateboard](https://blog.mixpeek.com/content/images/2026/02/mm44---with-milo.png)

### Multimodal Monday #44: Agents Ship Code, Robots Skateboard

Feb 2 - 9: GPT-5.3-Codex and Claude Opus 4.6 handle full software lifecycles from debug to deploy, MiniCPM-o 4.5 beats GPT-4o on vision tasks at 9B parameters running on-device, HUSKY skateboards using physics-based control, and TinyLoRA fine-tunes models with a single parameter.

Read More





](/blog/multimodal-monday-44)

### Author

PB

Philip Bankier

![Mixpeek Icon](/brand/logo-dark-icon.webp)

#### Multimodal Search, On Demand

Index, retrieve, and reason over videos, images, audio, and docs, all from a single API.

[Start Building](/start)

### Share

[](https://twitter.com/intent/tweet?text=Multimodal%20Monday%20%2329%3A%20Sampling%20Smarts%2C%20Composable%20Control&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fmultimodal-monday-29)[](https://www.linkedin.com/shareArticle?mini=true&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fmultimodal-monday-29&title=Multimodal%20Monday%20%2329%3A%20Sampling%20Smarts%2C%20Composable%20Control)[](https://www.reddit.com/submit?url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fmultimodal-monday-29&title=Multimodal%20Monday%20%2329%3A%20Sampling%20Smarts%2C%20Composable%20Control)