1.  [](/)
2.  [Diagrams](/diagrams)
3.  You search inside the file, not for it

[Back to Diagrams](/diagrams)IR Foundations

# You search inside the file, not for it

You search inside the file, not for it

![Object decomposition: you search inside the file, not for it. A one-hour recording.mp4 is split into scenes (visual embeddings), speech (transcript embeddings on silence and speaker turns), faces (who appeared and when), and on-screen text (OCR of slides and captions). A whole file being findable is not the same as usable: the thing you need is a moment inside it, like 23,41 where the renewal number is spoken while the pricing slide is on screen. The same move works on video, PDFs, and audio: one file becomes dozens of small, independently searchable documents.](/diagrams/foundations/decomposition.webp)Full screen

You search inside the file, not for it

The biggest unlock in multimodal search isn't a model. It's a decision: stop treating the file as the unit of search.

A one-hour recording stored as one record can be found, but not used. The thing you actually need is at 23:41, where someone says the renewal number while the pricing slide is on screen. So you decompose: split on scene changes, silence, speaker turns. Each segment gets its own embeddings for what was shown, what was said, who appeared, and what text was on screen.

One file becomes dozens of small searchable documents. The same move works on PDFs (pages, then paragraphs) and audio (transcript segments).

This is the first thing Mixpeek does to any file you ingest, and every downstream capability depends on it.

Nobody ever needed the video. They needed the moment at 23:41.

## Where this diagram appears

*   [Guide: Multimodal Data Warehouse Architecture →](/guides/multimodal-data-warehouse-architecture)

Run this on your own data

Mixpeek turns video, images, audio, and documents in your object storage into searchable, timestamped results through one API.

[Search your own data](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=diagram_detail&utm_campaign=mvs_onramp)

## Related diagrams

[

![The unstructured-data problem: the large majority of enterprise data is unstructured (video, images, audio, and documents) that keyword systems and relational databases cannot search by meaning until it is turned into embeddings and indexed. The raw files are stored but not answerable.](/diagrams/foundations/unstructured-data.webp)

99% of your data has no rows



](/diagrams/unstructured-data)[

![An embedding turns meaning into coordinates: a model reads 'dog', 'puppy', and 'invoice' and outputs vectors, so 'dog' and 'puppy' land near each other while 'invoice' lands far away. Text, images, audio clips, video frames, and faces all map into one shared coordinate space where distance measures difference in meaning.](/diagrams/foundations/embeddings.webp)

An embedding is meaning turned into coordinates



](/diagrams/embeddings)[

![Semantic search as nearest-neighbor lookup: embed the query into the same vector space as your content, measure distance to every indexed point, and return the closest top-K results with no keyword matching. Exact brute-force compares against everything and is accurate but slow, while approximate nearest-neighbor (ANN) indexes like HNSW and IVF check a smart fraction of the space and return 95-99% of true answers in milliseconds.](/diagrams/foundations/similarity-search.webp)

Search by meaning = nearest neighbors



](/diagrams/similarity-search)