1.  [](/)
2.  [Diagrams](/diagrams)
3.  MUVERA: How a Multi-Vector Set Becomes One Fixed Vector

[Back to Diagrams](/diagrams)MUVERA / Multi-Vector

# MUVERA: How a Multi-Vector Set Becomes One Fixed Vector

How a Multi-Vector Set Becomes One Fixed Vector

![A variable-size set of token vectors becomes one fixed-size vector via SimHash bucketing, projection, and repetition: no neural encoder required.](/diagrams/muvera-fde-pipeline.webp)Full screen

How a Multi-Vector Set Becomes One Fixed Vector

MUVERA turns a document's whole set of token vectors into a single fixed-length vector you can put in an ordinary ANN index, without any neural encoder in the loop. It works in six steps: a document is ~100 token vectors (a variable-size, unordered set); a SimHash partition of k\_sim random hyperplanes splits space into B = 2^k\_sim buckets; each bucket is collapsed to one sub-vector (the centroid of the tokens that fell in it, and an empty bucket copies the nearest non-empty one by Hamming distance); each sub-vector is randomly projected down with a JL-style plus/minus-1 matrix; the whole construction is repeated R\_reps times with fresh randomness; and the results are concatenated into one fixed vector of dimension B x d\_proj x R\_reps. The point of the design is that the inner product of two of these Fixed Dimensional Encodings (FDEs) approximates the expensive Chamfer / MaxSim similarity between the original token sets: so a variable-size set becomes a fixed-size vector that drops straight into HNSW, IVF, or DiskANN.

## Where this diagram appears

*   [Guide: Late-Interaction Retrieval (ColBERT, ColPali, MUVERA) →](/guides/late-interaction-retrieval)

Run this on your own data

Mixpeek turns video, images, audio, and documents in your object storage into searchable, timestamped results through one API.

[Search your own data](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=diagram_detail&utm_campaign=mvs_onramp)

## Related diagrams

[

![An embedding turns meaning into coordinates: a model reads 'dog', 'puppy', and 'invoice' and outputs vectors, so 'dog' and 'puppy' land near each other while 'invoice' lands far away. Text, images, audio clips, video frames, and faces all map into one shared coordinate space where distance measures difference in meaning.](/diagrams/foundations/embeddings.webp)

An embedding is meaning turned into coordinates



](/diagrams/embeddings)[

![Semantic search as nearest-neighbor lookup: embed the query into the same vector space as your content, measure distance to every indexed point, and return the closest top-K results with no keyword matching. Exact brute-force compares against everything and is accurate but slow, while approximate nearest-neighbor (ANN) indexes like HNSW and IVF check a smart fraction of the space and return 95-99% of true answers in milliseconds.](/diagrams/foundations/similarity-search.webp)

Search by meaning = nearest neighbors



](/diagrams/similarity-search)[

![Documents fill empty buckets with a mean; queries sum and leave empty buckets zero: the asymmetry is what makes the FDE dot product approximate Chamfer / MaxSim.](/diagrams/muvera-query-doc-asymmetry.webp)

MUVERA: Why Query and Document Are Encoded Asymmetrically



](/diagrams/muvera-query-doc-asymmetry)