1.  [](/)
2.  [Diagrams](/diagrams)
3.  How Reranking Works: Recall Wide, Then Score Precisely

[Back to Diagrams](/diagrams)Diagram Series

# How Reranking Works: Recall Wide, Then Score Precisely

How Reranking Works: Recall Wide, Then Score Precisely

![How reranking works: a fast bi-encoder recalls ~1,000 candidates from the full corpus, then a cross-encoder jointly scores each (query, document) pair to reorder the top results, fast recall, then precise scoring.](/diagrams/how-reranking-works.webp)Full screen

How Reranking Works: Recall Wide, Then Score Precisely

Your vector search returns the top 10 by cosine similarity. Fast, scalable, and approximate. The problem is that "approximate" means those 10 aren't always the real top 10.

Reranking fixes it with two stages.

First, a bi-encoder pulls 1,000 candidates out of a million documents in milliseconds. It embeds the query and each document separately, which is what makes it fast: you precompute every document vector ahead of time. The downside is it never looks at the query and document together, so it misses the subtle stuff.

Then a cross-encoder re-scores those 1,000. It reads each query and document as one input and sees both at once, which catches the token-level interactions the bi-encoder can't. That runs about 100ms per pair, so you only run it on the shortlist, never the full corpus.

What you get back is score redistribution. A document sitting at #47 by vector similarity can jump to #2 after the cross-encoder. The scores don't just reshuffle, they spread apart. The genuinely relevant results pull ahead and the false positives fall away.

So why not cross-encode everything? At 100ms a pair, scoring a million documents takes 28 hours. The bi-encoder narrows the field first.

Two variants worth knowing. MMR penalizes redundancy, so your top results stay diverse instead of five takes on the same thing. Learned reranking trains on your click and conversion data to fit your specific use case.

If you're building RAG or product search, or anything where the top 10 is what actually drives the outcome, reranking is where the precision comes from.

## Where this diagram appears

*   [Guide: cross encoder reranking →](/guides/cross-encoder-reranking)

Run this on your own data

Mixpeek turns video, images, audio, and documents in your object storage into searchable, timestamped results through one API.

[Search your own data](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=diagram_detail&utm_campaign=mvs_onramp)

## Related diagrams

[

![Reranking is the precision second stage of retrieval: a fast first-stage retriever recalls a broad candidate set optimized for recall, then a cross-encoder reranker reads each query-document pair together and re-scores them so the most relevant results rise to the top before they reach the model. Fast recall first, precise scoring second.](/diagrams/foundations/reranking.webp)

Wide net first, careful read second



](/diagrams/reranking)[

![Documents fill empty buckets with a mean; queries sum and leave empty buckets zero: the asymmetry is what makes the FDE dot product approximate Chamfer / MaxSim.](/diagrams/muvera-query-doc-asymmetry.webp)

MUVERA: Why Query and Document Are Encoded Asymmetrically



](/diagrams/muvera-query-doc-asymmetry)[

![Tier 1 FDE-encodes the query and does fast single-vector ANN over all N to get a top-K; tier 2 reranks only those K with exact Chamfer over the original token vectors.](/diagrams/muvera-two-tier-retrieval.webp)

MUVERA: Two-Tier Retrieval (Cheap FDE Recall, Exact Rerank)



](/diagrams/muvera-two-tier-retrieval)