1.  [](/)
2.  [Research](/research)
3.  Why Fine-Tuning Quietly Breaks Your Embedding Index (and AlphaWiSE's Fix)

[Back to Research](/research)

AlphaWiSE[arXiv:2607.15094](https://mxp.co/e/alphawise)

# Why Fine-Tuning Quietly Breaks Your Embedding Index (and AlphaWiSE's Fix)

Fine-tune a CLIP-style model and the cross-modal alignment that made old queries work shifts underneath your index: recall erodes with no warning. AlphaWiSE interpolates two frozen checkpoints with one learned coefficient per tensor to keep both, at zero added inference cost.

## Where this fits in Mixpeek

This is a Mixpeek operational hazard made concrete: change a collection's embedding model and every vector already in the index was written by the old model, so alignment drifts and recall silently degrades. The paper's fix (blend checkpoints) and its operational rule, pin embedding-model versions per collection, is exactly the discipline Mixpeek enforces so a model change never quietly breaks an existing index.

## About this research

Fine-tune a CLIP-style model on new data and the cross-modal alignment that made old queries work shifts underneath your index; recall erodes with no dashboard warning. AlphaWiSE interpolates two frozen checkpoints with one learned coefficient per tensor, fitted on a small exemplar memory, and bakes out a single model with zero added inference cost. Also covers the operational fix: pin embedding-model versions per collection. Paper: arxiv.org/abs/2607.15094

embeddingsmodel-driftversioningalignmentreliability

## Frequently asked questions

Why does fine-tuning break existing embeddings?+

## Go deeper

*   [Diagram: The embedding landscape →](/diagrams/embedding-landscape)

Put the research to work

Mixpeek turns video, images, audio, and documents in your object storage into searchable, timestamped results through one API: the retrieval stack these papers describe.

[Search your own data](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=research_detail&utm_campaign=mvs_onramp)

## Related research

[

![How Reverse Video Search Works: Embeddings, Time, and Copy Detection](https://cdn.mixpeek.com/videos/thumbs/85-reverse-explainer.jpg)

Meta AI

How Reverse Video Search Works: Embeddings, Time, and Copy Detection



](/research/video-similarity-challenge)[

![LoRA Fine-Tuning Explained on a Real Model: Train 1% of Qwen2.5-1.5B](https://cdn.mixpeek.com/videos/thumbs/75-lora.jpg)

Microsoft

LoRA Fine-Tuning Explained on a Real Model: Train 1% of Qwen2.5-1.5B



](/research/lora)