What is Mixpeek?

[Back to Blog](/blog)

[](https://twitter.com/intent/tweet?text=Visual%20Product%20Discovery%20to%20Increase%20Online%20Purchase%20Rates&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fvisual-shopping)[](https://www.linkedin.com/shareArticle?mini=true&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fvisual-shopping&title=Visual%20Product%20Discovery%20to%20Increase%20Online%20Purchase%20Rates)[](https://www.reddit.com/submit?url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fvisual-shopping&title=Visual%20Product%20Discovery%20to%20Increase%20Online%20Purchase%20Rates)

This was originally in our newsletter.

Get Updates

Jul 11, 2023•5 min read

# Visual Product Discovery to Increase Online Purchase Rates

Visual shopping allows shoppers to search by image, text, or a combination of both. This discovery experience uses A.I. to increase a store's purchase rate and size.

![Visual Product Discovery to Increase Online Purchase Rates](https://blog.mixpeek.com/content/images/2025/04/ChatGPT-Image-Apr-10--2025--11_11_32-AM.png)

Industry

TABLE OF CONTENTS

Have you ever seen a product or outfit that you liked but didn't know how to find online? Maybe you want a certain aesthetic, and putting that idea into words isn't really working.

Try typing "_green shoulder ties dress flowy bottom_" into your favorite apparel store's search bar. If it doesn't return the right results, they're likely not using **visual discovery.**

To showcase what's possible, we built an app using hundreds of stores: [try it out](https://web.archive.org/web/20250623213733/http://shimmer.so/).

Here's an example of it in action:

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-11.45.14-AM.png)

Shoppers can even combine pictures with words to find exactly what they're looking for. Search likes "_I want this product, but in a retro style_" are possible.

So let's dive into visual shopping and how it will shape the future of eCommerce.

[1 Minute Video Walkthrough](https://youtu.be/h0QMz1_g4O0?ref=blog.mixpeek.com)

## What is Visual Shopping? Is it Really a Game-Changer?

Starting with the science: Amazon published a paper where they introduced visual search via an A/B test and noticed an entire 2% increase in CTR (clickthrough-rate):

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-11.43.45-AM.png)

For a company that does 1.6m purchases per day [\[1\]](https://landingcube.com/amazon-statistics/?ref=blog.mixpeek.com#:~:text=How%20Many%20Orders%20Does%20Amazon,and%2018.5%20orders%20per%20second.), that's an instant increase in 32,000 purchases. Per day. This means every store that isn't using this technology is losing out on sales.

## Making the Most of It

There's a lot that goes into these systems, but let's highlight what they offer your shoppers in order to increase your store's conversion rates.

### Search by Description

Traditional online shopping supports keywords today, but the challenge is if those keywords aren't associated with the product, they won't turn up. Typically this is your merchandiser that's responsible for product tagging.

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-8.50.33-AM.png)

Ross, Marshall's, and TJ Maxx can attribute much of their success to the _treasure hunt_ of product discovery. Adding product discovery like this online is entirely possible with the right tooling.

### Search by Image

Rather than writing a detailed and possibly incorrect description, just upload a picture. Thankfully innovative companies are starting to adopt this tech:

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-8.52.40-AM.png)

### Search by Image & Description

You could even upload a picture of a trendy red sneaker and get recommendations for similar styles or different colors.

Here's an example, where we uploaded a picture of a dress and combined it with the terms "_longer and brown_":

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-9.08.37-AM.png)

Some other popular combinations can be "this picture but a retro style", or "this dress but with a bow".

## Adding Precision to Your Search: Refine, and Retry

You can even select the products you like, and refine them with another search. This takes the images you like and combines them with text to deliver results that overlap in similarity.

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-9.31.17-AM.png)

## Shopping your Feeds

Pictures and videos across the internet feature products your shoppers want. What if you could automatically tag them:

## Run this on your own content

Point Mixpeek at the storage you already have and search your video, images, audio, and documents the way this post describes. Build starts at $25/mo for up to 1M vectors.

[Search your own files](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=blog_onramp_mid&utm_campaign=mvs_onramp)[Talk to us](/demo)

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-9.13.36-AM.png)

You can even tag products across videos down to the timestamp:

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-9.14.33-AM.png)

💡

If you need to perform a keyword search across videos, [we got you](https://mixpeek.com/demo?ref=blog.mixpeek.com)

## Context is King

Let's say you search "_polo shirts":_

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-9.37.35-AM.png)

Then search "_green shirts":_

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-9.37.04-AM.png)

If the first result is not a green polo shirt, then the search failed to understand the history of the users' activity.

Visual shopping should understand how the user arrived at this search. It should take into account the interaction history of the user. They search a term, click a product then search another term, the results should be re-ordered to optimize for what they're looking for.

## Maximize Purchase Size with Bundling

Often you not only want to maximize the volume of purchases, but the size of each purchase. Therein lies the importance of **bundling**, which these systems understand how to do effectively.

For example, if a user is looking to purchase a yoga mat, you should certainly be presenting other recovery-related products. Amazon tends to do this quite well:

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/image.png)

Typically, again you'd rely on the merchandiser to make these associations, but with visual search systems, you can sit back and watch the A.I. make these categories automatically.

Another similar addition is to do a reverse image search on the same product. This gets you similar-looking products:

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-11.38.57-AM.png)

## So How do These Systems Understand my products?

Building a visual search system is complicated, here are the steps:

1.  **Establish bounding box** \- This allows our system to understand which parts of the image are the product to look up
2.  **Categorize products** - Different products are stored in different collections, we'll need to use the correct collection
3.  **Associate keywords** - Trends change daily, you need your search to understand that a "dad hat" is different from a "baseball cap"
4.  **Brand & sizing filtering** - One size certainly does not fit all, your users have specific criteria
5.  **Product search** - Finally conduct the search and return results

Here's what a final outcome could look like:

![](https://web.archive.org/web/20240409142517im_/https://learn.mixpeek.com/content/images/2023/07/Screen-Shot-2023-07-11-at-8.56.47-AM.png)

## Point and Click Solution, That Just Works

Your sales rely on the quality of your search results. Nailing down that perfect relevance is not easy.

Our eCommerce experts at Mixpeek take time to understand your catalog and your shoppers' habits to build a custom A.I. model that maximizes your stores' conversions.

Don't believe us? We'll put our money where our mouth is and conduct an A/B test for you, completely free of charge:

[Run an A/B Test on My Store](https://mixpeek.com/start?ref=blog.mixpeek.com)

Have questions on how to build this yourself? We're happy to share insights ☺️ [Just ask to speak with an engineer.](https://mixpeek.com/contact?ref=blog.mixpeek.com)

[ES

Ethan Steininger

Former lead of MongoDB's Search Team, Ethan noticed the most common problem customers faced was building indexing and search infrastructure on their S3 buckets. Mixpeek was born.



](/blog/authors/ethan)

## Run this on your own content

Point Mixpeek at the storage you already have and search your video, images, audio, and documents the way this post describes. Build starts at $25/mo for up to 1M vectors.

[Search your own files](https://studio.mixpeek.com/namespaces/create?mode=managed&utm_source=homepage&utm_medium=blog_onramp_end&utm_campaign=mvs_onramp)[Talk to us](/demo)

## Continue Learning

[

![AI Video Analysis for Sports: Build Automated Highlight Reels, Archive Search, and Performance Analytics](https://blog.mixpeek.com/content/images/2026/03/sports-blog-hero.jpg)

### AI Video Analysis for Sports: Build Automated Highlight Reels, Archive Search, and Performance Analytics

Sports broadcasters cut 4-8 hour editing sessions to 15 minutes using AI video analysis. Learn how to build automated highlight detection, archive search, and performance analytics pipelines for any sport.

Read More





](/blog/ai-video-analysis-sports)[

![IAB Contextual Classifier: Taxonomies for Videos and Images](https://blog.mixpeek.com/content/images/2026/02/ChatGPT-Image-Feb-15--2026--12_50_33-PM.png)

### IAB Contextual Classifier: Taxonomies for Videos and Images

Classify text, images, and video into IAB Content Taxonomy 3.1 categories using multimodal AI. Learn how it works under the hood and how to extend it for your contextual targeting needs.

Read More





](/blog/iab-contextual-classifier-multimodal-ai)

### Author

ES

Ethan Steininger

![Mixpeek Icon](/brand/logo-dark-icon.webp)

#### Multimodal Search, On Demand

Index, retrieve, and reason over videos, images, audio, and docs, all from a single API.

[Start Building](/start)

### Share

[](https://twitter.com/intent/tweet?text=Visual%20Product%20Discovery%20to%20Increase%20Online%20Purchase%20Rates&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fvisual-shopping)[](https://www.linkedin.com/shareArticle?mini=true&url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fvisual-shopping&title=Visual%20Product%20Discovery%20to%20Increase%20Online%20Purchase%20Rates)[](https://www.reddit.com/submit?url=https%3A%2F%2Fmixpeek.com%2Fblog%2Fvisual-shopping&title=Visual%20Product%20Discovery%20to%20Increase%20Online%20Purchase%20Rates)