NEWVectors or files. Pick a path.Start →
    Video Understanding
    8 min read
    Updated 2026-11-12

    How Do I Find What Makes My Best-Performing Video Ads Work? Tag Every Scene, Then Compare

    Split each video ad into scenes, tag what every scene shows (the hook, the product, people, on-screen text, the call to action), join those tags to each ad's results, and compare winners with the rest inside the same campaign and objective. Then confirm the pattern with an A/B test. Covers which attributes to tag, how to avoid crediting spend instead of creative, and how to run it on hundreds of ads.

    Ethan Steininger
    By , Founder & CEO, Mixpeek
    Video Ads
    Creative Analytics
    Advertising
    Video Understanding
    Clustering
    Taxonomies

    How do I find what makes my best-performing video ads work?



    Break every ad into scenes, tag what each scene shows, attach each ad's results, and compare your winners with the rest of the ads that ran under the same objective and budget. The attributes that keep showing up in winners and rarely in the others are your candidates: a face in the first seconds, the product on screen early, a spoken offer, a particular setting. Treat that list as a hypothesis and confirm it with an A/B test, because the ads that won also got more spend, and spend alone changes results.

    What a list of top ads misses



    Watching your five best ads shows what they have, and the other 95 ads may have it too. If every ad in the account opens on a face, a face in the hook explains nothing. A pattern only counts when it separates winners from the rest, which means you need the same tags on every ad, including the losers.

    Two more things distort a top-ads list:

  1. Delivery follows early results. Ad platforms shift budget toward ads that start well, so a winner often had more impressions, more audiences and more time than the ad next to it. Compare ads on a rate (cost per result, click-through rate, completion rate), and only ads with enough impressions to trust that rate.
  2. Objective and placement change what "good" looks like. A 6-second bumper and a 45-second product demo are judged on different metrics. Compare within one campaign objective, placement and format at a time.


  3. What should I tag in each video ad?



    Tag things you can see or hear and could change in the next ad. Each tag should be per scene, with a timestamp, so you can ask when something happened as well as whether it did.

    AttributeWhat to recordWhy it mattersHow to tag it at scale
    HookWhat is on screen and said in the first secondsAttention is decided early; Google's ABCD research puts it firstScene split plus a description of the first scene
    Product on screenWhether and when the product or packaging appearsSeparates ads that show the product from ads that only talk about itVisual search for the product, or a taxonomy of product categories
    PeopleFaces, how many, talking to camera or notTestimonial and creator styles behave differently from product shotsFace detection per scene
    On-screen textOffer, price, captionsMany feeds autoplay mutedOCR per frame
    Voice and soundVoiceover, music, spoken offerSound-on and sound-off placements differTranscription of the audio track
    SettingKitchen, street, studio, outdoorsContext can carry the messageScene description or a taxonomy of settings
    Call to actionWhat the ad asks for and whenThe last step before a clickTranscript and OCR near the end
    FormatLength, aspect ratio, number of cutsPacing differs by placementFile metadata and scene count


    Google's ABCD framework (Attention, Branding, Connection, Direction) is a useful checklist for this table. Google reports that ads following it showed a 30% lift in short-term sales likelihood and a 17% lift in long-term brand contribution in its work with Kantar (Think with Google).

    Step by step



    1. Export ads with their results. For each ad: an id, the video file, the copy, the campaign objective, placement, impressions and the metric you care about. Ad platforms export this from their reporting tools. 2. Split each video into scenes. Scene boundaries let you say "the product appears in scene 2 at 0:04" instead of "the ad contains the product". 3. Tag every scene. Use the attributes above. A fixed list of labels (a taxonomy) keeps tags comparable across hundreds of ads; free-text descriptions are useful for exploring but hard to count. 4. Group similar scenes. Clustering scenes by what they show surfaces patterns you did not think to tag, such as a recurring "unboxing on a kitchen counter" shot across brands. 5. Compare winners with the rest. Within one objective and format, mark the top group by your rate metric. For each tag, compare how often it appears in winners and in the others. Look for large gaps backed by many ads. 6. Test the pattern. Make two versions of one ad that differ only in the attribute, and run them as an A/B test, which Meta, Google and TikTok all support (Meta's A/B testing guide).

    Common mistakes



  4. Counting spend as creative. An ad that got ten times the budget will dominate totals. Use rates and an impression floor.
  5. Mixing objectives. An awareness ad and a conversion ad should not be in the same comparison.
  6. Too few ads. With a dozen ads, any tag can look like a winner by chance. Patterns become believable across dozens of ads per group.
  7. Tagging only the winners. Without tags on the other ads there is nothing to compare against.
  8. Stopping at correlation. The comparison tells you what to test, and the A/B test answers it.


  9. Doing it with Mixpeek



    Mixpeek indexes video ads from object storage and keeps every scene searchable, tagged and grouped, so the comparison above runs over hundreds of ads without anyone watching them. The Creative DNA template sets this up in one apply:

  10. Ads in, scenes out. Each ad is uploaded with its id, brand, copy and video. The multimodal extractor splits the video into scenes and embeds each one, and the ad copy is indexed separately.
  11. Search scenes in plain words. A retriever finds scenes by description ("a cup of coffee being poured", "someone talking to camera in a car") across every ad.
  12. Tag with a taxonomy. The template ships a product category taxonomy with eight labels that writes product_category onto every scene. In our 2026-11-11 test, eight public-domain sample ads became 50 scenes and every scene was tagged. Add your own taxonomies for hooks, settings or calls to action the same way.
  13. Group scenes into patterns. A clustering step groups scenes across brands by what they show and names each group, which is how recurring shots surface.
  14. Watch for competitors. An alert flags any new scene that shows another brand's product.


  15. The template stores the creative and its tags. Your results stay in your ad platform: join them to the scenes on the ad id, then run the winners-versus-rest comparison above. See pricing for what indexing costs per minute of video.

    Frequently Asked Questions



    How do I find what makes my best-performing video ads work?



    Tag every scene of every ad with the same attributes (hook, product on screen, people, on-screen text, sound, call to action), join each ad's results, and compare the top ads with the rest inside one objective and format. Attributes that appear far more often in winners are candidates; confirm each one with an A/B test.

    What should I analyze in a video ad's first seconds?



    What is on screen, whether a person or the product appears, whether there is text or a spoken line, and how fast it cuts. Google's ABCD framework lists attention as the first principle and suggests hooking the viewer from the start (Think with Google).

    How many ads do I need to find a real creative pattern?



    Enough that each group you compare has dozens of ads with enough impressions to trust their rates. With a dozen ads, chance differences look like patterns. Below that, use the tags to choose A/B tests rather than to draw conclusions.

    Can AI tag video ads automatically?



    Yes. Scene detection, multimodal embeddings, face detection, OCR and transcription cover most attributes in the table above, and a taxonomy turns them into fixed labels you can count. Spot-check a sample by hand before trusting the counts.

    Why do my winning ads stop working?



    Audiences see them repeatedly and respond less, and the platform keeps spending on them. Knowing which attributes made an ad work lets you build the next one with the same ingredients instead of rerunning the old one.
    Managed Mixpeek

    Put multimodal search to work

    Connect a bucket and Mixpeek runs the whole multimodal search pipeline for you: extraction, indexing, and search over your own objects. No models to wire up, nothing to host.

    Start with Managed
    MVS · bring your own

    Already have vectors?

    Keep your embeddings on your own cloud and run dense, sparse, and BM25 search directly on object storage. From $25/mo.

    Start with MVS

    Run this on your own data

    Point Mixpeek at the storage you already have and search your video, images, audio, and documents the way this guide describes. Build starts at $25/mo for up to 1M vectors.

    Search your own archiveRead Docs