NEWVectors or files. Pick a path.Start →
    Ad Tech
    9 min read
    Updated 2026-11-08

    Multimodal Attribution: Did the Video, the Podcast or the Article Drive the Sale?

    To tell which ad format drove a sale, combine a multi-touch attribution model for the touchpoints you can track, a marketing mix model for formats that never get a click (podcasts, CTV), and lift tests to confirm cause. Multimodal attribution adds what was in each ad and placement, read from the files, so the results say which creative and which context worked. Models, open-source tools and the join, step by step.

    Ethan Steininger
    By , Founder & CEO, Mixpeek
    Attribution
    Multi-Touch Attribution
    Marketing Mix Modeling
    Ad Tech
    Creative Analytics
    CTV
    Podcast Advertising

    Did the video, the podcast or the article drive the sale?



    Use three measurements together, because each one sees a different part of the path. A multi-touch attribution model splits credit across the touchpoints you can tie to one buyer, which mostly means clicks and site visits. A marketing mix model estimates each channel's contribution from spend and sales over time, so it covers podcasts, CTV and other formats that rarely produce a click. A lift test, where a region or a random group sees no ads from one channel, checks whether that channel caused sales at all. Multimodal attribution adds one input to all three: what was actually in each ad and in the content around it, read from the video, audio and image files, so the answer names the creative and the context that worked as well as the channel.

    Why do video, audio and text get credited unevenly?



  1. Last click credits the final step. Video and audio usually come early in a buyer's path and seldom
  2. end in a click, so a last-click report gives them little or nothing.
  3. Many formats leave no click. A podcast ad heard in a car or a CTV ad on a living-room screen reaches
  4. the buyer, who buys days later on another device. Podcast ads are counted by download under IAB Tech Lab's Podcast Measurement Technical Guidelines (version 2.3), which records that an episode was delivered. Whether anyone heard the ad is outside what a download can tell you.
  5. User-level paths have gaps. Fewer identifiers survive across sites, apps and devices, and the gaps
  6. fall hardest on formats that never send a visitor to your site.
  7. Creative is recorded as an ID. A report says ad 48213 drove 300 conversions and says nothing about
  8. what ad 48213 showed, so the finding cannot carry over to the next ad you make.

    Which attribution models are there, and which ones can I still use?



    ModelHow credit is splitWhat it under-credits
    Last clickAll of it to the final touchpointEverything earlier, where video and audio usually sit
    First clickAll of it to the first touchpointEverything that closed the sale
    LinearEqual shares to every touchpointDifferences in weight: a 6-second impression counts the same as a 20-minute podcast segment
    Time decayMore to touchpoints closer to the saleEarly awareness formats
    Position-based (U-shaped)40% to the first, 40% to the last, 20% shared by the middleMid-funnel content such as articles and reviews
    Data-drivenLearned by comparing converting and non-converting pathsTouchpoints it never sees, such as audio and offline


    Google removed first-click, linear, time-decay and position-based attribution from Google Ads and Google Analytics 4 in 2023, citing low use, which leaves data-driven and last click in those tools (Google's announcement). The rules-based models are still easy to compute yourself from a table of paths, and other analytics tools still offer them.

    How do I measure formats that never get a click?



  9. Marketing mix modeling (MMM). Model weekly sales against each channel's weekly spend or
  10. impressions, with carryover (adstock), diminishing returns, seasonality and price in the model. It needs no user-level data, so it covers podcasts, CTV, out-of-home and print. It needs a long history of weekly data in which spend actually varied. Two open-source frameworks: Google's Meridian (Apache-2.0) and Meta's Robyn (MIT).
  11. Lift tests. Turn a channel off in some regions, or for a random holdout group, and compare sales
  12. with the rest. Meta's open-source GeoLift designs and reads geographic experiments with synthetic control. A lift result is the best number you have for calibrating a mix model.
  13. Direct-response signals for audio. Promo codes, vanity URLs and a "how did you hear about us"
  14. question at checkout are cheap and undercount, so treat them as a floor.

    Where does knowing what was in the ad come in?



    Attribution tells you that a channel or an ad ID worked. To learn why, and to use it in the next campaign, each ad and each placement needs fields that describe it: the products and logos on screen, the words spoken, the text shown on screen, the type of scene, how soon the product appears, and the IAB Content Taxonomy 3.1 category of the content the ad ran next to. Join those fields to your conversions on creative ID and placement ID, and the same conversion data answers questions such as "do CTV ads that show the product in the first three seconds convert better?" or "which content categories do our podcast ads perform best in?".

    Tagging a few dozen ads by hand works. Tagging thousands of creatives and every placement consistently is where teams stall, and it is where reading the files with models pays off, since every file gets the same fields from the same models.

    StepWhat you doWhere it comes from
    1. Export conversionsConversions or credited value per creative ID, placement ID, channel and dayAd server, analytics tool, measurement partner or clean room
    2. Describe the creativeScenes, objects and logos, transcript, on-screen text, time to first product shotThe video, audio and image files
    3. Describe the contextContent category and topic of each placementThe page, episode or program the ad ran in
    4. Join and compareAdd the fields as columns to the data-driven model or the mix model, or compare results across groupsYour warehouse or notebook
    5. ConfirmTest the finding in an A/B or lift test before moving budgetYour experimentation setup


    What should I watch out for?



  15. Correlation. A creative feature that shows up in winning ads may simply follow the audience those
  16. ads were shown to. Test it before you rebuild a campaign around it.
  17. Thin slices. Splitting conversions by format, category and creative feature runs out of data fast.
  18. Group features into a handful of buckets and look at confidence intervals.
  19. Personal data. Join on creative and placement IDs, which carry none. Keep user-level paths with
  20. your analytics tool, measurement partner or clean room.

    How does Mixpeek fit?



    Mixpeek reads your files where they already live, in S3, GCS or any bucket, and turns what's in them into data your software can search, classify and moderate. In an attribution setup it covers the creative and context side: scenes, speech transcripts, on-screen text, objects and logos, and IAB Content Taxonomy 3.1 categories for each video, image and audio file, stored with that file's ID so they join to your conversion export. Attribution credit, user tracking and identity stay with your analytics tool, measurement partner or clean room. On the pricing page, video is $0.05 a minute for scenes, speech transcript and descriptions, on-screen text adds $0.10 a minute, and taxonomy classification is included.

    Related: how to fill content categories in a CTV bid request, the IAB Content Taxonomy 3.1 classification benchmark and the best ad tech AI platforms.

    Frequently Asked Questions



    What is multimodal attribution?



    It is measuring how ads and content in different formats (video, audio, images and text) contribute to conversions, using what is in each piece as well as where and when it ran. In practice it is an attribution model or a mix model with extra columns describing each creative and placement.

    Which attribution model works for video and podcast ads?



    Click-based models on their own undercount both. Use a marketing mix model or lift tests to size the channels that rarely produce a click, and a data-driven model for the paths you can track, then check one against the other.

    Can Google Analytics 4 attribute podcast or CTV ads?



    Only through visits it can see. GA4 offers data-driven and last-click attribution across the touchpoints it tracks, so a podcast or CTV ad with no later tracked visit from that channel is missing from the path. Promo codes, vanity URLs, a mix model and lift tests fill the gap.

    How do I find which creative elements drive conversions?



    Describe every creative with the same fields (products on screen, spoken lines, on-screen text, time to the first product shot), join them to conversions on creative ID, compare groups, and confirm the strongest difference with an A/B or lift test.
    Managed Mixpeek

    Put multimodal search to work

    Connect a bucket and Mixpeek runs the whole multimodal search pipeline for you: extraction, indexing, and search over your own objects. No models to wire up, nothing to host.

    Start with Managed
    MVS · bring your own

    Already have vectors?

    Keep your embeddings on your own cloud and run dense, sparse, and BM25 search directly on object storage. From $25/mo.

    Start with MVS

    Tag every creative and placement from the files themselves

    Mixpeek reads the video, audio and images in your bucket and stores scenes, transcripts, on-screen text and IAB Content Taxonomy 3.1 categories with each file's ID, ready to join to your conversion export.

    IAB classificationSee pricing

    Related guides

    Video Understanding

    How Does Scene-Level Contextual Targeting Work for CTV?

    Scene-level contextual targeting picks a CTV ad by the scene that plays just before the ad break, read from the video's frames, audio and captions, with no data about the viewer. Each scene is classified when the stream is ingested, the categories are stored with timestamps, and at the break the signal is a lookup. How it differs from program-level targeting, what it reads, how it reaches the bid, and who sells it.

    Read guide →
    Video Understanding

    Our Brand Safety Tool Flags Too Many False Positives on Video. How Do We Fix It?

    A brand safety tool over-flags video when it judges words instead of what the video shows, scores single frames out of context, applies one floor to every brand, and runs on a low default threshold against content that is rarely unsafe. Measure precision per category on a labeled sample of what got blocked, then fix the cause: score segments with picture, speech and on-screen text together, grade treatment as well as topic, and set tiers per brand. Covers the causes, how to measure them, a fix table, and where GARM stands since it shut down in 2024.

    Read guide →
    Video Understanding

    We Can't Tell What Content Our CTV Ads Ran Next To. How Do We Find Out?

    If you cannot tell what content your CTV ads ran next to, the record was never written: most CTV impressions reach the buyer with an app ID at best, and no show, episode or scene. Ask sellers for show-level reporting in the deal, add the VAST [CONTENTID] and [MEDIAPLAYHEAD] macros to your impression trackers so each impression carries the content ID and the second it played at, and have whoever holds the video join those two values to a scene index of the content. Covers what each party can see, the macros, the join, and what to put in a deal.

    Read guide →