The Emerald City Problem: Measuring Campaign Impact

Every journey down the yellow brick road ends the same way. You reach the Emerald City, you meet the Wizard, and he grants you your heart’s desire. There is comfort in the certainty that a wise and powerful being will have all the answers.

Every advertising campaign ends in a similar way. The media runs, the reporting comes in, and suddenly there are numbers — impressions, video completions, click-through rates. These numbers feel like proof. It feels like you have answers.

But it isn’t quite as certain as you want.

The data is real. The activity happened. But there’s a difference between counting what occurred and understanding what it meant. That gap is where most campaign measurement quietly falls apart — and where a lot of advertiser anxiety lives too.

 

You’ve Reached the Emerald City. Now What?

You followed the road. You survived the poppy fields, outran the flying monkeys, and made it through the gates.

But inside the palace, the questions get harder.

Take video completion rates. When a video completion is recorded, it means the video played to the end. That’s it.

It doesn’t tell us whether someone watched with full attention or had the ad running in the background while making dinner. Both register the same way in the data. One of them was engaged with. The other was ambient noise.

Ad clicks have the same problem. A click is a click, but the intent behind it varies enormously.

Some clicks come from genuine curiosity, someone leaning in because the message landed. Others are accidental taps on a small screen. The metric counts them equally. The experience behind them couldn’t be more different.

This isn’t a criticism of these tools. Completion rates and click-through data are useful signals. They tell us something real about reach and engagement at a surface level. But surface-level measurement was never going to answer the harder question: did this campaign change how people think about us?

 

A Diploma Isn’t a Brain

The anxiety advertisers feel at the end of a campaign is understandable. There’s a lot of data. It should add up to something definitive. But measurement confidence isn’t the same as measurement depth.

Scarecrow gets a diploma. Does that mean he is finally smart? Lion gets a medal. Does that mean he finally has courage? Tin Man gets a heart-shaped clock. Does that mean he can finally feel?

No. These are symbols. External indicators. Meaningful impact — whether a message was retained, whether perception shifted, whether brand consideration actually moved — doesn’t show up in ad server data. It lives in people’s minds. And the only reliable way to access that is to ask.

 

What the Wizard Can’t Give You

What the Wizard couldn’t conjure, and what metrics can’t either, is genuine internal change.

Sentiment surveys, tracked over time, do what metrics can’t. They reveal whether audiences absorbed the message, how they feel about the brand before and after exposure, and whether the campaign moved the needle on the dimensions that actually matter for business outcomes.

This is especially powerful when there’s a baseline to work from. Pre-campaign survey data transforms post-campaign results from an isolated snapshot into a real measure of change. That before-and-after comparison — where audiences were when you set off down the road, and where they are now that you’ve returned — is where a campaign’s true impact becomes visible.

 

Pull Back the Curtain

We’re not asking advertisers to abandon their metrics. We’re asking them to hold those numbers with appropriate expectations.

Completion rates and click data belong in the report. They just don’t belong at the centre of it.

Confidence in a campaign’s impact comes from combining what media can measure with what research can reveal. Together, they give a complete picture. Separately, they each tell half a story, and half a story has a way of feeling like certainty when it isn’t.

Dorothy didn’t find what she was looking for in the Emerald City. The answer was never there. It was with her the whole time. She just needed the right question to surface it.

Campaign impact works the same way. The proof isn’t in the data your ad server generates. It’s in your audience: in what they remember, what they feel, and whether they think differently about your brand than they did before. Surveys ask that question. Metrics never do.

There’s no wizard. There’s just the work, and the willingness to measure it honestly.