The Marketing Measurement Maze: measuring marketing is a mess.

Forgive the illustrative nature of the headline  – but I had to laugh out loud about this whole thing or else I would cry.

This post is a follow up to my previous post about how fragile measuring marketing technology really is based on a real time experience I was having with Technorati regarding the authority ranking of this blog.    Unhappily, my initial concerns about marketing measurement were realized so it is worth recapping.

About a week ago, by accident, I learn that according to Technorati this blog, getting a mere 1,000 visitors a month, vaulted 4x in authority rankings to about 400 when previously I ranked about 100. For about a week, I jumped up and down a few times going between 400 and then 600 (see pictures in my previous post).I contacted Technorati and told them I think there is a glitch. I got a very polite answer to tell me they are updating their rankings system and some blogs are radically shifting in position as a result.  Sounded rather fuzzy to me, but hey – what do I know?

After that response, over the course of the next 3 days, my blog bounced around some more in the 400 to 600 range and then yesterday I seem to have settled back into my original humble ranking of about 100. OK – I think – that sounds more reasonable – except now I am not even listed in the directory at all!

I went from a blogger superstar to a non entity in just three days and it is still not “unglitched”.

To put this into perspective, I get that when you are making improvement to a site, things go weird for a bit. But since Technorati is largely viewed as the authority on blogging ranking (and thus ad value), this whole episode is ample proof of the sorry state of measuring marketing efficacy. You often can’t trust the measurement data because of innocent technology glitches and then you have no way to verify the accuracy of the measurement reporting data you’re getting.

While it’s tempting to brush this aside as some little blimp in the world of marketing measurement – you can’t because the financial consequences can be significant. Imagine if my blog was a commerce oriented site or if I am advertiser trying to assess what’s the audience reach of all these blogs. Such variations in rankings can mean a lot of money gets spent or not depending on which side of the glitch you happen to fall on.  And this type of glitch is just the tip of the iceberg. I have seen measurement issues across the marketing landscape from traffic reporting to ad buys to data you get from PPD or CPL marketing programs.

Bottom line. It’s time to get serious about measuring marketing efficacy. Now it is a mess!

Judy Shapiro