Monday, March 18, 2013

Measuring Marketing Effectiveness and ROI (Part 1)

Either William Lever or John Wanamaker once said: "Half the money I spend on advertising is wasted; the trouble is I don't know which half." This idea that we never know what return we get from marketing spend is one that has permeated over the years and is prevalent amongst many business leaders. Sometimes I don't think marketers help themselves by behaving in a way that just further drives this misconception. I have always had the view that everything is measurable - including everything I do as a marketer.

My basic framework for measuring anything is very simple. Everything you do, you do to drive a result. Every action is motivated by the intent to create an outcome. So measuring the effectiveness of your action should be tied to how successfully you created the outcome or the results you were hoping for. Now the tricky part comes in making the connection between your immediate action and the ultimate end result you are seeking to drive. And this is where marketers sometimes drop the ball.

The gap often comes when the end result you are seeking, for example increased sales, can not be tied to the direct action you are initiating, for example an advertising campaign. But that's often the case, even beyond marketing. The trick is to understand the chain of results that can ultimately be correlated to the end result. For example, when I was at Texas Instruments where we didn't sell online, the question was often asked by business leaders as to the value of our marketing campaigns. How could they be assured that the millions we were spending was leading ultimately to sales and especially sales to new customers.

The approach we took was to try and map the customer journey from the point they interacted with our campaigns. We also tried to understand the same journey from the other direction backwards - ie for a customer making a purchase, what other behaviors do they exhibit leading up to the purchase. What we found through this exercise is that obviously these customers spend a lot of time on our website downloading datasheets and application notes, watching videos, participating in our community and requesting samples of chips for their protoypes. In fact through some simple number crunching we discovered that 95% of the customers who purchase something had placed a request for the sample for that product earlier in their design cycle.

Now we were able to turn this around and measure the marketing campaigns in their ability to generate a sample request, and how many of those came from new customers. This became the "ultimate" down-funnel conversion. We evolved from there and mapped out an entire conversion funnel identifying key activities that a customer would perform online (or offline) as they go through their design/purchase process. With this framework theoretically you could even model a specific value to each of these conversions based on their correlation to revenue generation. You could for instance put a $ number against each conversion reflecting its ability to eventually drive revenue for the business. So for example, a downfunnel conversion would have a much higher value than an upper funnel conversion. Of course if these conversions were online then measuring them is a lot easier, but with the right diligence and systems every offline conversion can also be tracked and measured.

In Part 2 of this post, I will outline some concrete examples of how typical marketing activities can be measured based on my experience in ecommerce.

Sunday, December 9, 2012

If you can't measure it, you can't manage it. But if you measure everything, you still can't manage it. You need to find the optimal 'goldilocks' point.

I am not sure who quoted that you can't manage what you can't measure, but it definitely is a concept that is deeply embedded in business. And to a large extent I agree with the idea. In fact given my reliance on "data based decision making" rather than relying on opinions - it is important to me that we always measure everything we do - so we can understand if what we are doing is driving the desired result. In fact, in a subsequent post I want to challenge marketers who struggle to understand how every dollar spent on marketing can be measured for a return. That's for another day.

Today I want to focus on not being able to manage something if you can't or don't measure it. In my observations there is a danger here of going overboard - when everything starts to get measured. Every little thing - often because you can - managers start to spend time on irrelevant areas. I think there is an optimal "goldilocks" point to the number of things that you should measure and at that optimal point you drive the highest level of effectiveness to your ability to manage. But beyond that optimal point you quickly hit the 'law of diminishing returns' - where too much data on irrelevant items actually starts to distract you, lead you down useless discussions, and actually reduces your ability to manage effectively.

Too much measuring, leads to too much data, which distracts and confuses managers, leading to reduced management effectiveness.

So whats the solution? In my opinion, start with identifying what you will measure to determine the success of something. Ensure those things are measurable. Measure them and use the data to determine insights - and use those insights to optimize what you are doing. Adjust your approach. Tweak something. This optimization is more valuable than wasting your time digesting data that just takes you off your path to success.

Saturday, July 24, 2010

My talk at GasPedal's Word of Mouth Supergenius: Chicago Dec 2009

Just a month before I left TI, I spoke about TI's E2E community in Chicago at GasPedal's Word of Mouth Supergenius conference w/ Telligent's George Dearing. It was quite fun and I especially enjoyed meeting a lot of very smart people :)


How Texas Instruments' E2E Community is Driving Engagement -- presented by George Dearing and Devashish Saxena from GasPedal on Vimeo.

Thursday, May 27, 2010

Think Big. Start Small. Move Fast.

At a recent professional gathering, I ended my talk by urging people to "think big, start small, move fast." Interestingly enough I stated that we usually do two of these three really well, and fail miserably at the third. Then I invited people to join me in "starting small". I sincerely believe that is really important.

We want to be open to big ideas. We want to be creative and let that creativity drive us to explore new and unchartered paths. All good.

We also want to execute fast. You have been in those project meetings where the entire time is spent discussing the schedule and trying to hit a date (something that may be a little overrated - but that's another post). The desire and need to move fast is universal across industries and organizations - primarily driven by a goal of creating a first-mover advantage.

However, often we don't start small. And then you have something BIG, and you are trying to move FAST. And this increases risk of failure in multiple areas. Missing planned delivery dates is just the beginning, compromising on scope comes next and most importantly delivering something after a long development cycle completely exposes you to the chance that the market and user needs have already shifted - and that is the biggest risk of them all.

Hence the importance of starting small. Starting small allows you to move fast. Deploy incremental work. Watch real user usage and use that behavioral data to adapt and iterate. Reduces the above risks. Costs less to get first iteration out - something basic, that you can continue to build on.

Try it. Think Big. Start Small. Move Fast.

Saturday, May 8, 2010

New Guy/Gal Syndrome

I started a new job about three months ago. And in my first few months at the job, I have heard several comments alluding to the following central theme:

"Ha, you are still new. Let's see if you still feel this way in a few months"
"I felt the same way when I started ... hope that you are able to do more w/ it than I did"
"It's good to see you pushing for some of this stuff - but you are still fairly new"
"Dude, you still got the 'new guy syndrome'!"

Implying that:

The desire to push for positive and wanted shifts in an organization is inversely proportion to the length of time you have worked in that organization. Or that as you get more comfortable and acquire a longer tenure at the organization - your desire to change things goes down, primarily driven from a lack of success (I assume).

And the funny thing is most everyone around you assumes that will be the likely scenario.

What a shame!

My response:

"If having the 'new guy/gal syndrome' is what drives an individual to objectively look at organizational processes and strive to drive more effectiveness and efficiency, than as a leader I hope that this syndrome is contagious and that I can infect everyone else around me with it!"

There. Now you have it. Go, spread it. Go :)

Thursday, February 25, 2010

Enterprise 2.0: Changing the way we work

Good video from MIT's Andrew McAfee on the topic of Enterprise 2.0. I don't think there is a template answer to how this would work for any given organization. You have to adapt your approach based on the culture of the enterprise in question. However, in my experience what is tougher is not identifying or rolling out the platform, but changing people's behavior to do meaningful work using these new tools.



I have found that people who are avid users of 2.0 tools in their personal lives are (as you would expect) early adopters of similar tools in an enterprise environment. This is partly due to familiarity, but also because these individuals are more likely to spot how work that is done in a traditional manner in an organization can be done using the E2.0 toolset in a more effective and efficient manner.

I also agree w/ Andrew that you can not force people to behave in a certain manner (well, you can ... but it may not lead to long term adoption). Instead my hypothesis is, you let the early adopters build some small success stories that they get excited about, and let them pull others via their passion. In reality, a hybrid approach of structured/top-down and organic/bottoms-up seems to offer the best chances for success. The balance will be organization dependent.

What have you tried? What worked? What didn't?