A Success/Failure method for Analytics

When identifying the Key Performance Indicators (KPI) of your business, it makes sense to choose the proper measures of success. I have written about choosing the proper measures of success in the past. Since most of the work that I do is in the realm of the web, the principles via which we operate and do reports are more or less the same.

The only thing that changes is the conversion … or the success metric. In other words, the reason for which the website is built, the purpose of that site. Hence, the measure of success approach works.

Designing for new paradigms

However, what would happen if the product being built is not meant for the web, or was not based on the same principles? How would we go about identifying metrics and actionable reports.

For that we would have to go to the very reason why we need analytics.

The Purpose of Analytics

If I were to define the reason why we use analytics in any product, it would be to –

  1. Identify the wins, celebrate them and try to find the rules which get us more wins
  2. Identify the failures, and figure out ways to fix those failures so that we can improve

This view helps us do two things primarily, one to find out and scale the good things, and the other to find out and weed out the bad things in our product.

To do this, we would need metrics (or KPIs) that would indicate a success or a failure.

Measures of Success

The measure of success metric help in identifying the clear wins and celebrating them within the team. These also help in figuring out what worked for you in the past and on how to re-create those wins. One definitive thing that needs to be done (and I have learnt this the hard way), is that wins or measures of success metrics need to shared in a broader audience to give a sense of purpose to the entire team on what they are working on.

A good measure of success is task completion rate, or conversion rate, or profitability.

Measures of Failure

The measure of failure metric help in identifying failures within a certain activity. These are also metrics which help in identifying opportunities of improvement. Measure of Failure metrics should help us root out problems within our current design/product. I say root out, because once you identify the failure, you have to act and ensure that the failure does not happen again.

An example of measure of failure could be bounce rate.

Unlike measures of success, measures of failure may not be shared with large teams. Rather I feel (and I am want your opinion on this), that they are much more effective when communicated to the right localized teams.

Notes from Pune Digital Marketers Meetup

March has been an exciting month so far, with multiple speaking opportunities both for 13 Llama Studio and me.

On the 1st of March, I was invited to speak at the Pune Digital Marketers Meetup. In case, if you are in Pune and are working in this exponentially growing industry, then this is one meetup which you should not miss!

You can find more about them and their event schedule here – Pune Digital Marketers.

As having led the digital marketing campaigns of one of the companies that I used to work for, I had a few thoughts on how to go about setting up a monitoring framework for start-ups. Sharing this would help me quickly gauge –

  1. Can this framework be improved
  2. Is there merit in this approach

Not to mention that I think that there is huge potential in this approach and one of the goals that I have would be to create a product in and around this space. This meetup was an opportunity not only to check this in action (that has already been done, in fact the approach is a gist of what my learnings have been).

In fact, for those interested in learning this in a more formal method, we have partnered with EduPristine to offer this as a certified course in Digital Marketing. As far as I know, this course is being conducted in India across all major metros and also in the form of webinars during the weekends.

Here is my deck,