Demystifying (not provided) Keywords

Removing (not provided)

Google has started protecting signed in users by not reporting their search terms, instead we see a (not provided). People have written this off saying that the number is insignificant, in fact you can make use of this nifty little Custom Report to check the impact of how many searches are not reported to you. Over a period of time, it has grown to be a huge 39% of the total organic results worldwide.

Blog owners have every right to be concerned; they are missing data and for content driven blogs, this can be painful. I have noticed that for all my games posts, the %age is quite high … 70%!!!

However, there is an alternative. If you are concerned with finding out the keyword data about your site, then you can retrieve this data from Google Webmasters (GWMT). This in combination with the Top Content Report for the Non-Paid search traffic segment should get you any data you require.

Combining the GWMT data with Analytics will help you get a better understanding for the funnel data on each of your individual keywords … all the more so if you have Goals configured.

Do note that there is a slight discrepancy in the data that is reported in GA and the one which is reported in WMT. GA reports visits, WMT reports clicks. GA’s SEO report does not provide the data of the past 2 days, WMT does. So if you are just starting out, using WMT would help you gain more insights on your on-page optimization as compared to simply using Google Analytics.

Edit: I found this great (but a tad tedious) article on SEOMoz on how you can decode the (not provided) keyword. If you are not well versed with Google Analytics and Filters, then I would suggest you skip it.

What is Branded Traffic?

Have you ever searched your own name on Google?

Don’t answer that, it’s a trick question! We all have!! In fact, if you have not yet (which I would be surprised to know), you must be doing that by now!

It’s always the little bit of curiosity, perhaps a bit of reflection that drives us to see what gets listed on our own name … on our brand name. We people are brands, and the reason we search our own names is to see what shows up in the search … do our profiles show up or does a different person stealing away your thunder!

Site owners also do this, in fact they have a nice name for traffic which originates from such searches. It’s called Branded Traffic.

Branded Traffic is not only limited to search, a portion of the branded traffic is also the direct traffic viz., the set of people who already know your site URL by-heart (love you folks :-D).

Importance of Branded Traffic

Shakespeare had written in his famed Romeo and Juliet,

What’s in a name?

Well, apparently a lot! Branded Traffic is important for us …

  • These are the set of users who KNOW your site … who are searching for you. Be nice to them, these are your friends
  • If you do work on Search Engine Optimization (SEO) strategies, then you will notice that your brand keywords will have awesome Click through rates … eye popping ones. At EduPristine, the CTR of the “pristine” keyword is around 32%, that of “edupristine” is a whopping 70%!!
  • Google will always give you additional benefit for your branded keywords, so get ready to be ranked on top! In fact the sad state of the Indian SEO industry I see is that most of the sales people get clients using such statements like “

Sir, we will get you on the top of Google Rankings (Meh!!)

  • If you do have Conversions setup on your site, then you will notice that your brand keywords will perform better as compared to your non-brand keywords!! If this is not the case, then perhaps you should consider taking a serious look at your site’s navigation and information architecture
  • This traffic is yours for the taking! I cannot stress on how important tracking this metric is … in fact as your site becomes popular you should see an increase in this traffic. It’s the digital version of your brand value.

How do you measure Branded Traffic?

This one is easy-peasy!

In case if you have a Google Analytics (GA) account setup, go to Advanced Segments, and define one segment.

Branded Traffic

I have set this up in my GA, you can use this segment and customize the keyword field with your brand terms! Get the Custom Segment for your GA profile here. Please keep a note to edit this Advanced Segment after you import this in your account and change the brand keywords!!

Do set up this segment and watch the general metrics for your site. I am sure that for your branded traffic all the metrics would be outperforming the site average!

Doesn’t it feel good to be loved!

Understanding the __utmz Google Analytics Cookie

Google Analytics does tracking by using the urchin tracking cookies. In case if you do not know what are HTTP Cookies, then you need to start reading some of these articles that I am linking to!! They can give the crunch to your digital marketing initiatives.

Do bear with me through this post, I will get a bit technical. In case if you do understand a bit of PHP, you will enjoy this post. For now, just keep this information with you, it will come to your aid sometime later when you would be talking to your developers!

Some Cookie Basics first

So if you have any kind of server side script running on your server, then you can create your own cookies! You should know that on a PHP server environment, the entire set of cookies is available in the $_COOKIE reserved variable.

Isn’t this awesome? What this means is that with one line of PHP code, you can refer to all the cookies which are now on your site for each of your visitors.

If you take look under the hood, then you will see that there are many cookies used by Google Analytics.

kidakaka utmz cookie

Each of these cookies have a certain purpose. The way GA utilizes these cookies is well documented, and you can find the developer note here.

So why the __utmz Cookie?

The __utmz cookie contains the traffic source information in Urchin tracker format. It contains information about how and when an individual visitor hits your site for the FIRST time. That means whenever the visitor comes back to your site, this value remains unchanged.

Imagine a scenario wherein a visitor first sees a post of yours on Facebook, or on Google … or other traffic sources. The visitor comes to the site, checks out a few pages and goes away (… such a shame!!). After a few days, the same visitor comes back to the site via an ad. This time the visitor leaves his information on one of your contact forms (I do hope you are using these!).

How would you know that the user is a repeat visitor? The form will only contain data which is about the visitor’s current visit.

So, whom would you attribute this event to? Your advertisement (the later) or your social media sharing (the former)? Do you believe in first impressions or do you believe in the recency effect?

Without having information about the user’s previous visit to your site, you will always choose the later. Thus misattributing your visitor acquisition to the wrong medium! And that’s why the __utmz cookie is so important! In effect it represents a unique visitor for your website.

I treat the __utmz cookie as equal to a real person!!

Associated with it is a story, this story which rolls out in a set of visits. Google Analytics can tell you if you are willing to sift through the data that is available to you.

What can we do with this Cookie?

How do we bite into this Cookie? Well, there are more than one method of cutting this cookie!!

  • If you have conversions on your site (Downloads, Sales, Contact Forms, etc), then you can always use the value in this cookie to track the origin of the visitor. This will give you a definite number on which traffic source (and which marketing campaign) is more effective for you when it comes down to conversions.
  • Each __utmz has a unique value set, this unique value can be converted into a Custom Variable and you can then track a unique visitor across your site using this Custom Variable (the free version of Google Analytics allows 5 Custom Variables, so use them sparingly).
  • For the more technically sound platforms, you can use this and the other GA cookies to track the visitor ACROSS multiple visits. However, there are other tools which are far more easier to setup to do this viz., Mixpanel.
  • If you are betting a lot on acquisition of traffic via Search engines, then the __utmz cookie can be mined for keyword data … yes, the data which people are searching for and are coming to your site. However, as of 2013, GA only provides the keyword data of users who have not signed in into their Google Accounts (around 30% of the data is not available).

Hmmm … crunchy delight!! And nutritious as well!!

I would love to hear from you how else can we use this and the other Cookies. In the meantime, do start integrating your Cookies with your CRM for more visitor intelligence!

Connecting MySQL to Excel using ODBC Connector

We use vTiger CRM for capturing leads and general workflow management at Pristine. vTiger is by far one of the most feature rich and economical CRM solutions that are available in the market today. It lacks one thing though, a strong Reporting backbone, especially for the marketing department. So if you are running multiple campaigns across different mediums and capturing all these leads in vTiger using Webforms, then there are very few useful reports to find things such as Return on Investment (ROI) of all my marketing campaigns, or to find which campaign is working out on a day to day basis.

This is where we generally use Excel! I had written about one such report that we use to evaluate our daily and weekly campaign performance using Subtotals in Excel. You can of course pull data from vTiger in the form of a .CSV file and then run reports on it. However, if you have a local replica of the MySQL database of your CRM, then you can easily connect MySQL to Excel using Data Connections and MySQL ODBC Connector. Here are the steps on how you go about it –

  1. Obtain the MySQL ODBC Connector setup, select the appropriate version for you and install it
  2. Add an ODBC Driver – You can find this in Control Panel > Administrative Tools > Data Sources (ODBC). Here you will find all the existing ODBC Drivers listed, if you do not see any MySQL drivers listed, click on the Add button on the right hand side. In this list you will find the MySQL ODBC Driver that you had installed from Step 1

    Add ODBC Driver
    Add ODBC Driver
  3. On selecting the MySQL driver, you will be prompted to enter the database details that you wish to connect to. These are your MySQL Database details that you are maintaining on your local network (Pro Tip: Check for connectivity from your machine to the MySQL Server first! I have seen many a programmer waste endless hours trying to connect in vain.)

    Fill MySQL Details
    Fill MySQL Details
  4. Now you can import one single table from your target DB or you can choose to execute a query and fetch its results. I always prefer the later since then I can retrieve all the data I require in one Data Connection.

    Connecting to a table
    Connecting to a table
  5. Click on Save and Finish. Your ODBC Connection is ready to be used in Excel!

    Finish Connection
    Finish Connection
  6. Now open Microsoft Excel and switch to the Data Tab  and click on Connections to see all the data connections already present in the workbook. If it’s an empty workbook, then there will not be any data connections. Click on Add.

    Connection files on this Computer
    Connection files on this Computer
  7. Now your Connections are available in ODBC, so you need to click on Browse and click on the New Source to go to the ODBC Prompt.

    Connect to a new datasource
    Connect to a new datasource
  8. Choose your ODBC Connection and you are done!
  9. Now when you save the connection, Excel will pull the data and display it in your current worksheet! The only thing you need is mad ninja dashboarding skills to make your Excel look awesome!

Typically you would use this system if your dashboard or excel report is pretty much set and the data comes from a database which changes frequently (transaction based database). The only pitfall that I see of this method is that the size of the excel file can really shoot up if you are pulling in a lot of data. Stuff such as pivot tables also work a lot in increasing the excel file size. So try to be frugal in their use when you create a dashboard! The screenshots that I am including are from me connecting our Excel report to our CRM database.

 

PS – A word of advice, do not directly connect your live database to the Excel file. ALWAYS use a mirror!

The Cinderella Visitor

It’s surprising, every time I open Analytics, I learn something new about this product and I learn something new about my site … like the fact that I have to deal with Cinderella Visitors!

Here is a maths problem for you. In fact if you have pored through your Google Analytics account, I am sure even you would also have been stumped by the same problem.

Below is a screenshot of my site’s monthly traffic stats –

Monthly Stats

Now, yes … these are humble beginnings! That is why some of you should visit this site more often!! So if you look at the unique visitors (that’s the total number of visitors coming to the website), then it is 530. This is good, that means through the blog I am getting in touch with at least 530 people a month!! Holy cow!! That’s roughly 18 conversations in the day.

Out of those 530, a huge number are new visitors (511). So does that mean only 19 visitors are returning back to the blog for those 126 visits? Hmmm … that should not be that hard to find. One look at the Returning Visitors Advanced Segment should shed more light on this …

Returning Visitors

Well, this seems to the problem don’t it. Things don’t just add up here! 45 visitors are responsible for those 126 visits, which means that 485 visitors are responsible for those 511 New Visits. How can this be possible? These 485 people have come on the site ONCE ( … sigh!! aee jaanewaale ho sake to laut ke aajaa …), but the number of visits tell me otherwise.

Which should bring us to the real question of what does Google Analytics define as a visit? Here is an insightful article from Google about How Visits are Calculated in Analytics. There we have our answer –

A single visitor can open multiple visits. Those visits can occur on the same day, or over several days, weeks, or months. As soon as one visit ends, there is then an opportunity to start a new visit. There are two methods by which a visit ends:

  • Time-based expiry (including end of day):
    • After 30 minutes of inactivity by the visitor
    • At midnight

Ahhh! So if the visitor comes to the site, sticks around for more than 30 minutes without doing anything and then clicks on any other links, then its considered as ANOTHER visit. This should have been a sufficient reason IF the average visit duration was on the higher side, but since its not the case (and I write reasonable short posts too!), so the other method seems to be in action here!

At least 26 visitors have been around the site around midnight!! A quick check on my GA for hourly visits confirms my suspicions! I had 26 visitors coming to the website around midnight … and as the clock struck twelve, these Cinderella visitors fled (or at least Google Analytics made them fade away) and came back as New Visits!! By the way, in case if you are wondering why have you not heard about this term Cinderella Visitor before, then do not worry … I just coined it!

So where are the glass slippers? The glass slippers are the ubiquitous utmz cookies!!

Custom Reporting in Google Analytics

Google Analytics rolled out more than 5 years back, and it has been rocking ever since. The first free enterprise class analytics seemed to keep on adding more and more awesome features every year. Especially after the acquisition of the Urchin tracker system, GA has been the de facto analytics system for all websites.

Of course for the more seasoned people out there who cannot get their exact set of data from GA, there are other niche analytics products. In fact Avinash Kaushik has an entire chapter dedicated to this in his kickass of a book Web Analytics: An Hour a Day (I recommend that you do read this!!)

I have been seriously working on GA for about a year or so now and the more I use this tool, the more I learn about how little I know! That’s the thing with knowledge, by the time you know a lot, you think you know very little. I wish if the other way was true as well :-D

The thing with GA and what turns off most people is that the sheer volume of data it can show in those pretty little orange pages is a lot. So a cursory glance gives you loads of data, however to get an insight, you have to sift through this data. Create segments, look at those segments and search through various different reports to find that one insight which will help you drive more traffic, more leads, more sales to your site.

This is where Google has shone their brilliance, they have allowed web developers, analysts, webmasters and business intelligence guys to actually work together and create custom reports, custom segments which can be shared. Yes, so I can burn the midnight oil trying to find which content works best for my site … however if I had to do the same for another website, I would have to re-create all those steps all over again. What a colossal waste of time! But now, I can simply share that report/segment and voila!!

In the next few days, I will be sharing more custom segments as well as custom dashboards which you can simply import in your Google Analytics and start right off!

Starters guide to SEO

One part of my role at Pristine is building up the site traffic, be it via Paid Advertising, Referral traffic or via Search Engines.

Anyone who has indulged in Paid Advertising would know how expensive it can turn out to be if you do not know what you are doing. It can be very effective in the short term, however for long term and more sustainable results, relying on non-paid search results is far better. Hence SEO or Search Engine Optimization.

The problem with SEO is that almost everyone who has a website think that they should do SEO, and SEO is playing around with meta tags. Seems simplistic no? In the past month or so, the amount of people whom I have talked to regarding to SEO has shown how less people know about the workings. Add to it the complexity of the ever-changing algorithm of search engines such as Google, Bing, etc.

The idea behind SEO is to target specific keywords for specific pages on your site, so that when your target audience searches for those keywords, your site shows up in the search results.

Here are some tips which I would have appreciated when I started off. Please do keep in mind, that I am no self-professed expert in SEO, just that like all of us around here, even I am learning, and this post is one such humble attempt to share whatever that I have learned, and what I know works to get results. Having said that, I know it would help all of us if you could point out any errors that i have made, or make suggestions and provide additional tips!

  • Read up on your meta tags, some of them are useful. Make a note of the description and author tags, you would be working with description the most.
  • Do not target more than 2-3 keywords per page, since you have to use that keyword in all the different important sections of the page viz., description tag, title tag, h1 tag, main content, etc. you cannot really target 1-2 keywords without damaging the copy of your page.
  • If you are working with a tight budget, then use a free tool such as Traffic Travis, the demo version is free. If you have a decent sized budget, then I would highly recommend Pro SEO MOz, it not only has a very comprehensive SEO tool, but also it has an extensive knowledge base on SEO
  • Search Engine’s maintain the authority of websites, this is generally a factor of how well you write, and how many sites are linking to your content. Google especially is one search engine which rewards regular content creation, in fact the current search algo (don’t know why its called the panda update) also favors freshness of content. So the same page would rank higher if it were regularly updated.
  • Always look at the different search terms via which people are coming to your site. Those are essentially content creation triggers!
  • Many people swear by backlinking, citing different open directories to publish your site links. However, I am skeptical about this approach. The one thing I use this approach for is to check where are my competitors linking, and get my presence their as well. I think if you can create good quality content, then it will automatically fetch the backlinks that you require.
  • Search engines are also influenced by social behavior, so typically the search results shown in Google would be influenced with what your friends are sharing on your social networks. E.g- If I share this post on say Twitter and if you are following me on Twitter, then you would definitely see this as a search result!
  • SEO is a long drawn game, and it requires patience, practice and discipline. Do not expect magic to happen, it’s a slow and gradual process and does not happen over night. To hope for such miracles, either you need to be Larry Page or Steve Ballmer.