Showing posts with label Web Analytics. Show all posts
Showing posts with label Web Analytics. Show all posts

Monday, June 17, 2013

The Future of Working with Data with Keeping Up with the Quants Author Thomas Davenport

Today, the increasing volume of data and the rate at which it’s captured has transformed many business professionals into de-facto data analysts. Thus, the ability to routinely execute quick, informed and data-based decisions is a top skill in demand in business today.

Author and professor Thomas Davenport’s new book, Keeping Up with the Quants, serves as a “quantitative literacy” guide for managers as they wade through the world of data today and tomorrow. Keeping Up with the Quants, co-authored by Davenport and Jinho Kim, covers the basics of quantitative analytics, the essential habits of effective analysts and insight on how business users and top-ranking quants can best collaborate.

Michael Koploy, Managing Editor at business intelligence software review company Software Advice, recently hosted a Google+ Hangout with Davenport to discuss key takeaways from the book and Davenport’s thoughts on the future of business analytics.

Among other topics, Davenport and Koploy cover:
  • The importance of balancing creativity with a regular, thorough analytical process
  • Why great companies hire great analysts--and why that isn’t likely to change anytime soon
  • Why visualization tools are effective at analyzing “Big Data”
  • How “Ph.Ds with personality” drive analytical innovation in business
  • Why everyone should dabble in coding
A full recording of the Google+ Hangout can be found below:

Software Advice has posted a blog post summarizing the key takeaways from the conversation on its Plotting Success blog, which you can check out here: Hangout with Thomas Davenport: The Future of Working with Data. Be sure to check out Keeping Up with the Quants: Your Guide to Understanding Analytics, on sale now. For further questions, connect with Koploy (@PlottingSuccess) or Davenport (@tdav) on Twitter.

Tuesday, July 31, 2012

Web analytics, business intelligence and big data

Is interest for Web analytics stagnating or even fading? According to Google Trends data, it still represents about 1/3 of the interest for business intelligence. But... at the same time, interest for Big Data is on the verge of surpassing business intelligence!



Despite the rebranding of the Web Analytics Association into Digital Analytics Association and evangelizing the term "digital analytics", people still largely refer to our discipline as "web analytics".



So... what does the future hold for digital analysts? I shared my thoughts in an article on Online-Behavior.com entitled "Big Data - what it means for the digital analyst". What does the future hold for you?

Monday, May 7, 2012

From WAA to DAA - what's in a name change?

This is a guest post from Joseph Carrabis, a mentor and friend who occasionally provides an unbiased independent and always very interesting view of the web digital analytics industry. One of his previous posts, "the unfulfilled promise of online analytics", written over two years ago, is still very relevant to this date - you might want to start there and come back. At the time, his views sparked a truckload of comments and I nodded Joseph in a previous post.

You Say Tomato, I say "Irrefutably demonstrate that you are different than what I recognize as a 'ToMAHto' and I'll call you a 'ToMAYto'".

Dan Linton Interviews NextStage CRO Joseph Carrabis on the Web Analytics Association-Digital Analytics Association rebranding.

(My thanks to Stéphane Hamel for his editorial guidance and to Dan Linton for helping to continue the myth that I'm intelligent. All opinions expressed are mine. This post is dedicated to Charles, NextStage's CTO, who periodically tells me "You're such an academic.")

In March 2012, the Web Analytics Association changed its name to Digital Analytics Association. In this article, Dan Linton interviews NextStage CRO Joseph Carrabis regarding that name change, what it means and whether it is likely to affect the Association's present and future.

Q1: How significant is this name change to you?

While I appreciate the question "How significant is the name change to you?", I'm not the audience that needs to answer it. To me, personally? Not much. I recognize that the world is changing and that rebranding is a simple strategy for claiming relevancy in a changing world, but rebranding purely to demonstrate relevancy without adaptation to the environmental changes (and this goes beyond indicating "we do mobiles, too!") is change without remissioning ("re-mission", as in "change of course", "recognition of new goals, new meanings, new purpose, ...") and is a futile endeavor.

Aboriginal societies rename (rebrand) individuals to designate status changes within that society and often the individuals will rebrand themselves based on life changes.

Whether aboriginal or modern society, rebranding only occurs when status changes. An individual or organization with a very strong brand (name identity) won't rebrand unless there's environmental (market) pressure to survive. That's evolution and any evolution is an indication the original organism is ill suited to the new environment.

Thus the greater question is "How deep does the rebranding go?"

Q2: Is "Digital" so different from "Web" really?

About five years ago, maybe. Between 2005-2007 the meanings were different and significantly so. Now, not so much so. If a recognizable difference exists it's probably a holdover from the first ten years of this 21stcentury and even then, only in the minds of luddites like myself - the "web" is what you get on your desktop's browser. "Digital" is what you hold in your hand. I mean, that's what "digital" relates to; your digits are your fingers, hence what you hold in your hand. This hearkens back to my statements early in 2007 that the history of technology is the placing of the most power in the most people's hands economically.

But the distinction I make in the above is one of device and by extension presentation because the presentation will be constrained by the device n which the information is presented. Device constraints are obviously a major consideration and the demonstration of this is the big selling points on successive generations of mobile devices - screen resolution, color density, speed and connectivity for example.

Those distinctions are the same ones that were touted ten years ago, twenty years ago and so on.

Now if the question is "Do people within the industry recognize a distinction between "web" and "digital"? then we're asking a completely different question and this leads to your next point.

Q3: Insiders mostly think "web site analytics" is far different from "mobile/web/app/social analytics" but from an outsider's perspective, do those two words really mean something different?

Note that Justin Cutroni wrote Radically Rethinking Web Analytics and it's an interesting read that answers the question from a branding perspective, not a use perspective (a la Defining "Definition" and People as "Programmable Entities" ). Identifying an activity (specifically, identifying one's self with an activity) is not the same as demonstrating the outcomes of an activity (specifically, demonstrating that one's activity produces specific outcomes). There are lots of people who can see a rocket launch and identify it as "rocket science" and the number of people who can get a rocket to launch is much smaller.

This difference between seeing and doing could be the divide Justin mentions re web vs digital analysts. But then membership numbers become confusing. Daniel Waisberg shared that the official WAA-DAA enrollment is "over 2,000". LinkedIn reports 11.5k or so members in the DAA Group. These numbers are after an eight year WAA-DAA history. Place those numbers against the number Justin offers for Google Analytics accounts (even counting inactives, multiple accounts, et cetera as was explained to me by ClickInsight's June Li ) and a social disparity appears - the active population is too small to sustain itself in anything but a highly networked world. The collapse of geographic boundaries is the only reason this "analytics diaspora" could maintain itself, and even then several other socio-cultural factors had to exist (many of them reported in the Unfulfilled Promise series).

But now another problem appears and it is demonstrated in Justin's post and the recent WAA-DAA rebranding: small cultures don't survive population fragmenting. Everybody knows about the great cultures of history, few know about the once thriving but too small to be sustained cultures of the Andean Blue Men, the GoatMen of Aguirra, the People of the Elk, ... Our only knowledge of them is from the scant oral and few written accounts of the Marco Polos who encountered them in their travels.
So while renaming et al is a fascinating exercise, the real goal should be population based (recruitment, unification, defragmentation, ...). The DAA should capitalize on its WAA roots as much as possible (as indicated in Justin's post) rather than completely rebrand. The situation reminds me of the chicken-or-the-egg question that exasperates semioticists; "What came first, the chicken or the egg?" is an illogical question. /Until someone pointed at some thing and said "That's a chicken." then there were no chickens to lay eggs that would hatch chickens, hence the chicken had to come first. The DAA was hatched from the WAA. It's first port of call should be all those web analysts Justin writes about.
Now, to answer Dan Linton's question...

The answer is within the question and the demarcation is between "insider" and "outsider", not between "web" and "digital".

I contacted forty individuals worldwide via email, Skype and phone; people whom I knew were in the online analytics field and who were involved in the WAA in some capacity or other (about half took part in The Unfulfilled Promise of Online Analytics study). The other unifying element of my sample was that their peers provided consistent evaluations of them as people (note that. I was evaluating by social status, not analytic ability). More specifically, I was separating "loyalty to the dollar" and "loyalty to the truth". "Dollar" is objective and binary, "truth" is subjective and analog.

One of the simplest ways to translate subjective, analog data into objective, binary data is via The Chinese General Solicitation : Does person A think person B is more apt to follow the dollar or follow the truth? People B who scored over 90% "truth" were those I interviewed.

Thus to the point of whether "digital" is so different from "web" and according to a fairly diverse group (whose only commonality was that their peers thought them a) truthful, honest people b) whose opinions weren't influenced by who was paying them), no, not really. The great rush, it seemed, was to catch up to where the industry was already going. All but a few people interviewed said that the industry was already "digital" and the majority of people were already doing "digital" so the name change was merely cosmetic.

It was at this point that those interviewed provided an internal demarcation regarding "insiders".

A few offered that the name change would allow for a rebranding of tools and trainings, requiring recertifications perhaps, but not because the tools were actually doing anything differently. They may be monitoring mobiles instead of websites but that was only a difference in access, not intention.

With this piece of information one can wonder who the insiders really are because the people actively doing the analytics have been adapting to the changing analytics ecology for a while. Thus if the name change represents nothing more than a new marketing opportunity, expect little real change - remissioning - to occur. You teach a WA course, correct? Has there been any discussion of teaching DA courses? And if so, is there any functional, operational change in what's being taught? How it's being taught? What actionability comes from the results?

The answers to these questions answer your Q3 question.

Dan Linton Responds: To my knowledge, those changes will come eventually but UBC like many academic institutions is a bit slow when it comes to the change approval process. The reality is though that the content already is inclusive of "digital" so I don't foresee any major changes.
The courses are mostly online reading with discussion forums and a few assignments which the tutors (like myself) mark and offer advice upon. The courses are more about "how to think about analytics" as opposed to any kind of technical training. I've always thought they needed to supplement them with far more tactical things like how to properly set up a dashboard in Excel, which is pretty basic but shocking how few people know how to do it.

Q4: Does the word "digital" reflect any piece of data stored on a digital medium (which is virtually every piece of data in the world now)?

Hmm...Within this context? Hmm... The question as phrased is fascinating. It indicates two-dimensional thinking. "Stored" relates to two things interacting with each other and can only be measured as an indication of existence. Something either exists in a given medium ("is stored") or not. There is no information regarding that thing's value, purpose, intention, function, et cetera. All we know is that that thing is interacting with the space bounded by the medium and that the interaction is "exists within". Ultimately these kinds of measurements are binary because all we can do is determine "Yes, it exists" or "No, it does not exist". If 50,000 people live in a city we've only summed 50,000 pieces of "Yes, it exists". We have no knowledge of what they're doing in that city. And if the only data we can collect is binary in nature, we need an enormous amount of binary sets to extract even the simplest information and make decisions.

Another fascinating element of the question is the use of the word "data", not "knowledge", "information" or "wisdom". Data is neutral in nature. Data in context is information. Knowledge provides structure to information, hence direction. Wisdom helps us decide if we want to go in that direction (actionability) or develop another structure, a new framework for that knowledge (applicability).

(image fromhttp://www.nathan.com/thoughts/unified/3.html)

Of course, wisdom doesn't come until you've screwed up lots of data, but there you go.
So if the basic form of the data is a series of existences, then yes, "digital" does reflect any piece of data stored on a digital medium. Should the WAA/DAA ever have to deal with social probabilities (where logical calculus rules) and neuromathematics, be prepared for big changes because "exists" is no longer the basis of the measurement. I use to get drink after drink after drink in bars because I could flip a coin and continually call the outcome (I discuss how to do this in Reading Virtual Minds V2: Theory and Application, by the way). Eventually I discovered I could make money by teaching others how to do it. What I was really teaching was a specific application of social probability theory.

But now we're discussing social, and most people doing social analytics are still taking binary measurements, so again, rebranding without remissioning. No new knowledge or wisdom, only new labels and titles.

Q5: Do you feel that the name change is simply cosmetic to refresh the WAA brand?

Dan, thank you for this lovely can of worms. How nice of you to hand it to me. The question is "Is this a renaming rebranding or a remissioning rebranding?" and in either case, change is always worth investigating. Change is adaptation is evolution.

This rebranding came to my attention when I received an invitation to a meeting. Normally invitations to any meetings quickly go into my trash bin. I hadn't received an invitation from this source in some time and my first thought was "They must be trolling their old email lists." Then I noticed the invitation had been rebranded.

Sort of.

All meetings that had once been WAA branded were now DAA branded. I'd also been told by a few people that what once were WAWs were now going to be DATs. The social-anthropologist in me kicked in. A fundamental concept in neuro- and psycho-linguistics is "If what you're doing isn't working change anything" and here in my Inbox was evidence that there had been change - a psychological and temporal distancing. The renaming was one thing, the changing dates (by some, I learned, not all) was real evidence of the latter's desire to separate from the former.

However, as often happens, exteriors had changed and not much else. The same people, the same purpose, the same goals, the same activities. The emperor had changed his clothes but still ruled the same way.

Was this some kind of splintering? Doubtful, considering the source. Was this a recognition of a fundamental flaw in the organizational logic? Ditto.

But my background is one of perpetual testing. I rarely take statements as valid regardless of source until I've tested them myself. What was this rebranding all about? That's what led me to conduct the survey I mentioned earlier in Q1c.

Organizational change has been necessary for a while. Several years back and at more than one con I openly stated thatthe WAA showed all the traits of a society in decline . Some people asked me what could be done to change that and I offered some suggestions based on historical precedents. Without going into agonizing detail, probably the best known historical precedent of a society in decline that successfully remissioned itself so that the society both survived and thrived is the United States before and after the US Civil War.

Much violence, much death, much destruction and in the end the one thing that linguists and social historians point to is that the change was conceptual; prior to the Civil War it was "THESE United States" and after it was "THE United States". The country went from a collection of individual entities who thought of themselves as "individual entities who were part of a group" to a single entity that was "the group". There's an old Greek proverb that fits this well, me thinks, "A civilization flourishes when people plant trees under whose shade they will never sit."

The WAA as I knew it and the pre Civil War US were suffering the same problem - lots of individuals who wanted to be recognized as individual parts of a group. The evidence of this was that people self-identified based on job title and company during casual conversation at conferences, nobody self-identified as some function or relation within or to the WAA. There is no organization until people are willing to self-identify with that organization. Likewise, how people self-identify demonstrates what they value. There were and probably still are a few people planting trees and I don't know if there's enough of them to insure future shade.

But as noted earlier, if the change produces only new names and titles then the emperor is changing clothes, not restructuring his kingdom and shade will neither exist nor long survive. The proliferation of conferences (many of them causing increased splintering rather than unifying), the changing of allegiances and alliances, the once friendly leaders now threatening to sue each other - it's almost as good as Tudor England! Everybody in Henry's court worked very hard to 1) get their way, 2) increase their own little empires and 3) keep their enemies at bay. Keeping the kingdom intact was everybody's stated purpose but only after 1, 2 and 3 were met.

Q6: ...or does it signify significant changes in the organization and the people involved?

There is another rule in neuro- and psycho-linguistics: Nothing changes until it absolutely has to.

Businesses won't bring about any change until they absolutely have to. From social and economic historians we also know that while a business may be a market leader it will not long lead the market because businesses have a remarkably poor ability to recognize internal threats. External threats are dealt with by protecting one's territory and as long as one is protecting, the only evolution that takes place is responsive, not adaptive, and responsive change results in evolutionary dead ends - the organism evolves to respond to a given threat perfectly but when the environment in which these two organisms thrive changes, they can't. They're designed for each other, not the environment, and can not survive in the changed environment. We're currently seeing this in the move to ebooks, except we're learning that ebooks are great for leisure reading and not for research/study reading (students using ebooks don't retain information as long or internalize it as rapidly as those using printed texts). People were planning on a new environment and it turns out that new environment is limited. Oops!

Organizations can bring on change but the only change they'll bring about is that which best serves their community. This is social and cultural anthropology writ large; determine which community best benefits from an organization's change and you learn who that organization serves. In the vernacular, Follow the Money.

I haven't noticed the fracturing of the online analytics community documented in theThe Unfulfilled Promise of Online Analytics trilogy decreasing (based on conversations I've had with those in it daily), and the fact that respondents to my Q3 survey differentiated "outsiders" from "insiders" from "Insiders" speaks volumes, me thinks, and is the final demonstrable answer to your question.

Q7: With this change in mind, do you see the DAA as leading, following, struggling to keep up, or slapping paint on a condemned building?

I recognize two issues at work here.

1) A few years back I was talking with someone very high up in the online analytics community and suggested they use the oncoming directional shift as an opportunity to take the lead. Their response was an emphatic "No!" They would loudly declare where the market is going but only after seeing where it went. This is a safe position but not a tenable one.

People who've taken NextStage trainings know about Towards and AwayFrom. Leading from the rear is an AwayFrom strategy and AwayFrom makes organization, effective communications, strategy making and planning, et cetera, extremely difficult. There are lots of ways to get "away from" a problem state and the (vast) majority of them do not get you any closer to a solution. Lots of money may be spent, lots of activity may occur and in the net result is zero. Success is declared by corporate - or organizational - decree, not by externally recognizable change.

What's exponentially worse is that there's only one way to minimize time and effort if you're an AwayFrom kind of person; go Towards the solution. Such solutions and Towards thinkers are easy to spot. They start where they are and step one step at a time until they've reached the solution. Towards thinkers keep their eyes on their desired outcomes and get there faster, more directly and with minimal expense in the long term.

Leading from the rear is a fascinating strategy and people who lead from the rear can not claim thought leadership. The two are incongruous. But now we're asking, "Is one function of the WAA/DAA is to offer thought leadership?"

In any case, the determination is one of following, not leading.

Next determine if the WAA/DAA is offering organization, effective communications, strategy making and planning, et cetera and providing them from the front or the rear? Is the WAA/DAA
  • Seeing where things are going then pushing their way to the center every time the migration ceases and declaring "This is where we're suppose to be"
  • Out in front and shouting "Everybody stay back until we find out if it's safe"
  • Fearful there's a cliff up ahead, counting the number of heads still on the plateau at the end of each day and deciding whether or not to declare there's a cliff without further investigation as to why there are fewer and fewer heads on the plateau at the end of each day
The United States government is going through the same thing right now. The time it's taking the Republican party to put forth a recognized candidate is indicative of this.

In any case, this determines whether there's any struggling and how much is involved.

2) One well recognized leader in the WAA told me that he's not a numbers person, rarely looks at site numbers and never pays attention to them. Yet this individual wanted help with their site. Another well recognized analyst told me that they don't use any analytics on their own site. How come? "It's not going to tell me anything useful."

These statements are not isolated by type or person and both indicate the leaders in the field have challenges with the industry's claims. Industry leaders demonstrating no faith in the tools of their industry creates amazingly deep problems within any community formed around that industry.

The building may be condemned but rather than rebuild it seems the owners have decided to invest in other real estate when good deals come along.

Q8: How will business outsiders who were vaguely familiar with the WAA view the name change? ...

That depends on their distance. The majority of the planet doesn't know WAA/DAA exists so the name change means nothing. How far outside does an outsider need to be to have a view on the name change? Consider myself. I would never refer to myself as a web, digital or online analyst and was once referenced as "an industry outsider". Yet businesses regularly contact me foradvice on their online analytics budgeting decisions and to recommend analysts to them. My first question is usually "How come my opinion matters?"

I know people in the business and have friends who self-identify as online analysts. I know of people who call themselves web analysts and started calling themselves online analysts years back. Again, this was due to market changes and not ability changes.

I suppose outsiders will view the change as they'd view any rebranding, a "Wait and See" attitude. WAA/DAA and marketing tend to be participants in an arranged marriage between families that still haven't learned how to get along, so "Wait and See" is a good place to be.

Q9: ...How do you think insiders view it? ...

There will be those who view it fearfully, those who view it hopefully, those who will wait and see and those who could care less. These groups will surface when any organization rebrands. Find out what is feared, what is hoped for, what is waited for and why apathy exists and in what numbers and operational paths for change reveal themselves.

There will be those who view it fearfully, those who view it hopefully, those who will wait and see and those who could care less.

Q10: ...What does it signify inside and outside?

Hmm...it only signifies something to people who care. Find out who cares and the level of their caring and you'll learn its significance.

Q11: For outsiders, do you feel the new name 'DAA' will resonate more than the old?...

No, DAA will have as much meaning as WAA because acronyms are jargon and jargon is only used to differentiate social, cultural, economic, et cetera, classes from each other. Jargon is why only doctors understand doctors, only lawyers understand lawyers and only web analysts understand digital analysts.

Q12: ...Will it mean more to those who aren't directly involved? ...

The terms "digital" will have more cache than "web" and only until another buzzword takes its place.

Q13: ...Will people more easily understand what we do simply from the name?

LOL! Not likely. Unless they work close to the border of what is being done.

Q14: Who do you think stands to benefit the most from the change?

Ah, more worms. Thanks so much.

There will be a cyclic flow between businesses providing solutions and conference promoters wanting to fill seats. Solution providers will claim "We do [insert buzzword]!" People entering the industry and not being completely familiar with the jargon will ask what the difference between "old word" and "buzzword" (web and digital, for example) is. Conference promoters will claim "We have the Answer! Look! We just created a conference dedicated to BuzzWord! BuzzWord 2012!" People already in the industry will know that jargon has changed. Their time in the industry will determine how much wisdom they bring to assigning relevance to the jargon change and how to respond to it.

This is why there's a rise in "Social Pass" sales to conferences. It's always fun to see friends and play. We did a three year study of how conferences were changing (in many industries). Fascinating stuff that some promoters are using to help create mutually recognized value for both attendees and sponsors. I keep on hoping to publish it someday...

Q15: If you could change one thing about the DAA, what would it be?

Susan Bratton interviewed me a while back . One question she asked was "If you could change one thing about the business world it would be ______?" I responded "If people would stop lying to themselves - not others, only to themselves - that would be the greatest change possible, me thinks." So my response holds for all organizations, not just the DAA.

Q16: Would you expect any unforeseen impacts of the change?...

I've been burned at the stake too many times for accurately predicting outcomes to answer this one without violating my response to Q15.

Q17: ...On insiders or business outsiders?

Ditto. Nothing unforeseen, human/consumer psychology being what it is.

Q18: What do you think employers and businesses will think of all this? ...

Employers and businesses will make up the largest percentage of the "Wait and See" crowd.

Q19: ...Will they notice?...

Employers and businesses will notice if 1) actionability increases, 2) outcomes improve based on increased actionability, 3) accuracy predicting outcomes increases such that there's improved decision making regarding actionability, ...

They'll most definitely notice if they get billed more.

Q20: ...Care?

They'll care if they get billed more and actionability, outcomes and accuracy stay the same or decrease. They'll love it if the reverse - they're billed less, actionability, outcomes and accuracy all improve - occurs.

Q21: What should the DAA be doing next?

Serving its members in proportion to their population, not their dollars. That's a nice response, possibly a popular one and also an amazingly ignorant one. No organism can survive without consuming resources and the consumption rate is dependent on many factors. Two environmental constraints on the DAA are its maximum population and the individual resources within that population (based on a recent "Top 10 Cities" infographic ).

There's not enough people making enough money to support much activity so the organization must either cut down on member activities and programs - and risk a decreasing membership - or take money from "supermembers" (businesses) that will only support the DAA if their needs are met.
That's not an envious balancing act. For anybody.

So I'd guess the first thing would be to decide who is going to be served best and state that openly.
Of course, doing so would bring us back to remissioning...

Afterword

Susan edited this and added the following:

Reminds me of what's currently happening in IT & "the cloud" - Talk to IT people and they laugh. "We've been doing the cloud for years. It's called 'virtualization of the storage'. Oh, now you want to outsource if so you call it 'the cloud'." (seeIt Might Be Time to Get Your Head Out of the Clouds and Cloud Bursting (Cloud Technology Adoption in 2012))


Talk to people outside the IT world, marketers and such, and they get all excited about this new thing out there that they must have. Talk to people in the know and they could care less.


DAA vs WAA. Talk to higher-ups and they want DAA cause it's new. Marketers go for it to prove to their boss they're up with the latest trends. Web analysts in a company say "we've already got a company doing that" or "we do that now". Their boss says "But we need one that does DAA, not WAA, so the web analysts find a company doing DAA, rebranded WAA, go to their bosses and say "See? I do good!" and everyone's happy. But they're still doing the same old thing just with a different name. Cloud versus virtual storage. DAA versus WAA. It's the same name for the same old dog. The real question is "Can the dog hunt?" Are we just calling "Rufus" "Rex" and now he's a better hunting dog because he has a new name?


Join NextStage Evolution at theNextStage Toronto BootCamp 23-27 July 2012 (#NextStageTO )

Wednesday, August 3, 2011

Stephane Hamel web analytics speaker schedule (fall 2011)

Just before taking some time off this summer, I wanted to share my fall conference schedule - as I like to say, meeting face to face is certainly one of the best social media outcomes! Come to one of my sessions, workshops or just grab me at a break and say hello!

Wednesday, May 18, 2011

Now blogging at Cardinal Path

After nearly 10 years and over 500 posts you will notice some silence at blog.immeria.net as I move things over to cardinalpath.com/blog.


The older posts will remain here, but please head over Cardinal Path to read my latest posts.

In your opinion, what's the right strategy in such a case? Please vote & comment.

What should I do about this blog?

Monday, May 2, 2011

Bob - here's Web Analytics. Web Analytics - please welcome Bob.

The following email from Bob (not really Bob, but let's call him Bob anyway) is representative of many emails I receive from people who want to do a career shift toward digital measurement and optimization, or web analytics if you prefer:
Hi Stephane,
The UBC Web Analytics Award of Achievement has been highly recommended to me to learn more of the technical side of SEO. I saw a comment you made on Lawrence Dyson's website and also recognized your name from the UBC website. I have always been interested in marketing and while I have experience in digital marketing, I want to get more technical experience in this area. I am 36 years old and taking these courses is part of a plan to shift careers. I've been an entrepreneur for the last 12 years, but am interested in going to work for an interesting company and being able to provide value in the marketing and management of their website. What are the job opportunities for someone graduating with the Web Analytics Award? I currently reside in the UK. Thank you in advance for your response!

Best regards,
Bob
Here's what I replied:
Hi Bob,
I strongly encourage you to do it – not that it is really "technical" about SEO (in fact, not at all), but mainly because it provides a very strong foundation on web analytics. With your entrepreneurial and marketing background, coupled with experience, I’m confident you can easily shift toward analytics – or in fact, maybe not as much a pure "web analyst" (spending your days looking at data & making recommendations to others) – you could be that manager who understands the value of data and make the decisions!

But that’s just my 1st thought based on what you’ve provided – you could ask the same question on the Yahoo! Web Analytics forum to get more input.

Sincerely,
Stéphane
Over the years tutoring the UBC program I have witnessed dozens of people with very diversified backgrounds entering our field. I often get asked about "a good bacgrkound to be an analyst". There is no such thing as a good or bad background - there are only people who want to leverage their own unique skills and experience. I've been told so often I didn't have a degree, or that I was just a techie and therefore too stupid to understand the business that I would never judge anyone who has the guts to make the plunge.

If anything, tutoring has given me this ability to easily spot who has the potential of becoming a top of the crop analyst... and who needs a little more help and guidance to be a decent one.

Other offerings

We hear a lot about UBC, but there are other offerings: USF, UToronto and of course Market Motive. Other universities are also integrating elements of web analytics in their marketing curriculum - a little survey of universities in my local market revealed USherbrooke, McGill and HEC covers web analytics - although they typically do not offer full semester classes. For one, I'm also teaching a full semester, graduate level class about "online analytics from a managerial perspective" at ULaval. Those students, of which many have real work experience, are the ones who will soon define online marketing strategies and manage businesses with a strong online component. The course is available online in French and I'm still working out the details to offer it in English. See Web Analytics Business Education at ULaval for further details.

What about more hands on, practical/technical training? Cardinal Path, which I joined recently, offers the popular Seminar for Success for Google AdWords and Google Analytics and there are many other offerings from vendors and agencies.

A note about the WAA Certification

If you read my comment from almost a year ago on Lawrence blog, you'll notice I was talking about the WAA Certification. Since then, nearly 50 people received the Certified Web Analyst title and I have myself proctored the test twice. More web analyst professionals are enrolling for the test and although it took a little longer then expected, awareness of Certification has significantly increased - not only for practitioners and consultants, but also for employers and clients.

My take

The industry is shaping itself and is answering a diverse array of educational and training needs - and that's excellent! If I had one complaint about the current WAA Education approach it would be its innability and seamingly unwillingness to list more academic and training resources (others than UBC and Irvine - both of which have close ties with the WAA). Personally I would prefer to see a more complete list of resources - even if not officially "endorsed" by the WAA - for the benefit of its members diversified needs and geographic considerations.

I have created a list of Web Analytics Academic Resources - please add, vote and share! Are there any other University programs you know of?

Any thoughts and comments about web analytics education are welcome!

Thursday, April 28, 2011

Cardinal Path announce key addition: me!

The recent announcement of a merger between Webshare, PublicInsite and VKI Studios was received very positively – Cardinal Path is destined to become the leading authority in the online digital measurement  space. Over the past couple of years I had the pleasure to discuss and work with both VKI Studios and Public Insite - John Hossack and Alex Langshur - two organizations and two persons I have utmost respect for. I valued the opportunities to work with them while enjoying the “independent thought leader” status; but now is the time for me to reconsider my role.

As of April 20th, I'm officially taking on the job of Director, Strategic Services for Cardinal Path. My role will be to push the envelope - tackle complex issues and challenges while bringing the most optimal and realistic solutions to make online digital measurement easier and more beneficial to our clients.

Alex Langshur, Cardinal Path co-founder and senior partner said "Adding Stéphane to our team solidifies Cardinal Path’s market position as a leading pure play web analytics and digital marketing firm. We’re assembling a group of thought leaders with deep experience across a variety of marketing verticals and we’re excited about what they can accomplish together for our clients."

Everyone I talked to were thrilled by the news. I'm very excited to join a team of unprecedented expertise  and profesionalism with a unique presence across North America.

More info:

Tuesday, April 19, 2011

eMetrics Toronto 2011: just a week away!

The annual Canadian web analytics pilgrimage is just a week away! eMetrics Toronto will be at the Sheraton Center, April 26-29th.

Once again, I will be very active and I hope to see you again, or meet you for the first time!
Are you a former UBC Award of Achievement in Web Analytics or Fundamentals of Business Analysis student? Maybe you were enrolled in my ULaval graduate-level online analytics course? Have you used WASP or gaAddons? Maybe you are following @immeria on Twitter or read my blog? Partners and clients please come say hello! Let's chime in on my former role as WAA Director and Treasurer, the industry, career development or the future of online analytics!

That's a lot for a couple of days! Oh! Did I mention the lobby bar tradition? :)

Tuesday, April 5, 2011

Analytics Canvas v1.1: serious ETL for web analytics

Analytics Canvas from Toronto-based nModal isn't merely a Google Analytics API tool, it's closer to a powerful ETL (Extract, Transform, Load). In fact, it reminds me of SAS Enterprise Miner.

Powerful ETL

I've been on the beta group and v1.1 should be available by the time you read this [1] - James Standen and the team at Analytics Canvas know their stuff! Basically, Analytics Canvas powerful visual query interface allows you, among other things, to:
  • intuitively build complex queries and apply advanced ETL rules on the data (transformation, filtering, join, sort, segment, summarize, etc.)
  • extract more data than the 10k per call imposed by GA API
  • combine multiple GA profiles, even from different accounts
  • easily extract more than the 10 metrics constraint imposed by GA API
  • work with sampled or full data sets and visualize the results 
  • combine with other data sources, be it Excel, MS SQL, Oracle, mySQL, etc.
  • export to flat files, Excel or databases

Why is Analytics Canvas important?

The future of web analytics is dim... if we want to bring business value, we need to be business focused, not merely looking at website visits. That's why I think "web analytics" as we know it today will give way to "business analysis" and "business intelligence" - and to get there we need to achieve higher level of online analytics maturity - and that's where tools like Analytics Canvas become essential.

A real-world scenario

I want to merge online behavior data with back-office data. I want to look at visits grouped by date and hour, days since last visit (recency), visit count (frequency), pageviews, time on site for each visit, as well as 5 different goals for each of the authenticated users to my site [2]. This data will then be merged with a SQL data source containing demographics info and monetary values of past customers (without any PII, so we comply with GA TOS - see my previous post on this topic). The end result is a nice RFM analysis model I can use to analyze customer behavior and make much better recommendations that speaks to business stakeholders.

The challenge
  • the volume of data can be substantial and break the 10k rows limit per GA call,
  • I have more than 10 metrics,
  • I want to group by date/time and get only the rows where there is a known user,
  • data needs to be joined with back-office data stored in a SQL database,
  • and of course, I want to export the result to an Excel file, or back into SQL, for further analysis.
The solution
The final canvas is quite easy to understand, let's look at each component.
The final canvas
We use elements from the Block Library to create a canvas.
Blocks library to build complex ETL
The Data sources are easy to define (here, I'm showing a GA query)
Simple yet powerful query builder
We can use the Join block to create any types of joins (those familiar with SQL will relate to inner, outer, exclusive and full outer joins).
The Join block

The Filter block
The SQL data source isn't shown here, I used the Excel data source for the sake of this example. The picture below shows the Filter block with a simple rule. The output then contains a new column with a True/False result.
Sample output
And finally, when we run our query, we can preview the results that will get exported to Excel.

My take

This simple example took only a few minutes to build. Doing adjustments is a snap and doesn't require a single line of programming or tedious testing rounds. The Analytics Canvas approach is different from Excel plugins like TatvicShufflepoint or Next Analytics (which I'm using for a super-cool dashboard to be presented here in the coming days as part of the "The math behind web analytics" series). Those coming from a database or even stats background will probably be more comfortable with Analytics Canvas than, say, purely marketing people. Analytics Canvas definitely offer very strong capabilities unprecedented in any other GA API tools I've seen.

If you want to extract massive amount of GA data and merge with back-office sources, Analytics Canvas is definitely worth a look!

Analytics Canvas will be exhibiting at eMetrics Toronto, April 25-29 - I will be there too!

---
[1] other than being on the beta list, I have received no compensation for this article.
[2] as per GA TOS, you are not allowed to store any PII info [wikipedia] in GA - but you can use a unique user id (not an email!) or in a similar scenario, you could use the e-commerce transaction id to reconcile with back-office data as long as it's not merged with any PII.

Tuesday, March 29, 2011

Web analytics ethic: from theory to practice

A week ago I published three short cases where people were invited to comment on whether they were legal, ethical and abiding by their web analytics vendor Terms Of Service (TOS). Inspired from my own experience and after much talk about the WAA Code of Ethic, sessions at the recent eMetrics and discussions I had with some vendors, I thought participation would be much higher.

Here’s my point of view and some info from the brave souls who were up for the task! You should really read the previous post before continuing!

Photo: stock.xchng
Disclaimer: I'm not a lawyer nor a specialist of ethics - this information is provided as is... do your homework!

The majority of the 14 respondents were from the US and UK with some participants from Canada and other European countries. Unsurprisingly, most respondents said they were using Google Analytics.

Case #1: matching transaction id against back-end.

Unsure No Yes
It is legal 20% 0% 80%
It is acceptable based on my TOS 27% 20% 53%
It is ethical 13% 13% 73%

In my opinion, this is perfectly legal – the data was collected with user consent in the context of a commercial relationship. It is also ethical – it is common and accepted to send a “thank you” email, along with the purchase details and some offers. The fact it is sent through traditional snail mail doesn’t matter – or does it? Since the transaction was done online, there is usually an expectation communications will also be conducted online. As one of the respondents put it, “At the end of the day, 'ethical' depends more on your relationship with your customer than anything else”. All serious tools vendors TOS specifically prohibit sending Personally Identifiable Information (PII) to their system.

A transaction id, which is clearly not PII, is typically set by your back-end system and stored in your web analytics service of choice. This is a piece of data coming from your own system, and used back to merge against it, generally no TOS issue – except with Google Analytics TOS! (emphasis mine)
7. PRIVACY . You will not (and will not allow any third party to) use the Service to track or collect personally identifiable information of Internet users, nor will You (or will You allow any third party to) associate any data gathered from Your website(s) (or such third parties' website(s)) with any personally identifying information from any source as part of Your use (or such third parties' use) of the Service. You will have and abide by an appropriate privacy policy and will comply with all applicable laws relating to the collection of information from visitors to Your websites. You must post a privacy policy and that policy must provide notice of your use of a cookie that collects anonymous traffic data.
Repeat: "You will not associate any data gathered from your website(s) with any personally identifiable information from any source as part of your use of Google Analytics". Essentially, if you use Google Analytics, you should not extract transaction ids to merge them back against your own system. This is a non-sense to me and I know of several organizations that are actually doing it – probably without realizing they are breaking their GA TOS. Let’s hope this will be revised.

Case #2: matching product id (SKU) against back-end

Unsure No Yes
It is legal 7% 0% 93%
It is acceptable based on my TOS 27% 0% 73%
It is ethical 7% 0% 93%

Legal, ethical and no TOS issue. The key element here is that no PII is involved. From a business standpoint, what’s interesting is the ability to use behavioural data to correlate with sales in order to build a predictive model where we “know” which online behaviours are early indicators of upcoming sales and therefore, adjust inventories accordingly.

Case #3: key created from (potential) PII without user consent

Unsure No Yes
It is legal 33% 20% 47%
It is acceptable based on my TOS 53% 40% 7%
It is ethical 33% 33% 33%

If I got it right, in the US: last name alone, 5 digits zip code or last digits of phone number are not considered PII.

However, in California, OPPA specifies what is typically a non-PII become PII when combined with other data (such as having gender associated with a specific person). In Canada, the PIPEDA law stipulates data must be collected with user consent and used for the purpose it was collected for. In Europe, and especially Germany, a last name is PII (so are IP addresses and a whole bunch of things!).

Is it ethical? In this specific case, the data is stored even if the transaction isn’t fully completed. Therefore, this practice is against the 3rd WAA Code of Ethic guideline: User Control. It is also against PIPEDA in Canada.

What about the TOS? In general, this wouldn’t be an issue and it doesn’t really matter if this string is further encoded to obfuscate it. However, Google Analytics TOS still doesn’t allow us to use this key to merge with any other data that could contain PII.
In airports, the stand by list typically shows first three letters of last name and first letter of first name

My take

While there are passionate arguments on "free vs paid" in the #measure tweet universe, I was sincerely disappointed a topic like ethic and legal didn’t raise much interest. Is it because of a lack of interest? Fear of being wrong?

Either way, it makes me wonder if web analysts happily embrace the WAA Code of Ethic because it feels good and it's a worthy cause... or are just full of it! I guess what’s most important for now isn’t to know all there is to know about ethic, legislations and TOS, but to take action when innapropriate situations are uncovered.

I don't pretend to know more than anyone else, in fact, I'm willing to be wrong! If you have comments or additional useful references, I would love to hear from you!

Monday, March 21, 2011

Web analytics ethic trivia

While I'm still working on the 3rd post in my series on "the math behind web analytics", I thought we could play a little game related to the WAA Code of Ethic.


Read the three cases below and for each one, think if this is something you might be doing already or would feel ok to do... or not. Then you'll be invited to vote and comment (anonymously).

  1. For an ecommerce site using your web analytics vendor of choice, the transaction id, along with traffic source data (referrer, campaign, search keywords, etc.) and micro-conversions info (which other business valuable tasks were completed) are extracted using the API. The transaction id are then looked up against your sales database in order to do further segmentation and build a customer list (name, address, purchase details, demographics, etc.) that will be used to send a "thank you" snail mail, along with a 50% discount on a future purchase. Clearly, there is a customer-vendor relationship in place and the information for the purchase was collected with user consent.

    Is this legal? Is this allowed by your vendor TOS? Is this ethical?

  2. Still for the same ecommerce website, you extract the product SKUs, along with item quantity sold and the same source data and micro-conversions info. The data is merged against the back-end inventory database using the SKU and predictive models are developed to know which stock levels are optimal for each SKU.

    Is this legal? Is this allowed by your vendor TOS? Is this ethical?

  3. A financial institution typically has several types of requests: credit card, mortgage and other financing inquiries, retirement simulator, insurance quotes, etc. Completed requests are stored in back-end systems for processing - those transactions are frequent targets of fraudulent behavior or are abandoned along the way. One way to generate a unique key is this: first 3 letters of last name + 1st letter of first name + 4 digits zip code (or last 3 characters of postal code) + last 4 digits of phone number. The result, for me, would be HAMS4C02637.

    Is this legal? Is this allowed by your vendor TOS? Is this ethical?

    Update: to make it clearer, this type of key could be used for lookups against other systems - and could be encrypted using MD5 to make it more obscure - but it is still built from input data even if the transaction isn't fully completed.
Let's see what you think - I'll share my point of view a bit later (along with pointers to reference material). I certainly don't pretend to be a lawyer or a professional of ethics, I'm just an analyst with some experience. Those three cases are inspired from real situations.

The question is... what would you do?

If you are up for it, head over here to vote and comment.

Monday, March 14, 2011

A major web analytics agency is born: Cardinal Path

Today at the eMetrics Marketing Optimization Summit, my good friends Alex Langshur, President and Founder of PublicInsite, John Hossack, President and CEO of VKI Studios, David Booth and Corey Koberg of WebShare announced they are joining forces to become one of the most significant players in the digital analytics world.


With offices in Ottawa, Vancouver, Boston, San Diego, Burlington, Phoenix, Mountain View and Chicago, Cardinal Path unites an impressive team of thought leaders across a range of disciplines, authors, speakers and top business consultants. Justin Cutroni of WebShare, a well known figure in our field comes to mind, but there are also Brian, Michael, Kent, Ken and Scott - about 35 of them!

I've known Alex & John for a long time and I have utmost respect for both of them. Their professionalism and the expertise they have built through their respective agencies is outstanding. Their success stems from hard work, obviously, but I've found in both of them that undefinable human touch, sense of ethic and respect. Interestingly, as an independent consultant, I was lucky to have both of them be what I called "angel advisors" - sounding boards for all my crazy ideas, but also sharing and collaborating on anything "analytics" related.

While there has been many mergers on the vendors side, this is the first big one on the services side and the strengths of the various partners are very complementary:
  • private, public, non-profit, education sectors; with several flagship clients Like NBC, Harvard University, Library of Congress, Electonic Arts, Virgin, etc.
  • deep ecommerce expertise with leading brands, and boatloads of knowledge for non-commerce, lead-gen and brand based sites;
  • "build for success" approach - the new firm has site design/capability that enables them to architect the success elements and ensure full end to end visibility.

I want to be among the first to wish them success in what will undoubtedly be a great adventure and bright future!

Thursday, March 10, 2011

The math behind web analytics: mean, trend, min-max, standard deviation

In the second installment of this series, we will leverage Excel to take over where Google Analytics left us.
  1. The math behind web analytics: the basics

Basic charting in Excel

The very first thing to do is to show the data as a simple line graph. For this post, I simply used visits to my blog in January of 2011. After some minor visual adjustments we end up with something like this:
Figure a: simple Excel charting
Figure b: time series (visits)
There are already some striking things: peaks & valleys corresponding to weekdays and weekends, and a week apparently performing better than others. Now we can easily apply some basic statistics on our time series.

Mean

The mean [wikipedia] is often referred to as the "average", which, in reality, is the "arithmetic mean". This is very simple math: add all the numbers and divide by the number of data points.

Look at Figure c - what can you tell about the red line crossing the whole graph? In a time series like daily visits for a month, honestly... we can't tell much! Yet, only averages are reported by most web analytics tools - so please, don't even bother saying "the average number of visits this month was X"!
Figure c: showing mean, trend, min & max and control limits.
Learning point: The average is rarely a good indicator in a time series such as those found in web analytics because it is influenced by extreme values (known as outliers [wikipedia]). At best, in the case above, one might want to calculate the mean for weekdays and the mean for weekends. As a rule of thumb, if you have less than 30 data points, use the median.
Figure d: descriptive statistics

Median and mode

The median [wikipedia] is the middle value. The mode [wikipedia], on the other end, is the value appearing the most frequently. Again, in a time series, where the spread of values (the standard deviation explained below) is large, those descriptive statistics [wikipedia] (Figure d) are usually of little interest.

Min & max

The min and max values are... well.. the maximum and minimum values in a time series. Those could be qualified as "anecdotes" - we could be thrilled we've got so much traffic on a single day, or deceived by a poorly performing day, but knowing that has absolutely no value if we can't explain why.

In the time series used in this example, the min value is 93 visits on Saturday, January 1st. What can we tell about that? Obviously, people were busy doing something else than visiting my blog. What happened during the 4th week, around January 25? I shared my views about our little web analytics community and recounted my contributions. In both cases, we have very plausible explanations and the min & max values were useful only because they made us ask "why?".

Trend

To me, the linear trend [wikipedia] (shown as a dotted line in Figure b) is one of the interesting modeling stats because it marks the begining of our regression analysis [wikipedia] capabilities - our ability to explain the why's and "this, therefore that". Basically, it can help us do some predictive analytics (albeit very simple). Remember y = mx + b? That is, the position of a point on the y axis (the visits) depends on a factor of x (the day) plus a starting baseline. I can tell, based on historical data, that I should get approximately 350 visits next Tuesday.

Standard deviation

If we do max - min we get the range [wikipedia], another descriptive statistic. Interesting at best. What's much more interesting is the standard deviation [wikipedia] - the variability of the data. As we've seen, the average isn't of much use because it is largely influenced by outliers. Standard deviation gives an appreciation of the spread of values around the mean, or if you prefer, the variation in a distribution of values.

Why is this important?

Figure e: control limits at +/- 1.5 sigma
First because standard deviation will be used to set control limits [wikipedia] (Figure e) - which in turn will be useful to define our tolerance and targets (covered in a later post). While control limits are typically set to +/- 3 times the standard deviation from the mean - I have found +/- 1.5 times (for a total of 3) to provide a better and easier indicator of values going below or above our historical track record (shown as the grayed area in Figure b). Basically, it gives us an easy way to set alerts when our metric might be going out of whack!

Secondly, a large variation is an indication of an unstable process (think conversion rate), or low reproductibitiliy (anecdotal campaign success), or if you prefer, a larger standard deviation reduces our ability to predict the value of Y given a certain X. Basically, as analysts, we want to explain the past, but we also want to provide insight on how to fix issues and seize opportunities - we eventually want to be able to predict outcomes of our recommendations.

Coming up: normal distribution, histogram and box-plots

In the next installment we'll look at what is an histogram as well as normal distribution and their impact on our analysis. Also, although nifty spinning 3D-shadowed-shiny-Flash graphs are impressive... we'll look at box plots elegant simplicity yet powerful and under-used visualization tool.

What do you think of this series so far? What would you like to see discussed or any examples you would like to see?

Monday, March 7, 2011

The math behind web analytics: the basics

Introduction

I tutored about 700 students enrolled in web analytics and business analysis classes at UBC and nearly a hundred in the new graduate-level class in online analytics I'm teaching at Laval University. Most students at ULaval are enrolled in MBA specializing in ebusiness or marketing - one day, they will manage organizations and leverage analytics to make better business decisions. In the meantime, questions and assignments are an endless source of inspiration and challenges to solve.

This is a first post of a series entitled "the math behind web analytics". The idea stems from a question posted by a UBC student to the Yahoo! Web Analytics forum: "what mathematics does a web analyst need to know?" I was somewhat baffled by the replies: "plus, minus, min, max, average... not much practical use of it (mathematic/statistics) within web analytics" or "simple counts or averages" and of course, "percentage... because that's what you'll use most often, e.g. with KPIs, conversion rates, etc".

What?!

Assignment: basic analysis

One of the first assignment in the ULaval class is simply stated as "analyze the visits to website XYZ" and the students are provided a data set.

Learning point: When referring to a metric broken down by a time-based dimension, we refer to a "time series": a sequence of data points measured at uniform time intervals.

In this first post we address what appears to be easy and obvious: graphing the data.


All web analytics tools provide basic visualization functions, as in the example shown above from Google Analytics. This graph shows visits by month.

Learning point: Notice how I used thirteen months of data instead of twelve. This is especially important to be able to compare year-over-year and more easily spot seasonality. Basically, we should always include at least one additional period in our analysis. Here, we clearly see an upward trend and certainly some year-to-year progress.

However, a monthly breakdown hides some interesting elements. When the same data is shown by day, we can see something slightly different:

The trap

This is the extent of visualization you'll get in most tools. And most would-be analysts will report something like "there was X number of visits, and the average was Y visits/day" simply because this is what the tool says. Some will mention an upward trend but won't be able to quantify it, at best, a few will switch from monthly to dayly view and mention the very common weekdays/weekend pattern.

What's most important, I rarely see an explanation for what happened where we see spikes of traffic - which, in this case, are explained by marketing and external, business-related events.

Coming up: Excel to the rescue

In the next installment of "the math behind web analytics" we'll use Excel to do some basic analysis.