Showing posts with label Site Optimization. Show all posts
Showing posts with label Site Optimization. Show all posts

Thursday, October 22, 2009

Smarter 404 with embeded Google Search Widget

When I posted on the Yahoo! Web Analytics forum to announce the availability of the free Web Analytics Maturity Model paper, the post included this text: "the paper at http://immeria.net/wamm." (notice the dot). The link was broken because of the way Yahoo! parses text to automatically build links.


Step 1: Use custom 404 page

The first step to improve broken links handling (404 errors) is to modify your web server configuration to point to a custom page handler instead of the default, very technical and dull error. For example, doing this on an Apache-based web server is as simple as adding the line "ErrorDocument 404 /http404.htm" to a file named .htaccess in the root folder of the site.

The specifics of your server configuration isn't the goal of this post. Contact your IT department or search for "custom 404 page" and similar keywords for additional help.

Step 2: Make a smarter 404 page

The custom 404 page handler is just another HTML page, so it can include your site navigation, brand and useful content. Often, the 404 page will have a de-dramatizing tone and some people have gone to great extent to make funny 404 pages.

Beyond trying to be fun, you want your visitors to get to your content. Two things are invaluable in this context: the referrer and the landing page URL. The next step is to make your visitors life easier by providing a path to the right page, or at least try... To do so, you can add a smart Google Search Widget:

<script src="http://www.google.com/jsapi" type="text/javascript"></script>
<script type="text/javascript">
    google.load('search', '1', {"nooldnames": true});
    function OnLoad(){
        var searchControl = new google.search.SearchControl();
        var siteSearch = new google.search.WebSearch();
        siteSearch.setUserDefinedClassSuffix("siteSearch");
        siteSearch.setSiteRestriction("yoursite.com");
        searchControl.addSearcher(siteSearch);
        searchControl.draw(document.getElementById("searchcontrol"));
        searchControl.execute(location.pathname.replace(/\//g, ' '));
    }
    google.setOnLoadCallback(OnLoad, true);
</script>
<div id="searchcontrol"/>

The important elements are:
  • setSiteRestriction("yoursite.com"): forces the search to be contained within your site (change it to your own site domain)
  • location.pathname.replace(/\//g,' '): replace the landing URL slashes with spaces so you can have a more meaningful search keyphrase
  • You might want to add a stylesheet element to your page so the Google Search Widget is larger (something like ".gsc-control{width:480px !important}")
The rest of the code simply handles and render the Google Search widget. In most cases, the automated search will offer some meaningful links destinations. In the worse case, the visitor has a neat search box and the site navigation to find their way around.

Feel free to visit http://immeria.net/custom/404page to get an example. Do a "view source" to see how I made mine.

Step 3: Analyze & Improve

Don't forget to put web analytics tags on that page so you can collect information about broken links. For Google Analytics, this is as simple as doing "_trackPageview('/404/'+location.pathname)" instead of the default "_trackPageView()" call. Create a custom segment to view all reports for broken links pages, look at the Content/Content Drilldown report, understand the source of traffic, what your visitors were looking for, and how you can further improve your site based this information:
  • If lots of traffic comes from a couple of sources, you might be able to ask them to fix their links
  • If those errors are the result of a site redesign, you might want to use redirections to map the old page URLs to their corresponding locations
Comments, additional ideas and any feedback is welcomed!

Tuesday, February 10, 2009

The end of Web analysts? No, the evolution of the analyst role

I love it when I do my morning round of Tweets, blogs and emails and stumble on something like "The end of Web analysts".

Charles Wiedenhoft proposes "that Internet marketing agencies and internal departments do away with the job title "Web analyst" and instead take time to establish and conduct cross-training programs with all personnel to help them understand what the figures mean and how best to use them in order to meet or exceed a campaign's stated objectives".

In my opinion, Wiedenhoft is proposing something that can, or can not work, depending on what I call the "web analytics maturity level" of the organization. A topic I will be presenting at eMetrics Toronto and eMetrics San Jose.
Web Analytics can succeed if you strike a balance between management, resources, objectives, scope, tools and process. Participants in this interactive session will get to know where they stand in their efforts to take advantage of web analytics data and how to get to the next level of marketing optimization.
Most organizations won't have the time/resources to train and disseminate the "analytical mindset", technical know how (yes, the Web/Internet is still quite technical!), communication skills and political acumen a dedicated analyst needs to develop. This, on top of their daily workload and focus on there core competencies.

Also, his position is heavily on the "marketing campaign optimization" while web analytics can and should be used for understanding and optimizing other aspects of the online business. This "slant" toward marketing is omnipresent in the way web analytics is being leveraged today. This is obvious to me as I tutor UBC web analytics intro, marketing optimization and site optimization, but also a course named "introduction to business process analysis". The relationships between business optimization and analytics are so evident in my mind!

And lastly, if anything, web analytics is shifting toward business analytics. Using "analytics" to understand and optimize all aspects of the business (online and offline) as a mean to gain a competitive advantage. That's what Davenport talks about in his book "Competing on Analytics".

Wednesday, January 21, 2009

Google Analytics: script to track outbound links and downloads

Update 2011-10-10! Check out gaAddons free script example! 
Important! Please see "gaAddons open source project: enhancing Google Analytics" instead.
In my opinion, tracking outbound links and downloads should be part of any good web analytics implementation.

In the past, Google Analytics trackPageView() call was often used to track outbound links and downloads. However, with the introduction of events tracking, I find it much more appropriate to use this technique. Counting downloads and outbound links as additional page views impacted several reports (Pageviews, Pages/Visit, Bounce Rate, Top Content, etc.) and people often had to set Goals in order to track those specific Pageviews as success events. No more!

Introducing gaAddons.js

The goal of this script is to automate a couple of common tagging requirements: outbound links, download links and email links tracking. It makes the job very easy and reduce risks of errors. Basically, just add a reference to gaAddons.js as explained bellow and voilĂ !

Outbound links:
  • Event: "outbound"
  • Action: "click"
  • Label: target URL
Email links:
  • Event: "mailto"
  • Action: "click"
  • Label: email
Download links:
  • Event: "download"
  • Action: "click"
  • Label: URL of downloadable document. The default looks for the following regular expression:
    /\.(docx*|xlsx*|pptx*|exe|zip|pdf|xpi)$
    It basically says: "Look for any links ending with a dot, followed by any of the popular file extension"
    Those can easily be changed in the gaAddons.js script.
If you have other automation you would like to see let me know. You are free to modify this script and re-distribute it as long as you keep the references to the authors at the top of the script.

Get going with gaAddons.js

To get going, do the following:
  1. Get the gaAddons.js script and save it somewhere on your own server
  2. Add this line near the closing BODY tag of all your pages, just after the standard Google Analytics tag:
    <script src="/js/gaAddons.js" type="text/javascript"></script>

Integrating the code

Your code should look like this:
<script src='http://www.google-analytics.com/ga.js' type='text/javascript'></script>
<script type='text/javascript'>
var pageTracker = _gat._getTracker("UA-999999-1");
pageTracker._trackPageview();
</script>
<script src='gaAddons.js' type='text/javascript'></script>

Your tracker variable should be named "pageTracker", otherwise you will need to modify the gaA_pageTracker variable in gaAddons.js code.

Looking at the stats

Once your change is live, give Google Analytics some time to gather data and look under Content/Event Tracking for outbound, mailto and downloads stats (if using events, the default), or under Content/Content Drilldown for /outbound, /mailto or /download statistics if using the page view method.

---
Credit where credit is due! A while back, Justin Cutroni at EpikOne published "Google Analytics Short Cuts". This script is an optimized/improved version of his script. Also inspired from the work of Brian Clifton, author of Advanced Web Metrics with Google Analytics. Contributors: Damon Gudaitis, Andy Edmonds.

Tuesday, January 13, 2009

Cool features on the new WASP site

I revamped the WebAnalyticsSolutionProfiler.com website when I launched WASP v1.0 last week. I'm now leveraging a couple of pretty cool services. The number of innovative services is staggering, but here's a couple I find most interesting.

Kampyle

Kampyle feedback analytics: I've been using it for a while and like it very much. I talked about it many times already. For the site revamp, I have modified the feedback categories and sub-categories to better fit my needs. Each page includes the Give Feedback button so visitors can easily get in touch with me, either anonymously or providing their email. It's a great way to engage the conversation privately!

Get Satisfaction

Get Satisfaction is the "people powered customer support". A mix of discussion forum and trouble ticket system. Again, a great way to be "open" about feedback and issues. I'm also using it as a knowledge base, so whenever I get asked a question through other channels and find it valuable, I simply enter it in Get Satisfaction so it becomes available for my WASP users to see.

User Voice

User Voice might be the "voice of customer" at its best! WASP aficionados can ask for new features and enhancement and vote for the ones they find the most interesting. Right now, anonymous voting is enabled, but I could turn it off if I find there is some abuse...

Friday, October 17, 2008

SiteBrand and First Time Visitors

This month Web Analytics Wednesday was sponsored by Sitebrand. Senior Analyst Jim Cain presented a very interesting summary of his white paper "First Time Visitor: A Marketer-Oriented Approach to Optimizing Online Conversions" (get it for free!)

First time visitors are "special"

The topic raised interesting questions and everyone could readily see how important it is to address the specific needs of first time visitors. Why is it what we take for granted in real life seems to be so hard to apply in the online world? Why do so many sites welcome everyone in the same way, regardless of their interest, location or level of engagement with us?

Ask the obvious

Jim explained some of the most important questions to ask about first time visitors:
  • What percentage of your traffic is 1st time visitor?
  • Where do they come from?
  • What are there entry and exit points?
Some might argue that cookie deletion, or geotargetting errors could make the approach difficult to apply. But what about the more than 80% if not 90% or 98% of the time where it works? Why put everyone in the same "unknown" basket when you can at least try to better serve them. Seems obvious to me!

Sitebrand's solution

And that's where Sitebrand comes in: their service makes it easy to create targeting rules based on various criteria. In my experience, even basic behavioural targetting is hard to get done by internal IT teams, so why not outsource this function to Sitebrand. The nice thing is the solution will cooperate with your web analytics solution of choice (actually the behavioral data is collected by Sitebrand, but in the future it will be integrated directly with your existing web analytics solution). Lots of companies are a bit afraid of behavioral targeting costs and complexity, but what I've seen with Sitebrand makes it very easy and affordable.

Sitebrand and WASP

WASP already detects Sitebrand, but with the help of Sitebrand's team, the upcoming release of WASP will highlight the targeting area directly in the page. Click on the thumbnail bellow for a larger view, basically, the behavioral targetting areas are automatically highlighted when the WASP sidebar is open.

Tuesday, October 14, 2008

Omniture is at it again: Mercado

From my inbox "We are excited to let you know that Omniture has agreed to acquire the assets of Mercado, a leader in site search and merchandising and a long-standing Omniture partner."

While I see a polarization toward Google Analytics and Omniture SiteCatalyst in the web analytics market space, the strategy are radically different. Google Analytics will continue to enhance its product and offer more features, grabbing some Omniture market, but hurting much more the lower to mid-market solutions. Rumors of a long awaited Google API, more advanced segmentation and other features are surfacing. But ultimately, Google Analytics mission remains to sell ads, either through AdWords or AdSense.

Omniture is playing a different game, they are expanding their portfolio of solutions horizontally, slowly but surely building the infrastructure to commoditize the whole online optimization process. With the acquisition of Mercado, they are adding another poweful site search functionality, but also a very powerful ecommerce platform. It remains to see how it will cooperate with SiteSearch & Content, or if one of the two will be doomed to extinction, but when it comes to merchandising, onsite search can make the difference between survival and growth... or extinction under economical turmoil.

As a senior web architect I have worked on a couple ebusiness ecosystem overhaul, consolidating dozens of websites and repositionning outdated technologies on new platforms. At the time, if Omniture had offered the current CMS, Search, eCommerce, behavioral targeting & testing, Survey and call center/retail analytics, I would have seriously considered it as a viable solution to lower the technological aspect of website development and focus more on the online marketing optimization aspecs.

Friday, August 22, 2008

WASP: a good tool to audit site tags

There's an interesting thread on the Yahoo! Web Analytics forum "What is a good tool/methodology to audit a large site for tags?". As often, my answer was getting long! It started like this:
"I'm starting a new job with a big, complicated site, and want to get a handle on its data collection strengths and weaknesses.  Any suggestions?"

Potential solutions

Even without lots of details, and as others pointed out, we can identify a couple of potential solutions. Of course, WASP comes to mind first... but let's look at other alternatives:
  •  Maxamine's flagship product, now owned by Accenture, would come to mind. But the price tag is high and it seems it's not available as a standalone product anymore. So one would have to hire Accenture consulting, which is probably an issue for lots of smaller companies, web and analytics agencies, etc.
  • EpikOne's SiteScanGA offers a Premium subscription. But unless your site is tagged with Google Analytics, this is of little use... Furthermore, SiteScanGA doesn't actually look at your site; it looks at whatever Google Search have in their cache. So it won't scan any "no-index,no-follow" areas of your site (secured sections, transactions, etc.) and since Google might not have your latest page version, this further lower the value of SiteScanGA.
  • Debugging proxies and manual method: if you are a techy, Charles and Firebug are your friends. But who would want to walk through tens of thousands of pages manually?

Poor guy's solution

Someone suggested that "if one had access to the actual server, could you not literally download the entire site to a local machine, then do a grep for the relevant text?"

That would be a very poor guy's (and very bad) way of doing quality assurance! Here's an analogy: would you trust your site works correctly just because you can see the company logo on the page?

It would only tell you the source code is there, but wouldn't guarantee it works and is actually sending the right data. I think it's how EpikOne SiteScanGA and other basic tag checking tools are doing it: they don't run the code, they simply look for a string in the source file.

Here comes WASP!

As you can see in a case study I made on a site using SiteCatalyst, there are things you would simply not be able to find if you don't actually load the page and run the code. From the start, WASP's goal was to run "in situ" of a real user. This makes WASP the most unique and robust way of doing quality assurance.

Someone suggested that since most sites are based on templates (CMS, ecommerce catalogues, etc.), why not check just one page of each template?
  • "You don't know what you don't know": ask a site owner if all their pages are tagged, at best they will say "yes", usually they will say "I think so"... WASP often tells otherwise by crawling all pages and finding whole sections that were missed! Static pages, but more surprisingly, transactions are usually the area were tags are missing or bad.
  • "All pages using a template are alike": yes and no. Since tags are often populated automatically from the data filled in the template, there might be cases where unexpected values are set: special characters, blanks, missing values, wrong data type, invalid range of acceptable values, etc. Since the person who controls the template is not the same as the one who populates it with data, the likelihood of errors is significant.
Other than the status bar tag indicator and the sidebar values being sent, WASP includes a powerful site crawling feature that allows you to start from any site page and recursively crawl to the level and number of pages you want. Use include/exclude filters, follow or not robots exclusion specifications (robots.txt), bypass alerts/confirm/print messages that could hang the crawl, etc. You can also start from an existing sitemap.xml or a file containing a list of URLs. Future versions of WASP will include incremental crawl and other features that will make it easier to be alerted when something unexpected happen.

Of course, you don't want to inflate your site statistics with a visit that would span thousand of page views. WASP already offers different ways to filter out your data: modify the User Agent string or block your IP address. Future release will include a "stealth mode" that will actually block the call from sending the data.

Ok, I need WASP now!

Hold on to your hat for a few more weeks. I'm literally working overnight to deliver WASP v1.0. In the meantime, you can get started with the beta release and help identify bugs, issues and feature requests in the WASP support forum.

I'm already receiving lots of requests for the commercial version but I want to make sure it's stable and well tested before selling it. I can tell you I've run scans of 30,000 pages in a single pass without major issues.

Case studies wanted!

I'm also looking to write other case studies. Put WASP (and me) to the challenge! Send me a note with your web analytics implementation audit challenge and I will consider it for a future case study. For free! You just have to allow me to mention you/company/client in my case study. Good deal isn't it! :)

Note: I'm putting the final touch on a video that will demonstrate WASP crawl in action. Stay tuned!

Monday, August 11, 2008

Even more Web Analytics Dashboards Fun in Excel 2007!

Update 2010-05-07: If you want to use this dashboard with Google Analytics data, check out "Tatvic enhances immeria's Excel web analytics dashboard".
Attention Internet Explorer users (MSIE)! When clicking on the link to download the .xlsx template, MSIE wrongly try to save it as a .zip file, which it's not. Make sure to rename the file with the proper .xlsx extension (or better yet, switch to Firefox!)
A couple of weeks ago I published "Web Analytics Dashboards: fun with Excel 2007", it got on Stumbled  and became one of the most visited article. A while back I also published Box plots and whisker plots in Excel 2007 and it consistently receives a lot of views.

So here's an update of Web Analytics Dashboard Fun with Excel 2007!

What is it?

I'm glad to release "Web Analytics Dashboard Fun" (Microsoft Excel 2007, 85KB .xlsx), a free Microsoft Excel 2007 template for web analytics professionals. It can be used for learning web analytics, Excel in general or as the basis for more elaborate dashboards. The goal is to use only Excel 2007 features and ease customization of the template and update of the data.

Why Excel?

As a teacher of web analytics and a web analyst myself, I noticed people often struggle to define KPIs and get going with dashboards. My clients use different web analytics tools, be it Omniture, Google Analytics, Coremetrics, WebTrends, Xiti or others. Although some of the tools offer very advanced dashboarding and analysis capabilities, there are a number of reasons why you would want to use Excel:
  • Control the information being distributed
  • Publish the information in a format people are used to (either Excel or PDF)
  • Avoid granting access to the web analytics tool itself
  • Include other sources of data
  • Ease "month to month" and "year to year" analysis
  • Ease analysis of major segments (such as two countries, two sites, etc.)
  • Include the analyst comments and evaluation

Get Web Analytics Dashbaord Fun!

Based on the feedback I got, and some further tweaking to make the dashboard more generic and easier to modify for your needs, I'm releasing "Web Analytics Dashboard Fun with Excel 2007 v1.1". To get started there are just a few steps:
  1. >>> Get the template <<< (Microsoft Excel 2007, 85KB .xlsx)
    (Get the Excel 2003 version - with some features disabled)
  2. Right-click on the S1 and S2 radio button and "Edit Text" to your licking
  3. Change "Success Event 1" through "Success Event 3" in all worksheets
  4. Update the data in WebDataS1 and WebDataS2
  5. VoilĂ !
Once you are comfortable with the spreadsheet, you can modify the dashboard to add/remove/modify KPIs to your liking. Although this step requires more work, it should become fairly easy once you understand the general pattern of the spreadsheet.

Feedback, comments and contribution

One of the goal of immeria.net is to "make it easy to do web analytics" by providing educational ressources, documented processes and tools that are both easy to use and non-specific to a vendor ("product agnostic"). You are free to use this template, modify it and even redistribute it as long as its not for profit.

Creative Commons License
Web Analytics Dashboard Fun by immeria.net is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 2.5 Canada License.

Friday, August 8, 2008

Always be testing (and learning!)

Bryan Eisenberg's latest book, "Always Be Testing: The Complete Guide to Google Website Optimizer", is now shipping at Amazon. I had the chance to view an earlier draft and I'm awaiting my copy within days. Bryan posted about the book and the upcoming seminars.

About the book

For years companies have tried to develop THE best website, even shamelessly copying from the so called "best of breed". The reality is although technology can be copied, although business processes can be inspired from best practices, humans can't be that easily copied. If one of the distinctive element of any company is its workforce, the decisive factor of success is understanding the client. And the only way to know if your website works for your clients is to test, measure and optimize your Persuasion Architecture.

A continuous improvement process isn't complete until we reach 100% success... in the meantime, read this book, learn a whole lot about testing, see what others are doing, and get plentiful of ideas to get going!

Although the book titles states "Google Website Optimizer", the book is really an excellent introduction to the concept of A/B and multivariate testing for any solution.

A funny situation!

For years companies have tried to develop THE best website, even shamelessly copying from the so called "best of breed".
When I read Bryan's latest blog post, "Always be testing unleashed" I clicked through to view the two versions of his book cover (since yes, he is doing A/B testing on that too!).

Shock!

I though my browser had a problem! Compare the two websites below. The first one is http://WebAnalyticsSolutionProfiler.com, the site I created for my tool almost a year ago, wihle the second is the newly launched site by Bryan http://www.testingtoolbox.com/:
Site A: WASPSite B: Testingtoolbox.com
http://WebAnalyticsSolutionProfiler.comhttp://www.testingtoolbox.com

Now... I feal a bit embarrassed and pleased at the same time... I've known Bryan for a while and I'm sure he wouldn't intentionally pick a site design so close to something that already exists in such a close industry. With Bryan's and FutureNow experience, I guess they took this design because they saw there was a good potential for persuasion architecture optimization. On the other hand, I wouldn't want people visiting either of the site thinking we stealed design from each other. It's simply that we both took inspiration from Template World!

A/B analysis of both sites

So now, you can visit both sites and comment about how to improve both sites! Some details like the following:
  • Buttons: The 3 big boxes on my site are clickable, while TestingTool click must be done on the small arrow within the box.
  • Tabs: My site uses tabs at the top navigation as a reminder of the site section you're in. Bryan's site doesn't have any visual clue on where you are.
  • Logo: By convension, the top-left logo is supposed to bring you home (safeharbor). Bryan's site will get you out of the book's site to FutureNow main site.
  • White space: Notice the amount of white space between the top nav and the 3 big buttons. I reduced it on my site because I wanted to bring most content above the fold.
  • Call to action: On my site, the green "Add to Firefox" is my conversion goal, we would presume for a book it would be something like "Buy the book now", but it's not there.
Any comments are welcome!

Monday, June 30, 2008

Omniture Test & Target: an alternative to costly site redesign

Over a month ago Omniture announced a new release of Test & Target and I finally had time to look at it. With the recent release of Omniture Survey, combined with Site Search and Publish, the suite looks like a viable and strong alternative to costly site redesign. In fact, as an ebusiness strategist and web analytics consultant, I often run into scenarios where traditional approach to web development could be greatly enhanced by taking a radically different approach.

Low pain, fast results, continuous improvement

By combining multivariate testing and behavioral targeting, Omniture not only makes it very easy to start testing, but can even use the results to automatically influence subsequent behavioral targeting. In my consulting I try to use the SixSigma DMAIC (Define, Measure, Analyze, Improve, Control) approach, or as Omniture put's it "Change, Track, Target". The process gets significantly accelerated:
  • Introduce home page personalization based on powerful segmentation (ex. keyword search, geography, visit frequency, ad shown, etc.)
  • Optimize on/off site ads and campaigns
  • For ecommerce, automatically build a top sellers list or even a recommendation engine
  • For media sites, update top stories based on behavioral data
  • Use the platform as a mean to manage content, promotions and offers over time
  • etc.

Control delegation

We all heard horror stories about marketing wanting to do something but being "stuck" by IT's abilities (or lack thereof) to deliver. Not prioritized or too many priorities, no budget, no time, no ressources or in even worse, crass political interests are only some of the reasons for the tension that often exists between marketing and IT. I've been on the IT side for most of my career... I know the story. Let's face it, for most organizations, "developing a web site" is far from their core competencies and so many aspects of websites have become "commoditized" that it simply doesn't make sense to develop thousands of lines of code to do an online catalog and checkout.

These days, most sites are built off templates (be it CMS or catalog driven) and a home page layout usually doesn't radically change every week... Try asking IT to build multiple versions of your home page and "render" control to marketing... good luck. Ask IT to change the home page template to include what are called "mbox" once (snippets of JavaScript code delimiting an area controlled by Test & Target): a lot easier. Agreeing on "who owns what" usually involves some political discussions, but once set, you are in full control of those content areas.Content can even be served off the Omniture infrastructure. IT can focus on optimizing core business processes and marketing can focus on the message and the online user experience.

A scenario

For some of my ecommerce clients who happen to be using Omniture HBX and who's ecommerce technological platform have reached its end of life, the current plans are to do a complete site overhaul: new technology, new design, greater marketing possibilities and of course, migrate to Omniture SiteCatalyst. Given the current state of the economy, the size and scope and cost of those projects, the difficulties to find good resources and the risks they imply, I would offer a radically different approach. Interestingly, despite being in two very different verticals, they share very common challenges:
  • Missed sells opportunities, low fidelity: new customers are not easily exposed to the full/better offerings and the low fidelity of existing customers require a constant focus on customer acquisition
  • Inability to do behavioral targeting: all customers are treated the same
  • Weak internal search results: no results, wrong results, too many results...
  • Manual cross-sells and top-sellers updates
  • Strong reliance on IT for any changes, never resolved and growing list of bugs and complaints, performance and stability issues, etc.
  • Expensive maintenance and development due to a technological platform that works at a low level (more of an SDK than a platform)
  • No Voice Of Customer at all

My take

As an alternative to the above scenario, consider this:
  • Migrate immediately to SiteCatalyst to strenghten the "fact based decision" approach
  • Modify the home page template, make extensive use of Test & Target to tailor the user experience according to each campaign, keyword or location
  • Modify content categories pages to automate recommendations and best sellers
  • Integrate Omniture Survey as a mechanism for content/product rating
  • Use Survey to listen to the voice of customer
  • Use Site Search as a search/recommendation engine
  • Maybe even consider Publish as a viable CMS/catalogue engine alternative
If you are already using SiteCatalyst, there are huge opportunities in integrating Test & Target (and Survey). The pricing structure, which is similar to the SiteCatalyst model, will allow you to start doing experimentation & targeting gradually without commiting to a huge investment. When conducted appropriately (I'm thinking "resources" and "process" here), the tool ROI will become positive very fast.

Speculations

In a previous post, I speculated the next Omniture acquisiton might be in the mobile or performance analytics. Based on the scenario above, it seems the missing piece might be more in the profile management and process engine (checkouts and such). Think of something like Coghead, Zoho Creator or Caspio.

Monday, June 23, 2008

Web Analytics Dashboards: fun with Excel 2007

Update 2008-08-11: Read "Even more Web Analytics Dashboards Fun in Excel 2007!" and get an enhanced version of this spreadsheet!
Defining KPIs and designing dashboards is challenging for most web analysts. Even if you are lucky enough to use such tools as Tableau or Crystal Xcelsius, you can still go a long way just with Excel 2007. Read on for some tips I've come up while creating dashboards for my clients.





A word on KPIs

I think it's fine to show base metrics on a dashboard, such as Visits and Visitors, Orders and Revenues, etc. People can easily understand what they are and those represent the lingua franca of web analytics. But I also want to show "composite" metrics such as:

  • Conversion rates and ecommerce: customers/visitors, orders/visits, items/orders, average order size, etc.

  • Success rate: ratio of any success events by visits, such as orders, of course, but also subscribing to the newsletter, participating in a contest, etc.

  • Engagement: I leave it to you to find your own formula, but thinking in terms of "persuasion architecture" we can identify waypoints, points of resolution and conversion events that are significant, assign weighting and values to those events and create a good indicator.


Current vs previous periods

A raw number without context is useless. Just saying "we had 150,000 unique visitors this month" doesn't provide enough context. If I add "... vs. 120,000 last month" it's already better. I'm always reporting the current month vs the last, and the current month vs the same month of last year. If you look only at the peaks and lows over months, you won't see the annual cycle that is characteristic of most sites.

% Change & indicators

The next thing to add to our dashboard is an indication of the magnitude of change. Did we significantly increase visitors or it's just a small tip? Then we want to add an indicator, such as an up or down arrow which will make it easier to spot metrics that might be correlated.

  • Formula: % Change = (this period metric/previous period metric)-1

  • Format: from Conditional Formatting, choose Icon Sets, 4 Arrows (Colored).

  • Rules: over 5% improvement is green, below 5% degradation is red, etc.Using an indicator along with the color will help those who are colorblind (1% of the population).


Sparklines

There are many ways to create "sparklines" and even some Excel addons like Bissantz SparkMaker or BonaVistaSystems MicroCharts. I think Excel 2007 does a pretty good job "out of the box":

  1. Create a line graph that includes 13 months of data (remember we want to see "this month" vs "same month of last year")

  2. Clean up everything (title, axis, legend, lines, etc.)

  3. Put this new chart in a slightly enlarged cell and voilĂ ! You have a spark line


Ok, now we have a nice little graph... pretty cool! But we lost the scale and it's often hard to see the real significance of this little graph. So let's add some control limits:

  1. Click on the line

  2. From the Chart Tools, Layout menu, click on Error Bars and Error Bars with Standard Deviation

  3. Some cleanup again; right-click on the error bars area and do Format Error Bars

  4. Direction: Both, End Style: No Cap, Standard Deviation: 1.0

  5. Line Color: 80% transparency and Line Style just wide enough to overlap each other by one pixel (bug: Excel won't keep those changes if you change the main graph)

In the example above, notice the trend over a 13 months period and two areas where the line goes outside the limits. If you look carefully, you will also notice small lines which are the months ends.

Control limits and significance

I already talked about box plots, significance and outliers. How do you know if your current metric is way out of bound? This is called an "outlier": the strict definition is "an observation that is numerically distant from the rest of the data". Since our data is usually pretty much a normal distribution, using the mean and standard deviation is ok:

  • Upper Control Limit = Previous 12 months Mean + Standard Deviation

  • Lower Control Limit = Previous 12 months Mean - Standard Deviation

With some layout, we can show the Upper Control Limit, the Mean and the Lower Control Limit. Combined with the above sparkline, we end up with something pretty cool!





Dashboard sections

Each client is different, but I usually create a couple of sections grouping related metrics, such as "General Statistics", "eCommerce" and "Conversions". One section that I particularly like for ecommerce or content sites is "Movers & Shakers", which goes beyond the "top 10s" and show those items that changed the most over the previous month.



When printed, each section of the dashboard must fit on a single page with enough room to take hand written notes.

Analysis

As an analyst, you should always add a couple of lines verbally explaining your analysis. You never know where the dashboard, either printed or electronically, will end up. Unless one metric is really significant, I prefer to put my comments at the bottom of a group of metrics and "make up a good story" about what happened. And please, don't just say "This months visitors are up"... this should already be obvious enough! "The increased traffic is representative of our annual sales cycle and confirm the significant (33%) improvement we've been seeing over last year."

Segmentation, automation & customization

I include a "control center" at the top of the Excel dashboard where you can pick the month and any other appropriate segmentation. This way, from a click of a button, you can easily switch back & forth between months or segments. All the data in the dashboard gets automatically updated.



Of course you don't want to spend days and weeks updating your dashboard. The data is fetched from other tabs and whenever possible the raw numbers are imported (for example, if you are using Google Analytics) or better still, hooked up through an API (for example, through Omniture SiteCatalyst Excel client). Some fairly sophisticated Excel formulas (not even macros) are used to automatically update everything.



From this master template, I can create dashboards much more easily and with a few quick changes, I can remove or add new metrics and KPIs.

Your take?

If you want to go further, I recommend the book "Information Dashboard Design: The Effective Visual Communication of Data" by Stephen Few and the Dashboard Spy blog is a pretty good source too.



Do you have any dashboard tricks to share? Any sugestions on how to improve my dashboard? I would love to hear your feedback!

Friday, May 30, 2008

About bad bots, web anaytics and WASP

Simple fact: bad bots can screw up your web analytics data.
Interesting post from Marshall Sponder this morning, himself referencing Jay Harper on SEOmoz and Judah Phillips. So I'll had my two cents from the "bot" side of things, specifically regarding the Web Analytics Solution Profiler (WASP).

No surprise

From a server-side perspective, IT has known since the early days of Yahoo! that crawlers would affect web server logs. If you want some historical tidbits fun, look at those early posts:
"I count the accesses to my page to see if it's being used . Similarly, I browse through the access logs to see _who_'s using the page" then someone replying "This ablity to know *exactly* what someone looks like is going to be very very sigificant down the road." (March 1995: Visitor counts?)
"Yahoo! has links to well over 40,000 different web pages, and over 300,000 people use Yahoo! every day."(August 1995: The *NEW* Yahoo!)
There is very little we can do about bad behavioring bots, executing JavaScript or not, but as long as it's not widespread (and even it it does) or you are not the deliberate target of an attack, that shouldn't render your web analytics data useless. Malicious bots will not care about robots.txt exclusion rules, or slowing down your servers or screwing up your data. The only difference is that more sophisticated bots (crawlers) or session recorders/playbacks can run JavaScript and simulate real user sessions.

This is not new, it just seems marketing took a long time to find out :)

The web analyst role

Data cleansing and validation is an essential activity of the web analyst job and whenever there's a spike in traffic you should be able to explain it. As Avinash said a while back: "data quality sucks, lets get over it".

Depending on your experience and skills, and of course the web analytics solution you are using, it might be fairly easy to identify misbehaving visitors and spot outliers. The next step is to segment the data to exclude what shouldn't be there. Not "delete", "exclude". I recently saw a post suggesting to create Google Analytics filters to completely get rid of non-US traffic for a US-centric website. Don't do that... you still want to know where your unqualified traffic is coming from! Be it outside your geographic market, bad keywords or referrers or anything else, what you think is "unqualified traffic" can still help you optimize your site and even discover new opportunities. Segment, segment, segment...

Now about WASP

From the other side of the coin, ethic and professionalism (and I guess knowledge of how the Web works and experience too) plays a big role in how a crawler will behave. For example, the crawling feature of WASP runs JavaScript and could screw up your web analytics data pretty badly. That's why the current version is limited to crawling only 100 pages. But a test was done for a website with 30,000 pages without any glitch and it is expected WASP will easily handle crawling sites of over 100,000 pages in a single run.

The upcoming version of WASP will include the following options:
  • Abide by the robots.txt rules for excluding areas of your site and reducing the load
  • Modify the user agent string to identify itself as a bot
  • Show your real IP address before crawling so you can filter that data
  • "Stealth mode", effectively blocking the web analytics request altogether.
Any other ideas?

Thursday, May 29, 2008

Performance analytics the Coradiant way

What has now been recently rechristened "performance analytics" has been in existence for decades in IT: managing availability, capacity and performance. I've been a system administrator, dba, developer of real-time applications for the Montreal stock exchange and involved with the Web since the first incarnation of Mosaic, so I was comfortable meeting Coradiant at their R&D center in Montreal to discuss about the new TrueSight WA integration with Omniture SiteCatalyst (through the Genesis plug & play architecture).

A case for multiplicity

By now it's a given that web analytics is not only about visits and page views. The concept of "multiplicity" put forth by Avinash Kaushik is not yet tapped by most organizations. Put simply, here's how Coradiant TrueSight WA can help:
"captured user information is typically used by the IT department for troubleshooting, service level reporting and change management. But with TrueSight WA, web traffic, performance, and availability metrics gathered from each user visit are seamlessly integrated into Omniture SiteCatalyst, so marketers can get entirely new insights into campaign and customer success."
Coradiant integrates to your infrastructure to collect performance information directly, without additional impact on the client side (no JavaScript tags to change).

Correlation IS causation

Especially in the field of web analytics, how many times have we heard "correlation does not not imply causation"? It's often a beginner's mistake to take two distinct metrics and come up with a misled explanation of why one would impact the other. When we're talking about conversion rates and performance, there IS a very strong correlation between the two. Put it anyway you want, I can guarantee you that non-availability will lead directly to zero conversion. I can also guarantee you that poor performance will lead to lower conversion.

So why do most web analytics solutions keep offering only non-performance related statistics? I guess it's in part caused by the great divide between IT and marketing. Now, thanks to Coradiant, that gap will be a little less cumbersome, bringing more context and a similar language around IT and marketing (at least when it comes to web analytics!).

An example

Let's make the case for performance analytics with what a typical empowered web analyst would say about a campaign (fictitious case):
"Our marketing campaign increased traffic to the site by a factor of 4 times, bringing 120,000 visits to the site on a single day instead of the usual 20,000 or so. Although the conversion rate was lower (2% instead of 4%), the campaign was a resounding success, bringing $X in increased revenues. In our next campaign we will try to increase conversion rate by doing better ad placement, but still, bringing more traffic also increased our brand awareness and engagement toward the site."
With Coradiant, here's the additional insight gained:
"The campaign was a success from a marketing perspective, but since 10% of the visits resulted in errors and about 15% were slower than usual, at the 4% conversion rate, we left $Y on the table and we probably have frustrated a fair number of our visitors. Next time I would recommend spreading out the campaign or increasing the infrastructure capacity beforehand."
Unless you were very, very, very friendly with IT, you would have never known that. Even then, it would be a lot more difficult and time consuming to come up with such a clear conclusion.

Tuesday, May 27, 2008

Kampyle: combining VOC and Support

From time to time I test new services. One such service is called Kampyle "feedback analytics service" and I've put it to the test on WebAnalyticsSolutionProfiler.com to get feedback about the site and the tool.

Similar but different

Kampyle is somewhat similar to other Voice Of Customer services such as iPerceptions or ForeseeResults: you include a snippet of code on your page and set the ratio of visitors that should get surveyed. Pretty simple.

The survey fires when the user moves the mouse out of the window space (and makes sure you don't get bugged down with it every time) and simply ask for a rating of the site and optional details. That's where it starts to be different.

It's a conversation

Kampyle move away from other VOC services at this point. The additional categorized feedback (Bug report, compliment, suggestion, etc.) really helps learn more about the reason for a positive or negative feedback. And it works pretty well!

Another incentive to get feedback is a little triangular icon shown at the bottom of web pages, simply stating "feedback us". This way, you don't only get the survey invite, you can willingly provide your feedback whenever you want. Of course, you can look at feedback globally or for specific pages on your site.

Out of the 40 feedback I got in about two weeks, about half of them includes more details that I could really act on (typos on the site, feature requests, bugs, etc.).

Managing

The management interface is nice and efficient. Grouped under Feedback Analytics, User Analytics and Feedback Inbox, the interface shows relevant stats and appropriate graphs.


  • Feedback Analytics works fine, is very simple and logical (shown above)
  • User Analytics is a bit less obvious. The goal is to get people to register to Kampyle and provide some demographics (gender, age, location, etc.). From a site owner perspective, this would be great information, but from a user perspective it's not obvious to me that people would be willing to provide such detailed information just to provide feedback. As I tell my students: always make sure to serve the primary purpose. In this case: get their feedback.
  • The Feedback Inbox is where you get a categorized view of the incoming feedback, similar to a mail inbox. The top pane shows comments grouped by type and ranking (think of tags) and the bottom pane shows the matching comments. Where I get confused is the handling of the feedback status and how the "Publish completed" works at the top level. I would expect to "reply" to a specific comment rather than "publish" a whole category (but maybe I'm missing something). Still, the fact you can get back to your client (given they left their email address, of course) is very interesting.

My take

Of course, Kampyle "eat their own dog food" and use Kampyle to get feedback about Kampyle beta... The service is very interesting and looks promising. The User Analytics doesn't look very obvious to me but could be valuable, we also have some good technographics (browser, OS, IP location) in the Inbox. I need to get a better handle on the way this Inbox works but this is really where Kampyle differentiate itself from other solutions. Kampyle's traditional Voice Of Customer surveying and similarities to a Trouble Ticket support system makes it very interesting.

Friday, May 23, 2008

Playing with my face: the influence of profile pictures

We have profile pictures everywhere: Flickr, Facebook, Google, Amazon, name it... also in my tutor profile for the classes I'm tutoring as part of the UBC Award of Achievement in web analytics.

I thought it would be fun to show how pictures can influence behavior. Thanks to my friend Joseph Carrabis who opened up my eyes to those details and to Gail Lipschitz, an instructor for another class I'm tutoring at UBC: Introduction to Business Process Analysis. Gail is amazingly good at "reading between the lines" of students posts and finding out about their personality just from a profile picture!

Let's play with my face

... and tell me what you think (honestly!)

Those snapshots were taken from the forum interface in the Web Analytics for Site Optimization class.

Profile #1: formal/younger

Other than the fact I was younger (and thinner), I'm looking straight at you. The formal background might make me look a bit more professional but also could represent a top-down hierarchy: "I'm the tutor/you're the student".

Profile #2: formal/older (more weight)

This picture was taken more recently (older - notice the gray hair... and more weight!). Still very formal, still looking straight at you and zoomed closer. Might be even more intimidating because I look older (I must have more experience then you!) but at least I'm smiling...

Profile #3: casual, looking away

The third picture comes from a conference I did recently (btw, notice the title of my presentation...). No tie, more "in situ" picture (in fact, it's a cropped section of the larger picture at the top of this post). Do I look more "accessible" and friendly then the previous pictures? But why am I looking away from you (or from the content)?

Profile #4: casual, looking at

The last one, which I will keep at least for this profile, is reverted so I look "at" the content, effectively bringing your attention to it.

Cool isn't it? Do you think this simple change might have a positive influence on this forum participation and even the overall class perception? (me think so!)

Friday, May 9, 2008

eMetrics appreciation

Back from a fantastic trip in San Francisco for eMetrics. Catching up on emails and work. But I thought I should share my impressions while things are fresh in my mind.

Ok, I must admit I might be biased... as I presented on the Industry Insight day and was moderating one of the track on Tuesday.

BUT... It was an amazingly productive conference.

Way back then...

Some years ago (well... many years ago... I'm getting old!), each Internet World conference brought something new to the forefront of the industry. Remember "push technology", VRML, the early days of streaming? Without any coordination, "the industry" was moving in a direction. Although we can now laugh at some of those concepts, they nevertheless changed the face of the industry and how we use the web today.

The same pattern is happening at eMetrics. Without any preliminary coordination, there are some things setting the path for the future.

Testing & beyond

I noticed this year eMetrics was a lot about the value of "testing". Bringing the "testing" culture and the right tools to do it in order to optimize and achieve success. Contrary to most other field of expertise, the Web allows us to deploy quickly and continually improve. You don't want to do that with your car, your house or the space shuttle... but with the web it's how it should be. Most companies don't understand that and still impose strict project cycles, those who understand are not only demonstrating huge benefits.

From IT, to marketing, to business

The other outcome, highlighted during the Industry Insight afternoon round table and in Thomas Davenport's great keynote is the transition from web analytics to business analytics. Just like the web, web analytics started in IT, then marketing found out about it and took control. We are there now. But winning businesses understand the value of the web and have optimized some of their most important business processes around it. We are maturing to a level where we won't only talk about using web analytics for marketing optimization, but we will be talking about analytics for business processes optimization and strategic level changes.

Being a tutor of both web analytics and business process analysis classes, it's obvious to me there are very strong benefits in leveraging analytics to optimize business processes.

What will be this fall highlight? Next year?

Industry Insight

Jim Sterne told me the experience of the Industry Insight was very positive and will be renewed this fall in Washington: leading experts sharing their view of the current and future state of the industry. I will be there to bring some hard core data about the vendor market shares and exchange with fellow analysts.

Friday, April 18, 2008

WASP: Listening to VOC

One of the challenge with a R&D project like WASP and listening to the Voice of Customer is the number of ideas that comes in and how to sort through them while keeping a vision. Every week I get great feedback, suggestions and comments. Of course, sometimes people will send in a few critics, but that's part of the game isn't it?

Please allow me to share some of those ideas and what I intend to do with them.

Browser extension: yes

From the start I envisioned WASP as a browser extension. In my opinion, it doesn't only makes it very easy to constantly be "in context" of a real user session but it also allows for easy ad hoc testing of transactions, secured areas and development environments.

Actually WASP is only available as a Firefox extension, but you can expect an Internet Explorer one in the future.

Site crawling: yes

I've been running a quick poll for a while and that was one of the question. 43% of those who answered asked for the possibility to crawl a site and report on the tags and implementation.

That's coming up in WASP v0.40, currently awaiting approval from the Mozilla Foundation.
  1. "Crawl from here" recursively spider a site
  2. "Load from file" allows you to pick a file containing a list of URLs to check

Reporting: yes

As you browse (or crawl), WASP creates a session log. The resulting CSV report contains the URL, the type and name of the solutions found on any given page, the page title, the exact tags and some other information. This report is available anytime from the "Save log" feature.

Web service or hosted solution: not for now

I'm not planning to create a remote crawling or web service solution for WASP, at least not for v1.0. There are some solutions like Browsercam.com that will allow you to test remotely and simulate different browser/OS environments. Or the great DejaClick.com Firefox extension from AlertSite.com that allows you to build a test script that you can run automatically (and WASP will record correctly). More advanced tools like HP's LoadRunner or MS Visual Studio Team System Test Edition brings the full range of load testing, unit testing and the tools to manage the QA process and track bugs.

Transaction simulation: not for now

Once the site crawling feature is there, why not simply stick in a transaction simulation capability like what DejaClick offers? Two reasons:
  1. there are already great tools to do that and WASP will correctly log the details
  2. WASP is currently quite simple to use, adding such a feature would divert too much from the original intent
Just use the DejaClick extension!

Flash & videos: future

As the industry evolves, tags are appearing more and more in Flash animations and videos. WASP doesn't currently detect those tags but this should come up in a post v1.0 version.

More tools detection: yes

The upcoming version now includes over 100 tag-based solutions in various categories: analytics, testing (A/B or multivariate), behavioral targeting, surveys, session recorders, click maps, etc. In fact, some sites have so many tools in place that the status bar and the number of tabs in the sidebar is becoming an issue (I will fix that in an upcoming release).

Please continue to send in your feedback when:
  • you know a site as a specific solution in place but WASP doesn't detect it: send me the site URL and the tools that is supposed to be there
  • WASP doesn't detect a tool and it's not in the list of known tools: send me a sample site the URL and the vendor URL

Market research: controlled

As is often the case with R&D projects, one of the unexpected side effect of WASP is the ability to do market research. As per the license agreement and the opt-out option, WASP is sending anonymous information about the domain and the tools found. The initial goal was strictly for debugging and enhancing WASP itself.

In fact, I'm receiving information about 20,000 domains every day, over 350,000 monthly. That provides a pretty good picture of the vendors market shares for various verticals and regions. Of course I can also do specific research from any given list.

This is highly valuable information for market and financial analysts covering the web analytics space, for vendors and agencies looking for prospects, or even companies looking at who is using which tools in their specific vertical. For the most part, this is how WASP will be able to survive as a commercially viable product. I'm sure you will understand I will keep a close control over this information and how it is being collected.

If you want more information about WASP market research please contact me.

Send in your feedback and suggestions

Get SatisfactionI have created a customer support collaborative environment to ease the gathering of suggestions and comments using a great new service called Get Satisfaction.

I've got some offers for help, people asking to open source the code (which I won't), even some investment proposals. I still need some time to continue the "incubation" phase and the planning (hey! I've been freelance only since December!).

But I'm listening: if you have any ideas for WASP or any business proposals, don't hesitate to contact me.

Thursday, March 20, 2008

Winning content, spring break and analytics

Winning content

A while ago I wrote an article on box plots and whisker plots using Excel 2007. When I wrote it, I had in mind the use of this concept in the web analytics field, but it turns out a lot of people are searching for this information, especially students enrolled in statistical classes. Soon this article got referenced by de.Wikipedia.org and en.Wikipedia.org.

Hypothesis #1: Reporting on spring break

The thing is... I'm getting a lot of traffic, good for my ego, but this traffic is for the most part, "not qualified" for my blog goals: talking about web analytics. So here's what happen when students go in spring break: a huge drop in traffic in the last week!

That's reporting: making up an hypothesis and comforting our conclusion with some data extracted from a report.

Hypothesis #2: using analytics

Is this really the cause? After all, I know it's spring break in most regions...

Then I did this:
  • Entry page: identify which pages got the highest drop in traffic: yes, the Box Plot page is the culprit
  • Search terms: double-checked to confirm this was the root cause: yes, there's about a 50% drop from searches containing the word "plot"
  • Referrers: referrers from Wikipedia, is there a drop: no?! Hmmm... why?
  • Segmented search terms by continent: traffic is down by about 50% regardless of the continent... it's not spring break everywhere at the same time!
The real culprit: a change in my blog setup to shorten the page titles using only "immeria::"+post title has got my ranking to fall dramatically in Google!

Conclusion

Doing web analytics often implies starting up with an hypothesis. Then we fall short of digging for a complete explanation and we jump to the conclusion as soon as we have some data to prove us right. However, pushing web analytics a bit further implies using different tools and different angles to observe the same situation. Just like a scientist would describe something with different attributes and different qualities and a team of scientists would bring their expertise from various fields to provide an even more thorough analysis.

Friday, February 29, 2008

Troublesome targets: where analytics and audience meet

Every once in a while I'm chatting with my friend Joseph Carrabis. In just about a year since we've met at eMetrics San-Francisco we've shared thoughts and ideas, learned a lot from each others, even had fun flying kites in the nice S-F weather and had dinner in Quebec city just after a snow storm.

What began as one of our usual chit chat turned out into a great article Joseph wrote on AllBusiness.com: "Troublesome targets: Where Analytics and Audiences Meet".

The storytelling skills of Joseph provide a great example of understanding the role of web analytics as a tool to measure business objectives. But one has to first know and understand who's the audience and what those business objectives are! Than we can put the mechanisms in place to measure, understand those metrics and take action accordingly. What's of interest here is M.Carrabis company, NextStage Evolution, come from the sociological, psychological and behavioral angles while I come from an IT background, applying my expertise to the field of web analytics and online business process optimization.

The result is interesting: two spot lights on the same object of study, making the whole picture a lot clearer.

Tuesday, February 26, 2008

Quality assurance using WASP: tag all pages

In a post from a year ago, I was commenting on the challenges of JavaScript tagging. Here, I want to share some insight and advantaged of doing web analytics implementation quality assurance using WASP. This will take the form of a series of posts, each one addressing a specific issue.

Tag all your pages!

First and foremost, we need to make sure all pages are tagged. Obvious isn't it?

What strikes me when beginning with a new client is how bad their web analytics implementation is. Missing tags is the #1 problem to look into. Sadly, the area that are left out are transactional areas: the outcomes! Why?
  • It's more complex to tag transactions beyond the mere "page view" tags
  • Content areas are often rendered out of templates, transactions require case by case tagging to be implemented
  • Transactions are often under the realm of IT and changing them implies "negotiation" for resources, timely delivery, tests and answering any security considerations.
  • In some cases, transactions are on a different host and even a different technology altogether

The WASP advantage

Using a crawler such as the excellent SiteScan by EpikOne to check if all pages are tagged is a start, but it's not enough (plus, that's fine for Google Analytics but none others). A crawler won't be able to log into secure areas of your site, fill forms and execute transactions. Most crawlers will look for a specific string within a page, so even if the JavaScript code is there it doesn't guaranty it will be executed (more on JavaScript execution in a later post). Using the debugger provided by the solution provider, such as the one from Omniture, is fine for ad hoc tests, but hardly usable and often hard to decipher. Using proxys such as Charles, ieWatch or Fiddler is interesting, but they work at a lower network level and are way too technical. The other alternative is to open your wallet and work with Maxamine to do a complete and thorough web analytics, security, web compliance audit.

Because WASP blends itself into your browsing session, you will be able to go into any area of your site and make sure the tags are correctly implemented, even checking if specific parameters are being set correctly: custom variables, events, segmentation, etc.

Simply put, I'm from the school who think quality assurance of transactions can hardly be automated. You have to define test scenarios and diligently go through them not only to make sure the transaction work as expected and provides the appropriate results, but also to make sure you are measuring them correctly.

Coming up in WASP

The next release of WASP will include a couple of long awaited features:
  1. Site crawl*: from any page, launch a recursive crawl of all pages on that same site.
  2. List of links to parse*: already have a list of URL you would like to scan? Simply open the file and WASP will visit all of them and report back the results.
This is perfect to check the non-transactional pages of your site. For transactions, you will still be able to use the passive page checking already offered.

You will also get two ways of viewing the information:
  1. Web analytics implement view: what's currently shown by WASP
  2. Web analyst view*: showing simplified and plain English information about the tags found on that page.
Another request that was on queue: results are going to be available as a CSV file with domain, page, web analytics solution found as well as the exact data sent.

* Those features will be part of an advanced version of WASP available on a subscription base/purchase only.