A Collaborative Effort Between Two Firms: Web Analytics Demystified and Altimeter Group
It’s just been over a month since we published the Social CRM Research paper (over 36k views on slideshare) and we’re continuing our cadence here at Altimeter Group of publishing widely available reports under the spirit of Open Research. This time, it’s different, we’ve aligned with who I feel are the smartest team of web analytics minds in the space, John Lovett (ex-Forrester analyst) and Eric Peterson (ex-Jupiter analyst) both of the Web Analytics Demystified firm. Stemming from Altimeter founder Charlene Li’s (ex-Forrester Analyst) framework, we co-developed this framework, and put our collective minds to work on measuring the rapidly changing social media marketing space. This self-funded research effort resulted in a thorough methodology as we interviewed over 40 ecosystem influencers.
Interested in learning more? Attend the no-cost webinar by registering.
Industry Challenge: “I can’t measure social media ROI”
Marketers around the globe are ranging from toe dipping to jumping all the way into the social marketing space –yet most lack a measurement yardstick. While experiments can fly under the radar for a short term, without having a measurement strategy, you run the risk of not improving what you’re doing, justifying investments, and the appearance of being aloof to upper management. To be successful, all programs (even new media) must have a measurement strategy, and we’ve done just that.
Finally, A Measurement Framework Based on Business Objectives
If you’re familiar with the Altimeter frameworks of developing a social strategy based on business objectives, then you’re in good shape, as this research report is the natural extension of the business objectives we put forth:
- Dialog: involves starting a conversation and offering your audience something to talk about while allowing that conversation to take on a life of its own
- Advocacy: activation of evangelism, word of mouth, and the spread of information through social technologies
- Supporting: customers may self support each other, or companies may directly assist them using social technologies.
- Innovation: The business objective of innovation is an extraordinary byproduct of engaging in social marketing activity.
Our framework is a common denominator, so if you’re already measuring converted leads, or actual sales from social media, you’re already a leg up! In this meaty report, we hope you’ll share with your marketing and analytics team, and use the actual KPI formulas to create your own cookbook.
A Nod To the Community Spirit
We’re putting a big stake out there, in order to further the industry to come together around a common set of KPIs and metrics, but we realize we don’t know all the answers. In the spirit of Open Research, we want this to be an open framework (we’ve even licensed this under Creative Commons) to customize it and make your own for non-commercial reasons with attribution. If you’ve ideas on how to improve it such as new KPIs, vendors, or approaches, we’re listening, and will incorporate and improve this community body of knowledge for all to benefit.
Related Links
I’ll link to others that extend the conversation (even critical reviews), feel free to embed the slideshare on your own site.
- John Lovett, my co-author, on the Web Analytics Demystified Blog. Note, they used their branded report template, but the content is the same.
- The Altimeter Blog (cross posting)
- Christine Tran is the lead researcher on this report, she writes a smart blog
- Lithium’s Phil Soffer, VP of Product Marketing, has shared it from the Lithium Blog
- Dennis Howlett of ZDNET suggests this could be the dark side.
- Shel Holtz gives a review, and suggests we couple our paper with KD’s checklist (PDF). She was one of the respected ecosystem contributors.
- Laura from Scoutlabs posts it to their official blog
- Ikedahayato, a Japanese blog, makes the report go global, thank you
- The Passion for Research Blog says “This report cuts through that confusion and delivers some great insights”
- Dave Fleet writes it’s a good start, and provides good KPIs but wants to see the conversation extend.
- Alterian’s Connie Benson adds to the conversation and highlights some of SM2’s capabilities.
- Geoff shares it from his French blog, more international spread.
- Connie Bensen cascades the research report to her career blog.
- CJLambert is cynical and doesn’t think a universal ruler can be applied to social media measurement. We look forward to her detailed review later.
- Ken Yeung does a wrap up post, highlighting the report, thanks
- Francine, a Silicon valley/Phoenix entrepreneur and friend is frustrated that the research report doesn’t write for small businesses, do see my response in the comments.
- Debbie Hemley publishes the report, over at Weber Media
- Marshall Spondor from Web Metrics Guru shares the report, has some funny comments about analysts, as well as Open Research, thanks Marshall. Excellent, he’s starting to try it out, see test 1.
- Pathway Communications embeds the report
- Social Media Biz embeds the report, I enjoyed the thoughtful content on their site
- More global spread, it’s now on German blogs.
- Seesmic founder and LeWeb producer Loic had comments, I engaged in dialog on Twitter, see the conversation
- Research Live highlights the report
- Marketing Profs has allowed me to guest post on Daily Fix, sharing it to a fantastic community of marketers
- Liberate Media posts the report, thanks Lloyd
- Christopher Berry does a review of the report, and tests out some of the formulas
- David Berkowitz shares the report, and points out it’s not a complete list of vendors.
OK, I admit I'm a little biased (I work for them), but why no Nielsen BuzzMetrics?
OK, I admit I'm a little biased (I work for them), but why no Nielsen BuzzMetrics?
Great start to begin defining metrics. Someone had to take that leap, its the best way to foster innovation.
We release most of our data and findings as well
http://www.mediabadger.com
Great stuff!
Great start to begin defining metrics. Someone had to take that leap, its the best way to foster innovation.
We release most of our data and findings as well
http://www.mediabadger.com
Great stuff!
I've been tinkering with similar business goals, but I think these hit it on the head. Foster Dialog, Promote Advocacy, Facilitate Support and Spur Innovation. As always Jeremiah, thanks for spurring the conversation.
I've been tinkering with similar business goals, but I think these hit it on the head. Foster Dialog, Promote Advocacy, Facilitate Support and Spur Innovation. As always Jeremiah, thanks for spurring the conversation.
The only serious omission is NetBase and our tool ConsumerBase Jeremiah. I think you've seen the tool, but what we're focusing on is measuring the emotional involvement of consumers with brands. Instead of just counting words we are actually parsing sentences and extracting emotional, behavioral, and functional meaning from the conversations people are having online. In the end the most successful brands online are the ones that can motivate participation in the culture that surrounds the brand online, and we're helping brands understand. Word of mouth is incredibly hard to measure, but more and more attention is being paid to it by some very serious companies, take a look at the McKinsay quarterly on Word of Mouth Equity: https://www.mckinseyquarterly.com/A_new_way_to_…
Cheers
The only serious omission is NetBase and our tool ConsumerBase Jeremiah. I think you've seen the tool, but what we're focusing on is measuring the emotional involvement of consumers with brands. Instead of just counting words we are actually parsing sentences and extracting emotional, behavioral, and functional meaning from the conversations people are having online. In the end the most successful brands online are the ones that can motivate participation in the culture that surrounds the brand online, and we're helping brands understand. Word of mouth is incredibly hard to measure, but more and more attention is being paid to it by some very serious companies, take a look at the McKinsay quarterly on Word of Mouth Equity: https://www.mckinseyquarterly.com/A_new_way_to_…
Cheers
I appreciate the note in this on being open to suggestions Jeremiah. Being such a fast changing field, it's all about being open. I'm coming back to this when I have a chance to review because the slide show has a lot to talk about. Thank you Jeremiah.
I appreciate the note in this on being open to suggestions Jeremiah. Being such a fast changing field, it's all about being open. I'm coming back to this when I have a chance to review because the slide show has a lot to talk about. Thank you Jeremiah.
This post really only approaches the most rudimentary tools that only apply to your own website. What about real social media analytics that can track where people are talking about you (your competitors, what they are saying, what your share of voice is, what the sentiment is? Now its new world of analysis and engagement.
With Regards
Sofia Wilson
Sr. Marketing Executive
Datarecoverysoftware successful results
This post really only approaches the most rudimentary tools that only apply to your own website. What about real social media analytics that can track where people are talking about you (your competitors, what they are saying, what your share of voice is, what the sentiment is? Now its new world of analysis and engagement.
With Regards
Sofia Wilson
Sr. Marketing Executive
Datarecoverysoftware successful results
No one talks about pageviews anymore, they™re talking about conversations, engagement and how consumers interact with a company and/or product.
Influence = the power or ability to affect someone elses desicions or actions
Engagement = user actions and reactions
Advocacy = engagement drive by a campaign
Sentiment = contextual expression of opinion
ROI = Return on Investment Yes this can be traced, tracked and quantified.
The return on social media marketing can be measured just as effectively as everything else you do online. Overdrive Interactive has been monitoring and showing Fortune 500's their ROI on social media through their innovative Social Eye dashboard. http://www.ovrdrv.com
No one talks about pageviews anymore, they™re talking about conversations, engagement and how consumers interact with a company and/or product.
Influence = the power or ability to affect someone elses desicions or actions
Engagement = user actions and reactions
Advocacy = engagement drive by a campaign
Sentiment = contextual expression of opinion
ROI = Return on Investment Yes this can be traced, tracked and quantified.
The return on social media marketing can be measured just as effectively as everything else you do online. Overdrive Interactive has been monitoring and showing Fortune 500's their ROI on social media through their innovative Social Eye dashboard. http://www.ovrdrv.com
Karl and the NetBase crew.
Thanks for the comment, we tried to include as many vendors as possible, but with such a fast growing field we did what we could within the time parameters we put in the scheduled methodology.
Although we included 39 ecosystem contributors, I agree, it's time for another look at Netbase.
Karl and the NetBase crew.
Thanks for the comment, we tried to include as many vendors as possible, but with such a fast growing field we did what we could within the time parameters we put in the scheduled methodology.
Although we included 39 ecosystem contributors, I agree, it's time for another look at Netbase.
Matt
We tried to get a healthy sample of as many vendors as we could, and were able to clinch 39 ecosystem contributors. It's a growing space, and would like to resume a discussion with Nielsen Buzzmetrics to get an update.
We're going to take this paper on the road through followup blog posts, webinars, speeches, so be sure to brief us.
Matt
We tried to get a healthy sample of as many vendors as we could, and were able to clinch 39 ecosystem contributors. It's a growing space, and would like to resume a discussion with Nielsen Buzzmetrics to get an update.
We're going to take this paper on the road through followup blog posts, webinars, speeches, so be sure to brief us.
It just seems odd that despite having so many ex-Forrester people involved, no one thought to include the best performer in their Wave studies of this space! 🙂
It just seems odd that despite having so many ex-Forrester people involved, no one thought to include the best performer in their Wave studies of this space! 🙂
Great stuff. I think that this will help a lot of companies get through some of their biggest challenges in dealing with SM
Great stuff. I think that this will help a lot of companies get through some of their biggest challenges in dealing with SM
I've read about your framework with interest. It is good as a basic framework, but your metrics barely scratch the top of what is required.
For example, when you focus on analysing user engagement, the number of engagements isn't actually all that interesting. It only tells you how strongly you managed to get people active around your content.
But it doesn't tell you how many people actually got active, or what demographics they are. You need to know more before being able to make the right conclusions.
For example, see a recent analysis of the average commenters on YouTube at http://www.vquence.com.au/2010/04/25/youtube-co… . The demographics give you actionable information – just knowing you have x comments won't.
I've read about your framework with interest. It is good as a basic framework, but your metrics barely scratch the top of what is required.
For example, when you focus on analysing user engagement, the number of engagements isn't actually all that interesting. It only tells you how strongly you managed to get people active around your content.
But it doesn't tell you how many people actually got active, or what demographics they are. You need to know more before being able to make the right conclusions.
For example, see a recent analysis of the average commenters on YouTube at http://www.vquence.com.au/2010/04/25/youtube-co… . The demographics give you actionable information – just knowing you have x comments won't.
Great read, and particularly interesting when I consider it against how we've tried to create our own categorisations around “participants”, “shares” and “coverage”.
Was there a view from the evaluation as to which tools (by category) are better suited to larger/smaller organisations? This is something we tried to factor in when running a tools evaluation ourselves recently (http://bit.ly/cf3C9Y).
Cheers
Simon
Great read, and particularly interesting when I consider it against how we've tried to create our own categorisations around “participants”, “shares” and “coverage”.
Was there a view from the evaluation as to which tools (by category) are better suited to larger/smaller organisations? This is something we tried to factor in when running a tools evaluation ourselves recently (http://bit.ly/cf3C9Y).
Cheers
Simon
The engagement KPI we presented is a good example –but not absolute of all the forms of social media. We'd expect companies to custom tailor the numerator depending on the form of media.
For example, the engagement formula that Twitter uses for 'resonance' is clearly going to be different than that of blog posts.
The engagement KPI we presented is a good example –but not absolute of all the forms of social media. We'd expect companies to custom tailor the numerator depending on the form of media.
For example, the engagement formula that Twitter uses for 'resonance' is clearly going to be different than that of blog posts.
Great stuff. A bunch have vendors have been pushing some of their own thoughts in this area and there's been tons of theory chatter. It's great to see the right people taking an industry consortia approach to working out some details.
Regarding comments having to do with some of these metrics not going deep enough, etc… I'd suggest that – besides these being early attempts – true KPIs should be very high level. One can always drill in deeper. As well, over time I'm sure people will take these and do correlations and such with a variety of numbers. And regarding those who suggest 'traditional' metrics such as pageviews, etc. don't matter anymore… of course they do. It all matters. To what degree things matter probably varies by content category / customer base, but it all matters.
In the meantime, I'd suggest the following:
* In “Audience Engagement” you have Comments, Shares, and Trackbacks in the numerator. Should there be a plus “other” category or should these categories be broken down further? I suppose if you want a hard industry standard comparable number, the answer is no. But it strikes me that there's still some question as to what goes into this. Are “commments” blog comments and forum comments and tweets?
* The difference between “Sentiment Ratio” and “Idea Impact” seems subtle. Essentially, just whether it's positive on the Idea Impact side. Are both of these really needed? I suppose “Impact” includes the shares, but why not let impact be Positive, Neutral or Negative? (Because sometimes it will be.)
Again, great job. Thanks for sharing. Very Tweetworthy!
Great stuff. A bunch have vendors have been pushing some of their own thoughts in this area and there's been tons of theory chatter. It's great to see the right people taking an industry consortia approach to working out some details.
Regarding comments having to do with some of these metrics not going deep enough, etc… I'd suggest that – besides these being early attempts – true KPIs should be very high level. One can always drill in deeper. As well, over time I'm sure people will take these and do correlations and such with a variety of numbers. And regarding those who suggest 'traditional' metrics such as pageviews, etc. don't matter anymore… of course they do. It all matters. To what degree things matter probably varies by content category / customer base, but it all matters.
In the meantime, I'd suggest the following:
* In “Audience Engagement” you have Comments, Shares, and Trackbacks in the numerator. Should there be a plus “other” category or should these categories be broken down further? I suppose if you want a hard industry standard comparable number, the answer is no. But it strikes me that there's still some question as to what goes into this. Are “commments” blog comments and forum comments and tweets?
* The difference between “Sentiment Ratio” and “Idea Impact” seems subtle. Essentially, just whether it's positive on the Idea Impact side. Are both of these really needed? I suppose “Impact” includes the shares, but why not let impact be Positive, Neutral or Negative? (Because sometimes it will be.)
Again, great job. Thanks for sharing. Very Tweetworthy!
A nice report that has a lot of practical insight. Thanks.
All this made me wonder — what social media measurement tools are out there to help get started? I trawled the web for a few days and came up with a list of *eighty-two* solutions of various flavors. And I'm sure I missed a bunch. You can see the list here: http://ianbruce.blogspot.com/2010/04/definitive…
Please — help me update the list. Thanks again.
A nice report that has a lot of practical insight. Thanks.
All this made me wonder — what social media measurement tools are out there to help get started? I trawled the web for a few days and came up with a list of *eighty-two* solutions of various flavors. And I'm sure I missed a bunch. You can see the list here: http://ianbruce.blogspot.com/2010/04/definitive…
Please — help me update the list. Thanks again.
sports shoes
Nike Sport Shoes
Women's Nike Sport Shoes
Men's Nike Sport Shoes
sports shoes
Nike Sport Shoes
Women's Nike Sport Shoes
Men's Nike Sport Shoes
MBT save up to 65%, MBT Shoes can activate your muscles ,MBT panda with the same functions for summer.
I can™t measure social media ROI i thinks its not easy as SM helps and many hidden ways to your business which can not be measured directly….its not like PPC in which you can track your users
SM is wide subject and used in proper planning can be huge ROI, infact in some SM, you have no need to spend money and return is great
I can™t measure social media ROI i thinks its not easy as SM helps and many hidden ways to your business which can not be measured directly….its not like PPC in which you can track your users
SM is wide subject and used in proper planning can be huge ROI, infact in some SM, you have no need to spend money and return is great
I like this article, I think this article is very level. Whether the content, or structural arrangements are very good. I believe some spent a lot of effort on it!embroidery design,embroidery designs,rapid prototyping,
plastic molds,product design,plastic molding
I like this article, I think this article is very level. Whether the content, or structural arrangements are very good. I believe some spent a lot of effort on it!embroidery design,embroidery designs,rapid prototyping,
plastic molds,product design,plastic molding
Thanks very much for sharing.
In Europe and America, a great number of stars choose the CChristian louboutin. So you can imagine how hot the cheap christian louboutin shoes are. These shoes are excellent in styling beautiful and sexy women. Also christian dior can be very good presents.
The ghd hair straighteners are completely safe to use, they are designed to protect the hair. you can be confident about the quality. The ghd straighteners are the best hair tool for you, no matter you have straight or curl hair. The ghd iv styler is easy to use and is functional.
You did very good job by this posting . Really good Analysis . Thanks ..
Nice article. It's great to read and not be distracted by words used wrong, improper punctuation, etc. Thanks for a well-written piece.
what your share of voice is, what the sentiment is? Now its new world of analysis and engagement.
SM is wide subject and used in proper planning can be huge ROI, infact in some SM, you have no need to spend money and return is great
well friend i read this site and i think there are more good tips so i really happy!
“Well ,your details is really reasonable and you guy give us valuable informative post. I actually love playing various sports and I believe only sports can make you energetic. I like this forum because I learned so much knowledge in here,and there are all kinds of newest news to us
By the way ,recently I gonna buy some shoes ,will you guys give some suggestions for me from below websites at thanks!
hi,
I have built a social media scorecard #smbc (that´s the metrics-language my customers understand) that implements strategy into action and your framework was really helpful. I will post the results this week on my blog http://www.rolandfiege.com (in German language; but I´m shure you will get the message – English version will follow).
keep up the great work.
Roland
well, i think there are so more tips!
Glad to see these social media marketing review. I noticed that most of their objective is for their business development and I think that was a good idea. If they want a successful business they should provide possible objective.
Thanks for sharing !! great work and great spirit.
Hi,
This is good Altimeter Report: Social Marketing Analytics (Altimeter Group & Web Analytics Demystified)
A nice report that has a lot of practical insight. Thanks.Â
For GPS Cell Phone Tracking to track a phone spy phone software ¦
It’s an interesting concept you have here as I would never have thought
of using buzz monitoring for keyword research as I normally associate it
with online reputation management or social monitoring.