Do social media and online community metrics really matter?

After talking with many people about this question and seeing/hearing others talk about it (here and here), what I've concluded is that metrics do *not* matter for those who can't easily or cost effectively measure, report, or analyze the statistics associated with their social media and online community. :-) As a precursor to our upcoming 2.0 release of Telligent Harvest Reporting Server, here are some teaser screen captures of the 100+ actual reports that will be available OOTB. I'll blog a lot more about the importance and value of "social analytics" and "community BI" along with specifics about Harvest RS 2.0 in the near future.

[Update: I replaced previous screen captures with later/sharper/brighter ones. What's not shown is the awesome zoom-in and drill-down capability that each graph has. I'll post some screencasts very soon.]

image

image

image

image

image

image

image

image


Posted Oct 29 2008, 02:27 AM by Lawrence Liu

Comments

Mike Rowland wrote re: Do social media and online community metrics really matter?
on 10-29-2008 8:34 AM

"After talking with many people about this question and seeing/hearing others talk about it, what I've concluded is that metrics do *not* matter for those who can't easily or cost effectively measure, report, or analyze the statistics associated with their social media and online community. :-)"

Lawrence - Love the quote... when we are consulting with clients new to social media we have a section of our presentation titled "Eighth Grade Math Revisited" to cover metrics and ROI. There are always two groups in the meeting, one who wants to know every detail about metrics and those who don't want to try and understand.

In today's budgetary world, continued funding means proving the value of your community. Remedial math is coming back into vogue...

Mike

Ari Herzog wrote re: Do social media and online community metrics really matter?
on 10-29-2008 11:32 AM

I don't care for metrics. I care more about peer review. When I buy a car, I care less about crash test dummy statistics and more about reliability reports from other owners. When I try a new restaurant, I care less about Zagat ratings and more about word of mouth reviews.

Then again, I'm not a numbers guy; I'm a people person.

Lawrence Liu wrote re: Do social media and online community metrics really matter?
on 10-29-2008 12:16 PM

Mike, I love your quote, "In today's budgetary world, continued funding means proving the value of your community." :-)

Ari, I'm a people person, too, but as my social and professional networks have grown, it would really help me to know some metrics about a person's activity (aside from just a long running newsfeed) within a particular community, which provides additional context for me to decide whose response or advice I should take more seriously than others. Social analytics (and profiling) based on community metrics enable me to grow my trusted network way beyond what I can do purely through social interactions.

Michael Russell wrote re: Do social media and online community metrics really matter?
on 10-30-2008 1:04 AM

Asked the stellar Katie Paine a variant of this question in person after her presentation at the PRSA travel confab in Pgh. this past summer.

As regards the topic of estimating ROI to cost justify social media-optimized PR initiatives in particular, where the objective is specifically building brand equity, I understood her to say, in essence, never try to quantify ROI to the client in terms of a dollar expenditure for an equivalent ad buy.

This on the heels of an earlier presentation by Laura Ries, author of  _The Fall of Advertising and the Rise of PR_.

Community's a whole different story altogether, though.

Matt Ranlett wrote re: Do social media and online community metrics really matter?
on 10-30-2008 1:05 AM

How are the metrics actionable?  In a community, all that you're doing seems to be measuring velocity.  Outside of providing that to advertisers, is there any real information in here which can be translated into action?

Pretty reports are fun to look at.  Take Xobni.  Totally changed how I use Outlook - can't live without it and I curse Live Mail (Outlook Express) client for not having it.  But the analytics?  Who cares?  Meaningless data but fun to look at.  I tend to think the screenshots above are the same.  Fun to look at but full of meaningless data unless there is a way to take action to impact a graph in a predictable manner.

Dean Thrasher wrote re: Do social media and online community metrics really matter?
on 10-30-2008 4:07 PM

Matt, the ability to take action rests on having enough information to make decisions in the first place. Otherwise, you're just taking shots in the dark. Don't think of these charts and graphs as the end of the story, but as a way to start the next one. :-)

Lawrence Liu wrote re: Do social media and online community metrics really matter?
on 10-31-2008 4:53 PM

Matt, my response would be similar to what Dean said. Moreover, without metrics, you simply cannot make an informed decision about what to do next. A common FAQ/complaint I hear from organizations that have invested heavily in social media and online community (mainly based on hunches) is, "What now?"

A concrete example are the SharePoint forums at http://MSSharePointForums.com that I used to be responsible for. After trying without much success to convince more product people to help answer questions in the forums, it took just one "Answer Rate" report (that showed an abysmal ~20% compared w/ 60+% for SQL Server and Exchange) to convince the right people that we need to put dedicated support engineers to monitor the forums. Within 3 months, the 5 most trafficked SharePoint forums achieved an avg Answer Rate of ~65%. While I didn't have enough time to validate the correlation between the increased Answer Rate and higher Customer Satisfaction scores, one very important metric that we did confirm was that "Cost Per Incident" in the support forums was only ~10% of the CPI for commercial phone support. Now *that* is ROI that any organization would get excited about these days.

Matt Ranlett wrote re: Do social media and online community metrics really matter?
on 11-07-2008 10:44 AM

Dean and Lawrence,

 I couldn't agree more that the ability to chart a course requires navigable metrics.  Lawrence, your story about taking action on Answer Rates is perfect and gets to the heart of my question - WHICH metrics matter for social sites?  The ability to adjust tactics and strategy depend on measuring the right trends.  

I think the right restatement to the question you asked in the original blog isn't DO metrics matter, but WHICH metrics matter.

Rob Gray wrote re: Do social media and online community metrics really matter?
on 11-07-2008 1:23 PM

Hey Lawrence - this looks like great stuff.

I say that metrics DO matter - a lot! Communities are not successful unless you can monitor their success and health. You guys seem to be doing a great job in this department.

How do you measure "sentiment" - are you looking for specific words or phrases?

I like your user "social technographics" report too.

Anyone who says this stuff is not important, has clearly never had to manage a large community

Lawrence Liu wrote re: Do social media and online community metrics really matter?
on 11-07-2008 2:59 PM

Harvest Reporting Server measures sentiment around specific keywords. But there's still lots of R&D to be done going forward. Our ultimately goal is to be able to recognize sarcasm. :-)

LL's Community Zen Master Blog wrote Telligent announces release of social analytics tool and hiring of Chief Social Scientist
on 11-10-2008 6:18 PM

A couple of weeks ago, I had posted some teaser screenshots of the 2.0 release of our Harvest Reporting

LL's Community Zen Master Blog wrote How to attain self-sustainability in community forums
on 11-14-2008 9:54 PM

A couple of weeks ago, I left the following comment on my post about " Do social media and online

Add a Comment

(required)  
(optional)
(required)  
Remember Me?
(C) 2008 - CommunityZenMaster.com
Powered by Community Server (Commercial Edition), by Telligent Systems