| ||||||||||||
"This may be the first study to document the dramatic overstatement of online video and mobile video," said Jim Spaeth, one of the founders of Sequent Partners, which collaborated with Ball State University's Center for Media Design on the Video Consumer Mapping Study on behalf of the Nielsen-funded Council for Research Excellence. The project, which cost $3.5 million to field, directly observed how people spent their day using media, found that while growing rapidly, online video and mobile video still account for a small fraction of the amount of time Americans spend watching all forms of video content, including live TV programming, time-shifted television, DVDs, video games, etc.
The researchers previously disclosed findings showing that traditional "live" television still accounts for more than two-thirds of the time Americans spend watching video content each day, and that online video represents less than 1%. The new findings unveiled Tuesday indicate that even the relatively small amount of time Americans spend watching online video has been, on average, grossly overstated by conventional forms of media research and audience measurement.
Conversely, Sequent's Spaeth said traditional TV viewing has been "pretty drastically under-reported" by research that asks people how they consume video. The reason why, he said, is that research based on how people perceive they consume media isn't nearly as accurate as research that actually observes who they use it.
The ad industry historically has known about such "halo effects" and the fact that it is considered socially unpopular for people to report that they watch as much TV as they actually do. On the other hand, Spaeth said people tend to over-report their online and mobile video consumption, because "it is new and cool."
Spaeth, and Mike Bloxham, director of insight at Ball State's Center for Media Design, are scheduled to reveal more previously unreleased details about online video from the study during a presentation and panel discussion at the upcoming OMMA Video conference June 16th in New York.
During MPG's meeting on Tuesday, Spaeth revealed other new insights from the study that he claimed actually "measure the future" of how people will consume video content. That aspect of the study relied on a method called "media acceleration," in which consumers were given substantial discounts - upwards of 50% - off the price of purchasing new consumer electronics equipment for their homes, and their media consumption patterns were observed before and after the new technologies were in place.
Spaeth said the No. 1 finding from that part of the study was that almost everyone who participated purchased a high-definition TV set - either their first, or a second one for their home - and that the adoption of HDTV generally led to greater usage of television initially, but that over time, that increased usage began to subside.
"There is an early indication that this may be a temporary effect," Spaeth said of HDTV's stimulus effect. But at least in the short run, he said, "Live TV viewing accelerated by more than twice as much among those people who acquired and HDTV."



* The first is "how many people have (ever) watched online video?" ... the answer is lots and lots of them.
* The second is, "of those who have ever watched online video how many are repeat consumers?" ... the answer is far less clear but in all probability it is 90%+.
* The third is, "of the repeat consumers how much time are they spending regularly consuming online video?" ... the answer is even less clear but until 100Mbps broadband is ubiquitous it appears as though it is the exception and not the rule.
What CRE are trying to do is put some meat on the bones and provide two things. First, they are trying to provide a robust estimate of each component to provide a picture of what is happening right now. Second, this starting point will provide a benchmark against which we can trend growth - growth we ALL know will happen.
The question I MOST want answered is, "do people who start consuming online video completely forsake forever traditionl video (i.e. television), and if not what 'share of eyeballs' does online tend to get?" The hyperbole of the online world says they do. The CRE research seems to be indicating that lots of us have trialled online, and become consumers of both - with the choice of which distrubtion channel at any given instance being a matter of content, convenience and cost (the three Cs of choice). It is also clear that we are not talking about a few decimal points, but that there is a massive gap between the barrow that those that are selling online video solutions, and what is actually happening (or is likely to happen in the next couple of years in my opinion).
If robust research and benchmarking is seen as being negative towards online, then so be it. Our job as researchers is to establish the facts to the best of our collective ability. If the facts don't accord with the hyperbole and the vision, please don't shoot the messenger!
One other point of clarification, this project actually used layered a couple of methods on top of the observational method to better understand how people are using media. I referenced one, the "media acceleration project" in the article we published. I did not explain how the CRE project gleaned the differences between "observed" and "self-reported" estimates for TV and online video viewing. To do that, the researchers fielded two separate waves -- one in the spring and the other in the fall of 2008 -- and also recontacted households with a follow-up telephone interview asking them to self-report how much time they spent watching TV, online video and other media. It was that differential that Jim Spaeth was referring to.
We linked to the actual study in the original article, but I am posting a link to it here as well:
http://www.researchexcellence.com/vcmstudy.php
The Committee for Research Excellence (CRE) which commissioned this research consists of around 35 research professionals. Sure Nielsen (who pay for it all) are there, as are the broadcasters. But so are the media agencies and the advertisers, such as Unilever, P&G, Kraft, Kimberly Clark. The CRE then went outside of that group and commissioned Jim Spaeth (Sequent) and Mike Bloxham (Ball State University) to perform a rigorous ethnographic study.
And what is Terry's take on this august group and the reporting of their findings? That they are trying to "unring the Internet bell". Just once I would like to see the same rigour applied to internet audience measurement. Yes, the same internet that doesn't even have an agreed set of definitions and procedures on how to measure itself, and has no agreed currency - may he who can report the biggest numbers win seems to be the war-cry. The internet is the new home of measuring traffic and passing it off as audience, having wrested that crown from Out-Of-Home who are working hard on audience models due soon. In my experience, most online sales and marketing people don't even realise that there is a difference between traffic and audience. They point to their server-log data and how huge the numbers are, then turn and criticise the robust research conducted that tries to provide audience data (yes, you Josh at ComScore and your compatriots over at Nielsen Online as well) and say "well they can't be right". This is "Research 101" stuff, and the gross majority of the internet business don't get that traffic does NOT equal audience. At the risk of repeating an example I have used before on here - when you aggregate the de-duplicated traffic data here in Australia you get a "uniques" figure of 45 million. Problem is that there are only 21.7 million of us. Josh may have similar data for the US that he could share, but I am sure it would be of the same magnitude.
I look forward to the day that the rigour that the CRE have approached this project with applies to all Internet measurement. Until that day, I'm afraid that the majority of online data and reports must fall into the overflowing hyperbole bucket.
Fortunately, the IAB in Australia is in lengthy and deep discussions with the agencies (full disclosure - I represent the media agencies), advertisers and the 'long tail' publishers to develop an agreed audience measurement system, having just this month launched an agreed-on audited traffic measurement system.
I'll also give you the tip - if television converted it's audience back in to traffic data, then they would swamp the internet! Fortunately, they realise it is a useless statistic.
Re. Josh Chasin's point: Well made. I think Jim Spaeth was mainly talking about self-reported methods, but I think the other point is that there is value in benchmarking actual behavior via the observational method. It doesn't replace what you or others are doing with things like Video Metrix, which of course is sound, representative research of its kind.
Re. Doug Ferguson, I am just a journalist and not a researcher, but my job is not to use mathematical skills to vet the quality of media research (that's up to organizations like the MRC, IAB, etc.). My job is to cover what they've found and report on that news, and let people like you weigh in. Sorry if I misled you into thinking otherwise.
Re. Rob Frydlewicz's point, that is interesting, and ironically, one of the other findings that Jim Spaeth shared (but I did not report on) was that their data suggests the opposite: That, "Early adopters of DVRs spent much more time with DVR playback than more recent adopters." Interesting.