Welcome | View My Profile | Sign Out
MediaPost Home About MediaPost Privacy/Terms Media Kit Sitemap
Publications Home News
Online Media Daily Media Daily News Marketing Daily Mobile Marketing Daily Search Marketing Daily
Daily Feed> Email Daily Feed> Video Daily Feed> Social
Online Blogs
Online Spin Email Insider Search Insider Behavioral Insider Online Publishing Insider Mobile Insider Video Insider Gaming Insider Performance Insider Metrics Insider Social Media Insider Just An Online Minute Daily Online Examiner Raw Blog
Media Blogs
Research Brief Diane Mermigas:On Media TV Watch TV Board Magazine Rack Media Creativity Notes From the Digital Frontier Digital Outsider Mad Blog Red White and Blog
Marketing Blogs
Engage:Hispanics Engage:Kids 6-11 Engage:Moms Engage:Boomers Engage:Gen Y Engage:Teens Marketing:Green Marketing:Sports
Magazines
OMMA Magazine Media Magazine
Subscribe
Feedback Loop RSS Feeds Archives Subscribe
Dec 2 Search Insider Summit (Utah) Dec 6 Email Insider Summit (Utah) Jan 11 OMMA Agency of the Year (NYC) Jan 12 MEDIA Agency of the Year (NYC) Jan 26 OMMA Social (San Francisco) Jan 27 OMMA Performance (SF) Feb 24 OMMA Metrics Measurement (NYC) Feb 25 OMMA Behavioral (NYC) Mar 15 OMMA Global (San Francisco) Apr 14 Search Insider Summit (FL) Apr 18 Email Insider Summit (FL)
Recently Concluded Events
Nov 3 OMMA Adnets (NYC) Oct 30 OMMA Video (LA) Oct 29 OMMA Mobile (LA) Oct 29 OMMA Mobile & Video (LA) Sep 23 Creative Media Awards (NYC) Sep 23 The Future Of Media (NYC) Sep 22 Online All Stars (NYC) Sep 21 OMMA Awards (NYC) Sep 21 MediaPost Live at Advertising Week All-Access (NYC) Sep 21 OMMA Global New York (NYC)
All MediaPost/OMMA Events Event Blogging Past Event Videos
Industry Events Calendar
2010 OMMA Agency of the Year 2010 MEDIA Agency of the Year
2009 Creative Media Awards 2009 OMMA Awards 2009 Digital Out-of-Home Awards 2009 Media Agency of the Year 2009 OMMA Agency of the Year
All Awards
Employment Situations Wanted Services Offered Post a Job
Briefs Reports Online
MediaPost Directories
Mobile Insiders Group
People Finder Edit My Profile View My Profile My Contacts My Calendar
HOME • MANAGE SUBSCRIPTIONS • MEDIA KIT
Set-Top-Box Data: Just A Part of the Equation
by Mike Bloxham, Wednesday, February 27, 2008, 1:00 PM

SHARE

TOOLS

RELATED ARTICLES
TAGS:  TV

MOST READ

Monday's TV Board featured a rousing call to action from Tracy Scheppach of Starcom, urging all sides of the media business to do their part in making set-top box data an everyday part of the research, planning, buying and selling processes.

It's a call that most of us (myself included) would heartily endorse as the prospect of wholesale and routine access to such data continues to move closer to reality, yet still remains tantalizingly out of reach (with a few notable exceptions).

Obviously we are getting there, but as John Grono of GAP Research observed in a response to Tracy's piece, even when we have all the set-top data we could wish for, we still won't know whether or not content is being viewed (unless channels are constantly being changed or a return path is active and enabling us to log different interactions with the content) or by whom.

No set-top box is going to be staring into the home in "Truman Show" fashion, recording every second of behavior in front of and near the TV to tell us when and for how long people are out of the room, when they are using other media, talking, sleeping and so on. This is an issue we addressed at Ball State in a pilot research project called Remotely Interested and in a white paper called Engaging The Ad Supported Media.

Leaving aside the cost and privacy issues of enabling electronic surveillance through the set-top, these days you'd have to wire up the entire home to account for the multiple TV sets typically found in the home.

But the other problem with set-top data is that -- valuable as it is -- it ultimately only tells us about TV, thereby helping to perpetuate the silo-based approach to media research and measurement. Although TV remains the primary medium in terms of time spent in the average day, still the ways in which we can use the TV and the number of video-capable platforms continue to proliferate -- so even set-top data will leave questions unanswered. And we'll still have the perennial problem of trying to meld together disparate sources of data intended to serve different media, as we search for a clearer picture of media use in context.

Often it's like trying to wade neck-deep through a data swamp that keeps pulling you down with no obvious way out.

As content becomes available on more platforms and as content owners seek to monetize it accordingly as the audience delivered by each platform grows, so the need to understand the way in which each platform is interwoven within people's daily lives increases. Yes, we still want better and more accurate measures of media use by platform, but unless our understanding of how they relate to each other improves also, we will be increasingly out of step with the silo-free consumers we seek to understand and reach. After all, when was the last time you encountered a single-silo consumer in this cross-platform, multitasking world of ours?

Of course all this is easier said than done. Adventures in cross-media research are still in their relatively early days (aside from one-off, generally proprietary projects). Where initiatives are underway, they typically revolve around just a couple of media rather than a more comprehensive mix of the media available to consumers. Some rely on self-report -- which, when you start asking questions about the use of several media, become very shaky indeed (to understand just how shaky, check out the first Middletown Media Studies report, which examined the difference between phone, diary and observational findings).

Naturally, there will always be a meaningful place for research that addresses specific issues relating to the consumption of individual media, but for those of us seeking a broader and deeper understanding of total media use (and it's context), there are few options available.

This week's announcement by Nielsen and the Council for Research Excellence of the decision to fund the Video Consumer Mapping Study will result in a very significant contribution to an understanding of the consumption of video across all platforms (full disclosure -- the study is to be implemented by Ball State and Sequent Partners). But while the observational method it employs will capture video use across all platforms and locations as well as the behavioral context in which it occurs, the method is necessarily costly and is ultimately most valuable when triangulated with outputs from other research -- something that will undoubtedly be done with the study.

This suggests that data fusion will have a role to play in our continued pursuit of media enlightenment. And yet -- unlike in Europe -- fusion seems to get a mixed reception here in the U.S., so the rate at which it becomes an accepted part of the process is uncertain.

One thing is certain, however. As complex as the media ecosystem is right now, it is only going to get more complex - and at an ever-increasing pace. What looks challenging and difficult to navigate now will probably look like the land of milk and honey when we look back in ten years' time. As such, it is equally certain that no one solution is going to provide us with what we need to optimize communications efficiency. We will increasingly go digital in our measurement systems, but we will still need to understand the context of media use that data harvested from devices and meters will never capture.

As goes the complexity of media, so goes the complexity of research and measurement. And unless we truly master the latter, we'll never be able to make best use of the former. Instead we'll find ourselves ever-deeper in the data swamp - loads of information but no real way to assess reliability or extract value from it.

1 person recommends this article. 

4 comments on "Set-Top-Box Data: Just A Part of the Equation "

  1. bill harvey from next century media, inc.
    commented on: March 04, 2008 at 9:29 AM
    Mike—I whole-heartedly agree with all your points as well as Tracey’s. We are all working on important and complementary pieces of the puzzle. Set top data has been my war cry for years but now that those data are becoming available, my emphasis is on using it in an integrated platform with all other valuable data sources e.g. the digital census-level databases available for other media and especially purchase data. Set top box data without these has value in TV planning, buying, post-evaluation, optimization and (demographic if not purchaser) targeting, but there’s that particular puzzle piece that’s missing: measurement of how that TV exposure led to sales! That is TRA’s emphasis of course. The Ball State work you continue to lead continues to be very exciting and will yield insights, hypotheses and Big Ideas for cross-media synergy. So far it is still focused on eyeball counts, not sales effects, and I look forward to a future integration of ethnographic research into the TRA platform.

    Media enlightenment is not so far from reality as you indicate. TRA’s method is inherently cross-media and our customers will be running three screen reach/frequency and ROI reports soon. We’re excited to be working alongside you and Tracey in parallel paths with an eye to putting it all together in the months and years ahead.

  2. John Hane from Highcast Network
    commented on: February 28, 2008 at 10:53 AM
    Data is good, more data is better, and more data that is more accurate is better still. "Switched on and tuned to" samples allow better estimates of reality than pure guesswork, but the market necessarily must discount the value of inventory when that inventory can't be measured precisely.

    Methods allowing aggregation across platforms and (eventually) measuring the direct behavioral impact of viewing of a single campaign across multiple platforms could erase a huge portion, if not all, of the billions of dollars left on the table annually because inventory that can't be measured accurately can't be sold at full value.

    You should look at what Backchannelmedia is doing. They're getting right at the cross-platform conundrum -- not precisely in the way Mike is contemplating - but with an approach is both elegant and plausible (and, frankly, cool).

    Incidentally, I don't see 100% accuracy of measurement as the holy grail. Measurement is just a component we use to value one campaign and make the next one more efficient. We want to get more value out of the inventory. It's better to know if a set is switched on or switched off, but 100% accuracy of that measure won't tell much. Better yet to know that it's on and what channel it's tuned to; better still to know if anyone is watching, and of course we'd prefer to know who that is. But what we really want to know is the extent to which a particular impression on a particular platform (or a multi-platform campaign) directly influences behavior and attitudes (which are proxies for future behavior -- the "long tail" of advertising). There is no 100% accuracy. It's an infinitely iterative process of better measurement, better insight into what to measure, and how to apply those evolving data sets to be more effective with future inventory.

  3. Scott Turner from MRI
    commented on: February 27, 2008 at 2:16 PM
    Set-top box data has limitations, as does observational research. Sample sizes in the millions, of passively collected set tuning & remote control data, along with well researched and thought out editing rules, can provide tremendous insights into video consumption habits, not readily available anywhere else.

    Using a household sample of one, based on channels/programs viewed, a jr. level researcher would be able to ascertain rather quickly, which of my two teenage children, my wife, or myself, was likely to be viewing one of the two sets hooked up to HD-DVR boxes in my abode.

    100% accuracy, certainly not, but how much accuracy is our industry willing to fund?

  4. John Billett from Johnbillett.com
    commented on: February 27, 2008 at 1:41 PM
    Come on Mike let's get real. If someone isn't there to watch TV our messages can't influence them. So a set top box is the MINIMUM acceptable TV measurement kit. Of course it's measuring only TV and yes we all want a lot more. But please dont justify retaining a crude set switched on measure, because it doesn't measure the holy grail of advertising effectiveness. Instead take a leaf from the medics book. Science enthuses about the advances in cancer care and reduced recurrence brought about by Herceptin. and doesn't abandon it because some cancer sufferers still die!

Leave a Comment

You must be signed in to comment. Sign In

Do you have strong opinions and inside knowledge about the topic of this article -- and do you want to share your insights, observations and points of view regularly with the readers of MediaPost? To be considered as a MediaPost contributing writer, please send pertinent info about your credentials, plus several column ideas and one example of your writing on the topic, to pfine@mediapost.com. Please see our editorial guidelines here first.

MIKE BLOXHAM
  • Mike Bloxham is director of insight and research at the Center for Media Design, Ball State University. (mbloxham@bsu.edu)


AUTHORS

ARCHIVES

Recent TV Board Articles
Media Insights Q&A with Jim Spaeth   
In this interview. Sequent Partners' Jim Spaeth goes on record with how he views industry change,...
Whose EBIF Is It Anyway: The Chrysalis & The Butterfly   
From what I have been able to glean, there are two stages of EBIF deployment: the...
Media Planners Take On Challenges Of Digital TV   
Back in the day, oh, say 10 or 12 years ago, media planning was relegated to...
Media Insights Q&A With Richard Zackon    
Richard Zackon is not only an accomplished media researcher, he is also a lawyer (from his...
A Baker's Doesn't - Or, Dueling Paddles: a Canoe Paddle Report (CPR)    
In 1976, Larry Fried, my boss at full service advertising agency BBDO, offered me a promotion...
Q&A With Simon Applebaum    
Simon Applebaum is a media veteran whose work reporting television news and trends spans over 30...
Uncomfortably Numb   
Over the last six months I've been laboring over monthly bill stuffers that included a myriad...
Interactive TV Advertising: DEAD In Water! But Digital TV Is Alive & Kicking    
Interactive TV advertising is DEAD in the water! There, I said it. And while I am...
Media Insights Q&A With TiVo's Todd Juenger   
Todd Juenger, who is vice president and general manager, audience research and measurement for TiVo, is...
Closer Encounters Of A Templated Kind    
The 2002/2003 broadcast season was pivotal for my interactive television evolution. TiVo, having sworn off advertising...
>> TV Board Archives 
ABOUT MEDIAPOST • MASTHEAD • MEDIA KIT • RSS FEEDS • PRIVACY/TERMS & CONDITIONS
©2009 MediaPost Communications. All rights reserved.
1140 Broadway, 4th Floor, New York, NY 10001
tel. 212-204-2000, fax 212-204-2038, feedback@mediapost.com