Welcome | View My Profile | Sign Out
MediaPost Home About MediaPost Privacy/Terms Media Kit Sitemap
Publications Home News
Online Media Daily Media Daily News Marketing Daily Mobile Marketing Daily Search Marketing Daily
Daily Feed> Email Daily Feed> Video Daily Feed> Social
Online Blogs
Online Spin Email Insider Search Insider Behavioral Insider Online Publishing Insider Mobile Insider Video Insider Gaming Insider Performance Insider Metrics Insider Social Media Insider Just An Online Minute Daily Online Examiner Raw Blog
Media Blogs
Research Brief Diane Mermigas:On Media TV Watch TV Board Magazine Rack Media Creativity Notes From the Digital Frontier Digital Outsider Mad Blog Red White and Blog
Marketing Blogs
Engage:Hispanics Engage:Kids 6-11 Engage:Moms Engage:Boomers Engage:Gen Y Engage:Teens Marketing:Green Marketing:Sports
Magazines
OMMA Magazine Media Magazine
Subscribe
Feedback Loop RSS Feeds Archives Subscribe
Dec 2 Search Insider Summit (Utah) Dec 6 Email Insider Summit (Utah) Jan 11 OMMA Agency of the Year (NYC) Jan 12 MEDIA Agency of the Year (NYC) Jan 26 OMMA Social (San Francisco) Jan 27 OMMA Performance (SF) Feb 24 OMMA Metrics Measurement (NYC) Feb 25 OMMA Behavioral (NYC) Mar 15 OMMA Global (San Francisco) Apr 14 Search Insider Summit (FL) Apr 18 Email Insider Summit (FL)
Recently Concluded Events
Nov 3 OMMA Adnets (NYC) Oct 30 OMMA Video (LA) Oct 29 OMMA Mobile (LA) Oct 29 OMMA Mobile & Video (LA) Sep 23 Creative Media Awards (NYC) Sep 23 The Future Of Media (NYC) Sep 22 Online All Stars (NYC) Sep 21 OMMA Awards (NYC) Sep 21 MediaPost Live at Advertising Week All-Access (NYC) Sep 21 OMMA Global New York (NYC)
All MediaPost/OMMA Events Event Blogging Past Event Videos
Industry Events Calendar
2010 OMMA Agency of the Year 2010 MEDIA Agency of the Year
2009 Creative Media Awards 2009 OMMA Awards 2009 Digital Out-of-Home Awards 2009 Media Agency of the Year 2009 OMMA Agency of the Year
All Awards
Employment Situations Wanted Services Offered Post a Job
Briefs Reports Online
MediaPost Directories
Mobile Insiders Group
People Finder Edit My Profile View My Profile My Contacts My Calendar
HOME • MANAGE SUBSCRIPTIONS • MEDIA KIT
The Most Measurable Medium Needs An XML Standard
by Judah Phillips, Friday, September 21, 2007, 12:30 PM

SHARE

TOOLS

RELATED ARTICLES

MOST READ

Over the last two weeks, my fellow Metrics Insider columnists have correctly pointed out that online metrics are neither standardized nor easily integrated across systems. Vocabulary is muddled. Numbers do not match. Data exists in silos and is isolated from related data. Systems do not adequately or easily talk to each other. Research services, ad servers, and Web analytics tools report similarly named, overlapping and often conflicting metrics. Unfortunately, these problems will not disappear anytime soon, even with emerging "standards" and continued attention paid by the industry to these important issues.

Current industry standards for Web metrics are limited, basic, and come from independent entities. Most recently, the Web Analytics Association released a set of "standards." The WAA's standards are elementary definitions of concepts from various periods of Internet measurement. Web 2.0 concepts like "events" are mingled with dated measurements like "hits." Regardless, these definitions provide a very useful starting point for framing a discussion about metrics. Recently, I've learned that the IAB and MRC are developing a set of IAB Reach Measurement Guidelines. Let's hope the IAB and WAA align their work efforts.

The IAB and MRC are also currently auditing "audience measurement" firms, like Comscore and Nielsen. It's rather unclear to practitioners what standards the IAB/MRC are applying to the audit. But the hope is that auditing will expose issues of coverage error and selection bias in the black box methodologies used to create the panels and generate the audience measurement data.

It is important to note that the IAB's audit has two parts. The first is certification, which indicates the company being audited is applying the "standards," and the second is accreditation, which demonstrates adherence to the IAB standards.

Only time will tell if companies like Hitwise, Compete, and Quantcast will be asked to submit to auditing. It's worth mentioning that legacy metrics "standards" (and audits) from historic organizations like ABCe still occur and carry weight with publishers and advertisers (especially outside of the United States). It's entirely possible that newly formed organizations, like the Association for Downloadable Media will offer their perspective on "standards" for online metrics.

The idea of "standards for the standards"--however absurd it sounds on the surface -- starts to seem like a good idea when considering that all these parallel efforts aren't intersecting. Honestly though, I question whether "standards" that are purely "definitional," even if agreed upon, will solve many of the measurement challenges companies have when trying to understand Web data and take action from it.

Standard definitions are helpful for promoting understanding and creating a controlled vocabulary for discussing online metrics, but they don't help with what I see as a huge challenge in today 's metrics technologies. The problem is this: currently available online metrics systems do not adequately separate data from presentation . That's a huge limitation preventing Web data from being easily integrated with other systems.

Detailed-level Web data (the raw data) is often costly to extract, if available at all. It is nearly impossible to deliver detailed data in real time from Web analytics, ad serving, and research-based technologies in order to feed other systems. The majority of hosted (ASP) metrics systems are closed and do not allow access to key interfaces using open software standards. For the most part, today's metrics technologies are black boxes where data goes in, but can only be extracted in various file formats after creating a report. Common export formats include csv, pdf, and doc. While XML exports are often available from many vendors, there is no standard XML schema for describing the same type of Web data across different sources!

The industry must begin collaborating and creating a standard XML schema for describing Web data. Creating a widely used, consensus-based, published, and maintained XML standard for online metrics would make it possible to more easily share, transform, and use Web data in other systems.

I firmly believe that current metrics standards must go beyond simple definitions and tackle issues pertaining to data portability and system interoperability. Then we'll all be in a better position to reuse Web data across the enterprise value chain. Once we all agree on "standard" definitions, I encourage us to start working together to develop a standard Online Metrics Markup Language.

**************


Insiders Wanted

Are you an Insider? Do you have inside knowledge about metrics -- and do you want to share your insights, observations and points of view with the readers of MediaPost? To be considered for the Insider team of online media influencers,please send pertinent info about your credentials, plus one column idea, to Insider@mediapost.com.

One comment on "The Most Measurable Medium Needs An XML Standard "

  1. Joshua Chasin from comScore
    commented on: September 22, 2007 at 9:36 AM
    Hey Judah. Welcome to the Insider!

    A couple of things. First, for the record I want to point out that it is the MRC that is auditing comScore and NetRatings; the IAB has nothing to do with the process (their continued press releases on the topic notwithstanding.)

    Second, with respect to companies like Hitwise, Compete and Quantcast submitting to an MRC audit, they are certainly welcome and eligible to do so at any time. A service isn't invited to apply for MRC accreditation; the service opts to, generally based on a belief that the process is demanded by the research company's clients. I can tell you, having run point on the process for comScore, that it is expensive and rigorous. My belief with respect to MRC accreditation has long been that it is best to wait until the measurement service reaches a certain level of marketplace maturity; both because it is wise to do as much testing and vetting as possible before beginning, and because it is prudent to wait until revenues justify the cost.

    Finally, with respect to what standards the MRC will apply, the standards are published at their website; you can grab the pdf here:

    http://www.mediaratingcouncil.org/MRC%20Standards.htm

    These standards are clearly written with an analog media measurement service in mind, but MRC has been aggressive about considering ways that they may be correctly applied today.

    Cheers,

    --josh--

Leave a Comment

You must be signed in to comment. Sign In

Do you have strong opinions and inside knowledge about the topic of this article -- and do you want to share your insights, observations and points of view regularly with the readers of MediaPost? To be considered as a MediaPost contributing writer, please send pertinent info about your credentials, plus several column ideas and one example of your writing on the topic, to pfine@mediapost.com. Please see our editorial guidelines here first.

JUDAH PHILLIPS


AUTHORS

ARCHIVES

Recent Metrics Insider Articles
What Do You Need In A Web Analytics Tool?   
I've often said that not all Web analytics tools were created equally. Each tool has various...
The 'Big Challenge' According To Eric Schmidt -- And Other Predictions   
I had a chance to talk briefly with Eric Schmidt, CEO of Google, at last week's...
Get Your Search House In Order For The Holidays    
The numbers are in. The National Retail Federation (NRF) is, not surprisingly, predicting another dip in...
The Click Is Wagging the Dog   
According to the most recent Interactive Advertising Bureau Internet Advertising Revenues Report, Internet advertising for the...
How Do You Value Your Performance Metrics?   
Return on investment of social media campaigns was a big topic a few weeks ago at...
The Five Questions That Kill Marketing Careers    
As the planning cycle renews itself, you should be aware of five key questions that have...
It takes A Village Or A City And More...   
Companies are more dependent on solid Web analytical data to drive increased revenue and improved efficiency...
The Lighter Side Of Metrics Today   
In the pressure of the current business environment, humor isn't lost. Here are a few ideas...
The Evolution Will Be Tweeted   
I believe that social networking is an evolution, not a revolution. In fact, I was originally...
The Numbers Just Don't Add Up    
A funny thing happened on the way to the CMO's office. Between the realization of an...
>> Metrics Insider Archives 
ABOUT MEDIAPOST • MASTHEAD • MEDIA KIT • RSS FEEDS • PRIVACY/TERMS & CONDITIONS
©2009 MediaPost Communications. All rights reserved.
1140 Broadway, 4th Floor, New York, NY 10001
tel. 212-204-2000, fax 212-204-2038, feedback@mediapost.com