Welcome | View My Profile | Sign Out
MediaPost Home About MediaPost Privacy/Terms Media Kit Sitemap
Publications Home News
Online Media Daily Media Daily News Marketing Daily Mobile Marketing Daily Search Marketing Daily
Daily Feed> Email Daily Feed> Video Daily Feed> Social
Online Blogs
Online Spin Email Insider Search Insider Behavioral Insider Online Publishing Insider Mobile Insider Video Insider Gaming Insider Performance Insider Metrics Insider Social Media Insider Just An Online Minute Daily Online Examiner Raw Blog
Media Blogs
Research Brief Diane Mermigas:On Media TV Watch TV Board Magazine Rack Media Creativity Notes From the Digital Frontier Digital Outsider Mad Blog Red White and Blog
Marketing Blogs
Engage:Hispanics Engage:Kids 6-11 Engage:Moms Engage:Boomers Engage:Gen Y Engage:Teens Marketing:Green Marketing:Sports
Magazines
OMMA Magazine Media Magazine
Subscribe
Feedback Loop RSS Feeds Archives Subscribe
Dec 2 Search Insider Summit (Utah) Dec 6 Email Insider Summit (Utah) Jan 11 OMMA Agency of the Year (NYC) Jan 12 MEDIA Agency of the Year (NYC) Jan 26 OMMA Social (San Francisco) Jan 27 OMMA Performance (SF) Feb 24 OMMA Metrics Measurement (NYC) Feb 25 OMMA Behavioral (NYC) Mar 15 OMMA Global (San Francisco) Apr 14 Search Insider Summit (FL) Apr 18 Email Insider Summit (FL)
Recently Concluded Events
Nov 3 OMMA Adnets (NYC) Oct 30 OMMA Video (LA) Oct 29 OMMA Mobile (LA) Oct 29 OMMA Mobile & Video (LA) Sep 23 Creative Media Awards (NYC) Sep 23 The Future Of Media (NYC) Sep 22 Online All Stars (NYC) Sep 21 OMMA Awards (NYC) Sep 21 MediaPost Live at Advertising Week All-Access (NYC) Sep 21 OMMA Global New York (NYC)
All MediaPost/OMMA Events Event Blogging Past Event Videos
Industry Events Calendar
2010 OMMA Agency of the Year 2010 MEDIA Agency of the Year
2009 Creative Media Awards 2009 OMMA Awards 2009 Digital Out-of-Home Awards 2009 Media Agency of the Year 2009 OMMA Agency of the Year
All Awards
Employment Situations Wanted Services Offered Post a Job
Briefs Reports Online
MediaPost Directories
Mobile Insiders Group
People Finder Edit My Profile View My Profile My Contacts My Calendar
HOME • MANAGE SUBSCRIPTIONS • MEDIA KIT
Is Your Market-Research Survey Really A Negative Ad Campaign?
by Max Kalehoff, Friday, February 2, 2007, 11:15 AM

SHARE

TOOLS

RELATED ARTICLES

MOST READ

Let's face it. If you respond to a survey these days, that makes you an anomaly.

Thanks to excessive commercial survey solicitations -- interceptive, disruptive, too long and delivering little in return -- consumers frequently avoid them with as much determination as they do advertising. It's a state of affairs that marketers don't like to talk about, but is a growing concern in this age of consumer empowerment and attention scarcity.

But some surveys present challenges that are potentially worse than simple reluctance among respondents to cooperate. When surveys intrude, confuse or offend, they can lead to brand erosion, and even brand backlash.

Sure, surveys have an extremely important role in market intelligence, and they'll be around forever. In fact, they're becoming ubiquitous as the Internet and low-cost management tools democratize and commoditize them. But combined with marketers' desire to measure more and more, the survey's rising status on the irritation scale means it has become a double-edged sword. Legitimate survey companies, including the brands that rely on survey data, must understand these nuances to navigate an increasingly complex environment. Etiquette now is more important than anything else.

At the Net Promoter Conference earlier this week, loyalty-measurement guru Fred Reichheld wisely underscored how surveys, when abused or improperly executed, can quickly become a negative ad campaign for a product or corporate brand. Imagine that: a direct-to-consumer campaign with not positive, but negative-sentiment GRPs! Every survey has a cost associated with it, far more than the survey itself. The total cost is tied more to the resulting impression left with the respondent. And if the potential respondent is particularly valuable, any cost can quickly turn into a major opportunity loss.

What can companies do to avoid the downside of survey campaigns and optimize the upside?

First, all marketing professionals must understand that the rules of engagement that apply to advertising and marketing campaigns also apply to survey campaigns. Commercial interaction is commercial interaction; surveys are an advertising event. That means respecting that the community and potential respondents come first. In the spirit of Reichheld, that is the key to brand advocacy.

Next, respect that people's time and attention are scarce. Presuming a respondent cooperates, don't ask too many questions, and make sure you ask all the right questions! The auto industry is among the biggest violators here (and would benefit by reading Reichheld's book, The Ultimate Question).

Then companies must be open to any feedback, especially with surveys among existing customers. It is amazing how often mega-brands today conduct customer surveys about product and service experience, but fail to arm their data-collection professionals with guidance or a method to accept open-ended feedback. This often happens when a passionate respondent feels questions don't accurately reflect the experience.

For example, a survey division of a big telecommunications company I did business with hung up on me recently when I insisted that the "how satisfied are you" multiple-choice question failed to reflect the issue, and therefore missed an opportunity to correct the real problem I had! If feedback among loyal customers is a gift, this company not only threw a major opportunity out the window, but tarnished its brand in the process. This survey was worse than a negative ad campaign, and the experience is not uncommon! The paradox is that formal survey feedback mechanisms often underscore just how closed companies are to feedback.

Similarly, surveys must show empathy. If the social-media realm has validated anything, it's that respondents have an emotional need to express and self-validate their beliefs. Surveys, in the eyes of respondents, should be more about listening versus soliciting answers.

Brands can avoid survey backlash by avoiding intrusive, unacceptable recruitment techniques. I'm amazed at how many unsolicited requests from random survey companies make it through my spam filter each day. These unwelcome solicitations usually come from fly-by-night survey and panel companies, but they're being financially supported by someone -- and if not by brands, I don't know by whom! And these spammers are often the same guys engaging in popup advertising (surprisingly, even today, in 2007). If you're a brand, it's a wise idea to disassociate from these sorts of outfits, the same way you'd avoid ethically questionable marketing agencies.

Finally, surveys must also provide more meaningful value in return. Recruitment incentives are important, but I'm talking about follow-up. If people dedicate and invest valuable time providing actionable intelligence, surveyors should feel obligated to follow through and share how respondent participation resulted in insights and action. The more valuable the respondent, the more important this is. This is what will entice respondents to participate in the future.

Now here's a survey: What's your opinion on the surveys you encounter in everyday life?

1 person recommends this article. 

8 comments on "Is Your Market-Research Survey Really A Negative Ad Campaign?"

  1. Max Kalehoff from Nielsen BuzzMetrics
    commented on: February 04, 2007 at 10:13 PM
    Larry, You make some good points. On the subject of Reichheld, I have the utmost respect for him. But I have many questions about the prompted nature of the Net Promoter method -- in other words, it's contingent upon a survey. I'd like to see where unprompted data sources interact -- for example, public-message board data.

  2. Larry Freed from ForeSee Results
    commented on: February 04, 2007 at 6:03 PM
    Interesting post. You are dead on, that surveys must respect peoples time. In addition, the results must provide value and actionable results. The fascination with 1 or 2 question surveys is misguided. For example, Reichheld's Net Promoter concept has such a high margin of error, that you need to literally ask every customer those questions to get any kind of reliability. Now that is an intrusion. If I can get better accuracy, reliability and actionability by asking 1% of my audience that is far more effective. If your results have no accuracy, you are wasting your time and your customers time.

    You also made an interesting statement about the "how satisfied are you" question you encountered. Interestingly, Reichheld's biggest case study in his book is Enterprise Rental Car. Did you know that they ask a satisfaction question, not a recommendation question? Makes you wonder about some of Reichheld's claims.

    -Larry Freed www.FREEDyourmind.com www.ForeSeeResults.com

  3. Miguel Oliveira from Encore Inc.
    commented on: February 02, 2007 at 2:36 PM
    sounds all very good, but is little to not actionable input. Some best-practice examples would help

  4. Justin Abbott from Blogads.com
    commented on: February 02, 2007 at 1:14 PM
    Max - You are spot on with this. I've been dealing with a number of survey requests over the past several weeks. Most of the companies want popup surveys, for when the reader leaves the blog to surf on over to another one.

    Seems like they're self selecting for idiots -- the people who don't have popup blocking software already installed or don't click to close the popup right away, cursing under their breath.

    I'd like to see more quick-n-easy surveys built into ads themselves. Just one or two questions after the ad has run; "would you recommend us" seems to be the most valuable question you can ask about your business, but of course, over time you could build up a significant amount of data -- all without ruining the user experience.

  5. Nick Britsky from Scripps Networks
    commented on: February 02, 2007 at 1:10 PM
    Is is just me or are online surveys getting longer? We use DL on our site and when I try to take our survyes and they are longer than about 5 questions, I bail. What do "normal" consumers do with long surveys?

  6. Joshua Chasin from Warp Speed Marketing, Inc.
    commented on: February 02, 2007 at 12:51 PM
    As a long time market research and media resrearch professional, I take about 5 surveys a week (not tough to do if you register in the online panels; Greenfield, Harris, NFO etc.) I cannot urge strongly enough that all users and practitioners of survey research should endeavor to take surveys; the respondent experience is eye-opening. I am amazed at how often I am asked questions that are either un-answerable, or for which the answers I give are utterly meaningless.

    By way of illustration, I like to ask fellow researchers, "Can you tell me the definition of 'somewhat unlikely'?" If you are "somewhat unlikely," aren't you also "somewhat likely?" Maybe even more likely than unlikely? When I pose this question to researchers, the response I get is an explanation of Likert scales. Which is all well and good, except that a scale would have end points derfined and numerical values in between. Questions with response choices, where one choice is "somewhat unlikely," are not esxperienced by respondents as scales; they are experiecned as they are presented-- multiple choice questions.

    In addition to the grave problems associated with declining response, I think a major skeleton in the closet of much market research is the tacit assumption that, if the researcher asks a question, the respondent is therefore capable of meaningfully answering it.

  7. Greg Timpany from Wilkin Guge Marketing
    commented on: February 02, 2007 at 12:14 PM
    As a research director for an integrated marketing agency I am feeling the pain. Surveys are part of the lifeblood of marketing intelligence or should that be intelligent marketing. With that said, as research professionals we need to up our collective consciousness and bring a higher level of integrity to the field.

    As for the surveys I encounter. I never turn one down. For as soon as I do my next project is destined to flop.

    Greg Timpany Wilkin Guge Marketing Claremont, CA

  8. Dean Collins from Cognation
    commented on: February 02, 2007 at 12:04 PM
    Hi Max, Best survey I've ever seen asked by one of our clients (I work for http://www.TractionPlatform.com) was a 1 question multiple choice with a box for comments if you chose to submit more info.

    That and they gave away a piece of content in this meaningful two way transaction.

    Thats what real surveys are about, not to provide ppt graph data for your monday morning snooze fest.

    Cheers, Dean

Leave a Comment

You must be signed in to comment. Sign In

Do you have strong opinions and inside knowledge about the topic of this article -- and do you want to share your insights, observations and points of view regularly with the readers of MediaPost? To be considered as a MediaPost contributing writer, please send pertinent info about your credentials, plus several column ideas and one example of your writing on the topic, to pfine@mediapost.com. Please see our editorial guidelines here first.

MAX KALEHOFF
  • Max Kalehoff is vice president of marketing for Clickable, a search-marketing solution for small and mid-size businesses. He also writes AttentionMax.com


AUTHORS

ARCHIVES

Recent Online Spin Articles
The Loss Of Apprenticeships Is A Tragedy    
I had breakfast earlier this week with Bug Labs CEO Peter Semmelhack, a friend who is...
Time To Eliminate Vacation Policies?   
There was quite a stir a few months ago when an internal presentation about how Netflix...
A Simple Prediction For 2010    
I've decided that making predictions in a climate which is so tenuous and conservative could be...
Understanding Social Media 2.0: The Widget Is Dead    
The Internet was around for many years before it got its "2.0" designation. Social media has...
How News Spreads Today: The Media-tization Of The Big Black Phone    
When I was a kid, a phone ringing in the middle of the night meant only...
Caskets? Great Deals At Costco   
'm not easy to market to. I'm loyal to few brands. I shun most advertising. I'm...
End The Debate: Go Ahead, Charge For Your Online Content    
"Web communism" and "ubiquity is the new exclusivity" were among the lines being traded in a...
Coupon Clippers Proven To Drive Incremental Sales   
Digital couponing has risen dramatically in the last 12 months because consumers are more concerned with...
The Secret Race For Permission: Facebook Vs. Google Vs. MySpace   
There is a race going on that a lot of people don't fully understand -- but...
Brand Velocity And Your Business Model   
We often affirm the necessity of thoughtful consumer brand marketing that conveys and sustains the brand....
>> Online Spin Archives 
ABOUT MEDIAPOST • MASTHEAD • MEDIA KIT • RSS FEEDS • PRIVACY/TERMS & CONDITIONS
©2009 MediaPost Communications. All rights reserved.
1140 Broadway, 4th Floor, New York, NY 10001
tel. 212-204-2000, fax 212-204-2038, feedback@mediapost.com