Welcome | View My Profile | Sign Out
MediaPost Home About MediaPost Privacy/Terms Media Kit Sitemap
Publications Home News
Online Media Daily Media Daily News Marketing Daily Mobile Marketing Daily Search Marketing Daily
Daily Feed> Email Daily Feed> Video Daily Feed> Social
Online Blogs
Online Spin Email Insider Search Insider Behavioral Insider Online Publishing Insider Mobile Insider Video Insider Gaming Insider Performance Insider Metrics Insider Social Media Insider Just An Online Minute Daily Online Examiner Raw Blog
Media Blogs
Research Brief Diane Mermigas:On Media TV Watch TV Board Magazine Rack Media Creativity Notes From the Digital Frontier Digital Outsider Mad Blog Red White and Blog
Marketing Blogs
Engage:Hispanics Engage:Kids 6-11 Engage:Moms Engage:Boomers Engage:Gen Y Engage:Teens Marketing:Green Marketing:Sports
Magazines
OMMA Magazine Media Magazine
Subscribe
Feedback Loop RSS Feeds Archives Subscribe
Dec 2 Search Insider Summit (Utah) Dec 6 Email Insider Summit (Utah) Jan 11 OMMA Agency of the Year (NYC) Jan 12 MEDIA Agency of the Year (NYC) Jan 26 OMMA Social (San Francisco) Jan 27 OMMA Performance (SF) Feb 24 OMMA Metrics Measurement (NYC) Feb 25 OMMA Behavioral (NYC) Mar 15 OMMA Global (San Francisco) Apr 14 Search Insider Summit (FL) Apr 18 Email Insider Summit (FL)
Recently Concluded Events
Nov 3 OMMA Adnets (NYC) Oct 30 OMMA Video (LA) Oct 29 OMMA Mobile (LA) Oct 29 OMMA Mobile & Video (LA) Sep 23 Creative Media Awards (NYC) Sep 23 The Future Of Media (NYC) Sep 22 Online All Stars (NYC) Sep 21 OMMA Awards (NYC) Sep 21 MediaPost Live at Advertising Week All-Access (NYC) Sep 21 OMMA Global New York (NYC)
All MediaPost/OMMA Events Event Blogging Past Event Videos
Industry Events Calendar
2010 OMMA Agency of the Year 2010 MEDIA Agency of the Year
2009 Creative Media Awards 2009 OMMA Awards 2009 Digital Out-of-Home Awards 2009 Media Agency of the Year 2009 OMMA Agency of the Year
All Awards
Employment Situations Wanted Services Offered Post a Job
Briefs Reports Online
MediaPost Directories
Mobile Insiders Group
People Finder Edit My Profile View My Profile My Contacts My Calendar
HOME • MANAGE SUBSCRIPTIONS • MEDIA KIT
The 'Balanced Scorecard': Measuring The Entire Email Picture
by Loren McDonald, Thursday, November 8, 2007, 2:01 AM

SHARE

TOOLS

RELATED ARTICLES
TAGS:  Email

MOST READ

An effective email marketing program isn't just a big single-cell creature. It's an interconnected ecosystem, with many factors that affect its vitality. Using a limited set of metrics to measure performance can mislead you into thinking you're succeeding wildly or failing miserably.

Instead, use a "balanced scorecard" approach to get readings from all around the ecosystem and help you understand more clearly exactly how well you're really doing.

This concept, used often by companies to assess corporate performance beyond just financial measures (e.g., customer and employee satisfaction, innovation, brand strength, etc.), can help you grasp the bigger and more complicated picture.

Applied to email, this forces you to move beyond simple metrics such as revenue per campaign or opens and clicks. Both sets of statistics will give you only part of the picture, no matter how accurate they might be.

This concept goes along with my previous EmailInsider column in which I urged you to begin assessing the strength or weakness of your email program in terms of business goals, not just email-oriented metrics.

These seven factors are one example of what might make up the balanced scorecard for your email program:

1. List growth and health

2. Deliverability

3. Message level

4. Campaign performance over time

Meet Loren McDonald at Email Insider Summit Utah!
Loren McDonald will be there speaking during "Looking Past Email Measurement" on December 09 at 9:45 AM. Top executives will be there. Will you?
Register today and save.

5. Conversion activity

6. Subscriber/customer engagement and relationship

7. Financial performance and ROI

Using the balanced scorecard can help you assess whether changes in your email program are ultimately helping or hurting it. One classic example is in deciding to increase message frequency in order to bring in more revenue -- a timely example as we head into the holiday shopping season.

If you rely only on bottom-line performance, you might think you've succeeded if you see an increase in number of orders, order size or total campaign revenue. This is actually what happened with one client that increased mailings from five a month to 12.

However, that increased frequency had a severe cost. Once we looked at process metrics, such as delivery rate, opens, unsubscribes and spam complaints, we uncovered a whole lot of subscriber unhappiness. Spam complaints and unsubscribes went through the roof, outpacing the revenue increase.

The total cost of boosting frequency -- reacquiring the subscribers who left, acquiring new ones, sending more campaigns, potential lost revenue -- would have actually cost the company money over the longer term and immediately harmed the client's sender reputation.

The balanced scorecard approach will help you spot problems in other areas so that you don't find yourself, six months down the road, wondering why you aren't making money anymore and why your email messages get blocked at every major ISP. And, it doesn't just help you avoid failing. It can also show you where you are succeeding when you want to measure things other than financial performance, such as customer engagement, list health, etc.

Yes, using a balanced scorecard will take more time and effort, but your reward is a more accurate picture of your email program's vitality and contribution to your corporate goals. That can help you justify your requests for a bigger share of the marketing-budget pie and for email's place as a strong channel in a multichannel marketing program.

5 comments on "The 'Balanced Scorecard': Measuring The Entire Email Picture"

  1. Peter Simmons from UnsubCentral
    commented on: November 14, 2007 at 12:28 PM
    Yanni has an excellent point - an overlooked source of information to target your email efforts are unsubscribes

    It tells you what your people don't want - which gives you information on what they do want

    Preference center behavorial information helps you give consumers on your email list content they want and value

    Peter Simmons - Director of Sales - UnsubCentral

  2. Naeem Kayani from Global Wide Media
    commented on: November 08, 2007 at 3:25 PM
    Jen,

    Each email program is different so I would recommend studying your opt-outs to make such decisions. The common reason users unsubscribe & complain is when their perception of what they are opting in varies from what they actually receive. Using a Score Card such as outlined by Loren, some programs can try creating a life cycle and add a dollar value to a new registration. As you make changes to your program, you can study the cause and effect so you can better understand the factors influencing your email program and its affects on the life cycle. This way, if you increase the frequency you can study if there is an increase in the number of complaints, unsubscribe and delivery challenges. You can also study your Opt-outs by adding an option on your Opt-out page that lists the most common reason for Opting out including frequency, and ask users to provide feedback so you can learn why users don’t want to be on your list.

    We also need to understand that increase in the registrations (signups) does not necessarily mean more revenue. Even the common perception that by growing your email list will get your message in front of a larger audience, in many cases, is not true either. The delivery challenges for the list that is collected as a result of a poor signup process effects the Reputation of the sender and results in getting its messages blocked or directed to the bulk folder by the ISP. If the signup process is clear and conspicuous then the growth of the list may drop but the value of the list will increase.

    Let’s take a scenario where a sender already has a process similar to the one outline above. Now if the signup process is improved, then the sender can start tracking the new registrations separately, and can compare the dollar value of the user collected before and after the changes to understand if the changes are favorable to the business. Of course, all other factors need to be the same between the segments to run such tests and I always recommend running multiple tests to validate results when you are going to draw important decisions from it. On the other hand, if you don’t have a similar process in place then it becomes difficult to understand the cause and effect. However, if you don’t have enough resources to monitor your program so closely then you should continue to follow industry best practices.

    I hope it helps! - Yanni

  3. Jennifer Agustin from Offermatica
    commented on: November 08, 2007 at 1:49 PM
    What are some best practices for measuring the value of an unsubscribe? Would you just take the average cost of acquiring a new lead? Any advice would be appreciated.

    - Jen

  4. Chad White from Email Experience Council
    commented on: November 08, 2007 at 11:57 AM
    Tom, what Loren is saying is that a balanced scorecard can reveal how short-term gains in ROI can potentially be at the great expense of future returns. You're right that the only important measurement is ROI. But the question that the balance scorecard helps address is: Are your current practices trading $10 in sales in the future for $5 in sale now? A wise marketer would focus on lifetime value and take the $10.

  5. Tom Griffin from eProspector
    commented on: November 08, 2007 at 10:52 AM
    Good practice. However, for most small businesses with limited marketing resources, the only important measurement is ROI.

    Griff http://eprospector.typepad.com/small_business_sales_and_/

Leave a Comment

You must be signed in to comment. Sign In

Do you have strong opinions and inside knowledge about the topic of this article -- and do you want to share your insights, observations and points of view regularly with the readers of MediaPost? To be considered as a MediaPost contributing writer, please send pertinent info about your credentials, plus several column ideas and one example of your writing on the topic, to pfine@mediapost.com. Please see our editorial guidelines here first.

LOREN MCDONALD
  • Loren McDonald is vice president of industry relations for Silverpop, a leading provider of engagement marketing solutions for both BtoC and BtoB marketers.


AUTHORS

ARCHIVES

RECENT VIDEOS
Recent Email Insider Articles
Five Lessons Email Marketers Can Learn From @Sh*tMyDadSays   
If you track the Twitterverse, you've probably read about Justin Halpern, who converted his father's crusty,...
It's Holiday Season. What If Your Emails Don't Care?    
If you thought inboxes were already cluttered, just wait until this year's holiday season ramps up...
Button Up Your Email   
Have you ever found yourself standing in front of an automatic towel dispenser, waving your hands...
Customer Segmentation   
This is a subject we often talk about in apologetic terms when it comes to email...
I'm Calling Your BS   
As the year winds down, marketers seem to be doing two things: planning for next year's...
   
Email's Antisocial Sin   
In all the talk of social media and its influence on email marketing, it occurred to...
How To Avoid 'Back Alley Syndrome'   
Imagine you're walking through a store and see signs for a demonstration of a product you're...
Ways To Increase Conversions From Seniors   
A study by Focalyst shows that seniors (62+) using the Internet today have higher purchase intents...
Your No. 1 Upgrade For 2010: Lifecycle Marketing    
If you're already thinking about how to take your email-marketing program to the next level in...
>> Email Insider Archives 
ABOUT MEDIAPOST • MASTHEAD • MEDIA KIT • RSS FEEDS • PRIVACY/TERMS & CONDITIONS
©2009 MediaPost Communications. All rights reserved.
1140 Broadway, 4th Floor, New York, NY 10001
tel. 212-204-2000, fax 212-204-2038, feedback@mediapost.com