Research Methodologies

June 11, 2019

How Likely Would You Be To Recommend NPS?

Longitudinal analysis of 30 data sets over seven years, revealed NPS was an inferior lead indicator of current and future market share.

How Likely Would You Be To Recommend NPS?
Ken Roberts

by Ken Roberts

0

Editor’s Note: I once heard a presenter at a conference say that “the roadside of marketing is littered with the dead bodies of market researchers who have argued against NPS.” NPS has certainly become ubiquitous in CX research. Despite the ubiquity, the regard of C-Suite executives who like NPS because it is simple and they understand it, and the injunction above, some brave researchers continue to argue against NPS. In this really interesting quantitative analysis, Roberts and Hansen argue that NPS is just not as well-connected to business outcomes as other available brand metrics. A valuable read.


Business leaders frequently seek advice on the statistical efficacy of NPS as a measure of business growth. Executives are not asking if customer-centricity is a reasonable pursuit; they are asking if the likelihood to recommend is the right, non-financial leading indicator for the organization’s prosperity.

Having conducted a longitudinal study of over 30 data sets spanning six categories, our analysis revealed that there is an expansive disconnect between setting out to improve NPS and hoping that a tangible business outcome follows suit. Astute executives should demand to see the in-market evidence of the relationship between NPS and in-market performance (e.g. sales). Executives who make such demands will only receive correlations with NPS and in-survey attitudinal questions which do not translate to in-market behavior.

We advise many global CEOs including those who led transformations in the aviation, banking, retail and supermarket industries – each of these leaders challenged NPS as ‘the one score to rule them all’.  In its place has been executive knowledge of the drivers of acquisition and churn, a focus on authentic leadership, brutal singularity, and enduring tenacity.

Just the Facts: Bringing Science to the Question of Acquisition

The Forethought Marketing Science team collated consumer market research data from 2012 to 2019, examining 30 data sets across six categories these include (aviation, banking, 401(k) retirement funds, FMCG (cereal), quick service restaurants, and supermarkets). In each instance, corresponding independent, third-party market share and/or sales data was available. What we found was striking, but not surprising.

  • NPS showed a weak relationship with current and future market share.
    The average correlation with current market share across all categories was .38.  This was even weaker where NPS was used as a lead indicator of future changes in market share, three-month lagged correlations averaged .22
  • The best indicator of in-market performance and change in market share was, by far, Brand Health. That is the weighted performance of a brand on the rational and emotional drivers of brand choice. For our clients, Brand Health is achieved by applying our Prophecy Thoughts & Feelings® methodology.   Brand Health achieved a .79 average correlation with current market share, while as a lead indicator of share changes, the average correlation was .76.

Simplicity is Not a Substitute for Science

The strong linkage between Brand Health and acquisition demonstrates that the brand performance variables that drive NPS are not the same brand performance variables that actually result in the acquisition of new customers. 

Furthermore, NPS as a dependent variable will result in identifying spurious drivers and wasting scarce resources in improving the wrong thing. Using NPS as a leading or even coincidental non-financial indicator for the organization’s relative prosperity will leave management confounded by the lack of relationship with validated market performance data.

Our Recommendations to the Executive

Our recommendations to C-suite Executives, customer experience, marketing and brand leaders are, therefore:

  • Be Smart: Ensure your organization’s key brand metric is meaningfully valid. Brand Health should be the integral performance metric in your organization’s acquisition and CeX programs. Our evidence proves it is a superior indicator of in-market performance and change in market share.  
  • Be Focused: Understand the hierarchy of drivers of Brand Health to enable the prioritization of investment into the most important factors that impact customer experience but more meaningfully, acquisition and retention.
  • Be Persistent: Measure the efforts and evaluating initiatives to improve performance on the key acquisition and retention drivers over time.

How likely would we be to recommend NPS? Certainly, Forethought is a detractor.  Instead, we are a promoter of Brand Health. Objectively, NPS has never been the one number organizations need to help them measure growth.

So, what do you think? 

We thank our colleague Paul Scutti, Forethought who provided insight and analytical expertise that greatly assisted the research.

0

customer experience

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

Comments

Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.

ARTICLES

Moving Away from a Narcissistic Market Research Model

Research Methodologies

Moving Away from a Narcissistic Market Research Model

Why are we still measuring brand loyalty? It isn’t something that naturally comes up with consumers, who rarely think about brand first, if at all. Ma...

Devora Rogers

Devora Rogers

Chief Strategy Officer at Alter Agents

The Stepping Stones of Innovation: Navigating Failure and Empathy with Carol Fitzgerald
Natalie Pusch

Natalie Pusch

Senior Content Producer at Greenbook

Sign Up for
Updates

Get content that matters, written by top insights industry experts, delivered right to your inbox.

67k+ subscribers

Weekly Newsletter

Greenbook Podcast

Webinars

Event Updates

I agree to receive emails with insights-related content from Greenbook. I understand that I can manage my email preferences or unsubscribe at any time and that Greenbook protects my privacy under the General Data Protection Regulation.*