January 2, 2018

GRIT Sneak Peek: Adoption of Top 20 Emerging Research Methods

[GRIT Report] Ray Poynter & Elissa Moses review the adoption of emerging methods.

GRIT Sneak Peek: Adoption of Top 20 Emerging Research Methods
Ray Poynter

by Ray Poynter

Managing Director at The Future Place

0

Editor’s Note: The new GRIT Report for Q3-Q4 2017 will be released in the next two weeks, but to start the New Year out right we wanted to give readers a sneak peek of one of the most popular sections we cover: the adoption of emerging methods in the industry. Ray Poynter always leads the charge on this analysis, and this year Elissa Moses of Ipsos Neuro and Behavior Science contributed a deeper dive into analysis of nonconscious techniques. As you plan for the year ahead, this list should be a guide on what to experiment with or invest in.

In addition to the emerging methods section, in the forthcoming report we explore a variety of topics, some new and some that our readers have already come to depend on GRIT to cover. These include: the use of traditional methods, satisfaction levels with suppliers, the perception of challenges & opportunities (and what to do about them), financial outlook and projected spending, how research professionals use their time and what tools they use most to do their jobs, buzz topics such as automation or AI, and the next iteration of our industry benchmark. Look for new info soon on the publication date soon!

In looking at what research approaches/methods are in use or under consideration it is important to remember that the GRIT sample is not a representative sample of the market research population. The GRIT sample tends to be drawn from those more engaged with the future of research, so the ‘in use’ figures will tend to be higher than for the wider MR population. The GRIT report’s key usefulness lies in the relativities between the approaches, the trends over time, and the differences between key groups (such as the buyers and sellers of research and insight).

One important note in the 2017 figures is that there have been several minor questionnaire changes (slight improvements to wording), but one major change. Before 2017 the term Mobile Surveys was used, and this had reached the point where 75% of participants said they were using Mobile Surveys. So, from 2017 we are using the term ‘Mobile First Surveys’ and this has, not surprisingly, reduced the ‘In Use’ figure, to 50% for the Total sample in 2017.

The Overall Picture

Table 1 shows the 21 approaches included in the GRIT study ranked in terms of how many people said they were already using these techniques. Remember, ‘using a technique’ does not necessarily means using it heavily, it may mean it is sometimes used, and sometimes not.  We are combing “In Use” and “Under Consideration” for a cumulate “Interest” metric.

Rank Labels In use Under Consideration Interest
1 Online Communities 60% 22% 82%
2 Text Analytics 46% 30% 76%
3 Mobile First Surveys 50% 24% 74%
4 Social Media Analytics 43% 28% 72%
5 Big Data Analytics 38% 32% 70%
6 Mobile Qualitative 44% 25% 69%
7 Webcam-Based Interviews 47% 22% 69%
8 Mobile Ethnography 35% 26% 61%
9 Micro-surveys 34% 25% 58%
10 Behavioral Economics Models 29% 29% 58%
11 Eye Tracking 34% 21% 55%
12 Research Gamification 25% 28% 53%
13 Facial analysis 20% 25% 45%
14 Applied Neuroscience 21% 22% 44%
15 Prediction Markets 19% 24% 43%
16 Internet of Things 12% 27% 40%
17 Virtual Environments/Virtual Reality 11% 27% 38%
18 Crowdsourcing 15% 22% 38%
19 Wearables Based Research 9% 27% 36%
20 Biometric Response 12% 20% 33%
21 Sensor/Usage/Telemetry Data 11% 19% 30%
Base 1533

 

 

Online communities are the only mainstream item amongst those examined, with 60% saying they are ‘In Use’ and 82% saying in use or under consideration. Note, the reason that the term Mobile Surveys was retired was that it was almost ubiquitous. In future editions of GRIT is is likely that Communities will also be removed from “Emerging Methods” now that it is mainstream.

Below online communities there are four items with large numbers of participants saying they are in use or under consideration, creating high ‘Interest’ scores: Text Analytics (76%), Mobile First Surveys (74%), Social Media Analytics (72%), and Big Data Analytics (70%). Three of these four are analytics and highlight the shift away from asking questions.

The next group comprises three qualitative options, that have interest scores in the range 61% to 69%, namely Mobile Qualitative, Webcam-based Interviews, and Mobile Ethnography. These three highlight the continued strength of qual in a data-centric world.

The remainder of the table can be divided into strong niches and small niches. The strong niches group runs form Applied Neuroscience, with 21% of participants saying they were already using it, up to Micro-surveys with 34% saying they are already using it and 56% showing interest. The bottom six, the smaller niches, all have fewer than 20% saying they use them, and fewer than 50% showing interest.

Stability More than Change

Table 2 shows the ‘In Use’ data for the dating back to August 2014, a period of three years. The data shows that there are changes, but few of them are large. Given the nature of the data, sampling variation etc, I would tend to ignore anything smaller than plus or minus 5%.

 

Table 2 2014 Aug 2015 Oct 2016 Nov 2017 Oct 12 month Change
Online Communities 56% 50% 59% 60% 1%
Mobile First Surveys 50% NA
Webcam-Based Interviews 34% 33% 43% 47% 4%
Text Analytics 40% 38% 46% 46% 0%
Mobile Qualitative 37% 34% 42% 44% 2%
Social Media Analytics 46% 43% 52% 43% -9%
Big Data Analytics 32% 34% 38% 38% 0%
Mobile Ethnography 30% 31% 33% 35% 2%
Micro-surveys 25% 25% 35% 34% -1%
Eye Tracking 34% 28% 35% 34% -1%
Behavioral Economics Models 25% 21% 29% 29% 0%
Research Gamification 23% 20% 25% 25% 0%
Applied Neuroscience 13% 15% 16% 21% 5%
Facial analysis 18% 18% 24% 20% -4%
Prediction Markets 19% 17% 24% 19% -5%
Crowdsourcing 17% 12% 16% 15% -1%
Internet of Things 12% 9% 14% 12% -2%
Biometric Response 13% 10% 12% 12% 0%
Virtual Environments/VR 17% 10% 14% 11% -3%
Sensor/Usage/Telemetry Data 7% 11% 11% 0%
Wearables Based Research 7% 8% 10% 9% -1%
Mobile Surveys 64% 68% 75%

 

The main decline has been for Social Media Analytics, which is looking like a correction, since the 2017 figure is similar to the 2015 and 2014 figures. But, we will see something more interesting with this methodology when we look at the balance between research buyers and providers.

Most of the approaches that are in the group we described as the small niches do not appear to be showing any sign of expanding beyond their small group of users.

Buyers and Suppliers

There are a couple of good reasons why Suppliers might say they are using more research techniques than research Buyers/Users:

  1. Suppliers typically work with many companies, and may use a different range of techniques with different clients. Of course, it is also true that large clients use many researcher suppliers.
  2. Suppliers need to know all of the details of the research they are providing, such as whether Research Gamification is used in the design and what proportion of the surveys are completed via mobile device. A research buyer may want to know this too, but in many cases the buyer of the research is less involved in these details.

Table 3 shows the ‘In Use’ data for Buyers and Suppliers of market research, and the right-hand column contrasts the results.

 

Table 3 Buyer Supplier Supplier – Buyer Total
Online Communities 59% 60% 1% 60%
Mobile First Surveys 43% 52% 10% 50%
Webcam-Based Interviews 45% 48% 3% 47%
Text Analytics 50% 45% -5% 46%
Mobile Qualitative 34% 46% 13% 44%
Social Media Analytics 60% 38% -22% 43%
Big Data Analytics 50% 35% -14% 38%
Mobile Ethnography 31% 36% 6% 35%
Eye Tracking 34% 34% 0% 34%
Micro-surveys 35% 33% -2% 34%
Behavioral Economics Models 25% 30% 5% 29%
Research Gamification 15% 28% 12% 25%
Applied Neuroscience 22% 21% -1% 21%
Facial analysis 17% 21% 3% 20%
Prediction Markets 18% 19% 0% 19%
Crowdsourcing 16% 15% -1% 15%
Internet of Things 12% 13% 1% 12%
Biometric Response 11% 13% 1% 12%
Virtual Environments/Virtual Reality 8% 12% 3% 11%
Sensor/Usage/Telemetry Data 12% 11% -1% 11%
Wearables Based Research 6% 10% 4% 9%

 

The pattern of techniques and approaches in use is similar between Buyers and Sellers (not surprisingly) with an r-squared value of 79%. However, there are some interesting differences.

In several of the technical areas of research the percentage of suppliers using them is considerably higher than the buyers, for example: Mobile First Surveys (Suppliers 52%, Buyers 43%), Mobile Qualitative (Suppliers 46%, Buyers 34%), and Research Gamification (Suppliers 28%, Buyers 15%).

However, the more interesting cases are those where the Buyers are more likely to be using an approach than the Suppliers. The two key ones being: Social Media Analytics (Buyers 60%, Suppliers 38%) and Big Data Analytics (Buyers 50%, Suppliers 35%). This finding is consistent with earlier waves of GRIT and we believe it indicates that for these two services many clients are buying from non-MR suppliers – which is consistent with the findings from some of the other findings from this wave of the GRIT study.

Differences By Region

There are some interesting differences by Region, and if you have a chance to dive into the data you will find some interesting differences by country too. However, the main message is that the advanced market research world is essentially a similar place – comparing North America to the other three groupings gives an r-squared of 89% or higher for each region.

Table 4 shows the data for North America, Europe, APAC, and Other – regions that have been determined by sample size and geography.

Table 4 North America Europe APAC Other
Online Communities 58% 66% 59% 54%
Mobile First Surveys 47% 56% 50% 54%
Webcam-Based Interviews 48% 49% 42% 36%
Text Analytics 47% 44% 56% 36%
Mobile Qualitative 42% 47% 46% 45%
Social Media Analytics 41% 46% 49% 47%
Big Data Analytics 38% 41% 37% 38%
Mobile Ethnography 32% 40% 37% 39%
Micro-surveys 31% 37% 37% 35%
Eye Tracking 28% 46% 39% 30%
Behavioral Economics Models 25% 34% 31% 30%
Research Gamification 21% 36% 26% 20%
Applied Neuroscience 18% 28% 21% 22%
Facial analysis 17% 28% 20% 17%
Prediction Markets 17% 24% 19% 19%
Crowdsourcing 16% 14% 19% 11%
Internet of Things 13% 10% 18% 10%
Biometric Response 12% 15% 8% 14%
Virtual Environments/VR 11% 12% 11% 10%
Sensor/Usage/Telemetry Data 11% 13% 13% 4%
Wearables Based Research 7% 12% 11% 8%
Base 900 370 156 96

 

One interesting, but not strong, pattern is that North America tends to score slightly lower than Europe and APAC. It could be that the sample for North America is a bit more general, and the sample from Europe and APAC a bit more tech-focused. Or, and this would be consistent with some of the other patterns in the data, that the use of tech in market research is maturing into mainstream and niche, and North America is further ahead in that process.

 

What is next?

We ask respondents via a verbatim option what other emerging technologies are considering using, and these coded responses are an effective means of looking ahead to what will might be the next major trend in research. Leading the list is AI, which is twice as likely  to be under consideration by Buyers vs. Suppliers compared to any other method, a theme that is echoed throughout GRIT . Video Analytics, automation in general, neural networks and multiple platforms are also of far larger interest to buyers than to suppliers, although all appear to have interest on both sides of the table.

 

  Insights Buyer / Provider
Insights buyer or client Insights provider or supplier
AI(Artificial intelligence) 13.0% 9.5%
Chatbots 0.0% 1.9%
Data visualization 2.6% 0.8%
Implicit association experiments/Test 1.3% 2.3%
Machine learning 2.6% 3.4%
Passive monitoring 0.0% 2.3%
Tracking 2.6% 3.4%
Video Analytics/Video surveys 5.2% 4.5%
Neural Networks 7.8% 3.4%
Automation 6.5% 1.9%
Beacon technology 0.0% 0.8%
Multi platforms 5.2% 0.8%
Mobility 1.3% 1.9%
Combination of online + offline parts 1.3% 3.4%
Bots 0.0% 1.1%
Provide the data according to client need 0.0% 0.8%
Behavioral Recruitment/Digital behavior 1.3% 3.0%
Data management platforms 0.0% 3.0%
Neuroscience 0.0% 1.1%
Data gained from TV 1.3% 0.4%
Customer/Shopper Traffic Counter Devices 0.0% 0.8%
Weather and spatial proxemics 0.0% 0.4%
Virtual plan-o-grams at retail 1.3% 0.8%
Face to face mobile research 0.0% 0.4%
Predictive analytics 0.0% 0.4%
Marketing attribution 0.0% 0.4%
Technology mapping/illustration 1.3% 1.5%
Expression reading 0.0% 0.4%

 

In the next wave of GRIT we will include some of these “next generation” methods in the general adoption rankings so we can begin to identify the next great emerging technique such as communities, mobile, and text analytics became over the past few years.

The Net on Nonconscious Measurement

For all the intense industry focus on Neuroscience and Behavioral Science methods, it has been baffling to see what appears to be low penetration for individual “System 1” tools specified in past Grit reports. We suspect that this is due to the fact that “Neuro tools” are a class of methods and that when spread out individually, they appear to be less than their shared usage and impact implies. This led us to combine the following five methods which comprise the backbone of nonconsious measurement across study types: Behavioral Economics Models, Eye Tracking, Facial Analysis, Applied Neuroscience and Biometric Response. (Implicit is also a major method in this class but is not yet included in the Grit Report.)

When we net the most prominent methods employed to capture nonconscious response, it appears that critical mass in the industry for both use (53%) and total interest (80%) has taken hold. No longer a “special occasion” consideration, nonconscious measurement has tipped to be embraced by the majority of the industry using one or more of the key methods available included in the Grit Report. Considering that the neuromarketing sub-industry is only about 10+ years old, this is a massive change in the thinking and acceptance among researchers and marketers alike.

These levels would, most likely, be even more dramatic if Implicit Reaction Time Testing were included in the study as well. Implicit is perceived to be one of the fastest growing nonconscious methods in the industry given the tool’s ability to be broadly applied and enable insight in the strength of conviction consumers hold for brand attributes and associations. It is strongly recommended that Implicit be added to future Grit Reports.

Labels In use Under Consideration Total Interest
Net Nonconsious Measures 53% 27% 80%
Eye Tracking 34% 21% 55%
Behavioral Economics Models 29% 29% 58%
Applied Neuroscience 21% 22% 44%
Facial Analysis 20% 25% 45%
Biometric Response 12% 20% 33%

 

Also curious is the relatively high level of agreement to using or considering Behavioral Economics Models. Leveraging Behavioral Economics is highly desirable in that it has potential to have demonstrable impact on brand outcomes. The right “framing” or “anchoring” can sway a decision in a particular context and scenario testing alternative brand positionings can have a huge impact on optimizing selection. But we wonder if almost 1 in 3 in the industry are literally applying Behavioral Economics Models, or do the words “behavior” and “models” invite selection because of other associations such as behavioral surveys, media models, etc.

To get the most accurate handle on the penetration and growth of nonconsious measurement adoption by the marketing industry, it would be elucidating to get a better sense of what people mean by these terms used going forward and be inclusive of all major nonconscious methods in usage.

But all in all, it is worth taking note that a major milestone has been achieved and most of the market research industry has entered the realm of nonconscious measurement usage or desire!

The Main Story

The two main messages are A) over the last three years things have been relatively stable, and B) that the advanced research world is pretty similar globally (yes you can find differences, but the overall pattern is one of similarity).

The stability message is of particular interest to those championing the exciting approaches that have yet to take off, for example Sensors/Telemetry, Virtual Reality, and Internet of Things. When and if we see these techniques becoming more mainstream, we will see them moving up the GRIT league table – but there is no sign of that yet. However, when we see the aggregate penetration of Nonconscious Measurement total interest, there is clearly a trend toward critical mass.

If you are running a middle-sized organization then the data suggest that unless you are an outlier, you should be using Mobile First Surveys and Online Communities, some of the techniques in the middle of the table, and perhaps one of the emergent techniques in the bottom group.

The main worry for market research providers is the suggestion from the data that many research buyers are turning to non-market research sources for their Text Analytics and Social Media Analytics – something the GRIT report has been showing for some time now.

0

grit report

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

Comments

More from Ray Poynter

Word Cloud Plus Extracts Hot Buzz Topics
Ray Poynter
Word Cloud Plus Extracts Hot Buzz Topics

The Future Place

Word Cloud Plus Extracts Hot Buzz Topics

The GRIT data collected toward the end of 2022 included 918 open-ended replies to the question “Related to insights, research, or analytics, which topics do you follow most closely and…

By Ray Poynter

Managing Director at The Future Place

Observational Data Has Problems. Are Researchers Aware of Them?

Research Methodologies

Observational Data Has Problems. Are Researchers Aware of Them?

Observational data is a tempting shortcut for insights but researchers must consider its potential shortfalls

Ray Poynter

Ray Poynter

Managing Director at The Future Place

Want it Faster, Cheaper, Better? Then You’d Better Sign Up to Prescriptive Analytics

Business-to-Business (B2B) Market Research

Want it Faster, Cheaper, Better? Then You’d Better Sign Up to Prescriptive Analytics

Using Prescriptive Analytics to navigate the data-filled world.

Ray Poynter

Ray Poynter

Managing Director at The Future Place

Company Size Matters: The Differential Impact of COVID-19

Company Size Matters: The Differential Impact of COVID-19

A deep dive into the very different experiences of the MRX community during COVID-19.

Ray Poynter

Ray Poynter

Managing Director at The Future Place

ARTICLES

Moving Away from a Narcissistic Market Research Model

Research Methodologies

Moving Away from a Narcissistic Market Research Model

Why are we still measuring brand loyalty? It isn’t something that naturally comes up with consumers, who rarely think about brand first, if at all. Ma...

Devora Rogers

Devora Rogers

Chief Strategy Officer at Alter Agents

The Stepping Stones of Innovation: Navigating Failure and Empathy with Carol Fitzgerald
Natalie Pusch

Natalie Pusch

Senior Content Producer at Greenbook

Sign Up for
Updates

Get what matters, straight to your inbox.
Curated by top Insight Market experts.

67k+ subscribers

Weekly Newsletter

Greenbook Podcast

Webinars

Event Updates

I agree to receive emails with insights-related content from Greenbook. I understand that I can manage my email preferences or unsubscribe at any time and that Greenbook protects my privacy under the General Data Protection Regulation.*