Unearth the power of declared data
Insights That Work
Brand & Retailer tickets for all IIeX events now start at just $99! Get or give one today!

Research Automation Comes Of Age With BrainJuicer/ZappiStore Partnership

I have maintained for some time now that the automation of the process of research, especially (but not only) quantitative research is the most highly disruptive trend in this industry for the foreseeable future.



I have maintained for some time now that the automation of the process of research, especially (but not only) quantitative research is the most highly disruptive trend in this industry for the foreseeable future. Platforms and hybrid platform/service solutions like ZappiStore, Gutcheck, Research Now, AYTM, Instantly, Macromill and dozens of others have cracked the automation code and are growing at an astonishing pace. In effect Sampling, Data Collection, Analysis and Reporting of anything survey based is rapidly joining the ranks of the vast majority of CX, Big Data, BI and Social Media platforms that enable the cost and speed efficiency that mass scaling allows, with very little human intervention.

I am privileged to be close to many of these companies, but I am on the Board of Advisers of ZappiStore so I have a front row seat watching them move from strength to strength as one of the key players in this evolution of the MR ecosystem. Other firms are following a similar trajectory and deserve all the kudos for their own unique offerings and approach to utilizing automation to create new models for insights generation, but the ZappiStore positioning is unique in that their position is fundamentally about being an IP marketplace vs. simply a suite of cheaper, faster tools. That is an important difference because of what it means for other suppliers and for clients.

There are many offerings in the world of MR that rely upon norms, longitudinal data and/or the corporate adoption of specific and long standing standardized tools: this goes beyond things like NPS to specific offerings that function today as “data currency”: Nielsen Ratings, BASES scores, Millward Brown tests, BrainJuicer FaceTrace®, TNS Conversion Model, myriad proprietary trackers and the list goes on and on. Just a few years ago clients were looking for cheaper, faster, and (perhaps) more impactful solutions, but because of the reliance upon these and other industry leading solutions they often felt held hostage. The emergence of DIY solutions as well as intense interest in emerging alternatives like social media analytics, neuroscience, behavioral data, etc.. have been largely driven by that client-side imperative. However, although these solutions have all gained traction as discrete solutions to address related business issues or as complements to existing standards, none have enabled clients to shift wholesale from their embedded and long terms standards.

Enter ZappiStore.

ZappiStore realized they could use their proprietary Intellection platform to take virtually any research IP, either from suppliers or from clients, and automate it, making it hugely cheaper and faster while giving it global scale, lowering the barrier to entry for new clients with limited budgets, and allowing for the “modularization” of research wherein clients could mix and match combinations of tools to create even more value and impact. When they won the Insight Innovation Competition three years ago at IIeX LatAm in Brazil we knew they were special, once they started to rapidly “democratize” the IP of companies like TNS, Millward Brown, MMR and others the revolution went from a spark to a flame. I know first hand through my work with leading clients in Gen2 Advisors and the IIeX Corporate Partner program how rapid this shift has been, and combined with regular updates in my BoA role at ZappiStore as well the hundreds of supplier conversations I have every month, I have a unique perspective and here is the bottom line:

The era of  process and/or “firewalled” IP being the driver of value for suppliers is already over (and to borrow from the William Gibson quote above), it’s just not evenly distributed yet.

It’s happening in quant first, but Gutcheck, and iModerate are examples of companies leading the charge for qual (which is tougher to do for sure) and as this evolution unfolds we will see more and more tech-driven players creating platforms to automate huge pieces of the research process. Clients will flock to those solutions and so suppliers will join forces with the automation enablers so they can remain competitive. There will be a rough period for many as they remove the research process as a revenue driver  for much (but by no means all) of their offerings and instead pivot to a combination of consulting and volume-driven licensing of their own IP. Like any evolutionary process, some will thrive and some will fall by the way side, but the industry as a whole will be in a much better place.

And all of that brings us to the best case in point in recent memory: the announcement today that BrainJuicer has now placed two of their biggest products into ZappiStore.

Here is an excerpt from the press release from BrainJuicer.


bj-logoBrainJuicer Group PLC (AIM: BJU), the world’s most innovative brand strategy and research agency, announces a collaboration with ZappiStore, a company specializing in providing top-class market research approaches in quick, automated, affordable and scalable options.

By partnering with ZappiStore, BrainJuicer now offers the core of its validated, award-winning research methodologies, BrainJuicer Ad Testing Express and FaceTrace® in a self-serve portal – a fit for ZappiStore through what its tagline calls “Insight Through Automation”.

Increasingly marketers are realizing that emotional measurement needs to be at the heart of their research tool-kits. But as the research industry continues to be leaner and more agile, there is an audience that needs access to proven tools available in an automated platform.

“We have sensed for a long time that the paradigms are shifting in the way in which clients want to engage with research partners.” John Kearon, Chief Juicer, explained, “On the one hand, clients want highly consultative and predictive advice, that draws on the very latest understanding behavioral science offers, for why people make decisions the way they do. That is our core business.  But there is also a hunger to do things more quickly and cost efficiently. What better and more exciting way to serve that need, than ensuring our validated and award-winning System 1 tools are available to as wide an audience as possible, in a cost effective and automated way, via the highly innovative and disruptive ZappiStore.”

FaceTrace launched in ZappiStore 8th February and BrainJuicer Ad Testing Express has followed, launching 15th February in the platform.

Steve Phillips, CEO at ZappiStore commented, “We are thrilled to welcome BrainJuicer to ZappiStore making two of their breakthrough emotional measuring tools, FaceTrace® and Ad Testing Express available to a wider community of researchers. Emotional measurement is crucial for brands to achieve successful marketing, advertising and NPD. BrainJuicer’s award-winning methodology, combined with the power of automation, will make for truly impactful, lightning-fast tools, giving brand and agency clients access to business-transforming emotional insight – all in a matter of hours.”


I knew this was coming, and as the announcement became imminent it seemed like a great opportunity to chat with Alex Hunt, President of The Americas for BrainJuicer to dig in a bit deeper into their thinking about jumping on the automation train now and what the company plans next.

LFM: Hi Alex! So today both BrainJuicer and ZappiStore announced some pretty cool news. Can you describe the deal in your own words?  

AH: The big news for this week is that BrainJuicer is making two of our core System 1 research approaches available to research buyers who use the ZappiStore platform. The first approach is a simple survey featuring our award-winning FaceTrace® tool [now used to survey over 5 million people worldwide!] for measuring how people feel about any given type of stimulus, the only question one ever really needs to pose to consumers. The second is our BrainJuicer Ad Testing Express method, which leverages FaceTrace® to assess emotional response to advertising ideas at any stage during their development. It also converts consumer feeling into a 1 through 5-star rating which is predictive of an ads in-market business effects. Using BrainJuicer Ad Testing, clients are able to use a validated system to quantitatively identify the famous 5-star creative ideas that will build Fame, Feeling and Fluency  for their brands.

LFM: Automation has become one of the biggest buzz terms in our industry, and companies like ZappiStore are examples of why: they are using technology to help scale the IP of other companies (like BrainJuicer) while creating cost and speed efficiencies never before possible. That is a pretty big disruption to the standard research business model; what made BrainJuicer decided to jump on this train?

AH: We are increasingly hearing clients express the urgent need to engage differently with research partners. On the one hand clients are seeking high engagement, consultancy and advisory, where research partners participate in strategy and execution for growth. This is the heart and soul of our core Juicy research business. More and more clients also have little use for the data collection-only models or traditional market research that asks consumers to answer rational questions bearing no resemblance to how they actually make decisions, and yield little to nothing in terms of directional, predictive guidance. 

On the other hand, brands need to be agile, cut costs and increase efficiency in a fast paced, ultra-competitive world. The knee jerk solve for this was DIY. But disruptors like ZappiStore are offering clients validated, world-class solutions and cost effective choices through an easy to use portal. As clients became hungry for lower cost solutions based on BrainJuicer System 1 methodologies, ZappiStore became an obvious path for us to provide them cost effectively to the largest number of prospects and clients.

LFM: Obviously you hope for this to be a significant revenue channel for the company, but what other benefits do you think this new model will provide to BrainJuicer and to your clients and prospects? 

AH: Developing a new revenue stream is certainly part of our motivation to make express versions of our products available in ZappiStore. But equally, we like to practice what we preach. We counsel our clients that to successfully grow their brands they need to build Fame, Feeling and Fluency; ZappiStore felt like a great way to make our suite of System 1 research tools more available and more famous among a wider group of research buyers. 

Another soft benefit is the speed with which we can actually bring a consumer voice to the dialog around any marketing or advertising industry discussion. An example of this in practice was just this past week when BrainJuicer and ZappiStore accepted the challenge of testing all 62 Super Bowl advertising spots overnight using BrainJuicer Emotion-into-Action™ Star rating system, via Ad Testing Express on the ZappiStore platform. We were able to rank and publish results from all 62 ads within 12 hours of the end of the game, enabling research to contribute to internal conversations at client organizations and the broader advertising industry dialogue while Super Bowl was still dominating the day after game press headlines. It was truly exciting to bring a valid consumer voice to the debate when the conversation was happening, something research has hopelessly struggled to do in the past. To hear more about the BrainJuicer and ZappiStore Super Bowl partnership click here.

LFM: John Kearon has talked a lot about the need for MR firms to shift to a consultancy model and certainly has made it plain that BrainJuicer is focused much more on that direction than the traditional market research play. Is the scaling of your research-centric tools and products through platforms like ZappiStore part of the strategy to free the organization up to focus on consulting?  

AH: Since our inception, BrainJuicer has been on a mission to transform the research industry and drag it into the modern era. This is no easy task given that the vast majority of research spend still reflects and supports the traditional, thinking-based, classical marketing model and the tools and frameworks that reinforce it. This despite the behavioral sciences proving consumers don’t think anywhere near as much as the traditional model assumes and rendering it wholly inaccurate. It’s also fair to say we’ve heard a lot of positive feedback and enthusiasm from clients for the possibilities offered by a partnership between ZappiStore, the industry’s most disruptive platform innovation, and BrainJuicer, voted Most Innovative Agency by clients in the GRIT report. 

To accomplish our strategic mission we knew we needed to make our suite of innovative System 1 tools starting with BrainJuicer Ad Testing Express, available through as many channels as possible starting with automated platforms such as ZappiStore. The side benefit of scaling our current tools like this is that it does leaves our team more time to focus on full service consultancy and disruptive innovations of the kind that have made BrainJuicer [arguably] famous. 

The pace of innovation at BrainJuicer in our core full-service Juicy research consultancy practice has certainly increased over the last 12 months: we’ve launched our new Brand Story-Teller product and our Fame Feeling and Fluency inspired BrainJuicer Brand Tracking approaches. While we can’t release the full details just yet watch this space for what we believe will be a genuinely ground breaking and disruptive announcement for the consultancy end of research industry coming from the BrainJuicer Group later this summer!

LFM: what do you think this heralds for the industry as a whole?

AH: Risking a dramatic prediction, don’t feel we are alone in foreseeing some radical shifts across the industry. Client-side budgetary pressures, a world moving quicker than ever and increasing demand for research premised on an accurate and behaviorally inspired model for why consumers make the choices they do, are going to dictate and accelerate change. As I mentioned before, we see the extremes of market research industry becoming clearly bifurcated on high end consultancy on the one hand and radically different platforms for efficient access to valid, behavioral science inspired, consumer insight on the other.  

This is going to be brutally challenging to several sectors of the research supplier community. Those traditional suppliers, who have been focused on once lucrative, but now too expensive and ineffective data collection services with minimal advisory – the big middle of the business , will become irrelevant. Costly trackers with no predictive features, largely because they focus on the wrong metrics, will simply go away.  

But all traditional suppliers [who have clung to outdated understanding of how consumers really make decisions, not grounded in a behavioral model] will be ill-equipped to evolve, innovate and create new methodologies. These new methods and platforms are essential to help modern marketers achieve famous marketing and profitable brand growth. If we may be so bold, innovators like BrainJuicer and ZappiStore, are better placed, as practitioners who defy convention, dare to experiment and risk failure, to lead the industry into a new era.

LFM: I think you’re spot on, and it’s a Brave New World emerging for sure! Here’s a “research” question or you: how will you measure success of this new direction?

AH: As with all BrainJuicer initiatives, success of placing our tools on ZappiStore will be measured according to three criteria. First, do our clients like it? We certainly hope they will enjoy having a new, easy way to access our System 1 research approaches. Second, do our shareholders like it? Typically shareholders like happy clients! And third, is our team enthused by it? We have incredibly passionate and Juicy team at BrainJuicer committed to our strategic mission to transform the research industry. Our team is very enthused about the extent to which BrainJuicer’s partnership with ZappiStore will facilitate accomplishing our strategic mission.

LFM: Last question Alex; are you considering rolling any other products into ZappiStore or other automation platforms?

AH: Yes, Lenny. We love to be bold and try innovative things at BrainJuicer – as you know! – and if successful we build on them. So anticipating the successful launch of BrainJuicer Ad Testing Express on the ZappiStore can certainly foresee our Predictive Markets approach to screening ideas using the Wisdom of the Crowd becoming the next methodology we make accessible through new platforms. Let’s see what 2016 brings! 

Take care and thanks for your time, Lenny.

So there you go, straight from the horse’s mouth.

BrainJuicer is one of the smartest companies in our space and they see the shift I outlined earlier happening. It’s certainly possible we’re drinking the same Kool-aid, but I am as certain about the trajectory of automation in MR as I was about the growth of mobile and Big Data several years ago, so I think my track record speaks for itself. However, I have been wrong before and will be again, so take it with a grain of salt if you must and we can compare notes in a few years to see how things have played out.

To add a bit more perspective, my friends at ZappiStore recently posted on LinkedIn Pulse their take on the implications of the BrainJuicer partnership. It’s a third data point to the case I have made that Research Automation has now come of age.

zappistoreZappiStore has come a long way since its launch in the spring of 2013. Opening shop with a handful of white label products, it took out its automation proposition to the MR industry. In those early days ZappiStore delighted some of the largest PCG companies with the offering, who helped them expand into new markets. With client endorsement of automation in the back pocket, we reached out to research agencies, evangelizing the benefits of automation: cost efficiency and speed.

The first agency to join the store was TNS who automated and launched TNS Conversion Model Express onto ZappiStore. Shortly after we were delighted to welcome Millward Brown and MMR as members to the store with their first listings.

Now we are thrilled and emotional (pun intended!) to be welcoming BrainJuicer as the latest Agency Member to the store. Working with a multiple winner “Most Innovative Agency” is exciting.

The current offering on the shelves at ZappiStore offers tools addressing Copy testing ( from Millward Brown, BrainJuicer, Zappi White label and soon Affectiva), Concept/idea screening (BrainJuicer and Zappi White label), Media Planning/Touch point ( PointLogic), Packtesting ( MMR), Brand equity ( TNS & Added Value).

We feel it is important to further build out and diversity our offering with tools from different big agencies to small boutique ones. The criterion remains ‘great research thinking’. ZappiStore’s goal is to work with the best thinkers in the research industry and help them bring that thinking to clients in a way that retains the quality that they value but also answers the cost and time questions. We are actively talking to a range of other agencies who are interested in building with us to get their great thinking and IP into an automated environment.

It should not surprise that clients are delighted to benefit from automation while continuing to leverage the quality research thinking they are accustomed to. And given the current business context and requirements, it is not a luxury but rather a prerequisite to address and answer the cost & time questions in some way or another. Stan S. from Unilever summarizes Unilever’s challenge to their MR suppliers as: “50% the cost 50% the time, 200% the impact”. Steve Phillip, CEO ZappiStore says: “I worry that in the drive for speed some clients are forgetting quality, and DIY surveys are being used more often even within smart corporates. We know the old saying of garbage in and garbage out but the key reason DIY is being used is speed. We see ourselves as offering the benefits of DIY but with the expertise of top researchers included, automatically.”

Together with our member agencies we can offer clients the best of both worlds enabling them to get the triumvirate of great quality, speed and cost. We provide the platform and the member agencies provide the thinking. This is also changing the behavior of our clients so that when previously they would have conducted one research project during the development of a new ad or product, now they can use a much more iterative test and learn approach. They can have an idea in the morning, test it using one of the industry’s best testing protocols over lunch and make an informed decision about where to go next in the afternoon. Or tweak it and test it again!

It’s an exciting new world and we hope 2016 becomes the year where Gonzalo Fuentes’s (Millward Brown) prediction of a tech revolution and consultancy evolution for our industry comes to be. From our end we will do our part and can’t wait to announce other major research partnerships soon.


Congratulations to BrainJuicer, ZappiStore, their clients and the industry as a whole. We’re entering a whole new world of leveraging the very best of technology and human brilliance to create new solutions to deliver impact. It’s going to be  a fun ride!

Please share...

21 responses to “Research Automation Comes Of Age With BrainJuicer/ZappiStore Partnership

  1. Either I am living in a parallel market research universe or Lenny you are preaching to an already converted small audience of which I am clearly not a part. Which is, I guess, at least confirmation of the articles headline image, that the distribution of disruption is indeed variable.

    The premise of the article seems to suggest an incredible ground swell of adoption of disruptive innovations in the world of market research. If one were to believe everything here, you would assume the industry was on course to complete automation, or what is referred to as “mass scaling that allows very little human intervention”. My goodness I may well be out of a job!

    However, in my universe the reality is otherwise. I refer to Greenbook’s very own GRIT Report for Q3-Q4 2015 which hardly suggests the industry is rushing to adoption of these new disruptive tools. The first and most obvious finding is that the buy side is clearly lagging way behind in claimed adoption behind the supply sides’ claims as offered services. Now why would that be? One could surmise here that whilst suppliers may feel the need to keep up and jump on the bandwagon it is clients that are less impressed.

    Too often we forget that there is usually a battle-hardened marketing guy in the market research decision process in most brand companies. Trying to sell new approaches to this audience is frankly difficult. Their expectations are often quite straight forward and in their minds easily resolved by standard research techniques. These guys are also risk takers and will make the call on things like creative evaluation without seeing the need to resort to neuroscience or emotions recognition. Typically, most of these brand companies are very careful with discretionary research budgets, if they have them at all. One then wonders just who the early adopters of these disruptive technologies are?

    The GRIT Report also suggests that what may have seemed as growth “at astonishing pace” from the disruptor bloggers may well be either wishful thinking or, to accept Greenbook’s thesis, quite clearly very unevenly distributed. Assuming the GRIT sample in 2015 is industry representative, then we can conclude that the adoption of many so-called disruptive technologies may have peaked in 2015, if not slipped. There has certainly been no growth in the adoption of techniques such as gamification, facial analysis, neuromarketing or biometrics. Indeed, the hot offers on ZappiStore like BrainJuicer’s behavioural economics and the emerging tools of virtual reality seem to actually be slipping in adoption in the research community that I know (through the GRIT Report)!

    BrainJuicer (“the world’s most innovative research agency” – I kid you not, that is how it bills itself!!) now offers a number of its technologies through ZappiStore. This is given as proof that the democratization of disruptive technologies is on a roll. It’s one thing to offer these tools and techniques, but will they be adopted? As a leading brand in the disruptive community we might ask how BrainJuicer is performing as a listed company, because surely that is the measure of adoption? In a report to the London Stock Exchange a few weeks ago, it is clear that some of BrainJuicer’s disruptive tools are not firing up markets in Europe. One in particular, its Juice Generation qualitative product, has seen declining support. Indeed, business volumes in all European markets seem to be down for BrainJuicer in 2015. I don’t wish to be overly focused on one company, but perhaps these trends could represent signs of disappointment with the promises suggested from disruption?

    I can hardly wait for the next GRIT Report to be proven wrong.

    1. Always good to get your common sense feedback Chris, but in this case you are missing a few pieces of information.

      1.) We don’t ask about Automation in GRIT, so it’s not a valid reference for the context of this article. That will change in the next wave though!
      2.) Automation generally is NOT happening with “new approaches”, it is happening with the good old survey as the core driver, and specifically long standing survey based products such as Millward Brown tests, TNS Conversion Model, standard package testing, etc…
      3.) Our industry does a truly terrible job of measuring the success of DIY research companies like Qualtrics and SurveyMonkey (both of whom have market caps of over $1B) as well as BI and Analytics firms, all of which employ some methods of automation, target marketing organizations more than MR, and enjoy turnover rates that are greater than MR and growing. That means there is a long history of clients spending more with those type of clients due to the speed and cost efficiencies. Now that model is being imported to MR.
      4.) In my consultancy I work at a deeply strategic level with clients who are flocking to automation platforms, and in many cases forcing their existing vendors to migrate to it as well. I know for a fact how much some very major spenders are allocating to these platforms and away from their existing suppliers, and I know how much many of the automation suppliers are growing due to my relationships with them. Obviously I cannot disclose specifics, but please trust me when I say that the shift is rapid and monumental, with growth rates virtually unheard of in our space.
      5.) My point about the importance of the BrainJuicer shift had nothing to do with their market performance, it was based solely on the fact that now Zappistore has emerged as a viable platform for IP automation across multiple companies, not just Kantar brands (who were the early adopters), and since they punch well above their weight in terms of reach and influence their decision to pivot has broad implications for the rest of the industry.

      So, points taken about adoption of disruptive methods, but this shift is just as fundamental and consequential as the shift from phone to online was in terms of process and business model, and in the next two years will radically define the marketplace. Watch the industry news re: annual reports, M&A and investment in this space over the next year my friend; you’ll see that I am right.

  2. For years, a substantial amount of quant mr has been of the field-tab-powerpoint variety, sometimes with a proprietary black box inserted before powerpoint. Much of it has been done factory-style for for years, with little need for highly skilled or experienced marketing researchers, by design. Yet premium prices have typically been charged and no surprise that clients have gotten fed up. There is still plenty of space for sophisticated customized quantitative mr but, unfortunately, there is a growing skills shortage in that area, and this is another complaint I hear from clients as well as from agencies trying to recruit talent.

  3. Lenny very interesting feedback. I take your point. I think this is an important area that needs to be represented in the next GRIT study in some format. I have seen some standard research systems shifting to an online but less automated platform, but one can see how this will evolve to full automation. . You need to focus something in the 2016 GRIT studies on this trend. It is clearly having an impact as seen in a recent article on how HR requirements are changing rapidly in the industry.

  4. Automation doesn’t seem to me to be a specific market research trend, in the same way that agile isn’t a research trend. Business process automation is happening across the whole business landscape and research is just part of that bigger picture. Automation offers huge cost and time benefits for clients but definitely doesn’t stop the requirement for great researchers thinking strategically about a clients business. Hopefully we can help agencies with the automation freeing them up to do the heavy thinking!

  5. Indeed, Steve. A former employer of mine began developing a questionnaire design tool for its employees and a user-friendly tabulation tool for employees and clients in the late 80s. This was in the DOS days! A big reason for this initiative was to cut down on unnecessary (and costly) clerical effort and allow researchers more time to do research. Marketing researchers who truly know how to use data and analytics to enhance decision-making will always be in demand. It’s the thought that counts.

  6. It seems that what BrainJuicer and ZappiStore are doing is part of an evolution that has finally reached a critical mass.

    It seems kind of ironic that an industry which exists solely on change has itself, such a hard time changing both our perspective and our measurement standards. Does your world look or fell anything like it did in 2000? 2010? Probably not and the pace is accelerating.

    Data tools are getting not only smarter but more adaptable and able to learn as new avenues of information present. The new generation of AI tools can manipulate huge amounts of data in a fraction of the time it used to take to extract data sets but more importantly, it can understand the content and apply insights. That’s a huge leap forward for what used to be the tracking industry and large scale 20 minute studies. We learn in real time from validated data what used to take twelve weeks to do and have at least a 4% margin of error.

    The new generation of research doesn’t ask monotonous drill down questions but instead seeks answers through the accumulation of many data points. It’s faster and better data that delivers not only direct answers but creates a body of response that defines the gradient of the response. That’s very new and hugely enlightening because we can now define the subtleties of value propositions. We don’t have to create people segments, we can create attribute segments.

    Who would have thought even five years ago it would be possible to order products online and have them delivered to your door in an hour? How would you have seen profitability for that model without understanding how the Internet and Amazon have changed expectations? More importantly how does that improve the life of elderly, in-firmed, the handicapped or a mom with a new baby? The point is that these new methods increase profitability but more importantly, they increase the quality of life for many people. Data will forge ahead with or without research but with research that can refine the big picture on a qualitative and in some cases individual level everybody wins.

    Nothing stays the same forever and the evolve or die principle holds true whether or not you choose to embrace it. The reality is that we live in a time where transparency is not an option and consumers can embrace information as the same pace as marketers. There will always be people who want to follow but now they have choices among leaders. How you define yourself is the key and the old saying about doing the same thing over and over and expecting a different result? We all know how that ends.

    Congrats to Zappi Store and Brain Juicer for forging new paths that provide solutions rather than just answers to the questions.

  7. Automation is good when you consider one or more of the following in the increasingly data driven market research world

    * Obviates the need for to do *low level plumbing* associated with the research. For instance, it may be like you have to acquire,filter and enrich data before its subjected to an analysis. ==> Lower the complexity and improve your resource allocation towards strategic aspects
    * The pattern of market data changes frequently that brings complexity and limitations through manual research or even with bespoke tools its going to take time and efforts
    * If your project suffers due to longer turn-around time with in-house methods and automated tools can help
    * Whats the value prop? Owning tools versus (Buy Vs Build) has cost and ROI implications
    * If specific MR problems can be solved through Agile methods. For instance to evaluate the brand or consumer experience of a 1 day Mega sport event or a marketing campaign, one wouldn’t want to go for a survey
    * If Automation helps gain new types of insights. example: we have 100 twitter comments coming in per second about a topic. how can we leverage automated tools to help gain insights?

  8. Kudos to Zappistore but can someone please explain to me how Brainjuicer can claim that their tools cited here are ‘system 1’? Facetrace requires respondents to choose a facial expression to match how they felt after watching an advertisement. This task engages reflective, controlled mental processes that rely on active consciousness i.e. it’s a ‘system 2’ task. ‘System 1’s mental processes are automatic and reflexive, which operate at a passive level of consciousness (what some call ‘pre-conscious’). To access these processes would require a neuro tool or implicit method.
    It’s worrying for clients if Brainjuicer don’t understand this. It’s even more worrying if they do, yet are still making claims about ‘system 1’!

  9. Whew Andrea, I didn’t want to go there. But good point. I assume you must be familar with that Facetrace model? If they are not using some implicit system, but just a face selection you are absolutely right to raise methodology concerns. In fact that whole System1/2 model has no direct relationship to the brain’s activity. Recent neurological work suggests the whole brain fires up for any decision making prcess.

  10. No takers huh? Either no-one reads these comments or they do but don’t know the answer or they do and do know the answer but are keeping quiet!

    So I will stick with my observation that Brainjuicer are billing themselves as ‘THE system 1 agency’ but, with Facetrace at least, no reason to believe this claim.

  11. Respondent reactions are the result of cognitive processes – “cognitive” does not mean “System II” only – so it is not really possible to ascertain what “level” has generated it (or if that is truly relevant). See EEG Methods for the Psychological Sciences (Dickter and Kieffaber) and The Statistical Analysis of Functional MRI Data (Lazar), for example. What respondents recall verbally about an ad or brand has never been shown to be irrelevant, irrespective of slick pseudoscientific claims to the contrary.

  12. Andrea and Kevin, thanks for having the courage to take on this tendency in the industry for over-claiming around technology effectiveness and neuro-hype. I feel less alone! I like Kevin’s term “slick pseudoscience”.

  13. Thanks Kevin. It is possible to distinguish between ‘automatic’ (system 1) and ‘controlled’ (system 2) cognitive processes. Typically, implicit methods (using reaction time/indirect measures) can prevent controlled responses and the resultant biases if a respondent has a motivation (and the time/opportunity) to control the response.
    It’s for this reason that I was questioning Brainjuicer’s claim to be ‘THE system 1 agency’. Do they have testing methods that prevent controlled responses or is it merely a claim?

    By the way, it’s also been shown that ad recall (spontaneous or prompted) is not a necessary condition for ad effectiveness 🙂

  14. Thanks, Andrea. Ad recall is just one measure of ad effectiveness, and indeed high levels of recall by no means guarantee an ad’s success. There may be those who would claim otherwise, but I’ve never been one of them. Regarding “System 1” , “System 2”, response latency, and implicit measures generally, I would simply encourage everyone to do their homework before they buy. (Good advice, I think, for anything unless the price and risks are minimal!) Moreover, even if a company does offer a method (for any purpose) grounded in real science, they may not be applying the theory properly or be cutting corners in order to make their product affordable.

  15. Years of comtinuous brand tracking have taught me two things. First, unless ad recall is proven through correct content recall and unprompted brand associations the capture of claimed ad recall is just a rubbish measure. Total ad reca;; invariably correlates with general brand awareness which means it has nothing to do with short term effects at all. Top of mind awareness can be useful, but often just meqsuring shrt term effects. The real learning is that no measures are as critical as attitude shifts. The rest is just noise in the system. Attitudes are hard to shift, Other measures may move relative to promotional efforts and ad activity but the effects are rarely sustained.

  16. So I may have found the answer to my original question, courtesy of Brainjuicer themselves whose latest newsletter contains a link to a report they’ve helped with (link below).

    In it they show ‘facetrace’ as an ‘implicit test’. They state ‘By asking people under time pressure, we get their real, gut-level, System 1 reactions’. Sounds good, BUT their timescale for answering is 3 seconds. THREE SECONDS?!?! This is ancient history in the brain and more than enough time for system 2 controlled processes to engage. 3 seconds is laughable and would not stand up to any academic or scientific scrutiny or peer review as an ‘implicit’ test. I’ve seen implicit tests with a mean reaction time of 800 milliseconds.

    So my hunch was right; Brainjuicer seem to be making misleading claims about being ‘THE system 1 agency’. I’d so love to hear a response from them on this (bet it takes longer than 3 seconds).

    Here’s the link;

  17. My final comment on this thread is to reiterate that everyone should do their homework and not blindly accept any claims regarding “Implicit” measurement or “System I” and System 2.” Some may have true scientific support, some may have little or none, and much will have none at all. It also will be useful for many marketing researchers to learn more about Psychometrics, which is much more than Factor Analysis and Cronbach’s alpha. There is also the question of how the ideas are implemented. Marketing researcher should be able to do research; we are supposed to be more than salespeople.

  18. Thanks Kevin, I couldn’t agree more with your statement. I hope Lenny reads this thread because Brainjuicer regularly win accolades for innovation in research. From what I’ve read they should perhaps win an award for making creative claims instead.

    Come on Brainjuicer, what’s your answer? How can a task which allows a respondent 3 seconds to answer possibly be a system 1 reaction? At best, it’s ‘fast explicit’ but it’s certainly not ‘implicit’.

Join the conversation