Research Methodologies

February 21, 2011

Can We Stop Arguing Over What’s The “Best” Methodology?

There is no “best” methodology or approach. The “best” methodology is the one that will be most ideal for the specific project at hand.

Ron Sellers

by Ron Sellers

0

By Ron Sellers

Blogs and message boards are a great way to discuss research questions.  Some discussions I’ve seen recently:

  • Is it better to do one long survey or multiple shorter surveys?
  • Is qualitative research or quantitative research more likely to result in usable insights?
  • Should researchers be using CATI interviews or online panels?
  • Are focus groups superior to IDIs, or do IDIs provide greater insights?
  • Are traditional focus groups better than online qualitative, or is it the other way around?
  • Are online panels better than social media sampling, or vice versa?

The fascinating thing is that in every case, the posed question is then followed by multiple answers and discussion of which option is right.  People passionately defend their selection and denigrate the other choice.  I’ve even seen some nasty comments and arguments arise from these debates.

The funny thing is that to have a blanket debate like this on these topics is largely pointless.  There simply is no overall answer to whether qualitative projects should be online or face-to-face.  There is no way to answer whether qualitative or quantitative work generates greater insight.  That’s like arguing whether every American would be better off driving a minivan, a family sedan, or a pickup truck.  If you want to haul lumber and tow your boat, you drive a pickup.  If you want to take your six kids to the soccer game, you drive a minivan.

To put it bluntly, saying a minivan is simply a better vehicle than a family sedan is, well, rather dumb.  So is saying IDIs are simply better than focus groups (or the other way ‘round).

As researchers, part of our responsibility is to know the best way of getting the insights we seek, taking into consideration the target audience, the geography, the budget, the timeline, the topic, and the information objectives.  There are times when telephone research is the best option.  There are other times when the project is much more appropriate for an online approach.  And guess what – there are even times when mail surveys or intercept interviews are the preferable way to go.

So can we stop arguing over what’s the “best” methodology?  There is no “best” methodology or approach, other than the fact the “best” methodology is the one that will be most ideal for the specific project at hand.

Unless you really think that everyone in the world should drive a minivan.

0

online researchqualitative researchquantitative research

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

Comments

Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.

More from Ron Sellers

Are the Fraudsters More Sophisticated Than the Researchers?

Research Methodologies

Are the Fraudsters More Sophisticated Than the Researchers?

It’s amazing what some people will do in order to make a buck-fifty. Two recent studies have brought to light how sophisticated panel fraud has become...

Ron Sellers

Ron Sellers

Still More Dirty Little Secrets of Online Panels

Research Methodologies

Still More Dirty Little Secrets of Online Panels

Nearly half of your panel data is trash. Here is how to fix it.

Ron Sellers

Ron Sellers

Can Political Polls Really Be Trusted?

Can Political Polls Really Be Trusted?

When political polls fail to predict the exact outcome of an election, maybe they’re not wrong…maybe we are.

Ron Sellers

Ron Sellers

Panel Quality Stinks and Clients Are To Blame

Research Methodologies

Panel Quality Stinks and Clients Are To Blame

Why should panel companies improve their results when clients accept the status quo and won’t pay for better?

Ron Sellers

Ron Sellers

ARTICLES

Moving Away from a Narcissistic Market Research Model

Research Methodologies

Moving Away from a Narcissistic Market Research Model

Why are we still measuring brand loyalty? It isn’t something that naturally comes up with consumers, who rarely think about brand first, if at all. Ma...

Devora Rogers

Devora Rogers

Chief Strategy Officer at Alter Agents

The Stepping Stones of Innovation: Navigating Failure and Empathy with Carol Fitzgerald
Natalie Pusch

Natalie Pusch

Senior Content Producer at Greenbook

Sign Up for
Updates

Get what matters, straight to your inbox.
Curated by top Insight Market experts.

67k+ subscribers

Weekly Newsletter

Greenbook Podcast

Webinars

Event Updates

I agree to receive emails with insights-related content from Greenbook. I understand that I can manage my email preferences or unsubscribe at any time and that Greenbook protects my privacy under the General Data Protection Regulation.*