Insights Industry News

January 17, 2014

Transparency & Methodological Agnosticism

An example of the power of triangulation and methodological agnosticism, in infographic form.

Allan Fromen

by Allan Fromen

0

By Allan Fromen

People sometimes ask me whether my doctorate in Psychology has helped me in the field of market research. I usually answer in the affirmative, saying how the principles of psychology, research methodology, and advanced statistics, are all highly relevant to market research.

However, I now realize another aspect of my education that has helped me far more than I ever realized. Our program director used to have us pick a topic, and then summarize 20 journal articles, detailing the findings, the relevance to the broader literature, as well as the strengths and weaknesses in the methodology. At the end of these 20 articles, we had to clearly summarize it all, and state how the research should evolve to best move the science forward. Essentially we had to boil down a massive amount of literature into a coherent story and look into our crystal ball to indicate where the research might go next.

Sound familiar? This is precisely what we do in the field of market research. We have to tell a story out of disparate data points. If we limit our insights to only a single study, well, that is a fairly narrow perspective – akin to reading only one chapter of a book. When we triangulate our understanding from multiple sources – data from multiple market research studies, for example – now that is a much more compelling story.

A related point, and one also informed by my education, is that there is no single “best” methodology. Different approaches to research have their benefits and limitations, and the specific method should be selected based on the nuances of the research question.

Now I realize that is an obvious conclusion, but it is one I fear is getting lost in so many conversations.  Many in the market research industry are writing about the death of traditional research methods, and how newer approaches (mobile, social, communities, etc.) will soon overwhelm us like a great flood smashing through the levies. To this I say, hogwash. Newer research approaches will coexist side-by-side with the more traditional ones, and we should choose the methodology that is best suited to our objectives.

To a hammer, everything looks like a nail. If someone is espousing the benefits on social media listening (for example), see if they have a vested interested in that type of research. More often than not, I would bet that they do. I am grateful that I can be methodology agnostic, so my clients know I will do what is in their best interest, not mine.

I think these two points, triangulation and methodology agnosticism, are encapsulated in the infographic below. First, in honor of my psychology director (a shout out to Roya Ayman, who inspires so many students), the story is an amalgam of four differ studies. No one study on its own would have identified The Smart(Phone) Shopper. But together, they paint a picture that tells a clear story.

Also, we combine a diary study, a mobile survey, mobile behavioral data, and a traditional online survey. Each approach has its place, and no one methodology would have been sufficient. They are all aligned to the objectives of the particular study, and as such, uniquely inform each chapter, so we can better understand the full story.

In our rush to embrace the shiny new methodology, or to write attention grabbing headlines, we sometimes forget the basics. Good research is founded in objective, critical thinking that can inform our perspective and lead to actionable insights. My dear director Roya would expect no less.

 

smartshopper_infographic

0

storytellingtransparency

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

Comments

Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.

More from Allan Fromen

Insights Industry News

How I Beat The Pundits and Predicted A Trump Presidency

Allan Fromen predicted a Trump presidency and out-forecasted all the experts. Or did he?

Allan Fromen

Allan Fromen

Consumer Behavior

Do Respondents Even Understand Our Surveys?

Language can be imperfect. How often does the receiver of a message truly understand it exactly as the sender intended?

Allan Fromen

Allan Fromen

Brand Strategy

What Marketers Can Learn From The Trump Campaign

Trump has demonstrated the impressive power of emotion, and it is a lesson marketers would do well to remember.

Allan Fromen

Allan Fromen

Research Methodologies

Heal Thyself! When Will Market Research Get Serious About Sample Quality?

Sample quality from online panels is an issue everyone knows about but no one wants to address.

Allan Fromen

Allan Fromen

ARTICLES

Moving Away from a Narcissistic Market Research Model

Research Methodologies

Moving Away from a Narcissistic Market Research Model

Why are we still measuring brand loyalty? It isn’t something that naturally comes up with consumers, who rarely think about brand first, if at all. Ma...

Devora Rogers

Devora Rogers

Chief Strategy Officer at Alter Agents

The Stepping Stones of Innovation: Navigating Failure and Empathy with Carol Fitzgerald
Natalie Pusch

Natalie Pusch

Senior Content Producer at Greenbook

Sign Up for
Updates

Get what matters, straight to your inbox.
Curated by top Insight Market experts.

67k+ subscribers

Weekly Newsletter

Greenbook Podcast

Webinars

Event Updates

I agree to receive emails with insights-related content from Greenbook. I understand that I can manage my email preferences or unsubscribe at any time and that Greenbook protects my privacy under the General Data Protection Regulation.*