The Top 21 Emerging Research Methods of 2016 (A GRIT Sneak Peek)
Editor’s Note: The GRIT Report for Q3/Q4 2016 will be published in early January and it is chock full of good stuff. In this wave we covered a variety of topics, some new and some that we track normally. They were:
- Adoption of emerging methods/technology
- Usage of traditional Qual
- Usage of traditional Quant
- Sample Quality and Respondent Engagement
- “Buzz Topics”: Automation, AI, Marketplaces, Big Data, Storytelling, Nonconscious Measurement, & Attribution Analytics
- Projected Research Spending/Budgets
- Use of non-traditional data sources for insight generation
- Trends Impacting Corporate Researchers: Organizational fit, impact, insourcing vs. outsourcing, internal innovation
- Supplier Satisfaction levels and drivers of satisfaction
- Hiring trends
- Training resources
- Information sources used by the industry
- Financial outlook for 2017
- Client side spend and average projects per year
Per our tradition, we’ll be doing some “sneak peeks” of certain sections prior to the publication, and we’re beginning today with the perennial favorite of our tracking of adoption of emerging methods, which industry Guru Ray Poynter always writes in the report.
Enjoy and Happy Holidays!
By Ray Poynter
In looking at what research approaches/methods are in use or under consideration, it is important to remember that the GRIT sample is not a representative sample of the market research population. The GRIT sample tends to be drawn from those more engaged with the future of research, so the ‘in use’ figures will tend to be higher than for the wider MR population. The GRIT report’s key usefulness lies in the relativities between the approaches, the trends over time, and the differences between key groups (such as the buyers and sellers of research and insight).
Table 1 shows the 21 approaches included in the GRIT study ranked in terms of how many people said they were already using these techniques. Remember, using a technique does not necessarily means using it heavily, it may mean it has gone from consideration to occasionally ‘In use’.
|Rank||Labels||In Use||Under Consideration||Total Interest|
|Wide Adoption||3||Social Media Analytics||52%||24%||76%|
|7||Big Data Analytics||38%||31%||69%|
|11||Behavioral Economics Models||29%||25%||54%|
|17||Virtual Environments/Virtual Reality||14%||24%||38%|
|18||Internet of Things||14%||26%||39%|
|21||Wearables Based Research||10%||27%||37%|
Table 1 – Base = 1580
The results can be broadly divided into three categories:
- The Mainstream Group. Mobile Surveys (75% ‘In Use’, 16% ‘Under Consideration’, making a ‘Total Interest’ score of 91%) and Online Communities (59% ‘In Use’, ‘Total Interest’ 82%) are mainstream and well ahead of all other ‘new’ research approaches.
- The second group runs from Social Media Analytics (52% ‘In Use’, ‘Total Interest’ 76% – which makes it almost mainstream) down to Behavioral Economics (29% ‘In Use’, ‘Total Interest’ 54%). These techniques are in wide adoption, but no single approach from this group can be considered essential. However, having some of them in your toolbox is likely to be necessary for most organizations.
- The bottom group runs from Research Gamification, which is just below the second group (25% ‘In Use’, ‘Total Interest’ 53%) down to approaches with very low scores, such as Wearables (10% ‘In Use’, ‘Total Interest’ 37%). This group tends to be a mixture of the very specialized and those approaches that have not yet broken through in terms of usage.
Table 2 shows the ‘In Use’ data for the last five waves, dating back to August 2014, a period of just over two years. The data shows that there are changes, but few of them are large. Given the nature of the data, sampling variation etc, we suggest that you ignore anything smaller than plus or minus 5%.
|Table 2||2014 Aug||2015 Feb||2015 Oct||2016 Feb||2016 Nov||Change|
|Social Media Analytics||46%||44%||43%||48%||52%||5%|
|Big Data Analytics||32%||32%||34%||39%||38%||6%|
|Behavioral Economics Models||25%||27%||21%||31%||29%||3%|
|Internet of Things||12%||11%||9%||14%||14%||1%|
|Wearables Based Research||7%||7%||8%||12%||10%||3%|
The two approaches that show the largest movement, +11% and +10%, are Mobile Surveys and Micro-Surveys – both of which tend to fit well with the trend towards agile research that has been a feature of many blog posts and conference presentations over the last two years.
Many people will be disappointed and/or surprised to see the scores for Social Media Analytics and Virtual Reality have not risen by more over the last five waves. At the bottom of the table, techniques such as VR and biometrics seem to be trapped in the bottom part of the table. We suspect this is due to the current scalability limits (and hence cost implications) of these approaches, and like others that have seen growth when scale is achieved with concomitant cost reductions, more growth will occur.
We also checked the open-ended suggestions for emerging techniques that were not part of the existing survey, and this process generated four suggestions. Three of the techniques were Automated Research, Geolocation, and Artificial Intelligence. The fourth suggestion was Implicit Research, something which could be seen as a sub-category of Neuro, but seems to be emerging in its own right. In future editions of GRIT we will monitor those emerging methods more closely as well.
There are a couple of good reasons why Suppliers might say they are using more research techniques than research Buyers/Users:
- Suppliers typically work with many companies, and may use a different range of techniques with different clients. Of course, it is also true that large clients use many researcher suppliers.
- Suppliers need to know all of the details of the research they are providing, such as whether Research Gamification was used in the design and what proportion of the surveys are completed via mobile device. A research buyer may want to know this too, but in many cases the buyer of the research is less interested in these details.
Table 3 shows the ‘In Use’ data for Buyers and Suppliers of market research, and the right-hand column contrasts the results.
|Table 3||Buyer %||Supplier %||Seller – Buyer|
|Social Media Analytics||64%||49%||-15%|
|Big Data Analytics||47%||35%||-11%|
|Behavioral Economics Models||24%||30%||6%|
|Internet of Things||16%||13%||-4%|
|Wearables Based Research||8%||11%||2%|
The pattern of techniques and approaches in use is similar between Buyers and Sellers (not surprisingly) with an r-squared value of 82%. However, there are some interesting differences.
In several of the technical areas of research the percentage of suppliers using them is considerably higher than the buyers, for example: Webcam Interviews (46% Sellers, 31% Buyers), Mobile Qual (45% Sellers, 31% Buyers), Mobile Surveys (77% Sellers, 65% Buyers), Research Gamification (27% Sellers, 17% Buyers), and Mobile Ethnography (35% Sellers, 26% Buyers).
However, the more interesting cases are those where the Buyers are more likely to be using an approach than the Suppliers. The two key ones being: Social Media Analytics (Buyers 64%, Suppliers 49%) and Big Data Analytics (Buyers 47%, Suppliers 35%). This finding is consistent with earlier waves of GRIT and we believe it indicates that for these two services many clients are buying from non-MR suppliers – which is consistent with the findings from some of the other findings from this wave of the GRIT study.
There are some interesting differences by Region, and if you have a chance to dive into the data you will find some interesting differences by country too. However, the main message is that the advanced market research world is essentially a similar place – comparing North America to the other three groupings gives an r-squared of 85% or higher for each region.
Table 4 shows the data for North America, Europe, APAC, and Other – regions that have been determined by sample size and geography.
|Table 4||North America||Europe||APAC||Other|
|Social Media Analytics||53%||52%||44%||55%|
|Big Data Analytics||43%||33%||30%||34%|
|Behavioral Economics Models||26%||35%||31%||20%|
|Virtual Environments/Virtual Reality||16%||14%||7%||8%|
|Internet Of Things Data||13%||11%||15%||19%|
|Wearables Based Research||10%||10%||10%||14%|
The top two items, Mobile Surveys and Online Communities are the same in each region, but after that there are a range of variations. In terms of the number of approaches being used, the averages are higher in Europe and North America (33% and 31%) and lower in APAC and Other (28% for both).
The two main messages are A) over the last couple of years things have been relatively stable, and B) that the advanced research world is pretty similar globally (yes you can find differences, but the overall pattern is similarity).
The stability message is of particular interest to those championing the exciting approaches that have yet to take off, for example Biometrics, Wearables, Virtual Reality, and Neuromarketing. When and if we see these techniques becoming more mainstream, we will see them moving up the GRIT league table – but there is no sign of that yet.
If you are running a middle-sized organization then the data suggest that unless you are an outlier, you should be using Mobile Surveys and Online Communities, some of the techniques in the middle group, and perhaps one of the emergent techniques in the bottom group.
The main worry for market research providers is the suggestion from the data that many research buyers are turning to non-market research sources for their Text Analytics and Social Media Analytics – something the GRIT report has been showing for some time now.