Research Methodologies

June 20, 2017

Behavioral Economics: Measuring Social Desirability

A quick look at a method to measure Social Desirability without the ‘self-selection’ error.

Behavioral Economics: Measuring Social Desirability
Michael Lieberman

by Michael Lieberman

Founder & President at Multivariate Solutions

0

A common finding in almost every Behavioral Economics experiment that respondents believe that they are ‘above average’. Self-description is rarely objective. In this piece we are going to take a quick look at a method to measure a certain trait, Social Desirability, without the ‘self-selection’ error.

When we ask people (employees, customers, or any other kind of respondent) for their opinions, one of the key points in ensuring reliable answers is an objective question. Having an objective question includes the words within the question itself, but also the environment in which it is asked, and who is doing the asking. The whole point is to make sure that when a question is asked, there is not an answer that seems “better” than another.

The reason that this is so important is that people have the tendency to answer questions in way that allows for a more positive self-reflection. . This tendency exists between people, but more importantly it varies between the situations that people are in when asked the question. This is the reason researchers insist on how and where questions are asked.

This tendency, referred to as Social Desirability, does not mean respondents are necessarily going to be untruthful. It does mean that you may only be hearing about what their overly positive self-reflection more than an assessment of how your respondents actually behave.

This is not necessarily new information when you consider that most respondents will tell you brand name is not important, and that each purchase decision is a careful calculation of value.

There are a great number of tools that are used to get around this issue but I thought it would be fun to share how this tendency is actually measured.

Social Desirability Tendency

If you are interested in seeing where you fall, take the 20 question quiz below BEFORE reading the scoring key. This is a test that is used by Psychologists when studying behavior and has been in use for a little over twenty years.

For what it’s worth, I’m not sure I would recommend giving this quiz to customers as a way to assess their answers.

Social Desirability Quiz

Indicate the extent to which you agree with each of the following statements. Use a 7-point scale to indicate your response, with 1 = “Not True” and 7 = “Very True”.

1) I sometimes tell lies if I have to

2) I never cover up my mistakes

3) There have been occasions when I have taken advantage of someone

4) I never swear

5) I sometimes try to get even rather than forgive and forget

6) I always obey laws, even if I’m unlikely to get caught

7) I have said something bad about a friend behind his or her back

8) When I hear people talking privately, I avoid listening

9) I have received too much change from a salesperson without telling him or her

10) I always declare everything at customs

11) When I was young, I sometimes stole things

12) I have never dropped litter on the street

13) I sometimes drive faster than the speed limit

14) I never read sexy books or magazines

15) I have done things that I don’t tell other people about

16) I never take things that don’t belong to me

17) I have taken sick-leave from work or school even though I wasn’t really sick

18) I have never damaged a library book or store merchandise without reporting it

19) I have some pretty awful habits

20) I don’t gossip about other people’s business

Scoring key: Give yourself one point for each 1 or 2 response to odd-numbered items and one point for each 6 or 7 response to even-numbered items.

The test developers found a mean score or 4.9 and a standard deviation of 3.2 for female college students and a mean score of 4.3 and a standard deviation of 3.1 for male college students. Those who score higher are more likely to present themselves in a more positive light.

Source: Lockard, J.S. and D.L. Paulhus (Ed.). Self-Deception: An Adaptive Mechanism. Prentice-Hall, 1988.

Interpretation

It is important to understand that people who are more prone to present themselves more favorably than others are typically unaware that they are doing so. If we look at the different items on this test, few of us can say that we have absolutely have never tried to cover up a mistake. However, somebody who rates high on Social Desirability may be more inclined to exaggerate the truth and indicate that this point is true for him or her.

Now, if we did actually know which of our respondents rated high for this tendency we may be able to adjust our interpretation of the results; but honestly it would likely be a challenge to get this information in most, if not all, of our studies. What is more useful though is to understand that this tendency exists and that we should know that it is a matter of to what extent respondents are prone to it, not if.

So when we ask a question such as, “To what extent do you make a purchase on impulse?”, a low score could reflect a desire for the respondent to present themselves in a rational light just as much as it could reflect behavior. As a result it is more difficult to interpret the results to this question than it would be for a question such as “How often do you make purchases that are only on your shopping list?”

In marketing research, perceptual validity of questions has been the subject of many discussions. There are certain methodologies to correct for Social Desirability (e.g. division by the standard deviation). However, the issue of Social Desirability, and data validity as a whole, remains on the front burner of branding image and product research and likely will be as long as research relies on Q&A.

0

behavioral economicsbrand researchcareer

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

Comments

More from Michael Lieberman

Deductive Reasoning and Effective Marketing Research

Research Methodologies

Deductive Reasoning and Effective Marketing Research

Learn about deductive reasoning, a logical process of drawing conclusions from premises. Statistics can support this process when data analysis and ev...

Michael Lieberman

Michael Lieberman

Founder & President at Multivariate Solutions

The Misrepresentation of Statistical Accuracy – Unethical, but Fraud?

Research Methodologies

The Misrepresentation of Statistical Accuracy – Unethical, but Fraud?

When does misrepresentation of statistical outcomes turn into fraud?

Michael Lieberman

Michael Lieberman

Founder & President at Multivariate Solutions

Making the Journey – From Marketing Based Analytics to HR

Competitive Intelligence

Making the Journey – From Marketing Based Analytics to HR

Why HR and analytics are the perfect pair.

Michael Lieberman

Michael Lieberman

Founder & President at Multivariate Solutions

Applied Behavioral Economics

Research Methodologies

Applied Behavioral Economics

Examples of behavioral economics in action.

Michael Lieberman

Michael Lieberman

Founder & President at Multivariate Solutions

ARTICLES

Moving Away from a Narcissistic Market Research Model

Research Methodologies

Moving Away from a Narcissistic Market Research Model

Why are we still measuring brand loyalty? It isn’t something that naturally comes up with consumers, who rarely think about brand first, if at all. Ma...

Devora Rogers

Devora Rogers

Chief Strategy Officer at Alter Agents

The Stepping Stones of Innovation: Navigating Failure and Empathy with Carol Fitzgerald
Natalie Pusch

Natalie Pusch

Senior Content Producer at Greenbook

Sign Up for
Updates

Get what matters, straight to your inbox.
Curated by top Insight Market experts.

67k+ subscribers

Weekly Newsletter

Greenbook Podcast

Webinars

Event Updates

I agree to receive emails with insights-related content from Greenbook. I understand that I can manage my email preferences or unsubscribe at any time and that Greenbook protects my privacy under the General Data Protection Regulation.*