Response bias

Response bias is the name of a group of cognitive biases which commonly influence the results of surveys, questionnaires, interviews, and polls. Like statistics, it's a great way to lie while still being honest, although honest mistakes are also common.

Tell me about
your mother
Psychology
For our next session...
  • Cognitive biases
  • Mental health
  • Superstition
  • Famed psychologists
Popping into your mind
v - t - e

Types

Acquiescence bias

Acquiescence bias is the tendency for people to respond positively ("yeah, sure") to survey questions when in doubt.

For example, 55% of respondents agree and 42% disagree with the statement, "The best way to ensure peace is through military strength", but when given the choice between the former and "Diplomacy is the best way to ensure peace" only 33% agree with the first statement, and 55% percent agree with the second.[1]

The Pew Research Center recommends that it is better practice to offer respondents a choice between alternative statements, than to simply ask whether they agree with something.[1]

Social desirability bias

Respondents eschew answers that are considered socially undesirable. This is especially common on topics such as drugs, immigration, personal finances, health, religion, sex, and personal achievements.

Some examples:

  • About 15% of US males report visiting a prostitute at least once in their life, but other surveys also show that men report a lot more sexual partners than women do, so something doesn't add up here. Once you account for the prostitution, the numbers do seem to add up though, and you end up with about 23% of males who've paid for sex.[2]
  • Responses will differ on topics such as feminism or sex depending on the gender of the researcher (especially when the participant is male).

Demand characteristics

This is the tendency of participants to (subconsciously) fit their behaviour to what is perceived to be the expected or desired behaviour.

Some examples:

  • Rape myths were more accepted when the researcher was dressed conservatively than when the researcher was dressed provocatively.[3]
  • When informed that the survey's interest was menstrual cycle symptoms, women reported significantly more negative symptoms than women who were not told the survey's interest.[4]

Extreme responding

The tendency to only select the most extreme responses in a survey where one is expected to choose from a scale (eg. to choose "Strongly agree" over "somewhat agree").

gollark: It says "up to 492Kbps" downlinks on "high-end terminals" as a "best effort" on that BGAN thing...
gollark: The actual IPoAC standard requires duct-taping paper to the pigeon, I think, but if you use the nonstandard method of having them, say, carry micro-SD cards, you get better bandwidth.
gollark: IP over Avian Carriers!
gollark: `I can'tonly option.`
gollark: DDR3 what? ECC or not?

References
  1. http://www.pewresearch.org/methodology/u-s-survey-research/questionnaire-design/
  2. Prostitution and the sex discrepancy in reported number of sexual partners
  3. Paradoxical Effect of Surveyor's Conservative versus Provocative Clothing on Rape Myth Acceptance of Males and Females
  4. http://sociologyindex.com/demand_characteristic.htm
This article is issued from Rationalwiki. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.