Participation bias

Participation bias or non-response bias is a phenomenon in which the results of elections, studies, polls, etc. become non-representative because the participants disproportionately possess certain traits which affect the outcome. These traits mean the sample is systematically different from the target population, potentially resulting in biased estimates.[1]

For instance, a study found that those who refused to answer a survey on AIDS tended to be "older, attend church more often, are less likely to believe in the confidentiality of surveys, and have lower sexual self disclosure."[2] It may occur due to several factors as outlined in Deming (1990).[3]

Non-response bias can be a problem in longitudinal research due to attrition during the study.[4]

Example

If one selects a sample of 1000 managers in a field and polls them about their workload, the managers with a high workload may not answer the survey because they do not have enough time to answer it, and/or those with a low workload may decline to respond for fear that their supervisors or colleagues will perceive them as surplus employees (either immediately, if the survey is non-anonymous, or in the future, should their anonymity be compromised). Therefore, non-response bias may make the measured value for the workload too low, too high, or, if the effects of the above biases happen to offset each other, "right for the wrong reasons." For a simple example of this effect, consider a survey that includes, "Agree or disagree: I have enough time in my day to complete a survey."

In the 1936 U.S. presidential election, The Literary Digest mailed out 10 million questionnaires, of which 2.4 million were returned. Based on these, they predicted that Republican Alf Landon would win with 370 of 531 electoral votes, whereas he only got eight. Research published in 1976 and 1988 concluded that non-response bias was the primary source of this error, although their sampling frame was also quite different from the vast majority of voters.[1] Non responders have been shown to be associated with younger patients, poorer communities and those who are less satisfied and subsequently could be a source of bias by a study published by Imam et al. in 2014.

Test

There are different ways to test for non-response bias. A common technique involves comparing the first and fourth quartiles of responses for differences in demographics and key constructs.[5] In e-mail surveys some values are already known from all potential participants (e.g. age, branch of the firm, ...) and can be compared to the values that prevail in the subgroup of those who answered. If there is no significant difference this is an indicator that there might be no non-response bias.

In e-mail surveys those who didn't answer can also systematically be phoned and a small number of survey questions can be asked. If their answers don't differ significantly from those who answered the survey, there might be no non-response bias. This technique is sometimes called non-response follow-up.

Generally speaking, the lower the response rate, the greater the likelihood of a non-response bias in play.

  • Self-selection bias is a type of bias in which individuals voluntarily select themselves into a group, thereby potentially biasing the response of that group.
  • Response bias is not the opposite of non-response bias, but instead relates to a possible tendency of respondents to give inaccurate or untruthful answers for various reasons.
gollark: There are eSIM thingies.
gollark: Yes, you need SIM cards to connect to the phone network, or virtual ones, the whole system is insane, aaaaa.
gollark: Not always, as far as I know, though that may be a software issue.
gollark: Hmm, really? Good to know. Still has the other issues, mind you.
gollark: Also, it is hard to make GNU/Linux run on them.

See also

References
  1. Fowler, Floyd (2009). Survey Research Methods (4th ed.) - SAGE Research Methods. doi:10.4135/9781452230184. ISBN 9781412958417.
  2. "Participation Bias in AIDS-Related Telephone Surveys: Results From the National AIDS Behavioral Survey (NABS) Non-Response Study".
  3. Deming, W. Edwards. Sample design in business research. Vol. 23. John Wiley & Sons, 1990.
  4. Ann, Bowling (2014-07-01). Research methods in health : Investigating health and health services. Milton Keynes. ISBN 9780335262755. OCLC 887254158.
  5. Armstrong, J.S.; Overton, T. (1977). "Estimating Nonresponse Bias in Mail Surveys". Journal of Marketing Research. 14 (3): 396–402. CiteSeerX 10.1.1.36.7783. doi:10.2307/3150783. JSTOR 3150783.

Further reading
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.