When contact changes minds

"When contact changes minds: An experiment on transmission of support for gay equality" is a fraudulent article by then-UCLA political science graduate student Michael LaCour and Columbia University political science professor Donald Green. The article was published in the academic journal Science in December 2014, and retracted in May 2015 after it emerged that the data in the study had been forged by LaCour.[1] The article purported to demonstrate that people's minds on the issue of gay marriage could be changed by conversations with gay canvassers, but not with straight canvassers.

Study

The authors claimed to have investigated whether gay or straight messengers were effective at encouraging voters to support same-sex marriage and whether attitude change persisted and spread to others in voters’ social networks. The purported results, measured by an unrelated panel survey, show that both gay and straight canvassers produced large effects initially, but only gay canvassers’ effects persisted in 3-week, 6-week, and 9-month follow-ups. LaCour and Green (2014) also found strong evidence of within-household transmission of opinion change, but only in the wake of conversations with gay canvassers.[2]

The article has been downloaded over 111,000 times and ranks in the top 5% of all research output, as scored using Altmetrics.[3]

The purported findings made international headlines and received wide media attention including in The New York Times,[4] The Washington Post,[5] The Wall Street Journal,[6] The Economist, The Los Angeles Times, and on This American Life.[7] The study attracted widespread attention, in part because it seemed to challenge the conventional understanding of social persuasion that people tend not to change their point of view even when presented with contrasting information.[8]

The Yes Campaign in Ireland stated that LaCour and Green (2014) “provided a template" for campaigners to use one-to-one contact and first person accounts to reach out to more conservative voters, leading to the historic Irish referendum legalizing gay marriage on May 22, 2015.[9]

Falsified data

The "When contact changes minds" study was discredited after a critique by David Broockman, Joshua Kalla, and Peter Aronow on May 19, 2015, titled "Irregularities in LaCour (2014)",[10] concluded that the data had been falsified and no data had been collected. Broockman et al. found that the survey company LaCour claimed to have used denied performing any work for LaCour and did not have an employee by the name LaCour listed as his contact with the company.[10] In addition, LaCour had claimed that participants were paid using outside funding, but no organization could be found that had provided the amount of money required to pay thousands of people.

The "Irregularities" paper also identified the likely method by which LaCour had forged the data. The baseline survey results appeared to have been taken from an earlier dataset called the Cooperative Campaign Analysis Project (CCAP), to which LaCour had access. The later sets of data appeared to have been simulated from the first using statistical methods to shift the results and by adding normally distributed noise.[10][11] In addition, the paper noted that canvasser identifiers were missing from the results, making it impossible to verify whether different canvassers produced different results as the original study claimed.

Additional evidence of the study's fictitiousness later emerged, such as evidence that LaCour had tried to retroactively claim that the study had been pre-registered using falsified documents.[12]

LaCour's coauthor, Donald Green, subsequently requested that the paper be retracted because of “irregularities” in the paper's data and LaCour's failure to give him the raw data on which the paper was based.[13] Yet Green, as senior author on the Science paper, certified that he had examined the raw/original data on his Science/AAAS Authorship Form and Statement of Conflicts of Interest.[14] The Science terms include, prominently, the following statement: “The senior author from each group is required to have examined the raw data their group has produced.”[15]

In his letter to the journal, Green wrote: "I am deeply embarrassed by this turn of events and apologize to the editors, reviewers, and readers of Science."[16] Andrew Gelman, a professor of statistics and political science at Columbia University, wrote in the Washington Post that Donald Green had accepted LaCour's data "on faith".[1] On May 28, 2015, the study was retracted by Science,[17] on the basis that incentives to participate in the survey on which the study was based had been misrepresented, that sponsors had been falsely identified, that the authors could not produce the original data, and (citing the findings of Broockman et al.) that there were "statistical irregularities."[18]

On May 29, 2015, LaCour uploaded a response to the criticisms.[19] LaCour admitted to some false statements and apologized for "misrepresenting survey incentives and funding," but denied intentionally falsifying the data itself (though he stated that he could not rule out the possibility that he had "mistakenly mixed up" hypothetical data with collected data). He disputed the timeline of events presented in Broockman et al. (2015). He argued that the failure of Broockman et al. to replicate LaCour and Green (2014) was likely the result of a failure to follow the respondent-driven sampling procedure used in LaCour and Green (2014). He stated that Broockman et al. had selected the "incorrect variable" from CCAP (2012) and then manipulated that variable to make the distribution look more like that in LaCour and Green (2014). LaCour claimed that when the "correct" variable is used, the distributions between the CCAP thermometer and the LaCour and Green (2014) thermometer are statistically distinguishable. LaCour said, "selecting the incorrect variable may have been an oversight, but further manipulating that variable to make the distribution look more like LaCour and Green (2014) is a curious and possibly intentional 'error.'" LaCour also claimed that an independent replication supported the main finding reported in LaCour and Green (2014).

In the New York Times article, LaCour said the study erred in methods, not results.[20] A subsequent article published by Science indicated that LaCour's response was lacking, failing to address a number of issues while raising new questions about his conduct.[21] A blog post published by Discover stated that LaCour's rebuttal arguments were "very weak" and failed to refute a central criticism of the Broockman paper.[22]

After the retraction, the Carnegie Corporation of New York rescinded Donald Green's 2015 Andrew Carnegie Fellowship, revoking a $200,000 award to support Donald Green's research,[23] and Princeton University rescinded an assistant professorship that had been offered to LaCour.[24]

The journal Science retracted the article with the concurrence of Green while LaCour did not agree to the retraction.[18]

While Green, David Broockman, and Joshua Kalla conducted numerous interviews with reporters outlining their version of events, LaCour refrained from talking to the media with the exception of a single interview with The New York Times.[25] Various opinions were advanced in the popular media regarding the implications of the scandal and the motivations of the parties involved.[26][27][28][29]

The editorial page of The Wall Street Journal speculated that LaCour's argument originally gained acceptance in the scientific community because it "flattered the ideological sensibilities of liberals, who tend to believe that resistance to gay marriage can only be the artifact of ignorance or prejudice, not moral or religious conviction. Mr. LaCour's findings let them claim that science had proved them right." The Journal editorial further argued that the paper and its acceptance reflected a broader phenomenon in the social sciences in which liberals, according to the editorial, "recast stubborn political debates about philosophy and values as disputes over facts that can be resolved by science".[26] New York Magazine columnist Jesse Singal dismissed the Wall Street Journal editorial, arguing that it was silly and uninformed, and suggested instead that the main reason for the article's publication was its contradiction of prior research.[30] Gelman, referring to LaCour's study, said that the journal Science is sometimes called a tabloid "because of its pattern of publishing dramatic but fishy claims (at least in social science)".[1] He added that one reason LaCour's fabrications were able to go unnoticed for so long was that they were so all-encompassing and thus could not be detected by normal statistical checks.[1] Conservative pro-gay-marriage columnist S.E. Cupp wrote that, "The doctored study will only encourage the perception that advocates are going too far."[29]

As to what motivated LaCour's behavior in the first place, his co-author, Donald Green, has expressed bafflement.[27] New York Magazine points to the pressure that social scientists are under to publish scholarly articles, while stating that "profound pressure to publish certainly can’t explain LaCour’s deception on its own".[28] A New York magazine opinion piece by sociology doctoral candidate Drew Foster argued that the study exposed problems with the culture of political science research and supervision given to junior academics, along with a competitive culture caused by overproduction of PhD students relative to available political science academic positions.[31]

Follow-up study

Following their debunking of When Contact Changes Minds, Broockman and Kalla (2016) conducted an experiment similar to the one purported to have been conducted by LaCour and Green.[32][33] Households in Florida were sent a survey on social attitudes, and were later visited by canvassers to discuss either recycling or transphobia and transgender rights, with the change in the householders' opinions tracked by follow-up surveys. The study found that extended conversations with canvassers did in fact reduce anti-transgender prejudice and were more effective long-term than attack ads.[34] However, contrary to one of LaCour's claims, the identity of the canvasser did not seem to matter; both transgender and non-transgender canvassers had a similar effect.[34]

gollark: "since it's turing complete it's definitely possible"
gollark: Also, fairly sure you can't really.
gollark: Stop Much.
gollark: Stop?
gollark: We need not spread the googulous taint further.

See also

References
Notes
  1. Gelman, Andrew (May 20, 2015). "Fake study on changing attitudes: Sometimes a claim that is too good to be true, isn't". The Washington Post. Retrieved June 7, 2015. Not to spoil the suspense or anything, but what really happened was that the data were faked by first author LaCour. Co-author Green (my colleague at Columbia) had taken his collaborator’s data on faith; once he found out, he firmly retracted the article. Details at Retraction Watch.
  2. LaCour, Michael J.; Green, Donald P. (2014). "When contact changes minds: An experiment on transmission of support for gay equality". Science. 346 (6215): 1366–9. Bibcode:2014Sci...346.1366L. doi:10.1126/science.1256151. PMID 25504721.
  3. Lacour, Michael J.; Green, Donald P. (2014). "When contact changes minds: An experiment on transmission of support for gay equality". Science. 346 (6215): 1366–1369. Bibcode:2014Sci...346.1366L. doi:10.1126/science.1256151.
  4. Carey, Benedict (11 December 2014). "Gay advocates can shift same-sex marriage views". New York Times. Retrieved 31 May 2015.
  5. Somashekhar, Sandhya (11 December 2014). "One conversation can change minds on same-sex marriage, study finds". Post Nation. The Washington Post. Retrieved 31 May 2015.
  6. Sapolsky, Robert M. (25 February 2015). "Gay marriage: How to change minds". Mind and Matter. The Wall Street Journal. Retrieved 31 May 2015.
  7. "The incredible rarity of changing your mind". This American Life. 25 April 2015. Retrieved 31 May 2015.
  8. Barbash, Fred (20 May 2015). "Co-author disavows highly publicized study on public opinion and same-sex marriage". Morning Mix. The Washington Post. Retrieved 2 June 2015.
  9. "Personal route to reach public central to Yes campaign". The Irish Times. 14 May 2015.
  10. Broockman, David, Kalla, Joshua, and Aronow, Peter (19 May 2015). "Irregularities in LaCour (2014)" (PDF). Retrieved 30 May 2015.CS1 maint: multiple names: authors list (link)
  11. "Neuroskeptic blog – The Problem With Michael LaCour's Rebuttal". Discover Magazine. Retrieved 8 April 2016.
  12. Singal, Jesse. "Michael LaCour Probably Fabricated a Document About Research Integrity". Science of Us. NY Magazine. Retrieved 8 April 2016.
  13. Barbash, Fred (May 20, 2015), "Co-author disavows highly publicized study on public opinion and same-sex marriage", Morning Mix, Washington Post
  14. https://www.sciencemag.org/site/feature/contribinfo/prep/coi.pdf
  15. ""If you think it's rude to ask to look at your co-authors' data, you're not doing science": Guest post". Retraction Watch.
  16. Schupak, Amanda (May 29, 2015). "Journal retracts controversial gay marriage study". CBS News. Retrieved June 7, 2015. But after two researchers raised serious questions about a lack of data and funding details outlined in the study, Green wrote to Science asking that it be retracted. "Michael LaCour's failure to produce the raw data coupled with the other concerns noted above undermines the credibility of the findings," he wrote. "I am deeply embarrassed by this turn of events and apologize to the editors, reviewers, and readers of Science.
  17. Carey, Benedict (28 May 2015). "Journal retracts study on changing attitudes on same-sex marriage". New York Times. Retrieved 28 May 2015.
  18. McNutt, M. (28 May 2015). "Editorial retraction". Science. 348 (6239): 1100. Bibcode:2015Sci...348R1100M. doi:10.1126/science.aac6638.
  19. LaCour, Michael (29 May 2015). "Journal retracts response to irregularities in LaCour and Green (2014)" (PDF). Retrieved 30 May 2015.
  20. Carey, Benedict (29 May 2015). "Study using gay canvassers erred in methods, not results, author says". The New York Times. Retrieved 31 May 2015.
  21. Malakoff, David (May 30, 2015). "Gay marriage study author LaCour issues defense, but critics aren't budging". news.sciencemag.org/. Science. Retrieved June 9, 2015. LaCour’s response does not, however, directly answer a number of other questions surrounding the study—and it raises new issues.
  22. Neuroskeptic (June 1, 2015). "The Problem With Michael LaCour's Rebuttal". blogs.discovermagazine.com. Discover. Retrieved June 9, 2015.
  23. "Andrew Carnegie Fellows 2015". Carnegie Corporation of New York.
  24. "U. revokes hire offer after allegations of publishing falsified data". Daily Princetonian. Archived from the original on 2015-07-03. Retrieved 2015-07-08.
  25. Carey, Benedict (2015-05-29). "Study Using Gay Canvassers Erred in Methods, Not Results, Author Says". The New York Times. ISSN 0362-4331. Retrieved 2015-11-19.
  26. "Scientific Fraud and Politics". Wall Street Journal. New York, NY. June 6, 2015.
  27. Gambino, Lauren and Devlin, Hannah. "Study of attitudes to same-sex marriage retracted over 'fake data'", The Guardian (May 20, 2015).
  28. Foster, Drew. "Will Academia Waste the Michael LaCour Scandal?", New York Magazine (June 5, 2015).
  29. Cupp, S.E. "Key to changing hearts and minds on gay marriage: Don’t lie or bully; As a supporter of gay marriage, I can attest that too often other supporters go too far.", Seattle Times (May 25, 2014).
  30. Singal, Jesse. "Is Social Science a Giant Liberal Conspiracy?", New York Magazine (June 8, 2015).
  31. Foster, Drew. "Will Academia Waste the Michael LaCour Scandal?". Science of Us – New York magazine. Retrieved 8 April 2016.
  32. Ed Yong (7 April 2016). "No, Wait, Short Conversations Really Can Reduce Prejudice". The Atlantic. Retrieved 8 April 2016.
  33. Bohannon, John (7 April 2016). "For real this time: Talking to people about gay and transgender issues can change their prejudices". Science. doi:10.1126/science.aaf9890.
  34. Broockman, David; Kalla, Joshua (28 April 2016). "Durably reducing transphobia: A field experiment on door-to-door canvassing". Science. 352 (6282): 220–224. Bibcode:2016Sci...352..220B. doi:10.1126/science.aad9713. PMID 27124458.
Bibliography
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.