Superforecaster

A Superforecaster is a person who makes forecasts that prove to be consistently more accurate than those made by others. Superforecasters use modern analytical and statistical methodologies augment the art of forecasting events with claims they are typically more accurate than experts in the field who do not use those techniques.[1]

Etymology

The term is a combination of the words super meaning "above average" and forecaster meaning one who suggests an outcome that might occur in the future.

History

Origins of the term are attributed to Philip E. Tetlock with results from The Good Judgment Project and subsequent book with Dan Gardner Superforecasting: The Art and Science of Prediction.[2]

In December 2019 a Central Intelligence Agency analyst writing under the pseudonym "Bobby W." suggested the Intelligence community should study superforecaster research on how certain individuals with "particular traits" are better forecasters and how they chould be leveraged.[3]

In February Dominic Cummings appeared to imply study of superforecasting was more effective than listening to political pundits.[4]

Superforecasters

Science

Superforecasters are understood to estimate a probability of an occurrence and review the estimate when circumstances contributing to the estimate change, with particular care to eliminate personal opinions and incorporating input from other superforecasters.[5] In The Good Judgment Project one set of forecasters were given training on how to translate their understandings into a probabilistic forecast, summarised into an acronym "CHAMP" for Comparisons, Historical trends, Average opinions, Mathematical models, and Predictable biases.[6]

Effectiveness

As part of The Good Judgment Project one group was given training in the "CHAMP" methodology and it was claimed this increased forecasting accuracy.[6] During the Superforecasters appear to have varying degrees of success: Bloomberg noting a poor prediction of 23% for a leave vote in the month of the June 2016 Brexit referendum; while the BBC notes collectively Superforecasters may have accurately predicted Donald Trump's success in 2016 primaries.[7] Aid agencies are using superforecasting to determine to the probability of droughts becoming famines.[1]

Traits

One of Tetlock's findings from The Good Judgment Project was that superforecasters personality traits rather than specialised knowledge allowed them to predict the outcome of various world events typically more accurately than intelligence agencies.[8]

People
  • Elaine Rich, a "certified" superforecaster who participated in the Good Judgement Project.[9]
  • Andrew Sabisky, a self proclaimed superforecaster, resigned from his position as advisor to the United Kingdom government at Downing Street, with chief advisor Dominic Cummings telling journalists "read Philip Tetlock's Superforecasters, instead of political pundits who don't know what they're talking about".[4]
gollark: That is wrong on so many levels.
gollark: In general, if there is no/very weak evidence for a thing not existing, the right response is "well, it probably doesn't exist, although if new evidence comes to light we can revise that", not "but maaaaaaaaaaaybe".
gollark: Given certain axioms, not on their own.
gollark: Intertemporal meme piracy is a big industry.
gollark: Really, basically all countries have laws which are far too complicated. People should *not* be bound by laws they cannot humanly read and comprehend.

References
  1. Adonis (2020).
  2. Tetlock & Gardner (2015).
  3. Bobby W. (2019), p. 14.
  4. BBC News (2020).
  5. BBC News (2020), What is the science behind it?.
  6. Harford (2014), How to be a superforecaster.
  7. BBC News (2020), How successful is it?.
  8. Burton (2015).
  9. Nilaya (2015), Guests.
  • Adonis, Andrew (20 February 2020). "In praise of (some) superforecasters". The New European. Archived from the original on 20 February 2020. Retrieved 20 February 2020.CS1 maint: ref=harv (link)
  • BBC News (18 February 2020). "Andrew Sabisky: What is superforecasting?". BBC News. Archived from the original on 18 February 2020. Retrieved 18 February 2020.CS1 maint: ref=harv (link)
  • Bobby W. (December 2019). "The Limits of Prediction—or, How I Learned to Stop Worrying About Black Swans and Love Analysis" (PDF). Studies in Intelligence. 63 (4). Archived (PDF) from the original on 19 February 2020.CS1 maint: ref=harv (link)
  • Burton, Tara Isabella (20 January 2015). "Could you be a 'super-forecaster'?". BBC. Archived from the original on 19 February 2020. Retrieved 19 February 2020.CS1 maint: ref=harv (link)
  • Harford, Tim (5 September 2014). "How to see into the future". Financial Times Magazine. FT Group. Archived from the original on 23 September 2019. Retrieved 18 February 2020.CS1 maint: ref=harv (link)
  • Nilaya, Josh (29 September 2015). "U.S. Intelligence Dabbles in Forecasting the Future". Connecticut Public Radio Home. Archived from the original on 11 January 2019. Retrieved 21 February 2020.CS1 maint: ref=harv (link)

Further reading
  • Tetlock, Philip E.; Gardner, Dan (2015). Superforecasting : the art and science of prediction. New York: Crown Publishers. ISBN 9780804136693. OCLC 898909721. OL 18233878W.CS1 maint: ref=harv (link)
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.