Radical probabilism

Radical probabilism is a doctrine in philosophy, in particular epistemology, and probability theory that holds that no facts are known for certain. That view holds profound implications for statistical inference. The philosophy is particularly associated with Richard Jeffrey who wittily characterised it with the dictum "It's probabilities all the way down."

Background

Main article: Bayesian probability

In frequentist statistics, Bayes' theorem provides a useful rule for updating a probability when new frequency data becomes available. In Bayesian statistics, the theorem itself plays a more limited role. Bayes' theorem connects probabilities that are held simultaneously. It does not tell the learner how to update probabilities when new evidence becomes available over time. This subtlety was first pointed out in terms by Ian Hacking in 1967.[1]

However, adopting Bayes' theorem is a temptation. Suppose that a learner forms probabilities P_old(A & B) = p and P_old(B) = q. If the learner subsequently learns that B is true, nothing in the axioms of probability or the results derived therefrom tells him how to behave. He might be tempted to adopt Bayes' theorem by analogy and set his P_new(A) = P_old(A | B) = p/q.

In fact, that step, Bayes' rule of updating, can be justified, as necessary and sufficient, through a dynamic Dutch book argument that is additional to the arguments used to justify the probability axioms. This argument was first put forward by David Lewis in the 1970s though he never published it.[2] The dynamic Dutch book argument for Bayesian updating has been criticised by Hacking,[3] H. Kyburg,[4] D. Christensen[5] and P. Maher.[6][7] It was defended by Brian Skyrms.[8]

Certain and uncertain knowledge

That works when the new data is certain. C. I. Lewis had argued that "If anything is to be probable then something must be certain".[9] There must, on Lewis' account, be some certain facts on which probabilities were conditioned. However, the principle known as Cromwell's rule declares that nothing, apart from a logical law, if that, can ever be known for certain. Jeffrey famously rejected Lewis' dictum.[10] He later quipped, "It's probabilities all the way down," a reference to the "turtles all the way down" metaphor for the infinite regress problem. He called this position radical probabilism.[11]

Conditioning on an uncertainty – probability kinematics

In this case Bayes' rule isn't able to capture a mere subjective change in the probability of some critical fact. The new evidence may not have been anticipated or even be capable of being articulated after the event. It seems reasonable, as a starting position, to adopt the law of total probability and extend it to updating in much the same way as was Bayes' theorem.[12]

P_new(A) = P_old(A | B)P_new(B) + P_old(A | not-B)P_new(not-B)

Adopting such a rule is sufficient to avoid a Dutch book but not necessary.[13] Jeffrey advocated this as a rule of updating under radical probabilism and called it probability kinematics. Others have named it Jeffrey conditioning.

Alternatives to probability kinematics

Probability kinetics is not the only sufficient updating rule for radical probabilism. Others have been advocated including E. T. Jaynes' maximum entropy principle, and Skyrms' principle of reflection. It turns out that probability kinematics is a special case of maximum entropy inference. However, maximum entropy is not a generalisation of all such sufficient updating rules.[14]

Selected bibliography

• Jeffrey, R (1990) The Logic of Decision. 2nd ed. University of Chicago Press. ISBN 0-226-39582-0
• — (1992) Probability and the Art of Judgment. Cambridge University Press. ISBN 0-521-39770-7
• — (2004) Subjective Probability: The Real Thing. Cambridge University Press. ISBN 0-521-53668-5
• Skyrms, B (2012) From Zeno to Arbitrage: Essays on Quantity, Coherence & Induction. Oxford University Press (Features most of the papers cited below.)

References

1. Hacking, Ian (1967). "Slightly more realistic personal probability". Philosophy of Science. 34 (4): 311–325. doi:10.1086/288169.
2. Skyrms, Brian (1987a). "Dynamic coherence and probability kinematics". Philosophy of Science. 54: 1–20. doi:10.1086/289350.
3. Op. cit.
4. Kyburg, H. (1978). "Subjective probability: Criticisms, reflections and problems". Journal of Philosophical Logic. 7: 157–180. doi:10.1007/bf00245926.
5. Christensen, D (1991). "Clever bookies and coherent beliefs". Philosophical Review. 100 (2): 229–47. doi:10.2307/2185301. JSTOR 2185301.
6. Maher, P (1992a). Betting on Theories. Cambridge: Cambridge University Press.
7. — (1992b). "Diachronic rationality". Philosophy of Science. 59: 120–41. doi:10.1086/289657.CS1 maint: extra punctuation (link)
8. Op. cit.
9. Lewis, C. I. (1946). An Analysis of Knowledge and Valuation. La Salle, Illinois: Open Court. p. 186.
10. Jeffrey, Richard C. (2004). "Chapter 3". Subjective Probability: The Real Thing. Cambridge: Cambridge University Press.
11. Skyrms, B (1996). "The structure of radical probabilism". Erkenntnis. 35: 439–60.
12. Jeffrey, Richard (1987). "Alias Smith and Jones: The testimony of the senses". Erkenntnis. 26 (3): 391–399. doi:10.1007/bf00167725.
13. Skyrms (1987a)
14. Skyrms, B (1987b). "Updating, supposing and MAXENT". Theory and Decision. 22 (3): 225–46. doi:10.1007/bf00134086.

External links

• Stanford Encyclopedia of Philosophy entry on