Kelly criterion

In probability theory and intertemporal portfolio choice, the Kelly criterion (or Kelly strategy, Kelly bet, ...), also known as the scientific gambling method, is a formula for bet sizing that leads almost surely to higher wealth compared to any other strategy in the long run (i.e. approaching the limit as the number of bets goes to infinity). The Kelly bet size is found by maximizing the expected value of the logarithm of wealth, which is equivalent to maximizing the expected geometric growth rate. The Kelly Criterion is to bet a predetermined fraction of assets, and it can seem counterintuitive.

It was described by J. L. Kelly, Jr, a researcher at Bell Labs, in 1956.[1] The practical use of the formula has been demonstrated.[2][3][4]

For an even money bet, the Kelly criterion computes the wager size percentage by multiplying the percent chance to win by two, then subtracting one. So, for a bet with a 70% chance to win (or 0.7 probability), doubling 0.7 equates 1.4, from which you subtract 1, leaving 0.4 as your optimal wager size: 40% of available funds. [check the Statement for better clarification]

In recent years, Kelly-style analysis has become a part of mainstream investment theory[5] and the claim has been made that well-known successful investors including Warren Buffett[6] and Bill Gross[7] use Kelly methods. William Poundstone wrote an extensive popular account of the history of Kelly betting.[8]


Example

In one study, each participant was given $25 and asked to bet on a coin that would land heads 60% of the time. Participants had 30 minutes to play, so could place about 300 bets, and the prizes were capped at $250. The behavior of the test subjects was far from optimal:

Remarkably, 28% of the participants went bust, and the average payout was just $91. Only 21% of the participants reached the maximum. 18 of the 61 participants bet everything on one toss, while two-thirds gambled on tails at some stage in the experiment.[9][10]

Using the Kelly criterion and based on the odds in the experiment (ignoring the cap of $250 and the finite duration of the test), the right approach would be to bet 20% of one's bankroll on each toss of the coin (see first example below). If losing, the size of the next bet gets cut; if winning, the stake increases. If the bettors had followed this rule (assuming that bets have infinite granularity and there are up to 300 coin tosses per game and that a player who reaches the cap would stop betting after that), an average of 94% of them would have reached the cap, and the average payout would be $237.36.

In this particular game, because of the cap, a strategy of betting only 12% of the pot on each toss would have even better results (a 95% probability of reaching the cap and an average payout of $242.03).

Statement

For simple bets with two outcomes, one involving losing the entire amount bet, and the other involving winning the bet amount multiplied by the payoff odds, the Kelly bet is:

where:

  • is the fraction of the current bankroll to wager; (i.e. how much to bet, expressed in fraction)
  • is the net fractional odds received on the wager; (e.g. betting $10, on win, rewards $4 plus wager; then )
  • is the probability of a win;
  • is the probability of a loss.

As an example, if a gamble has a 60% chance of winning (, ), and the gambler receives 1-to-1 odds on a winning bet (), then the gambler should bet 20% of the bankroll at each opportunity (), in order to maximize the long-run growth rate of the bankroll.

If the gambler has zero edge, i.e. if , then the criterion recommends for the gambler to bet nothing.

If the edge is negative () the formula gives a negative result, indicating that the gambler should take the other side of the bet. For example, in American roulette, the bettor is offered an even money payoff () on red, when there are 18 red numbers and 20 non-red numbers on the wheel (). The Kelly bet is , meaning the gambler should bet one-nineteenth of their bankroll that red will not come up. There is no explicit anti-red bet offered with comparable odds in roulette, so the best a Kelly gambler can do is bet nothing.

The top of the first fraction is the expected net winnings from a $1 bet, since the two outcomes are that you either win $ with probability , or lose the $1 wagered, i.e. win $−1, with probability . Hence:

For even-money bets (i.e. when ), the first formula can be simplified to:

Since , this simplifies further to

A more general problem relevant for investment decisions is the following:

  1. The probability of success is .
  2. If you succeed, the value of your investment increases from to .
  3. If you fail (for which the probability is ) the value of your investment decreases from to . (Note that the previous description above assumes that is 1.)

In this case, as is proved in the next section, the Kelly criterion turns out to be the relatively simple expression

Note that this reduces to the original expression for the special case above () for .

Clearly, in order to decide in favor of investing at least a small amount , you must have

which obviously is nothing more than the fact that the expected profit must exceed the expected loss for the investment to make any sense.

The general result clarifies why leveraging (taking out a loan that requires paying interest in order to raise investment capital) decreases the optimal fraction to be invested, as in that case . Obviously, no matter how large the probability of success, , is, if is sufficiently large, the optimal fraction to invest is zero. Thus, using too much margin is not a good investment strategy when the cost of capital is high, even when the opportunity appears promising.

Proof

Heuristic proofs of the Kelly criterion are straightforward.[11] The Kelly criterion maximizes the expected value of the logarithm of wealth (the expectation value of a function is given by the sum, over all possible outcomes, of the probability of each particular outcome multiplied by the value of the function in the event of that outcome). We start with 1 unit of wealth and bet a fraction of that wealth on an outcome that occurs with probability and offers odds of . The probability of winning is , and in that case the resulting wealth is equal to . The probability of losing is , and in that case the resulting wealth is equal to . Therefore, the expected value for log wealth is given by:

To find the value of for which the expectation value is maximized, denoted as , we differentiate the above expression and set this equal to zero. This gives:

Rearranging this equation to solve for the value of gives the Kelly criterion:

For a rigorous and general proof, see Kelly's original paper[1] or some of the other references listed below. Some corrections have been published.[12]

We give the following non-rigorous argument for the case with (a 50:50 "even money" bet) to show the general idea and provide some insights.[1]

When , a Kelly bettor bets times their initial wealth , as shown above. If they win, they have after one bet. If they lose, they have . Suppose they make bets like this, and win times out of this series of bets. The resulting wealth will be:

Note that the ordering of the wins and losses does not affect the resulting wealth.

Suppose another bettor bets a different amount, for some value of (where may be positive or negative). They will have after a win and after a loss. After the same series of wins and losses as the Kelly bettor, they will have:

Take the derivative of this with respect to and get:

The function is maximized when this derivative is equal to zero, which occurs at:

which implies that

but the proportion of winning bets will eventually converge to:

according to the weak law of large numbers.

So in the long run, final wealth is maximized by setting to zero, which means following the Kelly strategy.

This illustrates that Kelly has both a deterministic and a stochastic component. If one knows K and N and wishes to pick a constant fraction of wealth to bet each time (otherwise one could cheat and, for example, bet zero after the Kth win knowing that the rest of the bets will lose), one will end up with the most money if one bets:

each time. This is true whether is small or large. The "long run" part of Kelly is necessary because K is not known in advance, just that as gets large, will approach . Someone who bets more than Kelly can do better if for a stretch; someone who bets less than Kelly can do better if for a stretch, but in the long run, Kelly always wins.

The heuristic proof for the general case proceeds as follows.

In a single trial, if you invest the fraction of your capital, if your strategy succeeds, your capital at the end of the trial increases by the factor , and, likewise, if the strategy fails, you end up having your capital decreased by the factor . Thus at the end of trials (with successes and failures), the starting capital of $1 yields

Maximizing , and consequently , with respect to leads to the desired result

Edward O. Thorp provided a more detailed discussion of this formula for the general case.[13] There, it can be seen that the substitution of for the ratio of the number of "successes" to the number of trials implies that the number of trials must be very large, since is defined as the limit of this ratio as the number of trials goes to infinity. In brief, betting each time will likely maximize the wealth growth rate only in the case where the number of trials is very large, and and are the same for each trial. In practice, this is a matter of playing the same game over and over, where the probability of winning and the payoff odds are always the same. In the heuristic proof above, successes and failures are highly likely only for very large .

Using Python and SymPy

For a symbolic verification with Python and SymPy one would set the derivative of the expected value of the logarithmic bankroll to 0 and solve for :

>>> from sympy import *
>>> x, b, p = symbols("x b p")
>>> y = p * log(1 + b * x) + (1 - p) * log(1 - x)
>>> solve(diff(y, x), x)
[-(1 - p - b * p) / b]

Bernoulli

In a 1738 article, Daniel Bernoulli suggested that, when one has a choice of bets or investments, one should choose that with the highest geometric mean of outcomes. This is mathematically equivalent to the Kelly criterion, although the motivation is entirely different (Bernoulli wanted to resolve the St. Petersburg paradox).

An English-language translation of the Bernoulli article was not published until 1954,[14] but the work was well-known among mathematicians and economists.

Multiple outcomes

Kelly's criterion may be generalized[15] on gambling on many mutually exclusive outcomes, such as in horse races. Suppose there are several mutually exclusive outcomes. The probability that the -th horse wins the race is , the total amount of bets placed on -th horse is , and

where are the pay-off odds. , is the dividend rate where is the track take or tax, is the revenue rate after deduction of the track take when -th horse wins. The fraction of the bettor's funds to bet on -th horse is . Kelly's criterion for gambling with multiple mutually exclusive outcomes gives an algorithm for finding the optimal set of outcomes on which it is reasonable to bet and it gives explicit formula for finding the optimal fractions of bettor's wealth to be bet on the outcomes included in the optimal set . The algorithm for the optimal set of outcomes consists of four steps.[15]

Step 1: Calculate the expected revenue rate for all possible (or only for several of the most promising) outcomes:
Step 2: Reorder the outcomes so that the new sequence is non-increasing. Thus will be the best bet.
Step 3: Set (the empty set), , . Thus the best bet will be considered first.
Step 4: Repeat:
If then insert -th outcome into the set: , recalculate according to the formula:
and then set ,
Otherwise, set and stop the repetition.

If the optimal set is empty then do not bet at all. If the set of optimal outcomes is not empty, then the optimal fraction to bet on -th outcome may be calculated from this formula:

.

One may prove[15] that

where the right hand-side is the reserve rate. Therefore the requirement may be interpreted[15] as follows: -th outcome is included in the set of optimal outcomes if and only if its expected revenue rate is greater than the reserve rate. The formula for the optimal fraction may be interpreted as the excess of the expected revenue rate of -th horse over the reserve rate divided by the revenue after deduction of the track take when -th horse wins or as the excess of the probability of -th horse winning over the reserve rate divided by revenue after deduction of the track take when -th horse wins. The binary growth exponent is

and the doubling time is

This method of selection of optimal bets may be applied also when probabilities are known only for several most promising outcomes, while the remaining outcomes have no chance to win. In this case it must be that

and
.

Application to the stock market

In mathematical finance, a portfolio is called growth optimal if security weights maximize the expected geometric growth rate (which is equivalent to maximizing log wealth).

Computations of growth optimal portfolios can suffer tremendous garbage in, garbage out problems. For example, the cases below take as given the expected return and covariance structure of various assets, but these parameters are at best estimated or modeled with significant uncertainty. Ex-post performance of a supposed growth optimal portfolio may differ fantastically with the ex-ante prediction if portfolio weights are largely driven by estimation error. Dealing with parameter uncertainty and estimation error is a large topic in portfolio theory.

The second-order Taylor polynomial can be used as a good approximation of the main criterion. Primarily, it is useful for stock investment, where the fraction devoted to investment is based on simple characteristics that can be easily estimated from existing historical data – expected value and variance. This approximation leads to results that are robust and offer similar results as the original criterion.[16]

Single asset

Considering a single asset (stock, index fund, etc.) and a risk-free rate, it is easy to obtain the optimal fraction to invest through geometric Brownian motion. The value of a lognormally distributed asset at time () is

from the solution of the geometric Brownian motion where is a Wiener process, and (percentage drift) and (the percentage volatility) are constants. Taking expectations of the logarithm:

Then the expected log return is

For a portfolio made of an asset and a bond paying risk-free rate , with fraction invested in and in the bond, the expected one-period return is given by

however people seem to deal with the expected log return for one-period instead in the context of Kelly:

Solving we obtain

is the fraction that maximizes the expected logarithmic return, and so, is the Kelly fraction.

Thorp[13] arrived at the same result but through a different derivation.

Remember that is different from the asset log return . Confusing this is a common mistake made by websites and articles talking about the Kelly Criterion.

Many assets

Consider a market with correlated stocks with stochastic returns , and a riskless bond with return . An investor puts a fraction of their capital in and the rest is invested in the bond. Without loss of generality, assume that investor's starting capital is equal to 1. According to the Kelly criterion one should maximize


Expanding this with a Taylor series around we obtain


Thus we reduce the optimization problem to quadratic programming and the unconstrained solution is


where and are the vector of means and the matrix of second mixed noncentral moments of the excess returns.

There is also a numerical algorithm for the fractional Kelly strategies and for the optimal solution under no leverage and no short selling constraints.[17]

Criticism

Although the Kelly strategy's promise of doing better than any other strategy in the long run seems compelling, some economists have argued strenuously against it, mainly because an individual's specific investing constraints may override the desire for optimal growth rate.[8] The conventional alternative is expected utility theory which says bets should be sized to maximize the expected utility of the outcome (to an individual with logarithmic utility, the Kelly bet maximizes expected utility, so there is no conflict; moreover, Kelly's original paper clearly states the need for a utility function in the case of gambling games which are played finitely many times[1]). Even Kelly supporters usually argue for fractional Kelly (betting a fixed fraction of the amount recommended by Kelly) for a variety of practical reasons, such as wishing to reduce volatility, or protecting against non-deterministic errors in their advantage (edge) calculations.[18]

gollark: Even the biggest projects still have exploitable issues.
gollark: Pretty hard.
gollark: Also, situations when you're right but the compiler can't prove it occasionally happen.
gollark: It can be kind of painful sometimes. My main issue is just compile times and in some cases poor type errors.
gollark: !quote 746717745122639964

See also

References

  1. Kelly, J. L. (1956). "A New Interpretation of Information Rate" (PDF). Bell System Technical Journal. 35 (4): 917–926. doi:10.1002/j.1538-7305.1956.tb03809.x.
  2. Thorp, E. O. (January 1961), "Fortune's Formula: The Game of Blackjack", American Mathematical Society
  3. Thorp, E. O. (1962), Beat the dealer: a winning strategy for the game of twenty-one. A scientific analysis of the world-wide game known variously as blackjack, twenty-one, vingt-et-un, pontoon or Van John, Blaisdell Pub. Co
  4. Thorp, Edward O.; Kassouf, Sheen T. (1967), Beat the Market: A Scientific Stock Market System (PDF), Random House, ISBN 0-394-42439-5, archived from the original (PDF) on 2009-10-07
  5. Zenios, S. A.; Ziemba, W. T. (2006), Handbook of Asset and Liability Management, North Holland, ISBN 978-0-444-50875-1
  6. Pabrai, Mohnish (2007), The Dhandho Investor: The Low-Risk Value Method to High Returns, Wiley, ISBN 978-0-470-04389-9
  7. Thorp, E. O. (September 2008), "The Kelly Criterion: Part II", Wilmott Magazine
  8. Poundstone, William (2005), Fortune's Formula: The Untold Story of the Scientific Betting System That Beat the Casinos and Wall Street, New York: Hill and Wang, ISBN 0-8090-4637-7
  9. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2856963
  10. "Buttonwood", "Irrational tossers", The Economist Newspaper Limited 2016, Nov 1st 2016.
  11. Press, W. H.; Teukolsky, S. A.; Vetterling, W. T.; Flannery, B. P. (2007), "Section 14.7 (Example 2.)", Numerical Recipes: The Art of Scientific Computing (3rd ed.), New York: Cambridge University Press, ISBN 978-0-521-88068-8
  12. Thorp, E. O. (1969). "Optimal Gambling Systems for Favorable Games". Revue de l'Institut International de Statistique / Review of the International Statistical Institute. International Statistical Institute (ISI). 37 (3): 273–293. doi:10.2307/1402118. JSTOR 1402118. MR 0135630.
  13. Thorp, Edward O. (June 1997). "The Kelly criterion in blackjack, sports betting, and the stock market" (PDF). 10th International Conference on Gambling and Risk Taking. Montreal. Archived from the original (PDF) on 2009-03-20. Retrieved 2009-03-20.
  14. Bernoulli, Daniel (1954) [1738]. "Exposition of a New Theory on the Measurement of Risk". Econometrica. The Econometric Society. 22 (1): 22–36. doi:10.2307/1909829. JSTOR 1909829.
  15. Smoczynski, Peter; Tomkins, Dave (2010) "An explicit solution to the problem of optimizing the allocations of a bettor’s wealth when wagering on horse races", Mathematical Scientist", 35 (1), 10-17
  16. Marek, Patrice; Ťoupal, Tomáš; Vávra, František (2016). "Efficient Distribution of Investment Capital". 34th International Conference Mathematical Methods in Economics, MME2016, Conference Proceedings: 540–545. Retrieved 24 January 2018.
  17. Nekrasov, Vasily (2013). "Kelly Criterion for Multivariate Portfolios: A Model-Free Approach". SSRN 2259133. Cite journal requires |journal= (help)
  18. Thorp, E. O. (May 2008), "The Kelly Criterion: Part I", Wilmott Magazine
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.