{"id":8396,"date":"2016-07-21T01:59:09","date_gmt":"2016-07-21T09:59:09","guid":{"rendered":"http:\/\/www.oeconomist.com\/blogs\/daniel\/?p=8396"},"modified":"2016-08-26T03:37:07","modified_gmt":"2016-08-26T11:37:07","slug":"strong-independence-in-decision-theory","status":"publish","type":"post","link":"https:\/\/www.oeconomist.com\/blogs\/daniel\/?p=8396","title":{"rendered":"Strong Independence in Decision Theory"},"content":{"rendered":"

In the course of some remarks on Subjective Probability<\/cite> by Richard C. Jeffrey<\/a>, and later in defending a claim by Gary Stanley Becker<\/a>, I have previously given some explanation of the model of expected-utility maximization<\/span> and of axiomata of independence<\/span>.<\/p>

Models of expected-utility maximization are so intuïtively appealing to some people that they take one of these models to be peculiarly rational<\/em>, and deviations from any such model thus to be ir<\/em>rational. I note that the author of a popular 'blog seems to have done just that, yester-day.[0]<\/span><\/p>

My own work shows that quantities cannot be fitted to preferences, which pulls the rug from under expected-utility maximization, but there are other problems as well. The paradox that the 'blogger explores represents a violation of the strong independence axiom<\/span>. What I want to do here is first to explain again expected-utility maximization, and then to show that the strong independence axiom violates rationality<\/em>.<\/p>

A mathematical expectation<\/span> is what people often mean when they say average<\/q> — a probability-weighted sum of measures of possible outcomes. For example, when a meteorologist gives an expected<\/span> rainfall or an expected<\/span> temperature for to-morrow, she isn't actually telling you to anticipate<\/em> exactly that rainfall or exactly that temperature; she's telling you that, given observed conditions to-day, the probability distribution for to-morrow has a particular mean<\/span> quantity of rain or a particular mean<\/span> temperature.<\/p>

The actual mathematics of expectation<\/span> is easiest to explain in simple cases of gambling<\/em> (which is just whence the modern, main-stream theories of probability itself arose). For example, let's say that we have a fair<\/q> coin (with a 50% chance of heads<\/span> and a 50% chance of tails<\/span>); and that if it comes-up heads<\/span> then you get $100, while if it comes-up tails<\/span> then you get $1. The expected<\/span> pay-out is .5 × $100 + .5 × $1 = $50.50<\/span> Now, let's say that another coin has a 25% chance of coming-up heads<\/span> and a 75% chance of coming-up tails<\/span>, and you'd get $150 for heads<\/span> and $10 for tails<\/span>. Its expected<\/span> pay-out is .25 × $150 + .75 × $10 = $45<\/span> More complicated cases arise when there are more than two possible outcomes, but the basic formula is just prob<\/var>(x<\/var>1<\/sub>)·m<\/var>(x<\/var>1<\/sub>) + prob<\/var>(x<\/var>2<\/sub>)·m<\/var>(x<\/var>2<\/sub>) + … + prob<\/var>(x<\/var>n<\/var><\/sub>)·m<\/var>(x<\/var>n<\/var><\/sub>)<\/span> where x<\/var>i<\/var><\/sub> is the i<\/var>-th possible outcome, prob<\/var>(x<\/var>i<\/var><\/sub>) is the probability of that i<\/var>-th possible outcome, and m<\/var>(x<\/var>i<\/var><\/sub>) is some measure (mass, temperature, dollar-value, or whatever) of that outcome. In our coin-flipping examples, each expectation is of form prob<\/var>(heads<\/span>)·payout<\/var>(heads<\/span>) + prob<\/var>(tails<\/span>)·payout<\/var>(tails<\/span>)<\/span><\/p>

One of the numerical examples of coin-flips offered both<\/em> a higher maximum<\/em> pay-out ($150 v<\/abbr><\/span> $100) and a higher minimum<\/em> pay-out ($10 v<\/abbr><\/span> $1) yet a lower expected<\/em> pay-out ($45 v<\/abbr><\/span> $50.50). Most<\/em> people will look at this, and decide that the expected<\/em> pay-out should be the determining factor, though it's harder than many people reälize to make the case<\/em>.<\/p>

With monetary pay-outs, there is a temptation to use the monetary unit as the measure in computing the expectation by which we choose. But the actual usefulness<\/em> of money isn't constant. We have various priorities; and, when possible, we take care of the things of greatest priority before we take care of things of lower priority. So, typically, if we get more<\/em> money, it goes to things of lower<\/em> priority than did the money that we already had. The next<\/em> dollar isn't usually as valuable to us as any one of the dollars that we already had. Thus, a pay-out of $1 million shouldn't be a thousand times as valuable as a pay-out of $1000, especially if we keep in-mind a context in which a pay-out will be on top of<\/em> whatever we already have in life. So, if we're making our decisions based upon some sort of mathematical expectation<\/span> then, instead of computing an expected monetary<\/em> value, we really want an expected usefulness<\/em> value, prob<\/var>(x<\/var>1<\/sub>)·u<\/var>(x<\/var>1<\/sub>) + prob<\/var>(x<\/var>2<\/sub>)·u<\/var>(x<\/var>2<\/sub>) + … + prob<\/var>(x<\/var>n<\/var><\/sub>)·u<\/var>(x<\/var>n<\/var><\/sub>)<\/span> where u<\/var>() is a function giving a measure of usefulness. This u<\/var> is the main-stream notion of utility<\/span>, though sadly it should be noted that most main-stream economists have quite lost sight of the point that utility<\/span> as they imagine it is just a special case<\/em> of usefulness<\/span>.<\/p>

A model of expected-utility maximization<\/span> is one that takes each possible action a<\/var>j<\/var><\/sub>, associates it with a set of probabilities {prob<\/var>(x<\/var>1<\/sub>|a<\/var>j<\/var><\/sub>),prob<\/var>(x<\/var>2<\/sub>|a<\/var>j<\/var><\/sub>),…,prob<\/var>(x<\/var>n<\/var><\/sub>|a<\/var>j<\/var><\/sub>)}<\/span> (the probabilities now explicitly noted as conditioned<\/em> upon the choice of action) and asserts that we should chose an action a<\/var>k<\/var><\/sub> which gives us an expected utility prob<\/var>(x<\/var>1<\/sub>|a<\/var>k<\/var><\/sub>)·u<\/var>(x<\/var>1<\/sub>) + prob<\/var>(x<\/var>2<\/sub>|a<\/var>k<\/var><\/sub>)·u<\/var>(x<\/var>2<\/sub>) + … + prob<\/var>(x<\/var>n<\/var><\/sub>|a<\/var>k<\/var><\/sub>)·u<\/var>(x<\/var>n<\/var><\/sub>)<\/span> as high or higher than that of any other action.<\/p>

If there is a non-monetary measure<\/em> of usefulness in the case of monetary pay-outs, then there is no evident reason that there should not be such a measure in the case of non<\/em>-monetary pay-outs. (And, likewise, if there is no such measure in the case of non-monetary pay-outs, there is no reason to suppose one in the case of monetary pay-outs, where we have seen that the monetary pay-out isn't really a proper measure.) The main-stream of economic theory runs with that; its model of decision-making is expected-utility maximization<\/span>.<\/p>

The model does not<\/em> require that people have a conscious<\/em> measure of usefulness, and certainly does not require that they have a conscious process<\/em> for arriving at such a measure; it can be taken as a model of the gut<\/q>. And employment<\/em> of the model doesn't mean that the economist believes that it is literally true; economists across many schools-of-thought regard idealizations<\/span> of various sorts as approximations<\/em> sufficient for their purposes. It is only lesser economists who do so incautiously and without regard to problems of scale.<\/p>

But, while expected-utility maximization<\/span> may certainly be regarded as an idealization<\/em>, it should not be mistaken for an idealization of peculiar rationality<\/em> nor even for an idealization of rationality of just one variety<\/em> amongst many. Expected-utility maximization<\/span> is not rational even if we grant — as I would not — that there is some quantification that can be fitted to our priorities.<\/p>

Expected-utility maximization<\/span> entails a proposition that the relevant expectation is of potential outcomes which are taken themselves to be no better or worse for being more or less probable. That is to say that what would be<\/em> the reälized value of an outcome is the measure of the outcome to be used in the computation of the expectation; the expectation is simply lineär in the probabilities. This feature of the model follows from what is known as the strong independence axiom<\/u><\/q> (underscore mine) because Paul Anthony Samuelson, having noticed it, conceptualized it as an axiom. It and propositions suggested to serve in its stead as an axiom (thus rendering it a theorem) have been challenged in various ways. I will not here survey the challenges.<\/p>

However, the first problem that I saw with expected-utility maximization<\/span> was with that lineärity, in-so-far as it implies that people do not benefit from the experience of selecting amongst discernible non-trivial lotteries as such<\/em>.[1]<\/span><\/p>

Good<\/em> comes from engaging in some<\/em> gambles as such<\/em>, exactly because gambling more generally is unavoidable. We need practice<\/em> to gamble properly, and practice<\/em> to stay in cognitive shape for gambling. Even if we get that practice without seeking it, in the course of engaging in our everyday gambles, there is still value to that practice as such. A gamble may become more<\/em> valuable as a result of the probability of the best<\/em> outcome being made less<\/em> probable, and less valuable as a result of the best outcome becoming more certain. The value of lotteries is not<\/em> lineär in their probabilities!<\/p>

It might be objected that this value is only associated with our cognitive limitations, which limitations it might be argued represented a sort of ir<\/em>rationality. But we only compound<\/em> the irrationality if we avoid remedial activity because under other circumstance<\/em> it would not have done us good. Nor do I see that we should any more accept that a person who needs<\/em> cognitive exercise to stay in cognitive shape is thus out<\/em> of cognitive shape than we would say that someone who needs physical exercise to stay in physical shape is thus out of physical shape.<\/p>

[0 (2016:07\/22)]<\/span> Very<\/em> quickly, in a brief exchange, he saw the error, and he's corrected his entry; so I've removed the link and identification here.<\/p>

[1]<\/span> When I speak or write of lotteries<\/q> or of gambling<\/q>, I'm not confining myself to those cases for which lay-people normally use those terms, but applying to situations in which one is confronted by a choice of actions, and various outcomes (albeït some perhaps quite impossible) may be imagined; things to which the term lottery<\/q> or gamble<\/q> are more usually applied are simply special cases of this general idea. A trivial<\/em> lottery is one that most people would especially not think to be a lottery or gamble at all<\/em>, because the only probabilities are either 0 or 1; a non<\/em>-trivial lottery involves outcomes with probabilities in between<\/em> those two. Of course, in real life there are few if any perfectly trivial lotteries, but a lot of things are close enough<\/em> that people imagine them as having no risk or uncertainty; that's why I refer to discernible<\/em> non-trivial lotteries, which people see as involving risk or uncertainty.<\/p>","protected":false},"excerpt":{"rendered":"In the course of some remarks on Subjective Probability by Richard C. Jeffrey, and later in defending a claim by Gary Stanley Becker, I have previously given some explanation of the model of expected-utility maximization and of axiomata of independence. Models of expected-utility maximization are so intuïtively appealing to some people that they take one […]","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[6,36,4],"tags":[299,1406,1374,413,41],"class_list":["post-8396","post","type-post","status-publish","format-standard","hentry","category-commentary","category-economics","category-public","tag-decision-theory","tag-expectation","tag-expected-utility","tag-probability","tag-utility"],"_links":{"self":[{"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=\/wp\/v2\/posts\/8396","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8396"}],"version-history":[{"count":0,"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=\/wp\/v2\/posts\/8396\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8396"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8396"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.oeconomist.com\/blogs\/daniel\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8396"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}