Abstract
Decision-making in humans is known to be subject to several biases. For instance, when facing bets, humans demonstrate some asymmetry concerning their preference for the riskiest option depending on whether stakes involve potential gains or potential losses. They are indeed risk-averse for bets involving gains but risk seeking for bets involving losses. They also exhibit a distorted perception of probabilities. It is not clear whether non-human primates exhibit the same biases. Setting up a protocol that allowed two rhesus monkeys to make choices between lotteries involving either gains or losses, we demonstrated that rhesus monkeys facing bets exhibited an asymmetry in the treatment of gains and losses comparable with that of humans.
Similar content being viewed by others
Introduction
Attitudes toward risk include different behavioral features that can be studied independently: risk-aversion, loss aversion, and the distortion of probabilistic information (see Fig. 1). The connection between risk-aversion and the utility of action for an individual was established early in the history of decision-theory1,2. Loss aversion and distortion of probabilities have been identified much more recently when expectations of gains and losses were studied from the current reference point of the decision maker3,4. Indeed, the seminal studies from Tversky and Kahneman show that humans (i) are generally risk-averse for bets involving gains but risk seeking for bets involving losses, (ii) exhibit loss aversion, and (iii) their perception of probabilities is distorted in the sense that small probabilities are over-weighted and high probabilities are under-weighted. These works led to the formulation of the cumulative prospect theory—a common denomination of the second version of the model of Kahneman and Tversky5—that made the psychological insights compatible with the maximization of a utility function4.
In view of the phylogenetic proximity between monkeys and apes (that include human), it seems of interest to study attitude toward risk in the former in order to extend the descriptive validity beyond the realm of human decision making. Oddly enough, and despite the fact that risk-aversion has been reported in many other species, including bees6 and peas7, several studies in rhesus monkeys (Macaca mulatta) report preferences for the riskier option over the safer one when the expected values are equivalent8,9,10,11,12. It is also noticeable that such preference has also been documented in chimpanzees13. However, there are also some studies that report risk-aversion for gains in rhesus monkeys14. In order to explain these discrepancies, some authors have advanced the idea that confounding factors could skew the data in the studies reporting risk seeking15,16.
Nonetheless, most of the previous studies focus on the attitude toward risk for gains only and leave open the question to know if it exists some asymmetry of treatment when dealing with gains compared to when dealing losses, one aspect which is central in the prospect theory3,4.
The objective of the present study is thus to evaluate whether the asymmetry of treatment between gains and losses seen in humans can also be evidenced in non-human primates, and if so, provide a fine description of this asymmetry by characterizing it toward (i) risk-aversion, (ii), probability distortion, (iii) stochasticity in choice.
For this purpose, we designed an experimental paradigm in which rhesus monkeys had to choose between options involving either gains or losses in reference to some initial stock at the beginning of each trial. Let us highlight here that we assessed losses in a reference-dependent way. No “real” losses have been experienced by the monkeys such that, when their outcome fell below the reference point, they could still receive a reward. It was less than what they could expect, hence only a loss relative to a reference point. In other studies that have studied loss aversion with human or non-human primates, “loss” is, as far as we know, understood in this particular relative sense, not in an absolute one17,18.
We fitted their behavioral data to a cumulative-prospect-theory based decision model to assess the contrast between the treatments of losses and gains.
Results
Task
We trained two monkeys, Monkey H and Monkey G, to perform choices when facing a pair of lotteries. At each trial, the monkey had to touch one of two circular targets on a touchscreen, each of them associated with a lottery. Each lottery Li had two outcomes, a positive or negative amount xi and 0. The amount xi is the actual outcome of the lottery with probability pi, and 0 is the actual outcome with probability 1 − pi. For example, a trial could offer the possibility of choosing between (1) half of chance to get 2 tokens (p1 = 0.5, x1 = 2), and (2) one chance over four to get 3 tokens (p2 = 0.25, x2 = 3).
Amounts were represented by texture (different line orientations) and probabilities by the slice taken by the corresponding outcome on the target (see Fig. 2). For implementing losses, the monkey was rewarded at the end of the trial with an amount of water proportional to the level of gauge filled with tokens. Starting each trial with 3 tokens, the monkey could win or lose up to 3 tokens (see Fig. 3).
The lottery pairs can be characterized according to two criteria: (i) Do the pair contain lotteries with potential gains, or potential losses, or both? (ii) Do the pair contain a lottery that is a stochastic dominant option (i.e. a lottery A such as pA > pB and xA > xB)? For commodity purpose, we will name thereafter lottery pairs with potential gains only LPG, and lottery pairs with potential losses only LPL.
Therefore, we distinguished 7 types of lottery pairs:
-
Type 1. x1 > 0 and x2 < 0 while p1 = p2 (lottery pairs containing one lottery with potential losses and on lottery with potential gains); assess the discrimination of losses from the gains; 36 different lottery pairs.
-
Type 2. p1 = p2 and x1 > x2, with xi∈1,2 > 0 (LPG with a stochastic dominant option differentiating only by the x values); assess the discrimination of positive x-values; 12 different lottery pairs.
-
Type 3. p1 = p2 and x1 < x2, with xi∈1,2 < 0 (LPL with a stochastic dominant option differentiating only by the x values); assess the discrimination of negative x-values; 12 different lottery pairs.
-
Type 4. p1 > p2 and x1 = x2, with xi∈1,2 > 0 (LPG with a stochastic dominant option differentiating only by the p values); assess the discrimination of p-values associated to positive x-values; 12 different lottery pairs.
-
Type 5. p1 < p2 and x1 = x2, with xi∈1,2 < 0 (LPL with a stochastic dominant option differentiating only by the p values); assess the discrimination of probabilities associated to negative quantities; 18 different lottery pairs.
-
Type 6. p1 < p2 and x1 > x2, with xi∈1,2 > 0 (LPG with no stochastic dominant option); 18 different lottery pairs.
-
Type 7. p1 < p2 and x1 < x2, with xi∈1,2 < 0 (LPL with no stochastic dominant option); 18 different lottery pairs.
Type 1–5 lottery pairs have been used for assessing performance, while Type 6 and 7 have been used for assessing attitude toward risk. Indeed, for these two last types, the monkey had to realize trade-offs between quantity and probability: either he can have a greater quantity but with a smaller probability (the riskiest option), or he can have a smaller quantity but with a greater probability (the safest option).
Certainty-risk trade-off
In this first section, we report results for the case similar to that proposed by Kahneman and Tversky3. The two monkeys were faced with two lottery pairs. In the first, they had the choice between a lottery giving one token with certainty and one giving two tokens half of the time. The second pair was similar to the first, except that the amounts were negative.
Figure 4 shows the results for these two lottery pairs (Monkey H: 251 trials, Monkey G: 236 trials). The monkeys behaved similarly to the behavior reported in humans in similar trade-offs3: the monkeys preferred the safest option if the lottery offered a gain and the riskiest option if the lottery offered a loss (Monkey H: dll = 1, χ2 = 301.39, p < 0.01; Monkey G: dll = 1, χ2 = 89.37, p < 0.01).
Respect of first-order stochastic dominance
In order to assess accurately the performance of the task by the two monkeys, we consider separately the lottery pairs where there was a strictly dominant option (lottery pairs Type 1–5).
The results of the 96 lottery pairs meeting this condition are summarized in Fig. 5 (Monkey H: 19594 trials; Monkey G: 16938 trials). In the supplementary section, Table S3 provides the median success rate for each type of lottery pairs and Fig. S1 provides a similar representation of performances as Fig. 5, but considering separately 20 chunks of data in order to control for the stability of performances over time.
As the task design includes only two choice options, the chance level is 0.5. Results show that all interquartile ranges of success rates are above 0.5 (min: 0.61, max: 0.98), indicating that monkeys performed better than random for Type 1–5 lottery pairs. However, both monkeys performed worst in the condition where they had to choose between two lotteries that had two different potential losses with the same probability.
Consideration of difference of expected values during trade-offs between quantity and probability
Using the results for lottery pairs where it is possible to distinguish a safer option and a riskier option (lottery pairs Type 6 & 7), we checked that the frequency with which the riskiest option was chosen was dependent on the difference between the expected values of the safest option and the riskiest option. To assess this relationship we used an ordinary sigmoid function with two free parameters, one for the slope (β) and one for the intercept (γ), that we optimized to fit the data. This function is supposed to increase monotonically (i.e. β > 0): the more the difference between expected values favors the riskiest option, the more the monkey is expected to choose this option. As we fitted separately the data obtained with LPG, and those obtained with LPL, we optimized in all four parameters: βG, βL, γG, γL.
Data used were obtained on 18 LPG and 18 LPL without stochastic dominant option (Monkey H: 4952 trials, Monkey G: 4435 trials). Results are shown in Fig. 6. In the supplementary section, Table S4 summarizes the results of the optimization process.
The slope of the curve of the sigmoid function in Fig. 6A,B on the left side (in blue) is steep and the points are close to the curve, indicating that both monkeys consider the difference of expected values when realizing trade-offs between quantity and probability for lotteries with potential gains (Monkey H: βG = 1.70 [0.72, 2.68], Monkey G: βG = 1.83 [1.55, 2.12]).
However, the slope of the curve of Fig. 6A,B on the right side (in orange) is smoother and the points are further from the curve than for gains. This indicates that both monkeys less consider the difference of expected values when dealing with lotteries including potential losses, and we can not reject the hypothesis that they do not consider it at all (Monkey H: βL = 0.58 [−0.36, 1.52], Monkey G: βL = 0.45 [−0.17, 1.07]).
Attitude toward risk in non-human primates
Using the results for lottery pairs where it is possible to distinguish a safer option and a riskier option (lottery pairs Type 6 & 7), we fitted a decision-making model to better identify how the macaques behave in relation to risk.
This model includes six free parameters:
-
• ωG and ωL that describe to which extent the monkey is risk-averse for lottery pairs involving respectively gains and losses. Reference values are −1 (extremely risk-seeking), 0 (risk-neutral), and 1 (extremely risk-averse).
-
• αG and αL that describe to which extent the monkey has a distorted perception of probabilities for lottery pairs involving respectively gains and losses. Reference values are 0 (maximal distortion) and 1 (no distortion).
-
• λG and λL that describe to which extent the decision-making process is stochastic for lottery pairs involving respectively gains and losses. Reference values are 0 (maximal stochasticity) and ∞ (no stochasticity at all).
We optimized these free parameters for each monkey separately (Monkey H: 4952 trials, Monkey G: 4435 trials). In order to control for the stability over time of the fit, we separated for each monkey the dataset in 20 chunks with respect to the chronological order of the trials, obtaining 20 best-fit parameter values for each parameter.
For describing to which extent the two monkeys present asymmetry of treatment between gain and loss, we compared the best parameters values contrasting those computed after the fitting of results obtained with 18 LPG without stochastic dominant option, and those computed after the fitting of results obtained with 18 LPL whitout stochastic dominant option.
We assessed the statistical relevance of the comparisons with the Mann-Whitney’s U ranking test, applying the Bonferroni correction for multiple comparisons.
A visual representation of the functions for which these parameters are used is provided in Figs 7–9. In the supplementary section, Table S5 summarizes the results of the optimization process, Table S6 provides a summary of the statistical tests, Fig. S2 provides a visual representation of parameter values over time, and Table S7 summarizes the results of a regression analysis of the evolution of the best-fit parameters values (the only statistically relevant result concerns the evolution of ωL parameter for Monkey H, β = −0.02, F = 16.315, p = 0.009, nobs = 2 × 20, showing that Monkey H is slightly more risk-averse for LPL over time).
The optimized values of ωG and ωL allow reconstructing the utility functions of the two monkeys, as shown in Fig. 7. For both monkeys, these values indicate a slight risk-seeking for gains or quasi risk neutrality contrasting with a strong risk-aversion for losses (Monkey H: ωG = 0.28 ± 0.21, ωL = −0.71 ± 0.20; u = 0.0, p < 0.001, nobs = 2 × 20; Monkey G: ωG = 0.15 ± 0.31, ωL = −0.75 ± 0.28); u = 11.0, p < 0.001, nobs = 2 × 20).
The optimized values of αG and αL allow reconstructing the probability distortion functions of the two monkeys, as shown in Fig. 8. These values indicate a slight probability distortion for gains contrasting with a strong probability distortion for losses (Monkey H: αG = 0.63 (±0.14, αL = 0.21 ± 0.14; u = 7.0, p < 0.001, nobs = 2 × 20; Monkey G: αG = 0.90 ± 0.23), αL = 0.30 ± 0.21); u = 24.5, p < 0.001, nobs = 2 × 20).
The optimized values of λG and λL allow reconstructing the stochasticity functions of the two monkeys, as shown in Fig. 9. The comparison of these values for each monkey reveals no statically difference in stochasticity of choice for gains and losses (Monkey H: λG = 2.52 ± 0.98, λL = 1.82 ± 0.47; u = 104.0, p = 0.029, nobs = 2 × 20; Monkey G: λG = 1.71 ± 0.95, λL = 1.28 ± 0.66; u = 153.0, p = 0.625, nobs = 2 × 20).
Discussion
This study has developed a new paradigm assessing attitude toward risk in macaque monkeys facing lotteries that comprised potential gains and potential losses. Both macaques investigated displayed an asymmetric behavior toward gain and loss. They were slightly risk-averse or risk neutral for gains but strongly risk seeking for losses. They also exhibited either a slight probability distortion or a linear perception of probabilities for gains but a strong probability distortion for losses. Such asymmetry of treatment between lotteries involving gains and losses is congruent with the predictions of the prospect theory and is similar to what has been observed in humans3,4. However, the fact that we observe a slight risk-aversion for gains constitutes a discrepancy with the results of several studies in monkeys11,18, which leads to several questions.
Respect of first-order stochastic dominance
Before considering these questions, let us highlight that despite a large number of different lottery pairs, both monkeys generally demonstrate good performance on lotteries pairs with stochastic dominance.
The large number of choice situations rules out the possibility that the monkeys would have been able to memorize the best choice in each case, without decoding the stimuli (the protocol included 126 different pairs of lotteries, with stimuli rotated randomly from one trial to another).
However, in the lottery pairs with a stochastic dominant option where probabilities were fixed and magnitudes varied (see Fig. 5), they were less accurate (i.e. success rate was only about 60%). Since the monkeys had still good performances when choosing between lotteries containing similar losses but with different probabilities (i.e. they selected more than 80% of the time the lottery with the smallest probability of loss), it could indicate a difficulty to discriminate the magnitude of losses.
Consideration of difference of expected values when realizing trade-offs between quantity and probability
Our data show that both monkeys put more consideration to the difference of expected values between the riskiest and the safest option to make their choice for lottery pairs without stochastic dominant option involving gains, than to make their choice when losses were involved. This result is to put in relation to the one obtained in lottery pairs with a stochastic dominant option that show that they may have some difficulty to discriminate the magnitude of losses. Indeed, as expected value integrate not only probability but also quantity, assessing with difficulty the magnitude of losses could prevent the consideration of expected values when realizing trade-off between quantity of probability.
Stochasticity in choice
Our data show that the stochasticity in choice is not significantly different for lottery pairs involving losses than for those involving gains, as captured by the precision parameter in our data fitting.
Probability distortion
A strong probability distortion has been observed in humans19 and rhesus monkeys11,18 for lotteries involving gains and was therefore expected in this study. However, we observe only a moderate one in lotteries involving gains. Though, we observe a strong probability distortion for lotteries involving losses.
Unfortunately, to the extent of our knowledge, the previous studies on probability distortion either did not mixed losses and gains11 or did not use a different parametrization for both18, which makes the results difficult to compare. Therefore, even if such asymmetry of probability perception is not predicted by the prospect theory3,4, it would be interesting to know if such asymmetry in probability distortion and can be generalized to other species, including humans.
Asymmetric attitude toward risk
In this study, we observed a strong asymmetry in attitude toward risk between gains and losses for both monkeys. Both monkeys exhibited a slight risk-aversion or risk neutrality for gains while exhibiting a strong risk-seeking behavior for losses.
If our results fulfill the predictions of the prospect theory3,4 to that respect, they do not replicate the previous results in rhesus monkeys for what concerns attitude toward risk in gains. Indeed, several studies report a tendency to risk-seeking for gains8,10,12,18. We can consider several explanations. (i) In previous studies, the amount of reward is generally low (the stake for a bet is generally lying between 100 and 300 of water16) and this could create an incentive to prefer risky options, effect that has been labeled as the peanuts effect20. In our task, at the start of each trial, the monkeys had an initial amount of water, to which their gains (losses) were added (subtracted). This makes the stake for a single trial larger, maybe allowing the peanuts effect20 to be avoided. However, this could hardly be the only factor as it had been show that risk-seeking in rhesus monkeys were robust to the manipulation of the magnitude of stakes21. (ii) The number of different pairs of lottery was often lower in the previous studies, their findings could rather be specific to the lottery pairs chosen. However, a risk-seeking behavior has been also obtained with probabilities of outcomes drawn from a continuous distribution22, what seems to rule out this possibility. (iii) A similar bet is proposed several times in the same session. This could lead to a bias, as it had been shown in human that repetition of gambles can reduce risk-aversion23. (iv) In a recent study that implement also losses18, the introduction of a small amount of water for each successful trial is maybe the cause of the report of risk seeking for gains: the certainty for the monkeys to have a small reward may induce an incentive to choose the riskiest option. (v) Strong individual differences have been noted in humans and can also be expected to occur in rhesus monkeys (reason why we analyzed the behavior of the two monkeys separately). (vi) An another possibility is that this discrepancy is due to what is called the description-experience gap24. For instance, Heilbronner and Hayden25 show that rhesus monkeys were less risk-seeking when reward contingencies were described than when they were experienced. More generally, the way of presentation of stimuli has been shown to greatly impact on decision-making processes in humans and monkeys26, and it had been shown since several decades that risk attitude is sensitive to the design of the task that aims to assess it, in humans23 but also in non-human species as birds27.
Concerning the attitude toward losses, our data are consistent with the two studies that addressed specifically the question and revealed a risk-seeking behavior for losses in capuchins17, or rhesus monkeys18. The latter indeed proposed an experimental paradigm close to ours that mixes losses and gains and found risk-seeking behavior both for gain (see above) and losses.
One aspect that deserves to be highlighted is that if monkeys seemed to seek risk when dealing with potential losses, this behavior is combined with difficulty to evaluate the quantity of loss (see Fig. 5). It is thus hard to discriminate if the animals do seek for risk or just try to avoid losses whatever the magnitude. This could be assimilated to an adaptive behavior in the sense that if an individual cannot correctly evaluate the amount of a loss, one solution is to avoid all loss as far as possible, leading to adopt a seemingly risky behavior. This could indeed explain why our two monkeys are far more risk-seeking when facing potential losses than they are risk-averse when facing potential gains.
Even if more data would be needed to explore the validity of such explanation, the present study has demonstrated that we can retrieve in rhesus monkeys an asymmetric behavior toward gain and loss similar to that reported in humans and described by the prospect theory3,4. This brings an argument in favour of the use of the macaque model for the study of decision making under risk and the investigation the underlying neural mechanisms. Although, the discrepancy of the results concerning attitude toward risk in rhesus monkeys appeals to conduct further studies in order to better understand how the context in which the assessment of such attitude is done impacts on the results obtained.
Materials and Methods
Behavioral protocol
Animals
The study was performed on two female rhesus monkeys, Monkey H, 3-year-old at the time of the experiment (born in 2012), and Monkey G, 4-year-old at the time of the experiment (born in 2011). The monkeys were housed in the animal facility of the Institute of Neurodegenerative Diseases (UMR CNRS 5293, Bordeaux, France) under standard conditions (a 12 h light/dark cycle with the light on from 7.00 am to 7.00 pm; humidity at 60%, temperature 22 °C ± 2 °C). Experimental procedures were performed in accordance with the Council Directive of 2010 (2010/63/EU) of the European Community and the National Institute of Health Guide for the Care and Use of Laboratory Animals. The protocol received agreement from the Ethical Committee for Animal Research CE50 (agreement number: C33063268). Data used for analysis were collected over 151 days (Monkey H: 195.07 ± 102.42 SD trials per day; Monkey G: 171.76 ± 97.30 SD trials per day).
Composition of lotteries
At each trial, the monkey had to choose between two lotteries. Each lottery Li with i ∈ {1, 2} had two outcomes, xi and 0. xi is the outcome of the lottery i with probability pi while 0 is the output of the lottery with probability [1 − pi], with pi ∈ {0.25, 0.50, 0.75, 1.00}. For all lottery i, xi is a non-zero integer in the interval [−3,3].
We will name thereafter lottery pairs with potential gains LPG (xi∈1,2 > 0), and lottery pairs with potential losses LPL (xi∈1,2 < 0).
Because of a large number of possible lottery pairs, several cases were distinguished and grouped in two sets.
The first set is composed of lottery pairs that were used to evaluate the monkey’s performance. Pairs belonging to this set are those in which there was a stochastic dominant option whatever the attitude towards risk of the subject: L1 dominates L2 so the monkey is expected to choose L1 if it understands the task. The following cases were extracted:
-
Type 1. x1 > 0 and x2 < 0 while p1 = p2 (lottery pairs containing one lottery with potential losses and on lottery with potential gains); assess the discrimination of losses from the gains (this is the only case included in the design mixing potential gains and potential losses in a single trial); 36 different lottery pairs.
-
Type 2. p1 = p2 and x1 > x2, with xi∈1,2 > 0 (LPG with a stochastic dominant option differentiating only by the x values); assess the discrimination of positive quantities; 12 different lottery pairs.
-
Type 3. p1 = p2 and x1 < x2, with xi∈1,2 < 0 (LPL with a stochastic dominant option differentiating only by the x values); assess the discrimination of negative quantities; 12 different lottery pairs.
-
Type 4. p1 > p2 and x1 = x2, with xi∈1,2 > 0 (LPG with a stochastic dominant option differentiating only by the p values); assess the discrimination of probabilities associated to positive quantities; 12 different lottery pairs.
-
Type 5. p1 < p2 and x1 = x2, with xi∈1,2 < 0 (LPL with a stochastic dominant option differentiating only by the p values); assess the discrimination of probabilities associated to negative quantities; 18 different lottery pairs.
The second set is composed of lottery pairs that allowed the attitude toward risk of the monkeys to be evaluated, by assessing how the monkey realizes a trade-off between quantity and probability of reward. The following cases were extracted:
-
Type 6. p1 < p2 and x1 > x2, with xi∈1,2 > 0 (LPG with no stochastic dominant option); 18 different lottery pairs.
-
Type 7. p1 < p2 and x1 < x2, with xi∈1,2 < 0 (LPL with no stochastic dominant option); 18 different lottery pairs.
Indeed, we will consider that when dealing with gains, an option A is riskier than an option B if pA < pB and xA > xB, that is to say where option A leads to a greater amount of reward but with a smaller probability, while option B leads to a smaller reward but with a greater probability. We will consider that when dealing with losses, an option A is riskier than an option B if pA < pB and xA < xB, that is where option A leads to a greater loss but with a smaller probability, while option B leads to a smaller loss but with a greater probability. Thus, if the subject is risk-seeking, he will be biased toward choosing L1.
Implementation of lotteries, gains and losses
During experimental sessions, the monkeys have restricted access to water five days per week. This motivates them to perform the task. Hence, the potential gain from each lottery was water in place of the monetary gains customarily used in human experiments.
Each trial, the monkey had to choose between two lotteries. A single lottery is represented by a pie chart (see Fig. 2), as proposed by Stauffer et al.11. Each pie chart is composed of two slices. Starting from a reference point at the top of the circle, the first segment of the pie is shifted by a random angle between 0 and 359°. Each slice encodes one possible outcome of the lottery (xi or 0). The arc length of each slice represents the probability of this outcome (p or [1 − p]). The pattern of each slice represents the number of tokens earned or lost. The orientation of the parallel lines constituting the pattern indicates a quantity (see Fig. 2). Hence, horizontal lines represent 0. Rotation of these horizontal lines clockwise by one-, two-, three-quarters of 45° respectively represent a loss of −1, −2, −3 tokens. Rotation of these horizontal lines counter-clockwise by one, two, three quarters of 45° represent a gain of 1, 2, 3 tokens.
In each trial, the monkey could gain between −3 and +3 tokens. At the end of the trial, the monkey would be rewarded with water proportional to the tokens gained. Because it is not possible to give negative water, the monkey started each trial with 3 tokens, visible on the screen. Hence, the monkey would have between 0 and 6 tokens at the end of the trial. For each token, the water tank valve would be opened for 150 ms. This duration of opening gave approximately 100 of water. So, at the end of each trial the monkey would receive between 0 and 600 of water.
Experimental paradigm
The monkey sat in a primate chair positioned 20 cm from a touch screen. The experimental session was composed of a series of trials. Each trial consisted of several steps (see Fig. 3). At the beginning of the trial, a gauge with 3 tokens was displayed. The monkey had to grasp a grip for a short duration that varied randomly in a range from trial to trial (150~300 ms) to ensure that the monkey could not anticipate the stimuli display.
If the monkey did not hold the grip long enough, the trial was considered as failed and an error was raised. Error trials were concluded with the display of a black screen, and the monkey had to wait 2000ms for the beginning of the next trial.
After the monkey had held the grip for the required amount of time (150~300 ms), stimuli appeared. The stimuli presented were two circles representing two lotteries. The monkey had 2000 ms to decide which lottery to choose. If the monkey did not choose within the allotted decision time, an error was signaled.
After making a choice by touching one of the two circles the other circle disappeared. The monkey then had 5000 ms to return its hand to the grip (otherwise, an error was raised). Once the monkey had returned its hand to the grip the outcome was determined based on the probabilities shown in the two slices of the chosen circle. The amount of reward (loss) was indicated to the animal by the disappearance of the non-selected slice. The gauge filled (emptied) by the amount earned (forfeited), one token at the time. The time of the filling animation was kept constant at 1500 ms. At the end of the trial, the gauge emptied itself and the monkey received one drop of water (100) for each token in the gauge. The time of the emptying animation was kept constant at 1500 ms.
The inter-trial interval varied randomly between 150 and 300 ms.
Modeling
Lotteries, outcomes, and probabilities
Based on prospect theory3,4, we constructed a simple decision-making model designed to evaluate the attitudes to risk of the two monkeys. In our task, a lottery L has two possible outcomes x a non zero integer in the interval [−3, 3] with probability p and 0 with probability [1 − p]. The formula below supposed the use of a normalized value of x such as x ∈ [0, 1].
Utility functions
We define a function U that represents the utility — or the subjective expected value — of a lottery L:
with w the probability distortion function and u the utility function of an amount xi ∈ [0, 1]. w is defined over the interval [0,1] and is continuous, with w(0) = 0 and w(1) = 1. u is defined over the interval [−1, 1] and is continuous, with u(0) = 0 and ∀xi: −1 ≤ u(x) ≤ 1.
Let us define a utility function u such as:
with ωG ∈ [−1, 1] the parameter of risk-aversion for gains, and ωL ∈ [−1, 1] the parameter of risk aversion for losses. Thus, if ωG is positive, u′(x) is positive for ∀x > 0, meaning an aversion towards risk for gains – this method of modeling attitude towards risk is very common28. In the case where x is negative and ωL is positive, u′(x) is positive ∀x < 0, meaning an aversion towards risk in losses.
Probability distortion function
We assume that probabilities are perceived in a distorted manner. Following Prelec29, we defined a probability distortion function, w, in the following manner:
with α = αG if x > 0 and α = αL if x < 0. Both α-values are drawn from interval (0, 1] and describe to which extent the probabilities are distorted (the closer the α-value is to zero, the more the probabilities are distorted).
Stochasticity function
We also assume that action selection is probabilistic: the option that is subjectively seen as the best option is chosen only with a greater probability than the other options (and not always). As a classic softmax function30 to introduce stochasticity can induce non-monotonicity concerning the effect of risk parameter on probability to choose the riskiest option for a given lottery (i.e. monotonicity is not guaranteed for an arbitrary couple of two lotteries), we used the alternative proposed by Apesteguia & Ballester31.
Let L1 be a lottery riskier than L2 (i.e. p1 < p2 and x1 > x2). Let p(L1) be the probability of choosing L1:
with ω = ωG if x1 and x2 are positive and ω = ωL if x1 and x2 are negative, λ ∈ (0, ∞) a free parameter describing to which extent decision-making is stochastic, and f a function that gives the ω-value for which the decision-maker would be indifferent between the both lotteries. The lower the λ-value is, the more the decision-making is stochastic.
Analysis
Certainty-risk trade-off
We treated separately a singular case similar to one proposed by Kahneman & Tversky’s seminal paper3: (i) “In addition to whatever you own, you have been given $1,000. You are now asked to choose between: (A) $1,000 with probability 0.50, and (B) $500 for sure.” and (ii) “In addition to whatever you own, you have been given $2,000. You are now asked to choose between: (C) $ −1,000 with probability 0.50, and (D) $−500 for sure”.
Although we did not vary the initial wealth as Kahneman and Tversky had, we offered a very similar proposition to the monkeys. At the beginning of the trial, they had three tokens and they had the choice between one lottery giving one token (or removing one) for certain, and a second lottery giving two tokens (or removing two) half of the time.
To assess the statistical relevancy of the comparison of the behavior of the monkey depending on whether the lottery pair involved gains or losses, we used a chi−squaredtest. The null hypothesis was that animals would make an equal number of risky choices in lotteries involving gains and lotteries involving losses. We set the significance threshold at p = 0.01.
For Monkey H, we collected 88 trials for the pair of lotteries involving gains, 163 trials for the pair involving losses. For Monkey G, we collected 92 trials for the pair of lotteries involving gains, 144 trials for the pair involving losses.
Performance assessing
Lottery pairs with a stochastic dominant option (Type 1–5) were used to verify to check the monkeys’ performance.
Because we did not expect the distribution to be uniform, we computed the median and interquartile range (IQR) of the success rate for each pair of lotteries.
For Monkey H, we collected for lottery pairs Type 1 to 6 the results of respectively 3204, 3290, 6040, 3074, and 3986 trials. For Monkey G, we collected for lottery pairs Type 1 to 6 the results of respectively 2862, 2956, 4969, 2678, and 3473 trials (further details are provided in Table S2).
Consideration of the difference of expected values during trade-offs between quantity and probability
Lottery pairs with no stochastic dominant option (Type 6 & 7) were used to verify that the frequency with which the riskiest option was chosen was dependent on the difference between the expected values of the safest option and of the riskiest option.
To assess this relation, we used an ordinary sigmoid function f to fit the monkeys’ behavior such as:
with Δ the difference of expected values of the two lotteries, β = βG the slope parameter when considering LPG, and β = βL the slope parameter when considering LPL, γ = γG the intercept parameter when considering LPG and γ = γL the intercept parameter when considering LPL. We optimized these two sets of free parameters to fit the data points using a Levenberg-Marquardt algorithm (SciPy library). Margin error have been computed for each parameter value with threshold at p = 0.01.
For Monkey H, the number of trials used was 1947 for LPG and 3005 for LPL; for Monkey G, the number of trials was 1794 for LPG and 2641 for LPL (further details are provided in Table S2).
Attitude toward risk
In order to characterize this attitude toward risk, we optimized for each monkey separately the free parameters of our model, namely ωG, ωL, αG, αL, λG, λL, using a SLSQP optimization algorithm32 (Scipy Library). The optimization was based on minimization of the inverse of the log-likelihood for a given set of parameters. Such log-likelihood is computed as follows:
with θ a particular set of values of our five free parameters, \({n}_{{\mathbb{P}}}=168\) the total number of different lottery pairs a monkey encountered, ci a set of binary values for the pair of lotteries \(i\in 1,{n}_{{\mathbb{P}}}\), each of these binary values indicating if the monkey chose the lottery L1 when facing the pair of lotteries i in a particular trial (the size of this set can vary among the lottery pairs depending on the number of trials the pair i appears), and f being the density function that gives the probability of this observation given the set θ of parameters. As each set of choices for a pair of lotteries i is composed of binary values (i.e. choosing L1 or not), let f be:
with ni the number of trials in which the monkey encounters this pair of lotteries i, ki the number of times the monkey chooses L1 when it encounters the pair of lotteries i, and pi, the (theoretical) probability of choosing the lottery L1 when facing the pair of lotteries i given the set of parameters θ (naming the output of our model given θ). In other words, the value of f value depends only on ki, ni and pi given θ. Knowing that, we can define f as the following binomial mass function:
The trials used for this fit were the same than those for assessing the frequency with which the riskiest option was chosen was dependent on the difference between the expected values of the safest option and of the riskiest option (for Monkey H, the number of trials was 1947 for LPG and 3005 for LPL; for Monkey G, the number of trials was 1794 for LPG and 2641 for LPL; further details are provided in Table S2).
To assess the stability of the fit, we used a cross-validation process by binning the trials in 20 chunks by chronological order for each monkey and computing the average best value over these 20 chunks.
For comparisons of best parameter values for each monkey between those fitting results obtained with LPG and those obtained with LPL, as we did not expect a normal distribution of the data due to clustering effects at the boundaries of the parameter ranges, assessment of statistic relevancy has been made with Mann-Whitney’s U ranking test, applying Bonferroni corrections for multiple comparisons. We set the significance threshold at p = 0.01.
Data Availability
The data are available at the same address than the analysis program: https://github.com/AurelienNioche/MonkeyAnalysis.
Code Availability
The code for monitoring the task and for data analysis has been written in Python, using the Python scientific stack33,34,35. It ran under macOS Sierra. The code for the task is available at https://github.com/AurelienNioche/MonkeyProject. The code for the analysis is available at https://github.com/AurelienNioche/MonkeyAnalysis.
References
Bernoulli, D. Exposition of a new theory on the measurement of risk. In The Kelly Capital Growth Investment Criterion: Theory and Practice, 11–24, https://doi.org/10.2307/1909829 (World Scientific, 2011).
Von Neumann, J. & Morgenstern, O. Theory of games and economic behavior (commemorative edition) (Princeton university press, 2007).
Kahneman, D. & Tversky, A. Prospect theory: An analysis of decision under risk. Econometrica 47, 263–292, https://doi.org/10.2307/1914185 (1979).
Tversky, A. & Kahneman, D. Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and uncertainty 5, 297–323, https://doi.org/10.1007/BF00122574 (1992).
Wakker, P. P. Prospect theory: For risk and ambiguity (Cambridge university press, 2010).
Harder, L. D. & Real, L. A. Why are bumble bees risk averse. Ecology 68, 1104–1108, https://doi.org/10.2307/1938384 (1987).
Dener, E., Kacelnik, A. & Shemesh, H. Pea plants show risk sensitivity. Current Biology 26, 1763–1767, https://doi.org/10.1016/j.cub.2016.05.008 (2016).
McCoy, A. N. & Platt, M. L. Risk-sensitive neurons in macaque posterior cingulate cortex. Nature neuroscience 8, 1220, https://doi.org/10.1038/nn1523 (2005).
O’Neill, M. & Schultz, W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron 68, 789–800, https://doi.org/10.1016/j.neuron.2010.09.031 (2010).
Raghuraman, A. P. & Padoa-Schioppa, C. Integration of multiple determinants in the neuronal computation of economic values. Journal of Neuroscience 34, 11583–11603, https://doi.org/10.1523/JNEUROSCI.1235-14.2014 (2014).
Stauffer, W. R., Lak, A., Bossaerts, P. & Schultz, W. Economic choices reveal probability distortion in macaque monkeys. Journal of Neuroscience 35, 3146–3154, https://doi.org/10.1523/JNEUROSCI.3653-14.2015 (2015).
Genest, W., Stauffer, W. R. & Schultz, W. Utility functions predict variance and skewness risk preferences in monkeys. Proceedings of the National Academy of Sciences 113, 8402–8407, https://doi.org/10.1073/pnas.1602217113 (2016).
Heilbronner, S. R., Rosati, A. G., Stevens, J. R., Hare, B. & Hauser, M. D. A fruit in the hand or two in the bush? divergent risk preferences in chimpanzees and bonobos. Biology Letters 4, 246–249, https://doi.org/10.1098/rsbl.2008.0081 (2008).
Kim, S., Bobeica, I., Gamo, N. J., Arnsten, A. F. & Lee, D. Effects of α-2a adrenergic receptor agonist on time and risk preference in primates. Psychopharmacology 219, 363–375, https://doi.org/10.1007/s00213-011-2520-0 (2012).
Yamada, H., Tymula, A., Louie, K. & Glimcher, P. W. Thirst-dependent risk preferences in monkeys identify a primitive form of wealth. Proceedings of the National Academy of Sciences 110, 15788–15793, https://doi.org/10.1073/pnas.1308718110 (2013).
Heilbronner, S. & Hayden, B. Contextual factors explain risk-seeking preferences in rhesus monkeys. Frontiers in Neuroscience 7, 7, https://doi.org/10.3389/fnins.2013.00007 (2013).
Chen, M. K., Lakshminarayanan, V. & Santos, L. R. How basic are behavioral biases? evidence from capuchin monkey trading behavior. Journal of Political Economy 114, 517–537, https://doi.org/10.1086/503550 (2006).
Farashahi, S., Azab, H., Hayden, B. & Soltani, A. On the flexibility of basic risk attitudes in monkeys. Journal of Neuroscience 2260–17, https://doi.org/10.1523/JNEUROSCI.2260-17.2018 (2018).
Gonzalez, R. & Wu, G. On the shape of the probability weighting function. Cognitive psychology 38, 129–166, https://doi.org/10.1006/cogp.1998.0710 (1999).
Weber, B. J. & Chapman, G. B. Playing for peanuts: Why is risk seeking more common for low-stakes gambles? Organizational Behavior and Human Decision Processes 97, 31–46, https://doi.org/10.1016/j.obhdp.2005.03.001 (2005).
Xu, E. R. & Kralik, J. D. Risky business: rhesus monkeys exhibit persistent preferences for risky options. Frontiers in psychology 5, 258, https://doi.org/10.3389/fpsyg.2014.00258 (2014).
Strait, C. E., Blanchard, T. C. & Hayden, B. Y. Reward value comparison via mutual inhibition in ventromedial prefrontal cortex. Neuron 82, 1357–1366, https://doi.org/10.1016/j.neuron.2014.04.032 (2014).
Keren, G. & Wagenaar, W. A. Violation of utility theory in unique and repeated gambles. Journal of Experimental Psychology: Learning, Memory, and Cognition 13, 387, https://doi.org/10.1037/0278-7393.13.3.387 (1987).
Camilleri, A. R. & Newell, B. R. Mind the gap? description, experience, and the continuum of uncertainty in risky choice. In Progress in brain research, vol. 202, 55–71, https://doi.org/10.1016/B978-0-444-62604-2.00004-6 (Elsevier, 2013).
Heilbronner, S. R. & Hayden, B. Y. The description-experience gap in risky choice in nonhuman primates. Psychonomic bulletin & review 23, 593–600, https://doi.org/10.3758/s13423-015-0924-2 (2016).
Addessi, E. et al. Waiting by mistake: Symbolic representation of rewards modulates intertemporal choice in capuchin monkeys, preschool children and adult humans. Cognition 130, 428–441, https://doi.org/10.1016/j.cognition.2013.11.019 (2014).
Caraco, T., Martindale, S. & Whittam, T. S. An empirical demonstration of risk-sensitive foraging preferences. Animal Behaviour 28, 820–830, https://doi.org/10.1016/S0003-3472(80)80142-4 (1980).
Holt, C. A. & Laury, S. K. Risk aversion and incentive effects. American economic review 92, 1644–1655, https://doi.org/10.1257/000282802762024700 (2002).
Prelec, D. The probability weighting function. Econometrica 497–527, https://doi.org/10.2307/2998573 (1998).
Sutton, R. S. & Barto, A. G. Reinforcement learning: An introduction (MIT press Cambridge, 1998).
Apesteguia, J. & Ballester, M. A. Monotone stochastic choice models: The case of risk and time preferences. Journal of Political Economy 126, 74–106, https://doi.org/10.1086/695504 (2018).
Kraft, D. A software package for sequential quadratic programming. Forschungsbericht- Deutsche Forschungs- und Versuchsanstalt fur Luft- und Raumfahrt (1988).
Jones, E., Oliphant, T. & Peterson, P. SciPy: Open source scientific tools for Python (2001).
van der Walt, S., Colbert, S. C. & Varoquaux, G. The NumPy array: A structure for efficient numerical computation. Computing in Science & Engineering 13, 22–30, https://doi.org/10.1109/mcse.2011.37 (2011).
Hunter, J. D. Matplotlib: A 2d graphics environment. Computing In Science & Engineering 9, 90–95, https://doi.org/10.1109/MCSE.2007.55 (2007).
Tversky, A. & Kahneman, D. Loss aversion in riskless choice: A reference-dependent model. The quarterly journal of economics 106, 1039–1061 (1991).
Camerer, C. F. & Ho, T.-H. Violations of the betweenness axiom and nonlinearity in probability. Journal of risk and uncertainty 8, 167–196, https://doi.org/10.1007/BF01065371 (1994).
Wu, G. & Gonzalez, R. Curvature of the probability weighting function. Management science 42, 1676–1690, https://doi.org/10.1287/mnsc.42.12.1676 (1996).
Acknowledgements
This work was supported by the Agence Nationale de la Recherche (ANR-16-CE38-0003). The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Author information
Authors and Affiliations
Contributions
A.N. performed the experiments and the data analysis; A.N., S.B.-G. and T.B. designed the study and co-wrote the manuscript.
Corresponding author
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Nioche, A., Bourgeois-Gironde, S. & Boraud, T. An asymmetry of treatment between lotteries involving gains and losses in rhesus monkeys. Sci Rep 9, 10441 (2019). https://doi.org/10.1038/s41598-019-46975-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-46975-2
This article is cited by
-
A neuronal prospect theory model in the brain reward circuitry
Nature Communications (2022)
-
Capuchin and rhesus monkeys show sunk cost effects in a psychomotor task
Scientific Reports (2020)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.