Abstract
Evaluation relationships are pivotal for maintaining a cooperative society. A formation of the evaluation relationships has been discussed in terms of indirect reciprocity, by modeling dynamics of good or bad reputations among individuals. Recently, a situation that individuals independently evaluate others with errors (i.e., noisy and private reputation) is considered, where the reputation structure (from what proportion of individuals in the population each receives good reputations, defined as goodness here) becomes complex, and thus has been studied mainly with numerical simulations. The present study gives a theoretical analysis of such complex reputation structure. We formulate the time change of goodness of individuals caused by updates of reputations among individuals. By considering a large population, we derive dynamics of the frequency distribution of goodnesses. An equilibrium state of the dynamics is approximated by a summation of Gaussian functions. We demonstrate that the theoretical solution well fits the numerical calculation. From the theoretical solution, we obtain a new interpretation of the complex reputation structure. This study provides a novel mathematical basis for cutting-edge studies on indirect reciprocity.
Similar content being viewed by others
Introduction
Indirect reciprocity refers to a mechanism of evolution of giving behavior wherein a cooperator is given help not from its beneficiary but from a third party1,2,3. Social information about others, such as reputation or gossip, plays a central role there in order to distinguish between helpful and non-helpful individuals. In our society, it is common for individuals to give good or bad reputations to each other according to how they behaved in previous social encounters. In particular, when we establish a large-scale society, in which they contact not only their relatives but inevitably many strangers, knowing reputations of such strangers is essential. For example, it has been suggested that two thirds of our conversation is about social topics4,5,6, implying the importance of reputation in our daily life. Consequently, complex structure of mutual evaluation among individuals can emerge in a society, where a variety of individuals exist. For example, some may receive good reputations from many individuals, and others may receive bad reputations from many individuals. There may also be intermediate ones who receive good and bad reputations to some equal extent.
Reputation in indirect reciprocity is moral assessment of individuals, namely who is good and who is bad, in a world of binary reputations. Many theoretical models of indirect reciprocity have considered a situation where all in the population give the same reputation to a given individual7,8,9,10,11,12,13,14,15. One of the reasons for this treatment is because the model becomes analytically tractable. Such reputation is called “public reputation”. Under a public reputation model, we need to know how a given individual is evaluated but not by whom, which considerably simplifies the system. The reputation state of all individuals in the population is given by a one-dimensional array, each component of which is how individual (say, i) is evaluated.
To consider a more realistic and general situation, however, we suppose another setting in which each individual independently evaluates a given individual. A reputation given under such a system is called “private reputation”. Under the assumption of private reputation, opinions on the same person may not agree between individuals, and hence we need to know not only how a given one is evaluated but also by whom. The reputation state of all individuals in the population is, thus, generally represented by a two-dimensional matrix (called “image matrix”16,17,18,19,20; each of its components represents how individual (say, i) is evaluated by another individual (say, j).
Reputations can be private if only a part of the individuals in the population can observe a specific interaction7,16,18,19,20,21, if there is a possibility of individually committing errors in assigning reputations to others8,18,20,21,22, and/or if different individuals adopt different rules of reputation assessment16,21,23,24. In recent years, models of private reputation have been used in studies for reasoning a variety of human nature, such as empathetic behaviors25,26,27, prejudicial attitudes28, and so on29,30,31,32. Most of those studies have been based on individual-based computer simulations so far (but see references18,23,30,33,34), primarily because of its difficulty of their analytical treatment. In that respect, the study33 is notable in the sense that it makes a strict, but extreme, assumption that a social interaction is observed by a single observer, in order for the authors to avoid solving infinitely many equations of joint probabilities. However, for a more general setting where many observers independently observe the same social interaction, the nature of “image matrix”, that is, the opinion distribution of who evaluates whom and how, has been studied only through computer simulations. To our knowledge, no analytical insights have been provided so far.
In this study, we analytically tackle the question of private reputation. We assume that all individuals adopt the same “discriminator strategy” (explained in Model section in detail). Following a widespread convention in studies of indirect reciprocity, we consider a world of binary reputation; an individual is deemed either good or bad. A rule of how to assign a reputation is called “social norm”, and we assume that all individuals in the population share the same social norm. However, as a source of disagreement between different individuals on the reputation of the same target, we consider individual errors in reputation assignment; that is, each individual can independently commit an error in assigning a reputation to others. Thus, the same person (say, i) can be deemed good by some individuals and deemed bad by the other individuals in the population at the same time. The “goodness” of individual i is then defined as the proportion of those who regard i as good among all in the population. Under this setting, we derive an integro-differential equation that describes how the frequency distribution of goodnesses in the population changes over time, and calculate its equilibrium distribution. When the population is sufficiently large, we demonstrate that the equilibrium distribution is approximated by a summation of Gaussian functions. Furthermore, we reveal that the equilibrium distribution of goodness very much differs between social norms adopted in the population. We then give intuitive interpretations to each equilibrium. We believe that this study provides a fundamental advance in the study of indirect reciprocity. In addition, the results of this study can lead to unraveling complex relationships among individuals through reputations in a society.
Model
Let us consider a population where there are a certain number, N, of individuals. Suppose that at each time t, either a good or bad reputation is given from every individual to every individual. This corresponds to a case of “private reputation”, where each individual independently assigns a reputation toward the same target. Let \(\beta _{ji}\) be one (resp. zero) if individual i is good (resp. bad) in the eyes of individual j. Matrix \(\{\beta _{ji}\}\) is called the image matrix. As noted in the introduction, the “goodness” of individual i, denoted by \(p_{i}\), is defined as the proportion of individuals who give a good reputation to individual i in the population. Thus, it is given as \(p_i=N_i/N\), where \(N_{i}=\sum _{j=1}^{N} \beta _{ji}\) is the total number of individuals who give a good reputation to individual i.
At each elementary step of update, we randomly select a donor and a recipient from among N individuals (see Fig. 1 for schematics). They may be the same individual, but such a case occurs with probability 1/N and can rightfully be neglected in the following analysis that assumes a large N. The donor takes one of the two actions to the recipient; cooperation or defection. The donor has a rule to choose to cooperate or defect, that can be conditional on the reputation of the recipient in the eyes of the donor. This study supposes that all individuals have the same rule called “discriminator strategy”. A donor with this strategy chooses to cooperate (resp. defect) with a recipient whose reputation is good (resp. bad) in the eyes of the donor. In words of the image matrix, donor (\(i_D\)) chooses cooperation (resp. defection) with recipient (\(i_R\)) if \(\beta _{{i_D}{i_R}}=1\) (resp. \(\beta _{{i_D}{i_R}}=0\)). We suppose that with probability \(0 \le e_1 \le 1/2\), the donor takes the opposite action to the intended one, in which case we say that an “error in action” occurred.
After an action, intended or unintended, is taken by the donor, all individuals independently update the donor’s reputations as observers (see Fig. 1). In words of the image matrix, a reputation of the donor (\(i_D\)) in the eyes of each observer j, which is denoted by \(\beta _{j{i_D}}\), is updated for all j simultaneously. How each observer updates donor’s reputation follows a social norm adopted by the observer. In this study, we consider “second-order” social norms, which are mappings that assign an updated reputation to the donor from a combination of the donor’s actual action (first-order information) and the recipient’s reputation in the eyes of the observer (second-order information)35. We assume that all individuals adopt the same social norm. Here, we suppose that with probability \(0< e_2 < 1/2\), an observer assigns to the donor the opposite reputation to the intended one, in which case we say that an “error in assessment” occurred.
Furthermore, among \(2^4=16\) possible second-order social norms, we focus on four norms: Stern-Judging (SJ), Simple Standing (SS), Shunning (SH), and Scoring (SC), which have often been the main target of studies in the literature of indirect reciprocity among 16 possible second-order norms7,12,14. Table 1 shows how these four norms assign a reputation. Observers with these norms assign a good (resp. bad) reputation to a donor when the donor cooperates (resp. defects) with a good recipient from the observer’s point of view. On the other hand, there are some differences in their ways of reputation assignment when the recipient is bad from the observer’s point of view. First, SC7 gives the same reputation independent of whether the recipient is good or bad. Thus, SC is a first-order norm in accurate classification. Second, SJ14 (also known as “Kandori” after Kandori36) conversely assigns a bad (resp. good) reputation to a donor who cooperates (resp. defects) with the bad recipient. Third, SS12 always gives a good reputation to a donor when the recipient is bad. Fourth, SH3 always gives a bad reputation to a donor when the recipient is bad.
We are interested in what type of structure of reputation assessment between individuals emerges in the population, and why. To this end, we will analytically derive the equilibrium distribution of “goodness” of individuals in the population.
An overview of simulation results
First, we have conducted individual-based computer simulations. Fig. 2-A shows a snapshot of reputation assignment between all the individuals after a sufficiently long time has passed in a simulation. We note that, for social norm SJ, a similar pattern has been observed in the study18 (see their Fig. 2). Hilbe et al.20 have obtained the image matrix for eight different social norms, including SS and SJ (see their Fig. 2). Figure 2-B (colored area) is a frequency distribution of goodness, \(p_i\), in an equilibrium state obtained by computer simulations. The four panels clearly differ from each other, depending on what social norm is employed by the population. Below we will develop a theory that explains those patterns shown in Fig. 2-B.
Formulation of macroscopic dynamics of reputation
We now consider a single update of goodness \(p_i\) (see Fig. 1 for schematics). The update is a process in which a donor and a recipient are randomly chosen from the population, the donor takes an action to the recipient, and all individuals in the population update the donor’s reputation in their eyes. Suppose that the donor is individual \(i_D\) and that the recipient is individual \(i_R\). In the following we denote the social norms employed in the population as \(A={\text{SJ}},{{\text{SS}}},{\text{SH}},{\text{SC}}\).
Because the goodness of the recipient is \(p_{i_R}\) and because the donor is randomly sampled from the population, the probability that the recipient is good in the eyes of the donor is \(p_{i_R}\). Given this, there are two possibilities in donor’s actual action toward the recipient.
In the first possibility, the donor cooperates with the recipient. This occurs with probability
here, the first term of Eq. (1) represents the case in which the recipient’s reputation in the eyes of the donor is good (with probability \(p_{i_R}\)) and the donor succeeds in performing cooperation as intended (with probability \(1-e_1\)). On the other hand, the second term represents the other case in which the recipient’s reputation in the eyes of the donor is bad (with probability \(1-p_{i_R}\)) but the donor erroneously cooperates (with probability \(e_1\)). When the donor cooperates with the recipient, the number of those who assign a good reputation to the donor at the next time step (i.e. after this donor’s cooperation), denoted as \(N_{i_D}'\), is given by
or, in an equivalent shorthand notation;
here, \({{\mathscr {B}}}(n,p)\) represents a binomial distribution with success probability p and trial number n. The first term on the right side of Eq. (3) is the number of individuals who assign good reputations to donor \(i_D\) at the next time step among \(N_{i_R}\) observers who assign good reputations to recipient \(i_R\) at the present time step. There, \(a^{\text{GC}}_A\) indicates the probability that an observer who assigns a good (G) reputation to the recipient at the present time step assigns a good reputation at the next time step to the donor who cooperates (C) with that recipient under social norm A. The values of \(a^{\text{GC}}_A\) can be calculated for each social norm A, and they are shown in Table 2. The second term in the right side of Eq. (3) is the number of individuals who assign good reputations to donor \(i_D\) at the next time step among \(N-N_{i_R}\) observers who assign bad reputations to the recipient at the present time step. There, \(a^{\text{BC}}_A\) indicates the probability that an observer who assigns a bad (B) reputation to the recipient at the present time step assigns a good reputation at the next time step to the donor who cooperates (C) with that recipient under social norm A (see Table 2). For the calculation of \(a^{\text{GC}}_A\) and \(a^{\text{BC}}_A\), compare Tables 1 with 2; G-pivots in Table 1 become \(1-e_{2}\) in Table 2, corresponding to the fact that the assignment of a good reputation to the donor is successful without an error in assessment with probability \(1-e_{2}\), and B-pivots in Table 1 become \(e_{2}\) in Table 2, corresponding to the fact that a good reputation is erroneously assigned to the donor with probability \(e_{2}\).
The expected value and the variance of \(p_{i_D}'=N_{i_D}'/N\) are given by
In the second possibility, the donor defects with the recipient. This occurs with the complementary probability to Eq. (1), that is
The value of \(N_{i_D}'\) at the next time step follows
where we have used the same shorthand notation as Eq. (3). Here, \(a^{\mathrm{GD}}_A\) indicates the probability that an observer who assigns a good (G) reputation to the recipient at the present time step assigns a good reputation at the next time step to the donor who defects (D) with that recipient under social norm A. Similarly, \(a^{\mathrm{BD}}_A\) indicates the probability that an observer who assigns a bad (B) reputation to the recipient at the present time step assigns a good reputation at the next time step to the donor who defects (D) with that recipient under social norm A. See Table 2 for their values.
The expected value and the variance of \(p_{i_D}'=N_{i_D}'/N\) are given by
Two linear functions \(f_A^{\mathrm{C}}\) (defined in Eq. (4)) and \(f_A^{\mathrm{D}}\) (defined in Eq. (8)), as well as their slopes \(\Delta f_A^{\mathrm{C}}\) and \(\Delta f_A^{\mathrm{D}}\), will be of particular importance in the analysis below. In the following, we call \(f_A^{\mathrm{C}}\) and \(f_A^{\mathrm{D}}\) “C-map” and “D-map”, respectively.
Time change of reputation distribution
For simplicity we start with the case of \(N\rightarrow \infty\), where the variance \(s^2\) in Eqs. (5) and (9) is ignored. Let us define \(\phi (p)\) as a frequency distribution of individuals with goodness p in the population. Then, its time evolution is given by
here, we use \(\delta (\cdot )\) as a Dirac delta function. In Eq. (10), the first term on the right side represents a loss of individuals with goodness p due to updates of their reputations. The first (resp. second) term inside the integral on the right side represents donors with an updated goodness p after meeting a recipient with goodness \(p'\) and cooperating (resp. defecting) with him/her.
Next, we consider a case of \(1\ll N<\infty\), and replace delta functions in Eq. (10) with Gaussian functions, because binomial distribution is well approximated by Gaussian distribution for large N. In the following, we represent a Gaussian function with mean \(\mu\) and variance \(\sigma ^2\) by
Accordingly, \(\delta (p-f_A^{\mathrm{C}}(p'))\) and \(\delta (p-f_A^{\mathrm{D}}(p'))\) in Eq. (10) are replaced with \(g(p;f_A^{\mathrm{C}}(p'),s^2)\) and \(g(p;f_A^{\mathrm{D}}(p'),s^2)\), respectively. Thus we obtain
A calculation of equilibrium state
Again, we start with the case of \(N\rightarrow \infty\). When \(\mathrm{d}\phi /\mathrm{d}t=0\) is satisfied in Eq. (10), an equilibrium state \(\phi =\phi ^*\) of the equation is given by
We assume that this equilibrium state is described by a summation of delta functions with peak \(\mu _j\) and mass \(q_j\) (\(j=1, \ldots )\), i.e.,
By substituting Eq. (14) in Eq. (13), we obtain
Thus, the problem in the case of \(N\rightarrow \infty\) is to derive pairs \(\{(q_j,\mu _j)\}_{j=1, \ldots }\) which satisfy Eq. (15).
Next, we consider the case of \(1\ll N<\infty\). From Eq. (12), an equilibrium state \(\phi =\phi ^*\) is given by
here we assume that this equilibrium state is given by a summation of Gaussian functions;
We further assume that deviations \(\sigma _j\) are negligible in the order of O(1) and that
holds. When we substitute Eq. (17) into Eq. (16), we obtain
here, from the second to third line, we have used the following two approximations. One is that the interval of integral \(0\le p'\le 1\) is replaced with \(-\infty< p' < \infty\). The other is that some but not all \(p'\) are replaced with \(\mu _j\). A rationale behind these approximations are that \(g(p';\mu _j,\sigma _j^2)\) is almost zero outside the interval \(\mu _j - O(N^{-1/2})< p' < \mu _j + O(N^{-1/2})\), the width of which is as small as \(O(N^{-1/2})\). From the third to fourth line in Eq. (19), we have calculated an integral of a product of two Gaussian functions through completing the square with respect to \(p'\), as
Thus, the problem in the case of \(1\ll N<\infty\) is to derive triples \(\{(q_j,\mu _j,\sigma _j)\}_{j=1, \cdots }\) which satisfy Eq. (19).
Now we give an intuitive interpretation of Eq. (19). The left side of Eq. (19) represents a summation of Gaussian functions with mean \(\mu _j\) and variance \(\sigma _j^2\), whereas the right side represents another summation of Gaussian functions, which have been transformed from the original summation. Let us call individuals represented by the jth Gaussian function \(g(p;\mu _j,\sigma _j^2)\) with mass \(q_{j}\) “class-j” individuals. Eq. (19) tells us that among those donors who interact with class-j recipients, the fraction \(h(\mu _j)\) of them cooperate with their recipients, and the distribution of their updated goodness becomes \(g(p;f_A^{\mathrm{C}}(\mu _j),s^2+(\Delta f_A^{\mathrm{C}})^2\sigma _j^2)\). The transition of mean, \(\mu _j\mapsto f_A^{\mathrm{C}}(\mu _j)\), is governed by the C-map. As for the transition of variance, \(\sigma _j^2\mapsto s^2+(\Delta f_A^{\mathrm{C}})^2\sigma _j^2\), the first term \(s^2\) represents newly generated variance due to errors in assessment and to the finiteness of the population size. The second term \((\Delta f_A^{\mathrm{C}})^2\sigma _j^2\) means that the variance \(\sigma _j^2\) that originally existed in the distribution of goodness of class-j recipients is damped by the C-map (recall that its slope is \(\Delta f_A^{\mathrm{C}}\)). Similarly, among those donors who interact with class-j recipients, the fraction \(1-h(\mu _j)\) of them defect with their recipients, and the distribution of their updated goodness becomes \(g(p;f_A^{\mathrm{D}}(\mu _j),s^2+(\Delta f_A^{\mathrm{D}})^2\sigma _j^2)\). Similar explanations are possible for the transition of mean, \(\mu _j\mapsto f_A^{\mathrm{D}}(\mu _j)\) and for the transition of variance, \(\sigma _j^2\mapsto s^2+(\Delta f_A^{\mathrm{D}})^2\sigma _j^2\).
Equilibrium state for each social norm
We now give an overview of our calculation of the equilibrium state for each social norm, \(A=\mathrm{SJ},\mathrm{SS},\mathrm{SH},\mathrm{SC}\). Fig. 2-B shows that analytical solutions to Eq. (19) excellently fit results of computer simulations (see SI for a more detailed calculation of \((q_j, \mu _j,\sigma _j)\)).
As seen in Eq. (19), C-map (\(f_{A}^{\mathrm{C}}\)) and D-map (\(f_{A}^{\mathrm{D}}\)) play an important role in considering the transition of each peak position \(\mu _j\). As Fig. 3-A illustrates, these C-map and D-map differ depending on the social norm that the population adopts. If there was only one map f, sequentially applying this map would lead to a fixed point, which is a crossing point of map f and the identity map (represented by a 45 degree line), as Fig. 3-B illustrates, and this fixed point would correspond to the peak position of the single Gaussian distribution at an equilibrium state. In our case, we have two maps \(f_{A}^{\mathrm{C}}\) and \(f_{A}^{\mathrm{D}}\) so the situation is different, but analyzing a fixed point of each map is still crucial for analyzing Eq. (19).
Below we will study each social norm.
When the social norm is SJ: As Fig. 3-A shows, both C-map and D-map have the same fixed point, \(p=1/2\). Thus, the only possible peak position of Gaussian distributions at the equilibrium state is at
The equilibrium distribution is given by a single Gaussian distribution.
When the social norm is SS: As Fig. 3-A shows, the C-map is a constant map, \(f_{\mathrm{SS}}^{\mathrm{C}}(p)=1-e_2\), so this position is one of the peaks of the Gaussian distributions at the equilibrium state;
(see an illustration in Fig. 4-A). The other peaks can be obtained by repeatedly applying the D-map. More specifically, \((j+1)\)-th peak position \(\mu _{j+1}\) is obtained by
(see an illustration in Fig. 4-B). These infinite classes allow us to characterize the population.
When the social norm is SH: As Fig. 3-A shows, the D-map is a constant map, \(f_{\mathrm{SH}}^{\mathrm{D}}(p)=e_2\), so this position is one of the peaks of the Gaussian distributions at the equilibrium state;
The other peaks can be obtained by repeatedly applying the C-map for the same reason as in the case of \(A=\mathrm{SS}\). Thus, \((j+1)\)-th peak position \(\mu _{j+1}\) is obtained by
When the social norm is SC: Both C-map and D-map are constant maps; \(f_{\mathrm{SC}}^{\mathrm{C}}(p)=1-e_2\) and \(f_{\mathrm{SC}}^{\mathrm{D}}(p)=e_2\). Thus, there are two possible peak positions of Gaussian distributions at the equilibrium state. They are at
and the equilibrium distribution is given by a summation of two Gaussian distributions.
We can also derive \(\sigma _j^2\) and \(q_j\) for each social norm. See SI for the detailed calculation. Here we only summarize the results in Table. 3.
Based on Table 3, we now describe the equilibrium distribution of goodness in the population for each social norm.
When the social norm is SJ: All individuals receive good reputations from almost a half of the population and receive bad reputations from almost the other half of the population. The average goodness in the population is 1/2. Surprisingly, the two error rates \(e_1\) and \(e_2\) do not affect the equilibrium distribution at all.
When the social norm is SS: There are an infinite number of peaks in the equilibrium distribution. The highest one is at \(\mu _{1}=1-e_{2}\) and individuals that belong to this class-1 are those who receive good reputations the most. The second highest peak is at \(\mu _{2} = 2e_{2}(1-e_{2})\) and individuals that belong to this class-2 are those who receive bad reputations the most. The positions of the third, fourth highest peaks and so on are arranged in an oscillating fashion across 1/2 as \(\mu _2< \mu _4< \cdots< 1/2< \cdots< \mu _3 < \mu _1\). The average goodness in the population is relatively high compared with the other three social norms.
When the social norm is SH: There are an infinite number of peaks in the equilibrium distribution. The highest one is at \(\mu _{1}=e_{2}\) and individuals that belong to this class-1 are those who receive a good reputation the least. The positions of the second, third highest peaks and so on are monotonically increasing as \(\mu _1< \mu _2< \mu _3< \cdots < 1/2\). The average goodness in the population is relatively low compared with the other three social norms.
When the social norm is SC: A half of the individuals receive good reputations from a majority of individuals (i.e., high goodness, \(\mu _1=1-e_2\)), and the other half receive bad reputations from a majority of individuals (i.e., low goodness, \(\mu _2=e_2\)). The average goodness in the population is 1/2, which is the same as in the case of SJ. However, there is a large difference in the frequency distribution of goodnesses between SJ and SC, as shown in Fig. 2-B. The action error rate, \(e_1\), does not affect the equilibrium distribution at all.
Remarks on SS: The equilibrium distribution of goodness under SS is especially interesting because there are some individuals with low goodness (such as class-2) although the average goodness in the population is high. Here, we explain a mechanism of how such an equilibrium distribution is formed under SS. First of all, SS tends to generate many individuals with high goodnesses labeled as class-1. This is because once a donor cooperates with a recipient, observers assign good reputations to the donor under SS regardless of whether the recipient’s reputation in the eyes of those observers is good or bad, unless observers commit an error in assessment (see Fig. 5-A). On the other hand, SS also generates a small number of individuals with low goodness labeled as class-2. Such individuals with low goodness emerge when a donor defects with a recipient in class-1, either because the donor belongs to a minority of individuals who think the recipient is bad or because the donor thinks the recipient is good but this donor erroneously chooses defection as opposed to his/her intention. In either case, such a donor receives bad reputations from almost all observers and descend to class-2, because in the eyes of those observers the donor’s defection is seen as a defection against a good recipient (see Fig. 5-B). The mechanism of how individuals in class-\((j+1)\) are generated is similar; a donor who defects with a recipient in class-j moves to class-\((j+1)\).
One might expect that the goodness of a randomly sampled individual from the population that employs SS should always be higher than the goodness of a randomly sampled individual from the population that employs SJ, because SS assigns a good reputation in more cases than SJ (compare SS an SJ in Table 1; if a donor receives a good reputation under SJ, such a donor would also receive a good reputation under SS). However, this naive expectation is not true because class-2 individuals (and more generally, class-2j individuals) under SS have the goodness of less than 1/2, whereas all individuals under SJ have the goodness of about 1/2. This apparently paradoxical phenomenon is now explained as follows. Observers under SS more frequently assign good reputations than those under SJ, and thus generate a lot of individuals with high goodness (i.e., class-1 individuals). However, the existence of such individuals in turn causes the emergence of a minority of individuals with low goodness (such as class-2 individuals). As a result, a large divide with respect to one’s goodness occurs among individuals in the population that employs SS; extremely good individuals and extremely bad individuals coexist there.
Discussion and conclusion
This study theoretically analyzed a question of how reputation relationships among individuals are established, by using a model of indirect reciprocity. Under the assumption of private reputations, the question has mainly been discussed by computer simulations until now, except for few studies18,33. Here we formulated a change of “goodness” of an individual, which is defined as the proportion of individuals who regard the focal individual as good, by a stochastic process (Eqs. (3) and (7)). Then, we formulated time evolution of a frequency distribution of goodness in the population by a deterministic integro-differential equation (Eq. (12)). By employing an approximation that uses a mixture Gaussian distribution and assumes a large population size, we obtained a closed equation that the equilibrium distribution must satisfy (Eq. (19)). We succeeded in calculating the equilibrium distribution of goodness (Table 3) and interpreted its meaning.
As far as we know, this is the first study that has analytically derived the equilibrium frequency distribution of goodness for a model of indirect reciprocity that assumes private reputations, and we believe that our study provides a major advance in theoretical studies of indirect reciprocity. As relevant literature, we compare our approach with two recent works that have analytically studied a model of private reputations.
Uchida and Sasaki18 analyzed the average goodness in the population under the SJ social norm for a model of private assessment, and reached the conclusion that it is 1/2. In contrast, our study has derived the distribution of goodness. From this obtained distribution it is easy to calculate the average goodness under SJ, that is 1/2. Moreover, we have analyzed three other social norms, SS, SH, and SC. By using the approach developed in this paper, it is possible to analyze the other 12 second-order social norms that have not been studied here in a similar manner.
Okada et al.33 studied cases where there is always only one observer who updates his/her private reputation of a donor. By making such an extreme assumption, the authors successfully avoided calculating higher-order correlations between reputations of the same individual among observers. In contrast, we have assumed that all individuals in the population play a role of observers and update their private reputation of the same donor simultaneously. Such an approach explicitly considers correlations in opinions among observers. It will be interesting to develop a similar theoretical framework to ours that studies a model in which only a part of the individuals in the population (say, proportion \(0< \theta < 1\)) become observers and simultaneously update their private reputations of the same donor. We leave it as a future study.
As significant progress in the analysis of reputation structure, this study treated a model that all the players adopt the (1) same (2) second-order social norms under (3) random interactions between a donor and a recipient. However, this simple model may not perfectly reflect a real human society. First, the society consists of various kinds of people who have different viewpoints, i.e., different social norms. This extension brings another question of which social norms can be evolutionarily advantageous, concerning studies on the emergence of cooperation11,37,38,39 and exploitation40,41,42. Second, real people may take more information into account than second-order social norms do when they assign reputations to others, such as third-order information (i.e. the current reputation of a donor) (e.g., social norms named standing43, staying44 and consistent standing20) or more35,45. Such additional pieces of information will bring more complexity to the reputation structure among people35,45. Third, real people interact mainly with neighbors or friends. Such biased interactions are often modeled by introducing lattices or complex networks46,47,48,49,50,51,52,53,54,55,56,57. Our study can be applied to the analysis of reputation structure even for such extended situations in the future.
There are various kinds of people in a society, from those who receive good reputations from many people to those who receive good reputations from a few. Such diversity is established by complex dynamics of mutual evaluation of their behavior. This study theoretically approached such complex dynamics. Although there are some differences between our simple model and a real society, our findings give some basic insight into the mechanism of how good and bad individuals emerge in the context of indirect reciprocity (corresponding to “generalized exchange”58,59,60,61 in sociology). In conclusion, this study provides a new theoretical approach to investigate reputation structure in the population where individuals privately assess each other.
Data availability
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Alexander, R. D. The Biology of Moral Systems (Aldine de Gruyter, 1987).
Nowak, M. A. & Sigmund, K. Evolution of indirect reciprocity by image scoring. Nature 393, 573–577 (1998).
Nowak, M. A. & Sigmund, K. Evolution of indirect reciprocity. Nature 437, 1291–1298 (2005).
Emler, N. Gossip, Reputation, and Social Adaptation (University Press of Kansas, 1994).
Dunbar, R. I. M. Grooming, Gossip, and the Evolution of Language (Harvard University Press, 1998).
Dunbar, R. I. Gossip in evolutionary perspective. Rev. General Psychol. 8, 100–110 (2004).
Nowak, M. A. & Sigmund, K. The dynamics of indirect reciprocity. J. Theoret. Biol. 194, 561–574 (1998).
Leimar, O. & Hammerstein, P. Evolution of cooperation through indirect reciprocity. Proc. R. Soc. Lond. Series B Biol. Sci. 268, 745–753 (2001).
Panchanathan, K. & Boyd, R. A tale of two defectors: The importance of standing for evolution of indirect reciprocity. J. Theoret. Biol. 224, 115–126 (2003).
Ohtsuki, H. & Iwasa, Y. How should we define goodness? Reputation dynamics in indirect reciprocity. J. Theoret. Biol. 231, 107–120 (2004).
Ohtsuki, H. & Iwasa, Y. The leading eight: Social norms that can maintain cooperation by indirect reciprocity. J. Theoret. Biol. 239, 435–444 (2006).
Ohtsuki, H. & Iwasa, Y. Global analyses of evolutionary dynamics and exhaustive search for social norms that maintain cooperation by reputation. J. Theoret. Biol. 244, 518–531 (2007).
Brandt, H. & Sigmund, K. Indirect reciprocity, image scoring, and moral hazard. Proc. Natl. Acad. Sci. 102, 2666–2670 (2005).
Pacheco, J. M., Santos, F. C. & Chalub, F. A. C. Stern-judging: A simple, successful norm which promotes cooperation under indirect reciprocity. PLoS Comput. Biol. 2, e178 (2006).
Suzuki, S. & Akiyama, E. Evolution of indirect reciprocity in groups of various sizes and comparison with direct reciprocity. J. Theoret. Biol. 245, 539–552 (2007).
Uchida, S. Effect of private information on indirect reciprocity. Phys. Rev. E 82, 036111 (2010).
Sigmund, K. Moral assessment in indirect reciprocity. J. Theoret. Biol. 299, 25–30 (2012).
Uchida, S. & Sasaki, T. Effect of assessment error and private information on stern-judging in indirect reciprocity. Chaos Solitons Fractals 56, 175–180 (2013).
Okada, I., Sasaki, T. & Nakai, Y. Tolerant indirect reciprocity can boost social welfare through solidarity with unconditional cooperators in private monitoring. Sci. Rep. 7, 1–11 (2017).
Hilbe, C., Schmid, L., Tkadlec, J., Chatterjee, K. & Nowak, M. A. Indirect reciprocity with private, noisy, and incomplete information. Proc. Natl. Acad. Sci. 115, 12241–12246 (2018).
Brandt, H. & Sigmund, K. The logic of reprobation: Assessment and action rules for indirect reciprocation. J. Theoret. Biol. 231, 475–486 (2004).
Yamamoto, H., Okada, I., Uchida, S. & Sasaki, T. A norm knockout method on indirect reciprocity to reveal indispensable norms. Sci. Rep. 7, 1–7 (2017).
Uchida, S. & Sigmund, K. The competition of assessment rules for indirect reciprocity. J. Theoret. Biol. 263, 13–19 (2010).
Uchida, S., Yamamoto, H., Okada, I. & Sasaki, T. A theoretical approach to norm ecosystems: Two adaptive architectures of indirect reciprocity show different paths to the evolution of cooperation. Front. Phys. 6, 14 (2018).
Radzvilavicius, A. L., Stewart, A. J. & Plotkin, J. B. Evolution of empathetic moral evaluation.. Elife 8, e44269 (2019).
Krellner, M. et al. Putting oneself in everybody’s shoes-pleasing enables indirect reciprocity under private assessments. in ALIFE 2020: The 2020 Conference on Artificial Life, 402–410 (MIT Press, 2020).
Krellner, M. et al. Pleasing enhances indirect reciprocity-based cooperation under private assessment. Artif. Life 31, 1–31 (2021).
Whitaker, R. M., Colombo, G. B. & Rand, D. G. Indirect reciprocity and the evolution of prejudicial groups. Sci. Rep. 8, 1–14 (2018).
Brush, E., Brännström, Å. & Dieckmann, U. Indirect reciprocity with negative assortment and limited information can promote cooperation. J. Theoret. Biol. 443, 56–65 (2018).
Lee, S., Murase, Y. & Baek, S. K. Local stability of cooperation in a continuous model of indirect reciprocity. Sci. Rep. 11, 1–13 (2021).
Schmid, L., Shati, P., Hilbe, C. & Chatterjee, K. The evolution of indirect reciprocity under action and assessment generosity. Sci. Rep. 11, 1–14 (2021).
Murase, Y., Kim, M. & Baek, S. K. Social norms in indirect reciprocity with ternary reputations. Sci. Rep. 12, 1–15 (2022).
Okada, I., Sasaki, T. & Nakai, Y. A solution for private assessment in indirect reciprocity using solitary observation. J. Theoret. Biol. 455, 7–15 (2018).
Lee, S., Murase, Y. & Baek, S. K. A second-order perturbation theory for the continuous model of indirect reciprocity. arXiv preprint arXiv:2203.03920 (2022).
Santos, F. P., Pacheco, J. M. & Santos, F. C. The complexity of human cooperation under indirect reciprocity. Philos. Trans. R. Soc. B 376, 20200291 (2021).
Kandori, M. Social norms and community enforcement. Rev. Econ. Stud. 59, 63–80 (1992).
Hamilton, W. D. The genetical evolution of social behaviour. II. J. Theoret. Biol. 7, 17–52 (1964).
Axelrod, R. & Hamilton, W. D. The evolution of cooperation. Science 211, 1390–1396 (1981).
Nowak, M. A. Five rules for the evolution of cooperation. Science 314, 1560–1563 (2006).
Press, W. H. & Dyson, F. J. Iterated prisoner’s dilemma contains strategies that dominate any evolutionary opponent. Proc. Natl. Acad. Sci. 109, 10409–10413 (2012).
Fujimoto, Y. & Kaneko, K. Emergence of exploitation as symmetry breaking in iterated prisoner’s dilemma. Phys. Rev. Res. 1, 033077 (2019).
Fujimoto, Y. & Kaneko, K. Exploitation by asymmetry of information reference in coevolutionary learning in prisoner’s dilemma game. J. Phys. Complexity 2, 045007 (2021).
Sugden, R. The Economics of Rights, Co-operation and Welfare (Basil Blackwell, 1986).
Sasaki, T., Okada, I. & Nakai, Y. The evolution of conditional moral assessment in indirect reciprocity. Sci. Rep. 7, 1–8 (2017).
Santos, F. P., Santos, F. C. & Pacheco, J. M. Social norm complexity and past reputations in the evolution of cooperation. Nature 555, 242–245 (2018).
Fu, F., Hauert, C., Nowak, M. A. & Wang, L. Reputation-based partner choice promotes cooperation in social networks. Phys. Rev. E 78, 026117 (2008).
Traag, V. A., Van Dooren, P. & Nesterov, Y. Indirect reciprocity through gossiping can lead to cooperative clusters. in 2011 IEEE Symposium on Artificial Life (ALIFE), 154–161 (IEEE, 2011).
Masuda, N. Ingroup favoritism and intergroup cooperation under indirect reciprocity based on group reputation. J. Theoret. Biol. 311, 8–18 (2012).
Nakamura, M. & Masuda, N. Groupwise information sharing promotes ingroup favoritism in indirect reciprocity. BMC Evolut. Biol. 12, 1–12 (2012).
Oishi, K., Shimada, T. & Ito, N. Group formation through indirect reciprocity. Phys. Rev. E 87, 030801 (2013).
Tian, L.-L., Li, M.-C. & Wang, Z. Cooperation enhanced by indirect reciprocity in spatial prisoner’s dilemma games for social p2p systems. Physica A Stat. Mech. Appl. 462, 1252–1260 (2016).
Gross, J. & De Dreu, C. K. The rise and fall of cooperation through reputation and group polarization. Nat. Commun. 10, 1–10 (2019).
Dong, Y., Sun, S., Xia, C. & Perc, M. Second-order reputation promotes cooperation in the spatial prisoner’s dilemma game. IEEE Access 7, 82532–82540 (2019).
Roberts, G. et al. The benefits of being seen to help others: Indirect reciprocity and reputation-based partner choice. Philos. Trans. R. Soc. B 376, 20200290 (2021).
Oishi, K., Miyano, S., Kaski, K. & Shimada, T. Balanced-imbalanced transitions in indirect reciprocity dynamics on networks. Phys. Rev. E 104, 024310 (2021).
Santos, F. P., Santos, F. C., Pacheco, J. M. & Levin, S. A. Social network interventions to prevent reciprocity-driven polarization. in Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, 1643–1645 (2021).
Podder, S., Righi, S. & Takács, K. Local reputation, local selection, and the leading eight norms. Sci. Rep. 11, 1–10 (2021).
Levi-Slrauss, C. Structures élémentaire de la parenté (Presses Universitaires de France, 1949).
Ekeh, P. Social Exchange Theory: The Two Traditions (Harvard University Press, 1974).
Yamagishi, T. & Cook, K. S. Generalized exchange and social dilemmas. Social Psychol. Quart. 56, 235–248 (1993).
Takahashi, N. The emergence of generalized exchange. Am. J. Sociol. 105, 1105–1134 (2000).
Acknowledgements
Y.F. acknowledges the support by JSPS KAKENHI Grant Number JP21J01393. H.O. acknowledges the support by JSPS KAKENHI Grant Number JP19H04431.
Author information
Authors and Affiliations
Contributions
Y.F. and H.O. designed research, calculated results numerically and analytically, and wrote the paper.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Fujimoto, Y., Ohtsuki, H. Reputation structure in indirect reciprocity under noisy and private assessment. Sci Rep 12, 10500 (2022). https://doi.org/10.1038/s41598-022-14171-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-14171-4
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.