Abstract
Efficient foraging is essential to survival and depends on frontal cortex in mammals. Because of its role in psychiatric disorders, frontal cortex and its contributions to reward procurement have been studied extensively in both rodents and non-human primates. How frontal cortex of these animal models compares is a source of intense debate. Here we argue that translating findings from rodents to non-human primates requires an appreciation of both the niche in which each animal forages as well as the similarities in frontal cortex anatomy and function. Consequently, we highlight similarities and differences in behavior and anatomy, before focusing on points of convergence in how parts of frontal cortex contribute to distinct aspects of foraging in rats and macaques, more specifically. In doing so, our aim is to emphasize where translation of frontal cortex function between species is clearer, where there is divergence, and where future work should focus. We finish by highlighting aspects of foraging for which have received less attention but we believe are critical to uncovering how frontal cortex promotes survival in each species.
Similar content being viewed by others
Introduction
All animals, both human and non-human, need to forage in order to maintain nutrient homeostasis. In the wild, animals spend a large portion of their day searching for and then consuming sustenance. While most modern humans do not spend the majority of their day foraging, our human ancestors certainly did. Thus, the need to efficiently find food was a strong evolutionary pressure that selected for specific traits that were then passed down through genes. For each species, their environmental niche would have promoted traits or cognitive abilities that would have increased their foraging success. Thus, appreciating the foraging strategies engaged by a species is essential to understanding what shaped its biology in general and its brain in particular.
Foraging relies upon first assessing where to look for sustenance based on an evaluation of the quality and a prediction of the availability of food. Then behaviors can be planned to maximize food procurement over time. Resource assessment and planning functions are closely associated with functions ascribed to frontal cortex [1, 2]. By understanding how animals typically forage we may be able to glean insight into the functions of frontal cortex across species [3].
The link between foraging and frontal cortex is particularly relevant to current discussions on the relationship between rodent and primate frontal cortex, which is our primary focus in this review. This question is essential for understanding how to interpret the myriad of results from neuroscientific studies of frontal cortex in rats to macaques, which we primarily focus on here. This debate has often focused heavily on neuroanatomy, for instance on the differences in the cytoarchitecture—the layered organization of neurons in an area of brain—of frontal cortex between the species [4]. Here we advocate for a more holistic view that incorporates frontal cortex anatomy within the context of foraging behaviors. In that regard, our approach incorporates neuroethological approaches to cross-species comparisons and is similar to the approach taken by Cisek [5].
Consequently, in this review, we first discuss commonalities and differences in foraging behavior across rats and macaques, but also draw on research from mice and marmosets as well. We believe that foraging niche is germane to understanding the distinctions between frontal cortex in these two animals. Then we delve into the anatomical organization of frontal cortex in rats and macaques. Rather than center our analysis on the evolution of neuroanatomy (which can be found in Preuss and Wise, in this issue) or evolution more generally [5], here we focus on cytoarchitecture and the connections of frontal cortex. In particular, we review recent comparative work that has explored the correspondences and distinctions in frontal cortex connections in rats and macaques [6, 7]. We then turn to comparing functional anatomy, highlighting commonalities in the roles that two parts of frontal cortex, orbitofrontal (OFC) and anterior cingulate cortex (ACC) play in foraging as assessed by reward-guided tasks. We concentrate on these areas as their relationship between rats and macaques is more apparent, although as we will discuss key differences remain.
We finish by highlighting the aspects of foraging that we believe have not received ample consideration and which are markedly different between rodents and primates: foraging range and “time horizon” [8]. Here we do not mean time in terms of the delay to receiving food on the order of seconds but rather in days, weeks, or even seasonal changes in food resources; the kind of information pertinent to foraging success and therefore survival in all animals over the course of their lives. Closely related to the consideration of foraging ranges and time horizons in rats and macaques, we acknowledge there may also be important distinctions and parallels in attention and working memory functions [9]. However, due to space considerations we limit our review to reward-related foraging and results of experiments with that primary assessment in mind.
Foraging behaviors in rodents and non-human primates
When foraging, all animals, both rodents and primates included, must solve a number of problems to find food. They must perceive and determine food availability, incorporating an assessment of probability, risk, and the cost required to procure the food (i.e., make a Prediction). They must also assess the quality of food among available options (i.e., make an Evaluation). Finally, they must adopt a strategy, or a plan as to how and when to forage, when to explore and seek information about the environment vs. maximizing a known food patch (i.e., plan a set of Actions). These three aspects of foraging have clear associations with concepts linked to stimulus, response, and outcome processes from behavioral learning theory [10]. How different animals solve the prediction, evaluation and action problems, and thus forage, depends on many factors but is heavily influenced by their homeostatic needs as well as their perceptual and physical abilities (Fig. 1).
In primates, there are many explanations for brain evolution ranging from genetic, developmental, social, and ecological to include some aspect of foraging [11, 12]. Recent evidence suggests that meeting the energetic and dietary needs of a rapidly accelerating metabolism [13] was a primary driver in increasing brain-to-body size ratio; perhaps even more influential than the role of increasing social complexity and cooperative group sizes needed for foraging [11]. All explanations for primate brain evolution are based largely on correlational evidence, so there is likely no single mechanism and instead several possibilities for increases in frontal cortex size and specialization, and the innovation of a granular prefrontal cortex, in particular [3]. The need for more efficient and successful foraging played a major role in that development, however what is clear is that rodent and primate lineages diverged 60–70 million years ago, and thus it would be reasonable to assume that differences in frontal cortex enabled adaptation of each animal to their niche.
The most commonly studied non-human primate in neuroscience is the Old World macaque monkey, although New World monkeys such as marmosets are becoming increasingly used. In the wild, macaques’ diet includes seeds, cereals, buds, bark, and fruit. In order to find these foods in ample supply, macaques forage over large distances primarily relying on vision to identify foods. As a consequence, their ranges typically span several thousand hectares [14]. With such a foraging range, perceiving available food stuffs at a distance, planning what type of food to forage for, the time of day in which to do so, and estimating the egocentric distance in accordance with the scarcity and ephemerality of resources are key considerations [15,16,17]. These abilities are thought to have arisen from the mental mapping requirements of frugivorous species and the greater need for ecological sophistication [15]. Indeed, forming large spatial-temporal maps or mental representations of the foraging range, as well as discriminating and using both visual and olfactory cues to guide selection of fruits at precisely the right times, are crowning features of primate foraging behavior. Other mammals including rodents do “plan ahead” and cache food in anticipation of seasonal changes, and it is believed this ability coevolved primarily with provisioning offspring, preventing theft of high-value foods, and avoiding the “high costs of a variable environment” [18]. Importantly, rats cache over much smaller ranges, time horizons, and throughout a much shorter life span (i.e., fewer seasonal changes) compared to macaques.
A particularly interesting aspect of the foraging environment is the possibility of the emergence of “foraging innovations” [11], when the species samples new foods and/or adopts new strategies to procure foods. These often lead to increases in the energy flow to the organism, and thus success in mastering the unique foraging niche (Fig. 1). Given the above considerations on the need for primates to plan ahead for the right time to harvest (at a much longer time horizon), we surmise that many foraging innovations in the primate arose to enhance the Prediction function of frontal cortex, particularly those contributing to the formation of mental maps used for future planning in space and time. These innovations, resulting in enhanced mental representations, may correspond to specializations of granular OFC, ventrolateral prefrontal cortex (VLPFC), and dorsolateral prefrontal cortex, in particular [3].
Compared to macaques, the foraging ranges and time horizons of rats are much smaller, in accordance with their smaller body size and dependence on odor-guided navigation [19]. Their ranges are also bounded by the assessment of predation risk [20] and the reach of their perceptual capabilities in discriminating the cues associated with that risk. Without prior knowledge of their environment, a rat’s foraging range is the airborne “odor plume” gradient toward the odor source, making stimulus discrimination critical to initial foraging in unknown territories. Yet with increased experience with the locations of the odor sources, rodents switch their foraging strategy to weight knowledge of previous locations more heavily, resulting in a more efficient search strategy [14].
Rat foraging is also affected by indirect, not direct, cues signaling predation risk: the former being more reliable for estimating risk from a wider range of predators than the latter. For example, rodents will collect more food on nights with low moonlight and greater precipitation than in the presence of a specific predator odor [21]. Thus, foraging innovations in rodent species may have arisen in favor of enhancing the assessment of cues in their more immediate environments with short time horizons, or the Evaluation functions of frontal cortex. In summary, though both rodent and non-human primates necessarily engage in Evaluation and Prediction functions for optimal food procurement, mastery of their unique foraging niches likely favored one function over the other. With wide foraging ranges, macaques have to rely on aspects of prediction to increase their chance of finding high-energy foods, whereas in rats, evaluating proximate options likely enhances survival when foraging locally.
The Action function may be most similar across rodent and primate species as it involves a convergence of evidence accumulation pathways to resolve a single outcome among all possible alternatives. Mechanistically, action selection requires interactions of frontal cortex with sensorimotor systems, shaped by adaptation to foraging environments in both rodent and primate species [22]. We review anatomical boundaries of rat frontal cortex and macaque frontal cortex along with their functions, next.
Comparative brain anatomy
Macaques and rats forage in very different ways, as the prior section highlights. Macaques use highly developed visual perceptual abilities to forage over large ranges to find high-energy foods that are essential to meeting its homeostatic needs; rats rely on acutely developed olfactory abilities to forage more locally. When thinking about how these differences in foraging may relate to neuroanatomy it may be useful to consider an analogy from the world of business.
At their most elemental, large international businesses like Airbus are not so different from your local independent grocery store: both need to balance profit and loss by seeking out paying customers, and both need to conduct this important process of accounting. Despite these similarities, there are meaningful differences in size and economic niche that necessitate different organizational structures. For instance, marketing as well as research and development divisions of a large corporation like Airbus are highly specialized teams, sometimes many hundreds of people who are dedicated to each function. The marketing at your local grocery store might be a single person who also has other duties, whereas research and development may simply not be covered by anyone. Critically, and perhaps most relevant to our topic here, some functions such as accounting can be studied in one company and reliably translated to the other, although such functions may be more distributed in larger companies. To return to comparisons of rat and macaque frontal cortex, given the divergence in foraging niches, differences in frontal cortex organization should be plain to see at the level of cytoarchitecture and connections.
In his parcellation of the human brain in 1909, Brodmann distinguished between the anterior granular and posterior agranular cortex of the frontal lobe [23]. Granular frontal areas are defined by their six-layer structure and clearly visible layer IV made up of small, densely packed granule cells. Brodmann noted that the granular frontal areas, especially on the lateral surface of frontal cortex were present in humans as well as other primate species, but were largely absent in other mammals such as rodents.
In macaques, later work by Walker and Von Bonin and Bailey showed that caudal parts of orbital, including agranular insula cortex and parts of area 13, and medial frontal cortex, including areas 25, 32, and 24 are agranular, in that they lack the clear granule cell layer [24, 25]. More anterior parts of the macaque medial (10 m), orbital (areas 13, 11, and 12) and lateral prefrontal cortex (46, 9, and 6) are either dysgranular or fully granular frontal cortex (Fig. 2). What the specific function of granule cells are in layer IV and how the presence of granular frontal cortex imbues higher cognitive abilities are unclear, but over time these anterior parts of the primate brain became the defining feature of “prefrontal cortex” [4].
From this initial observation by Brodmann, many articles have been written on frontal cortex organization in primates and other species based on cytoarchitecture [24, 26,27,28,29,30]. Specifically, there has been, and continues to be extensive debate over whether rodents have a region of prefrontal cortex similar to the anterior granular cortex present in primates [31, 32]. Here we accept the view taken by Preuss [4] and later developed by Wise [9] that have addressed this point in depth on the basis of cytoarchitecture.
Frontal cortex in rats as well as mice including prelimbic (PL), infralimbic (IL), anterior cingulate (Cg 1 and Cg 2 subfields, cf. van Heukelum et al. [33]), and all parts of the orbital cortex are agranular (Fig. 2), in that they lack the densely packed granule cells in layer IV [34]. Based on this as well as other factors that we discuss below, Preuss and others have argued that rats do not possess an area anatomically similar to the dorsal and/or lateral prefrontal cortex in macaques. On the other hand, parts of rat caudal OFC and rostral ACC are similar based on cytoarchitecture, due to shared agranular cortex [9]. Thus, there are similarities between PL, IL, Cg 1/2 (canonically these have been designated areas 32, 25, and 24, cf. [33]), and orbital-agranular insula parts of the macaque orbital cortex. Consequently, Wise suggested that researchers should not focus on whether rats have a part of frontal cortex that cytoarchitectonically resembles the anterior portions of macaque frontal lobes as clearly, they do not. Instead, the focus should be on the shared functions that these agranular areas subserve within the context of the unique foraging niche in which the animal finds itself. In other words, it makes sense to use your local grocery as a case study for how a large corporation might run its accounting division (i.e., a ground-level ability that transfers across niches), but not for how it conducts its research and development (i.e., a specialized ability relevant to a niche that requires large foraging ranges).
In addition to cytoarchitecture, the study of connections of frontal cortex to other parts of the brain is another approach for comparing between rodents and non-human primates (see Haber et al. in this issue, [6, 7, 33]). One of the defining features of prefrontal cortex in macaques and other primates is its bidirectional connections to the mediodorsal thalamus, MD, [35]. Rat frontal cortex is similarly connected with this part of the thalamus [34]. Indeed, on the basis of these connections to the MD, Woolsey et al. proposed that rats have a prefrontal area similar to those in macaques [36, 37]. However, with the advent of better anatomical tracing techniques, researchers have come to appreciate more diversity in these projections [38], and that many other areas outside of prefrontal cortex, such as supplementary motor area and premotor cortex also receive input from MD [39,40,41,42,43], limiting the usefulness of this criterion [4].
Comparison of connections and their physical arrangement is still a powerful approach for understanding differences and similarities of frontal cortex across species. Each subregion of ACC sends projections to distinct parts of the striatum [44, 45]. In a recent series of studies, Heilbronner et al. compared the organization and topography of these projections across rats and macaques from a large database of tract-tracing studies [46]. Their analysis showed that there was concordance between the connections from area 32 and area 25 and to a lesser degree orbital areas to striatum across species, complementing previous analyses [9]. Notably, the connections of area 24 to the striatum in macaques were different to those from the analogous area in rats [46], which is somewhat unexpected since ACC in both rats and macaques is agranular (i.e., the connections would be expected to be comparable if cytoarchitecture is similar). Despite this difference, van Heukelum et al. [33] recently emphasized that based on connections with amygdala, OFC, hippocampus, hypothalamus, thalamus, and retrosplenial cortex, rat, macaque, and human cingulate cortex appear to have a similar rostral-caudal pattern of connections whereby ACC is distinct from mid cingulate cortex. Thus, while cytoarchitecture may not bear as much similarity between species, there is often closer correspondence revealed by connectivity analyses.
Given the prior discussion emphasizing that there are potential anatomical similarities between caudal orbital and parts of medial frontal cortex in non-human primates and rodents, a word of caution is warranted. Even when there are strong anatomical similarities between species, there may still be differences in how a part of frontal cortex contributes to behavior. A recent set of findings from marmosets illustrates this point [47].
One of the classic findings in behavioral neuroscience relates to the roles of rat frontal cortex areas PL and IL in defensive threat conditioning [48,49,50]. Based on the pioneering work of Quirk and others we known that PL is essential for generating appropriate defensive responses to threats, commonly measured using tone-foot shock pairings. By contrast, IL plays a specific role in storing memories related to threats especially during extinction [51]. When Wallis et al. conducted the equivalent set of experiments in marmosets using loud noise instead of foot shocks, however, they found the opposite pattern of effects to those in rodents. Specifically, inactivation of area 32 was associated with altered memory of extinguished threat associations, whereas inactivation of area 25 impacted expression of defensive responses. This difference between the functions of area 25 may relate to slight differences in connections to structures with direct control over autonomic effectors [52]. Thus, even though there is strong anatomical data indicating that PL and IL in rats are analogous to areas 32 and 25 in non-human primates respectively, it does not always follow that these parts of the brain contributed to behavior in the same way.
Confirming functional similarities is therefore essential for frontal areas that we think may be anatomically similar. We take up this point below with an in-depth comparison of orbital and anterior cingulate areas in rats and macaques concentrating on the key processes engaged during foraging: Prediction, Evaluation, and Action. In making these comparisons we directly contrast orbital and cingulate areas that we have emphasized are agranular in rats and granular, dysgranular and agranular in macaques. This is not because we do not think that anatomical differences are important, but because: (1) while frontal cortex expanded and became more differentiated in macaques compared to rats, the core functions that areas subserved are largely maintained; and (2) though multi-species assessments of foraging behavior do exist [53], direct comparisons of the importance of areas in frontal cortex of rats and macaques are few and far between. For instance, there is only one published study reporting the effects of agranular insula lesions in macaques [54]. Consequently, in this review we attempt to piece together patterns of functional relevance across rats and macaques, using the available literature as well as findings from mice and marmosets.
Dissecting reward-guided behavior and decision making: Prediction
As we emphasized earlier, animals must predict the availability of rewards when foraging. In this section we focus on this process to reward procurement. In particular, we highlight cross-species comparisons across tasks probing the roles of OFC and ACC, major subregions of frontal cortex. Though some paradigms incorporate aspects of the Evaluation and Action components of foraging, the tasks described here mainly involve discrimination of reward-predictive stimuli, adapting to changes in, and assessment of the uncertainty or risk of not receiving reward.
Stimulus-based reversal learning
Adaptive foraging relies upon the ability to discriminate stimuli that predict food from those that do not, and to flexibly update behavior when those predictions are violated. In other words, an animal needs to keep track of food availability. This ability has been classically measured in laboratories using discrimination and reversal learning paradigms. There are many variants of this paradigm that have been comprehensively reviewed including stimulus, action, and spatial versions and with stimuli presented in different sensory modalities [55,56,57]. Here we focus our discussion on stimulus-based versions of the task as they may pertain more closely to learning about reward-predictive cues in foraging niches and have been extensively studied across rodents and primates.
In one commonly-administered paradigm, subjects are presented with stimuli or three-dimensional objects, one of which results in reward every time it is chosen (e.g., selecting SA results in reward compared to SB or SC…), wherein the subject learns about the sensory features of the stimulus that bring about reward and those that do not [58,59,60,61,62,63]. After reaching a performance criterion, a set number of trials/errors, or consecutive wins, the stimulus-reward contingencies are reversed. It is important to note that while mice, rats, and macaques are able to complete discrimination reversal tasks, performance varies widely. While macaques often take a few trials to change their responding the first time they experience a reversal, rats and mice can take many hundreds of trials [55]. This difference illustrates an instance where non-human primates differ from rodents in their abilities to predict changes in rewards.
The neural systems involved in reversal learning have been reviewed in detail elsewhere [55], so we focus instead on two regions of frontal cortex, ACC and OFC, and direct comparison across rats and macaques. The role of OFC in behavior is inextricably linked to reversal learning. In nearly every species tested, damage to this area is associated with decrements in performance on reversal learning tasks [64]. Recently, however, with new findings in macaques, the contribution of OFC to reversal learning has become unclear. This is because in rhesus macaques, unlike large, aspiration lesions of OFC [65], excitotoxic fiber-sparing lesions of OFC including Walker’s areas 11,13, and 14 do not adversely impact fully-predictive (deterministic) reversal learning [66, 67]. Smaller excitotoxic lesions of subregions of OFC or anterior agranular insula cortex similarly do not impact performance of reversal learning [54, 66]. Importantly, when a narrow “strip” lesion of posterior OFC was made (incorporating posterior parts of areas 13l, 13m, 13a, and 14c, see Fig. 2) this reproduced the reversal learning impairment seen after aspiration lesions of whole OFC. This indicates that these “strip” lesions interfered with white matter projections, such as the uncinate fascicle that course into the ventral frontal lobe around this point.
In contrast, excitotoxic lesions of OFC areas 11 and 13 in marmosets do produce reversal-specific effects [68, 69]. This effect is similar to the impairments on analogous stimulus-based reversal learning with deterministic rules that have been reported in rodents with excitotoxic lesions of OFC [61, 63]. While it is difficult to provide a simple account for these patterns of effects in two species of non-human primates as well as rats after OFC lesions, we surmise that this divergence could stem from two related features. First, compared to New World monkeys such as marmosets, Old World monkeys have an enlarged and more highly differentiated prefrontal cortex [70]. Second, while marmosets have advanced visual abilities compared to rodents, their foraging ranges are much smaller than macaques and their primary food sources, including tree sap and insects, necessitate more local foraging [71, 72]. A third possibility that could be tested experimentally is that marmosets and rodents use similar strategies to learn the discrimination reversal learning task. By contrast, macaques either use a different strategy or can rely on multiple different aspects of prediction to quickly reverse the associations between stimuli and rewards. The combination of these factors thus influence the involvement of OFC in reversal learning, and may be related to foraging strategies.
By contrast to OFC lesions, damage to ACC (areas 24) primarily impacts both action-based reversal learning in macaques, but deficits in stimulus-based tasks are also apparent [73, 74]. Impairments revolve around maintaining appropriate Win–Stay/Lose–Shift-like strategies across trials, which we review later. Lesions of ACC and posterior cingulate in rat are without effect on fully-predictive reversal learning [75]. Interestingly, both perigenual ACC (area 32) and OFC (area 11 and 13) in marmoset are necessary for related visual stimulus-based reward contingency learning (i.e., tested by the extent to which one pair of actions and its outcome can be selectively degraded) [76], suggesting that there may be shared support of this function in primate frontal cortex. Though there are no equivalent data in rodent that we know of, we hypothesize that there would be a similar shared division of labor of these regions in rodents. It would be interesting to assess if the pattern diverges in Old World macaques. Indeed, species differences pull apart when more prediction is required (i.e., in probabilistic paradigms), which we discuss in more detail below.
Probability and risk-based decisions
It has long been known that patients with OFC lesions perform poorly on gambling tasks where the association between choices and reward is probabilistic [77]. Neuroimaging studies have consistently found that uncertainty about reward is correlated with BOLD signal in human OFC (for instance, Hsu et al. [78]). Thus, there is ample evidence that human OFC also encodes risk of reward. With intracranial recordings Li et al. [79] found that both medial and lateral OFC signal reward probability in humans. Importantly, although human ACC has been implicated in linking reward information with alternative actions/options [80], and risk prediction, or “expected risk” [81], it has not been demonstrated to have causal involvement in risk or probabilistic decision-making per se.
Macaque experiments are largely consistent with these observations: neural populations in monkey OFC signal the variance of different probability distributions of reward [82] and a similar “expected uncertainty” signal in ACC (area 24) has also been reported [83, 84] although there appears to be much more diversity and valence-specificity in ACC (e.g., reward, punishment, and uncertainty), rather than a general risk signal, as in OFC. The function of this variance/risk encoding or expected uncertainty is not completely known though there are several theoretical perspectives on the topic [85,86,87], but this could enable adaptation to changes in the value range of options (i.e., range adaptation), which has already been studied in the context of economic decisions, and due to space limitations we do not review here [88, 89]. Range adaptation has been shown to involve primate OFC [88], therefore, there is an abundance of data to suggest that there are risk representations in both ACC and OFC, in both human and non-human primates.
Unfortunately, few studies have probed this kind of known risk or expected uncertainty in rodents with few exceptions, c.f. “fixed relative uncertainty,” or SD, [90, 91]. Instead, the most popular behavioral paradigm in rodents involves less prediction (i.e., learning about individual option values) and more evaluation (i.e., choosing between known values). Typically, these tasks involve animals choosing between options associated with different reward probabilities wherein the likelihood of reward is varied for one option. For this type of task, rats are presented with a lower probability large reward vs. a higher probability small reward, deemed risky vs. safe options, respectively. Similar to effort- and delay- discounting paradigms, the preferred, larger reward is associated with at-first equal probability of 100%, but then decreasing probabilities of reward through subsequent blocks of trials. Such probabilistic discounting assays have been utilized to explore dissociations within rodent frontal cortex in risk, concluding that PL, but not OFC, is involved in probabilistic discounting [92, 93], with dopamine in OFC similarly not involved in this kind of decision making in rats [94].
Recent studies have uncovered that transient inactivations of medial, and not lateral OFC, render rats more risk-preferring [95]. However, there are other tasks, as noted above, that do not employ discounting methods where probabilities vary by block, but instead require animals to first learn the probabilities and offer no “safe,” predictable rewards. Under these conditions rats with lesions to (predominantly lateral) OFC exhibit a clear preference for risk [96], consistent with the results for macaque OFC. Rat OFC is key for generating value expectations [97], and perhaps value distributions or risk [91], that may be used to determine whether value updating is needed or not [98]. Though there is significant evidence that ACC plays a role in evaluating predatory risk [99], there does not appear to be strong evidence of a prominent role for ACC in reward risk in rats, as measured by probabilistic discounting [93]. To our knowledge, encoding of such variance or expected uncertainty has not been reported in rats. In sum, assessing whether rat and macaque studies converge in probabilistic and risk-related decision making is unclear and requires further investigation. One key aspect of such efforts would be to better match behavioral paradigms across species.
Stimulus-based reward learning under uncertainty
Deterministic reversal learning tasks have been useful for gaining initial insight into how parts of frontal cortex make predictions about reward availability but in the wild, rewards are rarely available with perfect certainty. Instead, most animals have to incorporate the probability of obtaining food into their predictions. Further, this assessment of food availability has to be constantly updated as food is procured (or not). Citing evidence from both rat and macaques, we recently reviewed how stimulus-based variants of probabilistic reversal learning (PRL) can serve as a powerful animal model for investigating neural mechanisms of reward learning under uncertainty [86]. For example, neural recording experiments have revealed that activity in OFC and ACC is correlated with behavior during probabilistic and reversal learning [100,101,102,103,104,105]. Studies using pharmacological inactivation, lesion, and virally-mediated approaches have further confirmed these roles in probabilistic reward learning [106,107,108,109] and have helped to dissociate the functions of each structure in this type of learning.
Consistent with the evidence reviewed above, OFC recordings in monkeys [110] suggest largely orthogonal representations—or single-variable encoding—of reward attributes (i.e., probability, magnitude, volatility). Importantly, the timing of encoding for each of these attributes is simultaneous, suggesting there is parallel encoding of these attributes in OFC [110]. Furthermore, representations of subjective value in OFC are transient and not integrated across the length of time that would be required for decisions [111]. Instead, such temporal integration may instead occur in ACC neurons [112], where perhaps global learning rates are also set [87]. Though not specific to ACC, neurons in the medial frontal cortex of mouse similarly bias choices with slow decay [113], suggesting there are stable representations of value in this region as well. Supporting this, an analysis of population and single-unit activity across various regions of macaque PFC [112] suggests that ACC is important in accept/reject decisions, and while ACC contains some information that is redundant with that encoded by OFC (e.g., stimulus value), it also contains additional information not encoded by OFC, such as action values. This specialized role for ACC in action selection and strategy is a point we take up below in “Dissecting reward-guided behavior and decision making: Action” section.
Despite the discussion above, precisely which parts of the ventral prefrontal cortex in non-human primates are essential for learning and tracking probabilistic reward associations has recently become more clear. Previously, OFC appeared to be central for this aspect of behavior: aspiration lesions in non-human primates and excitotoxic lesions in rats both impaired probabilistic reward learning (for example, [114, 115]). However, subsequent work showed that excitotoxic lesions of OFC in macaques, including Walker’s areas 11, 13, and 14, are without effect on PRL, but do impact reward assessment in reinforcer devaluation settings [116]. Instead, lesions of the more laterally adjacent VLPFC, including areas 12, 45 and ventral 46, impair probabilistic reward learning, but not reinforcer devaluation tasks. This specialized role for VLPFC in probabilistic reward learning is consistent with findings from fMRI [117], aspiration lesions of VLPFC [118], and pharmacological studies in macaques [119]. It also corroborates emerging work in humans [120].
While the difference between the contribution of lateral OFC and adjacent VLPFC to probabilistic learning might seem trivial because both are on the orbital surface of the frontal lobe in macaques, such a view misses a number of key points. First, it is important to realize that studies of macaques with OFC lesions have almost never included VLPFC, Walker’s area 12 (for example, [65, 114, 121]. Instead, VLPFC was seen as separate to OFC, as area 12 which spans both orbital and lateral surfaces is distinct in its cytoarchitecture from areas 11 and 13 [24]. Second, aspiration lesions of VLPFC produce deficits on deterministic reversal learning tasks that are distinct to those following OFC lesions [122]. Taken together, VLPFC appears to be specialized for probabilistic learning and its function appears to be distinct from OFC [123].
If VLPFC, not OFC, in macaques is critical for probabilistic reward learning, then how does this relate to rat frontal cortex? The part of the rat frontal cortex closest in location to VLPFC is lateral OFC, and as we noted above, this area and circuit incorporating it are essential for (spatial-based) probabilistic learning [108, 115]. As we review in “Dissecting reward-guided behavior and decision making: Evaluation”, lateral OFC in rodents is also required for evaluative processes during foraging as measured by devaluation tasks [124]. As such, lateral OFC in rats appears to support both of the functions separately ascribed to OFC and VLPFC in macaques. One account of these findings is that the more lateral parts of rat lateral OFC, such as the dorsal-lateral area (DLO), might be specialized for probabilistic learning [108]. Although we note that more posterior lateral OFC lesions in rats do impact deterministic reversal learning, it is unclear how this might translate to probabilistic reward settings.
It is also important to realize that whereas there are clear anatomical similarities between rat and macaque OFC, none exist for VLPFC as this granular frontal area emerged during non-human primate evolution (Fig. 2, [28]). Unlike OFC, which receives inputs from multiple sensory modalities and is preferentially connected to rhinal cortex, VLPFC primarily receives input from inferotemporal cortex [125,126,127]. This distinction means that unlike the rich and varied sensory information arriving at OFC, VLPFC primarily receives visual information below the level of whole objects. As Murray et al. highlighted, VLPFC emerged in anthropoid primates as it likely provided a selective advantage for estimating the availability of food at distant locations, a mode of foraging that became especially important as non-human primates became larger and their foraging ranges became more extended [128]. When looking for food at distant locations, information about the fine-grained visual properties, smell, or taste are less useful. As we have speculated before [116], a role for VLPFC in representing reward probability may have arisen because this area provided an advantage (a “foraging innovation”) in estimating resource availability at distant locations. This point highlights that compared to rats, the different foraging niche of macaques required more highly developed prediction of food, especially those at distant locations.
Dissecting reward-guided behavior and decision making: Evaluation
Unlike making a prediction about where or how to forage, the Evaluation aspect of foraging is more dependent on a local assessment of a potential food. For instance, from outside of the grocery store you might be able to see that they have strawberries, but it is only when you go inside and get close enough to closely inspect and smell them that you can evaluate whether they are good to eat. In laboratory settings, the evaluation of options has been assessed with a number of different paradigms including reinforcer devaluation, specific Pavlovian-to-instrumental transfer, incentive learning, and over-expectation tasks to mention just a few. Of these, reinforcer devaluation has been most extensively studied across rodents and non-human primates. These tasks not only test whether a subject can remember the sensory qualities of a reward, such as its smell and taste, but also whether they are able to update and use the current value of the food to guide behavior. This ability to update the desirability of a food is often done by manipulating its value by associating the food with sickness or satiety [129]. Notably, in both rats and macaques performance of reinforcer devaluation tasks is qualitatively similar: both rats and macaques are able to rapidly update the value of an association after satiety or sickness and use that knowledge to guide choices [129, 130]. In this regard the evaluative aspect of foraging appears to be similar between rats and macaques.
Over many years and experiments a general consensus has emerged that OFC in both rats and macaques is essential for appropriately evaluating options in the reinforcer devaluation task (for instance, Izquierdo et al. [65], Gallagher et al. [124]). Specifically, without a properly functioning OFC, monkeys and rats are unable to appropriately change their behavior to track the current value of a particular food. Similarly, recordings in OFC in devaluation settings show that neurons in this area track the current value of rewards [131, 132]. Similarly, work in humans shows that this role for OFC in evaluating the quality of foods is well-conserved across species [133, 134]. Furthermore, in all of the species tested, the evaluation of potential foods requires functional interaction between OFC and amygdala [135,136,137]. This role for OFC in evaluation of the sensory specific value of food items in rats and macaques fits well with its dense connections from sensory and limbic structures [138]. Indeed, recent work has highlighted the association between sensory cues as being the key mechanism engaged in OFC [139].
There are, however, a number of differences in functional anatomy between rats and macaques with regard to the evaluation of foods during devaluation tasks. In rats, initial insights into the parts of frontal cortex engaged in devaluation tasks highlighted a role for PL in the medial frontal cortex [140] as well as OFC [124]. One interpretation was that PL and OFC were essential for devaluation in instrumental and Pavlovian settings, respectively, with lateral OFC especially necessary for updating Pavlovian associations [141]. This difference between Pavlovian and instrumental based settings is consistent with the effects of OFC and ACC lesions in macaques in stimulus- and action-based tasks [142].
When Rhodes et al. directly tested the role of macaque area 32, the area analogous to area 32/PL in rat frontal cortex [33], in an instrumental devaluation task they found that lesions were without effect [143]. Previously, area 32 lesions had also been shown to be without effect on stimulus-based devaluation tasks, indicating that area 32 is not involved in updating and retrieving the current value of foods [73]. By contrast, in the instrumental devaluation tasks, lesions of macaque OFC did impact ability to update their evaluation of potential rewards after sensory specific devaluation. Follow up studies again confirmed the specificity of the macaque OFC-amygdala pathway for reinforcer devaluation, but extended these to instrumental settings [144]. Thus, in macaques, OFC is essential for the evaluation of potential foods, whereas in rats these functions appear to involve both OFC and PL [140]. It remains to be determined, however, if more dorsal area 24 in rat serves a similar function. Such a difference between rat and macaque may reflect differences in OFC connections in primates [138], or it may reflect a priority for Evaluation functions to be better integrated into assessments of foraging in rodents, where local evaluation of food items dominates behavior.
OFC is not, however, a homogeneous structure [145] and in particular there are major differences in connections over the medial-lateral and anterior-posterior extent in both rats and macaques [125, 146, 147]. Across the medio-lateral extent, key differences in connectivity to subcortical structures are apparent [148, 149]. Extant research indicates that lateral OFC in rat and macaques is specialized for choices between objects or stimuli [66, 150], whereas medial OFC, especially anterior medial OFC in rats may, like PL, play a role in updating and using reward value in instrumental settings [151, 152].
As we noted earlier, interaction between amygdala and OFC is central to performance on devaluation tasks and amygdala projections to OFC exhibit a gradient from posterior to anterior, with the highest density of amygdala inputs in posterior OFC [153]. This indicates that there may be differences in how anterior and posterior lateral OFC contribute to evaluating different foods in devaluation tasks. Recently, Panayi and Killcross [154] found that lesions of either anterior or posterior lateral OFC impacted the performance of rats in Pavlovian devaluation tasks. Adaptive performance in these types of tasks, however, requires two distinct processes; updating the value of currently available foods and then using that stored value to guide responding. Based on lesion experiments OFC is required for both, whereas amygdala is only required for the updating of values [155], which is in contrast to pathway-specific manipulations showing that amygdala terminals in OFC, but not OFC terminals in amygdala, are crucial for adaptive conditional responding [135]. The experiments conducted by Panayi and Killcross [154] were not designed to distinguish between updating and retrieval processes and the different contributions of anterior and posterior OFC. However, in a recent study in macaques, Murray et al. were specifically able to address this question using temporally specific inactivation of anterior and posterior OFC in macaques. They showed that pharmacological inactivation of anterior lateral OFC, primarily encompassing Walker’s area 11, was important for using the stored value of a particular food reward after it had been updated. Posterior lateral OFC was found to be essential for updating the value of a food, but not subsequently using that updated value. Thus, distinct parts of non-human primate OFC appear to be important for updating and using the stored value of a reward to guide behavior.
While a similar dissociation between anterior and posterior OFC in rodents during devaluation paradigms has not been reported, a recent study by Malvaez et al. did find a dissociation between updating and storing the current value of a food reward in OFC during incentive learning. This study assessed how projections from lateral or medial OFC to amygdala contributed to updating and retrieving the value of reward to guide rats’ behaviors [156]. Using a combination of carefully designed behavioral tasks, glutamate recordings, and chemogenetic manipulation, they showed that projections from lateral OFC to basolateral amygdala are essential for updating reward value. Interaction between medial OFC and amygdala was essential for using the stored value of a reward to guide current behavior. Note that this is potentially different to macaques where anterior lateral OFC is more important for the using the current value of reward to guide behavior. Drawing such a distinction is premature, as the incentive learning task used by Malvaez et al. entailed instrumental responses, and it is unknown how medial OFC in macaques might contribute in these settings. Ultimately, further experiments are required to determine how OFC in rats and macaques contributes to the evaluation of different food rewards. What is clear, however, is that both agranular OFC in rats and granular OFC in macaques are central to the evaluation of foods during foraging that can only occur when the associated sensory features of a food can be inspected closely and a decision to eat or not is made.
Dissecting reward-guided behavior and decision making: Action
At the same time as predicting and evaluating different potential foods, animals have to determine the set of actions or strategy that will enable them to obtain those foods. ACC is a key integrator of reward, cognition, and action planning [1, 2, 157, 158]. Notably, neurons in this area track trial-by-trial outcomes of choices [159,160,161,162,163,164], reward history [165], reward prediction errors, RPEs [100,101,102, 162], and represents better, unobtained rewards [166]. These counterfactual outcomes or “fictive reward signals” [161] may be especially informative in integrating multiple decision parameters allowing the comparison of alternative responses in ACC so that more fruitful actions can be taken. A role for the ACC in volitional control action is also underscored by its connections to parts of the brain involved in preparing and executing actions including premotor cortex as well as motor effectors in the brain stem [167].
ACC may not contribute robustly to probabilistic, stimulus-based reversal learning in rats [168] or macaques [73]. Instead, many of the “low-level” stimulus-based OFC-encoded variables described above may be multiplexed in ACC [166] to perform computations that derive higher-level signals such as RPE [101], confidence (or conversely) uncertainty of predictions [168], with mixed neural selectivity of these variables yielding increased dimensionality [169, 170]. These derived signals could provide a way to monitor overall performance and update behavioral strategies when necessary (particularly overall trial strategy following positive feedback, i.e., Win–Stay [168, 171]).
Several groups have shown that ACC neurons in macaques represent unsigned RPE during tasks that mimic foraging-like behaviors, and the RPE signal is correlated with behavioral adjustment [100, 172, 173]. Note that these RPE signals can only occur after a food has been obtained which again indicates that representations generated in ACC occur in a later stage of processing than both prediction and evaluation functions highlighted earlier. Similar to macaques, recording neural activity in rat ACC, Hyman et al. [101] found neurons in this area encode past outcomes and, when expectations are violated signal negative RPEs, signals that are likely critical for driving behavioral adjustment. It important to note that RPE encoding in ACC are distinct; there is scant evidence that OFC signals RPEs [174,175,176]. This correspondence between rats and macaques indicates that ACC may play similar roles in both animals, and is essential for updating action plans after food has been procured (or not).
Lesion, pharmacological inactivation, or chemogenetic inhibition studies of ACC point to a causal role suggested by the single neuron recording studies [73, 74, 83, 163, 168, 171, 177], that ACC is required for the maintenance of an action strategy. For example, Tervo et al. [171] found that muscimol inactivation or chemogenetic inhibition of ACC increases behavioral variation, and makes animals more exploratory and less sensitive to feedback. Corroborating this, we have found that DREADDs inhibition of ACC similarly decreases a Win-Stay strategy [168]. This is similar to reports in monkeys, where aspiration lesions of ACC (area 24) in macaques result in impaired use of rewarded trial feedback to sustain the selection of the correct response during learning [73, 74] and pharmacological inactivation of ACC (area 24) in marmosets impacts performance in contingency degradation tasks [177]. This pattern of effects was interpreted by Chudasama et al. as indicating that ACC is essential for “using information about reward and non-reward to sustain effective choice behavior.”
Lesions and transient/reversible pharmacological inactivation of OFC in rats and macaques result in more specific deficits in learning and performance under conditions of probabilistic (risk) and reinforcement uncertainty [91, 115, 116, 145, 151, 178,179,180], and seem centered not on trial-by-trial strategy but in overall acquisition of the reversal state of PRL, and specific to early phases of learning. In contrast to ACC, lesions of OFC are without effect on action-based reversal learning tasks in macaques [142], indicating that OFC is especially involved in stimulus-based assessments of value, computations that are essential for both prediction and evaluative aspects of foraging. As a notable difference, most PRL paradigms in rodents employ action- and spatial-based reversal learning procedures (with exceptions to the rule, for instance [181, 182]); and OFC inhibition or lesions do in fact impair performance on action-outcome reversals [108, 115, 183]. Thus, support of action- and stimulus-based PRL is potentially a general function of OFC in rats, not specialized as in macaques.
Taken together, this distinction between OFC and ACC indicates that they have dissociable, yet complementary roles in behavior in rats and macaques. Specifically, OFC supports the updating and use of stimulus values. In rats, the estimation of probabilities cumulatively over multiple trials to provide a baseline for computing a need for update/behavioral change within a state is also supported by OFC, but in macaques this function is dependent on VLPFC/12o. By contrast, ACC may instead carry a spectrum of signals encoding learning rates or transition rates [87, 184, 185]. Such representations are essential for estimating reward expectations but also allows violations of these expectations to be signaled promoting changes in actions when violations are detected [86]. In sum, given the proximity of ACC to motor output, both stimulus and action values may be multiplexed at the level of ACC in both rats and macaques to drive choice strategy. One key difference between rats and macaques is also apparent; while prediction, evaluation, and action aspects of foraging rely on single subregions or circuits within frontal cortex in macaques, these processes in rats are subserved by a more integrated set of frontal cortex areas. For instance, OFC neurons in macaques rarely encode spatial locations [186], whereas in rats and mice they encode the spatial location itself [183, 187].
Conclusions and future directions
Efficient foraging is essential to survival and relies on frontal cortex. Rats and macaques, experimental animals commonly used in neuroscience, occupy unique ecological niches that necessitates different types of foraging. Here we emphasize that appreciating the foraging niche of an animal is essential for understanding the organization and function of their frontal cortex. Variations on this idea have a long history in both biology (for instance, [188]) and neuroscience [5, 128]. Here we emphasized that this point has been overlooked when attempting to draw comparisons or translate findings from frontal cortex between species [31]. As we have seen there are key differences, but also some similarities in how frontal cortex of rats and macaques is organized and contributes to behaviors necessary for foraging. Much is still to be discovered, but appreciating the points of intersection and divergence will facilitate the type of translation essential for furthering neuroscience research as well as enabling medical advances.
When discussing the role of different parts of frontal cortex in forgaing, we primarily focused on a specific set of laboratory based paradigms. This has enabled insight into certain aspects of foraging but has left others understudied. As examples, as we outlined in the “Foraging behaviors” section, planning for the best time of day to forage for foods while estimating spatial distance and accounting for ephemerality of those resources requires higher-level planning [15]. These functions became more advanced in non-human primates, such as macaques. In particular, areas of primate frontal cortex (VLPFC, area 12o, specifically) appear to be more specialized in predicting the availability of foods at distance [3], the probability of reward [116], and the motivation to resolve uncertainty of both rewards and punishments [189]. When foraging at distance macaques have to be able to use both visual information as well as memories of unseen options to guide foraging. Spatial maps or mental representations of the animal’s range likely increased foraging success by enhancing the Prediction of food availability in primates. Consequently, establishing how parts of the brain involved in spatial navigation [190] interact with parts of frontal cortex during foraging would enable this to be revealed. Indeed, the recent characterization of value fields in macaques hippocampus opens the possibility that representations exist [191]. In this regard, the tasks designs for macaques as well as human experiments stand to gain from the many years of task development in rats and mice to probe how spatial cognition and value interact.
We also proposed that smaller ranges and shorter time horizons in rodent reward environments may have produced foraging innovations related to the close-inspection of stimuli or cues involved in the Evaluation of foods. While there is mounting evidence that OFC is specialized for this function through connections with amygdala, other parts of rat medial frontal cortex are also essential, highlighting that evaluation of local items appears to be more integrated across areas in rat frontal cortex compared to macaques. Within rat frontal cortex, lateral OFC appears to be specialized for choices between objects/stimuli, whereas medial OFC may play a larger role in updating and using value and instrumental choices. Another area for future study we highlighted above is in stimulus-based risk and probability learning in rats and macaques. Specifically, better aligning paradigms so as to better ensure tasks do not rely on probability discounting or action/spatial response methods [108], will enhance the translation of findings.
In summary, we outlined important divergences in foraging niches between rodent and primate, which in turn would produce different kinds of problems that frontal cortex is required to solve. Specifically, we highlighted that these foraging differences likely affected the balance of Prediction and Evaluation functions in primates and rodents, respectively. Not only did these divergences result in obvious differences in cytoarchitecture and connectivity, but they also likely shaped specializations in OFC and ACC function. While there may be general functions that can be studied in rats that have reliably translated to macaques (for which there is strong evidence of convergence), careful attention should be paid to functions that may not translate well, or for which there is poor evidence of convergence. Future investigation should take into account species’ foraging niches when designing or interpreting experiments and, more importantly, translating their findings to humans.
References
Rushworth MF, Noonan MP, Boorman ED, Walton ME, Behrens TE. Frontal cortex and reward-guided learning and decision-making. Neuron. 2011;70:1054–69.
Heilbronner SR, Hayden BY. Dorsal anterior cingulate cortex: a bottom-up view. Annu Rev Neurosci. 2016;39:149–70.
Murray EA, Wise SP, Rhodes SEV. What can different brains do with reward? In: Gottfried JA, editor. Neurobiology of sensation and reward. CRC Press/Taylor & Francis; 2011.
Preuss TM. Do rats have prefrontal cortex? The rose-woolsey-akert program reconsidered. J Cogn Neurosci. 1995;7:1–24.
Cisek P. Resynthesizing behavior through phylogenetic refinement. Atten Percept Psychophys. 2019;81:2265–87.
Tang W, Choi EY, Heilbronner SR, Haber SN. Nonhuman primate meso-circuitry data: a translational tool to understand brain networks across species. Brain Struct Funct. 2021;226:1–11.
Mars RB, Jbabdi S, Rushworth MFS. A common space approach to comparative neuroscience. Annu Rev Neurosci. 2021;44:69–86.
Timberlake W, Gawley DJ, Lucas GA. Time horizons in rats foraging for food in temporally separated patches. J Exp Psychol Anim Behav Process. 1987;13:302–9.
Wise SP. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci. 2008;31:599–608.
Holland PC. Cognitive versus stimulus-response theories of learning. Learn Behav. 2008;36:227–41.
Dunbar RIM, Shultz S. Why are there so many explanations for primate brain evolution? Philos Trans R Soc Lond B Biol Sci. 2017;372:20160244.
Humphrey NK. The social function of intellect. In: Bateson PPG, Hinde RA, editors. Growing points in ethology. Cambridge: Cambridge University Press; 1976.
Pontzer H, Brown MH, Raichlen DA, Dunsworth H, Hare B, Walker K, et al. Metabolic acceleration and the evolution of human brain size and life history. Nature. 2016;533:390–2.
Lindburg DG. The rhesus monkey in North India: an ecological and behavioral study. In: Rosenblum LA, editor. Primate behavior: developments in field and laboratory research. New York: Academic Press; 1971. p. 1–106.
Zuberbuhler K, Janmaat K Foraging cognition in nonhuman primates. Primate Neuroethol. 2010:64–83. https://doi.org/10.1093/acprof:oso/9780195326598.003.0004.
Janmaat KR, Polansky L, Ban SD, Boesch C. Wild chimpanzees plan their breakfast time, type, and location. Proc Natl Acad Sci USA. 2014;111:16343–8.
Janmaat KR, Byrne RW, Zuberbuhler K. Primates take weather into account when searching for fruits. Curr Biol. 2006;16:1232–7.
Smith CC, Reichman OJ. The evolution of food caching by birds and mammals. Annu Rev Ecol Syst. 1984;15:329–51.
Gire DH, Kapoor V, Arrighi-Allisan A, Seminara A, Murthy VN. Mice develop efficient strategies for foraging and navigation using complex natural stimuli. Curr Biol. 2016;26:1261–73.
Anderson PK. Foraging range in mice and voles: the role of risk. Can J Zool. 1986;64:2645–53.
Orrock JL, Danielson BJ, Brinkerhoff RJ. Rodent foraging is affected by indirect, but not direct, cues of predation risk. Behav Ecol. 2004;15:433–7.
Seth AK. The ecology of action selection: insights from artificial life. Philos Trans R Soc Lond B Biol Sci. 2007;362:1545–58.
Brodmann K. Brodmann’s localisation in the cerebral cortex: the principles of comparative localisation in the cerebral cortex based on cytoarchitectonics. Leipzig: Barth-Verlag; 1909.
Walker AE. A cytoarchitectural study of the prefrontal area of the macaque monkey. J Comp Neurol. 1940;73:59–86.
Von Bonin G, Bailey P. The neocortex of Macaca mulatta. Illinois: University of Illinois Press; 1947.
Petrides M, Pandya DN. Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns. Eur J Neurosci. 1999;11:1011–36.
Petrides M, Tomaiuolo F, Yeterian EH, Pandya DN. The prefrontal cortex: comparative architectonic organization in the human and the macaque monkey brains. Cortex. 2012;48:46–57.
Preuss TM, Goldman-Rakic PS. Connections of the ventral granular frontal cortex of macaques with perisylvian premotor and somatosensory areas: anatomical evidence for somatic representation in primate frontal association cortex. J Comp Neurol. 1989;282:293–316.
Barbas H. Pattern in the laminar origin of corticocortical connections. J Comp Neurol. 1986;252:415–22.
Barbas H. General cortical and special prefrontal connections: principles from structure to function. Annu Rev Neurosci. 2015;38:269–89.
Carlen M. What constitutes the prefrontal cortex? Science. 2017;358:478–82.
Laubach M, Amarante LM, Swanson K, White SR. What, if anything, is rodent prefrontal cortex? eNeuro. 2018;5:ENEURO.0315-18.2018.
van Heukelum S, Mars RB, Guthrie M, Buitelaar JK, Beckmann CF, Tiesinga P, et al. Where is cingulate cortex? A cross-species view. Trends Neurosci. 2020;43:285–99.
Krettek JE, Price JL. The cortical projections of the mediodorsal nucleus and adjacent thalamic nuclei in the rat. J Comp Neurol. 1977;171:157–91.
Russchen FT, Amaral DG, Price JL. The afferent input to the magnocellular division of the mediodorsal thalamic nucleus in the monkey, Macaca fascicularis. J Comp Neurol. 1987;256:175–210.
Rose JE, Woolsey CN. The orbitofrontal cortex and its connections with the mediodorsal nucleus in rabbit, sheep and cat. Res Publ Assoc Res Nerv Ment Dis. 1948;27:210–32.
Akert K. Comparative anatomy of frontal cortex and thalamofrontal connections. In: Warren JM, Akert K, editors. The frontal granular cortex and behaviour. New York: McGraw-Hill; 1964.
Barbas H, Henion TH, Dermon CR. Diverse thalamic projections to the prefrontal cortex in the rhesus monkey. J Comp Neurol. 1991;313:65–94.
Wiesendanger R, Wiesendanger M. The thalamic connections with medial area 6 (supplementary motor cortex) in the monkey (macaca fascicularis). Exp Brain Res. 1985;59:91–104.
Kievit J, Kuypers HG. Organization of the thalamo-cortical connexions to the frontal lobe in the rhesus monkey. Exp Brain Res. 1977;29:299–322.
Ilinsky IA, Jouandet ML, Goldman-Rakic PS. Organization of the nigrothalamocortical system in the rhesus monkey. J Comp Neurol. 1985;236:315–30.
Giguere M, Goldman-Rakic PS. Mediodorsal nucleus: areal, laminar, and tangential distribution of afferents and efferents in the frontal lobe of rhesus monkeys. J Comp Neurol. 1988;277:195–213.
Goldman-Rakic PS, Porrino LJ. The primate mediodorsal (MD) nucleus and its projection to the frontal lobe. J Comp Neurol. 1985;242:535–60.
Choi EY, Ding SL, Haber SN. Combinatorial inputs to the ventral striatum from the temporal cortex, frontal cortex, and amygdala: implications for segmenting the striatum. eNeuro. 2017;4:ENEURO.0392-17.2017.
Haber SN. Neuroanatomy of reward: a view from the ventral striatum. In: Gottfried JA, editor. Neurobiology of sensation and reward. CRC Press/Taylor & Francis: Boca Raton (FL); 2011.
Heilbronner SR, Rodriguez-Romaguera J, Quirk GJ, Groenewegen HJ, Haber SN. Circuit-based corticostriatal homologies between rat and primate. Biol Psychiatry. 2016;80:509–21.
Wallis CU, Cardinal RN, Alexander L, Roberts AC, Clarke HF. Opposing roles of primate areas 25 and 32 and their putative rodent homologs in the regulation of negative emotion. Proc Natl Acad Sci USA. 2017;114:E4075–84.
Baldi E, Bucherelli C. Brain sites involved in fear memory reconsolidation and extinction of rodents. Neurosci Biobehav Rev. 2015;53:160–90.
Quirk GJ, Beer JS. Prefrontal involvement in the regulation of emotion: convergence of rat and human studies. Curr Opin Neurobiol. 2006;16:723–7.
Sierra-Mercado D, Padilla-Coreano N, Quirk GJ. Dissociable roles of prelimbic and infralimbic cortices, ventral hippocampus, and basolateral amygdala in the expression and extinction of conditioned fear. Neuropsychopharmacology. 2011;36:529–38.
Milad MR, Quirk GJ. Neurons in medial prefrontal cortex signal memory for fear extinction. Nature. 2002;420:70–4.
Freedman LJ, Insel TR, Smith Y. Subcortical projections of area 25 (subgenual cortex) of the macaque monkey. J Comp Neurol. 2000;421:172–88.
Sweis BM, Abram SV, Schmidt BJ, Seeland KD, MacDonald AW, Thomas MJ, et al. Sensitivity to “sunk costs” in mice, rats, and humans. Science. 2018;361:178–81.
Jang AI, Costa VD, Rudebeck PH, Chudasama Y, Murray EA, Averbeck BB. The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals. J Neurosci. 2015;35:11751–60.
Izquierdo A, Brigman JL, Radke AK, Rudebeck PH, Holmes A. The neural basis of reversal learning: an updated perspective. Neuroscience. 2017;345:12–26.
Izquierdo A, Jentsch JD. Reversal learning as a measure of impulsive and compulsive behavior in addictions. Psychopharmacology. 2012;219:607–20.
Manning EE, Bradfield LA, Iordanova MD. Adaptive behaviour under conflict: deconstructing extinction, reversal, and active avoidance learning. Neurosci Biobehav Rev. 2021;120:526–36.
Schoenbaum G, Chiba AA, Gallagher M. Changes in functional connectivity in orbitofrontal cortex and basolateral amygdala during learning and reversal training. J Neurosci. 2000;20:5179–89.
Alvarez P, Eichenbaum H. Representations of odors in the rat orbitofrontal cortex change during and after learning. Behav Neurosci. 2002;116:421–33.
Eichenbaum H, Fagan A, Cohen NJ. Normal olfactory discrimination learning set and facilitation of reversal learning after medial-temporal damage in rats: implications for an account of preserved learning abilities in amnesia. J Neurosci. 1986;6:1876–84.
Izquierdo A, Darling C, Manos N, Pozos H, Kim C, Ostrander S, et al. Basolateral amygdala lesions facilitate reward choices after negative feedback in rats. J Neurosci. 2013;33:4105–9.
Schoenbaum G, Nugent SL, Saddoris MP, Setlow B. Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neuroreport. 2002;13:885–90.
Chudasama Y, Robbins TW. Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci. 2003;23:8771–80.
Rolls ET. The orbitofrontal cortex and reward. Cereb Cortex. 2000;10:284–94.
Izquierdo A, Suda RK, Murray EA. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci. 2004;24:7540–8.
Rudebeck PH, Murray EA. Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J Neurosci. 2011;31:10569–78.
Rudebeck PH, Saunders RC, Prescott AT, Chau LS, Murray EA. Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat Neurosci. 2013;16:1140–5.
Man MS, Clarke HF, Roberts AC. The role of the orbitofrontal cortex and medial striatum in the regulation of prepotent responses to food rewards. Cereb Cortex. 2009;19:899–906.
Rygula R, Walker SC, Clarke HF, Robbins TW, Roberts AC. Differential contributions of the primate ventrolateral prefrontal and orbitofrontal cortex to serial reversal learning. J Neurosci. 2010;30:14552–9.
Smaers JB, Gómez-Robles A, Parks AN, Sherwood CC. Exceptional evolutionary expansion of prefrontal cortex in great apes and humans. Curr Biol. 2017;27:1549.
Hubrecht RC. Home-range size and use and territorial behavior in the common marmoset, Callithrix jacchus jacchus, at the tapacura field station, recife, Brazil. Int J Primatol. 1985;6:533–50.
Scanlon CE, Chalmers NR, da Cruz MAOM. Home range use and the exploitation of gum in the marmosetCallithrix jacchus jacchus. Int J Primatol. 1989;10:123–36.
Chudasama Y, Daniels TE, Gorrin DP, Rhodes SE, Rudebeck PH, Murray EA. The role of the anterior cingulate cortex in choices based on reward value and reward contingency. Cereb Cortex. 2013;23:2884–98.
Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF. Optimal decision making and the anterior cingulate cortex. Nat Neurosci. 2006;9:940–7.
Bussey TJ, Muir JL, Everitt BJ, Robbins TW. Triple dissociation of anterior cingulate, posterior cingulate, and medial frontal cortices on visual discrimination tasks using a touchscreen testing procedure for the rat. Behav Neurosci. 1997;111:920–36.
Jackson SAW, Horst NK, Pears A, Robbins TW, Roberts AC. Role of the perigenual anterior cingulate and orbitofrontal cortex in contingency learning in the marmoset. Cereb Cortex. 2016;26:3273–84.
Bechara A, Damasio H, Damasio AR. Emotion, decision making and the orbitofrontal cortex. Cereb Cortex. 2000;10:295–307.
Hsu M, Bhatt M, Adolphs R, Tranel D, Camerer CF. Neural systems responding to degrees of uncertainty in human decision-making. Science. 2005;310:1680–3.
Li Y, Vanni-Mercier G, Isnard J, Mauguière F, Dreher JC. The neural dynamics of reward value and risk coding in the human orbitofrontal cortex. Brain. 2016;139:1295–309.
Williams ZM, Bush G, Rauch SL, Cosgrove GR, Eskandar EN. Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nat Neurosci. 2004;7:1370–5.
Brown JW, Braver TS. Risk prediction and aversion by anterior cingulate cortex. Cogn Affect Behav Neurosci. 2007;7:266–77.
O’Neill M, Schultz W. Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron. 2010;68:789–800.
Amiez C, Joseph JP, Procyk E. Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex. 2006;16:1040–55.
Monosov IE. Anterior cingulate is a source of valence-specific information about value and uncertainty. Nat Commun. 2017;8:134.
Yu AJ, Dayan P. Uncertainty, neuromodulation, and attention. Neuron. 2005;46:681–92.
Soltani A, Izquierdo A. Adaptive learning under expected and unexpected uncertainty. Nat Rev Neurosci. 2019;20:635–44.
Behrens TE, Woolrich MW, Walton ME, Rushworth MF. Learning the value of information in an uncertain world. Nat Neurosci. 2007;10:1214–21.
Conen KE, Padoa-Schioppa C. Partial adaptation to the value range in the macaque orbitofrontal cortex. J Neurosci. 2019;39:3498–513.
Zimmermann J, Glimcher PW, Louie K. Multiple timescales of normalized value coding underlie adaptive choice behavior. Nat Commun. 2018;9:3206.
Li Y, Dudman JT. Mice infer probabilistic models for timing. Proc Natl Acad Sci USA. 2013;110:17154–9.
Stolyarova A, Izquierdo A. Complementary contributions of basolateral amygdala and orbitofrontal cortex to value learning under uncertainty. Elife. 2017;6:e27483.
Constantinople CM, Piet AT, Bibawi P, Akrami A, Kopec C, Brody CD. Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases. Elife. 2019;8:e49744.
St Onge JR, Floresco SB. Prefrontal cortical contribution to risk-based decision making. Cereb Cortex. 2010;20:1816–28.
Mai B, Hauber W. Orbitofrontal or accumbens dopamine depletion does not affect risk-based decision making in rats. Cogn Affect Behav Neurosci. 2015;15:507–22.
Stopper CM, Green EB, Floresco SB. Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice. Cereb Cortex. 2014;24:154–62.
Pais-Vieira M, Lima D, Galhardo V. Orbitofrontal cortex lesions disrupt risk assessment in a novel serial decision-making task for rats. Neuroscience. 2007;145:225–31.
Schoenbaum G, Roesch M. Orbitofrontal cortex, associative learning, and expectancies. Neuron. 2005;47:633–6.
Miller KJ, Botvinick, MM, Brody CD. Value representations in the rodent orbitofrontal cortex drive learning, not choice. bioRxiv. 2020. https://doi.org/10.1101/245720.
Jhang J, Lee H, Kang MS, Lee HS, Park H, Han JH. Anterior cingulate cortex and its input to the basolateral amygdala control innate fear response. Nat Commun. 2018;9:2744.
Hayden BY, Heilbronner SR, Pearson JM, Platt ML. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J Neurosci. 2011;31:4178–87.
Hyman JM, Holroyd CB, Seamans JK. A novel neural prediction error found in anterior cingulate cortex ensembles. Neuron. 2017;95:447–56 e3.
Kennerley SW, Behrens TE, Wallis JD. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neurosci. 2011;14:1581–9.
Marquardt K, Sigdel R, Brigman JL. Touch-screen visual reversal learning is mediated by value encoding and signal propagation in the orbitofrontal cortex. Neurobiol Learn Mem. 2017;139:179–88.
Massi B, Donahue CH, Lee D. Volatility facilitates value updating in the prefrontal cortex. Neuron. 2018;99:598–608 e4.
Knudsen EB, Wallis JD. Closed-loop theta stimulation in the orbitofrontal cortex prevents reward-based learning. Neuron. 2020;106:537–47 e4.
Verharen JPH, den Ouden HEM, Adan RAH, Vanderschuren LJMJ. Modulation of value-based decision making behavior by subregions of the rat prefrontal cortex. Psychopharmacology. 2020;37:1267–80.
Hervig ME, Fiddian L, Piilgaard L, Božič T, Blanco-Pozo M, Knudsen C, et al. Dissociable and paradoxical roles of rat medial and lateral orbitofrontal cortex in visual serial reversal learning. Cereb Cortex. 2019;30:1016–29.
Groman SM, Keistler C, Keip AJ, Hammarlund E, DiLeone RJ, Pittenger C, et al. Orbitofrontal circuits control multiple reinforcement-learning processes. Neuron. 2019;103:734–46 e3.
Walton ME, Mars RB. Probing human and monkey anterior cingulate cortex in variable environments. Cogn Affect Behav Neurosci. 2007;7:413–22.
Yang T, Murray EA. Orthogonal representations of reward magnitude, certainty, and volatility in the macaque orbitofrontal cortex. biorxiv. 2018. https://doi.org/10.1101/365080.
Lin Z, Nie C, Zhang Y, Chen Y, Yang T. Value-based decision making takes place in the action domain in the prefrontal cortex. biorxiv. 2018. https://doi.org/10.1101/444646.
Hunt LT, Malalasekera W, de Berker AO, Miranda B, Farmer SF, Behrens T, et al. Triple dissociation of attention and decision computations across prefrontal cortex. Nat Neurosci. 2018;21:1471–81.
Bari BA, Grossman CD, Lubin EE, Rajagopalan AE, Cressy JI, Cohen JY. Stable representations of decision variables for flexible behavior. Neuron. 2019;103:922–933.e7.
Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron. 2010;65:927–39.
Dalton GL, Wang NY, Phillips AG, Floresco SB. Multifaceted contributions by different regions of the orbitofrontal and medial prefrontal cortex to probabilistic reversal learning. J Neurosci. 2016;36:1996–2006.
Rudebeck PH, Saunders RC, Lundgren DA, Murray EA. Specialized representations of value in the orbital and ventrolateral prefrontal cortex: desirability versus availability of outcomes. Neuron. 2017;95:1208–20 e5.
Chau BK, Sallet J, Papageorgiou GK, Noonan MP, Bell AH, Walton ME, et al. Contrasting roles for orbitofrontal cortex and amygdala in credit assignment and learning in macaques. Neuron. 2015;87:1106–18.
Baxter MG, Browning PG, Mitchell AS. Perseverative interference with object-in-place scene learning in rhesus monkeys with bilateral ablation of ventrolateral prefrontal cortex. Learn Mem. 2008;15:126–32.
Groman SM, James AS, Seu E, Crawford MA, Harpster SN, Jentsch JD. Monoamine levels within the orbitofrontal cortex and putamen interact to predict reversal learning performance. Biol Psychiatry. 2013;73:756–62.
Noonan MP, Chau B, Rushworth M, Fellows LK. Contrasting effects of medial and lateral orbitofrontal cortex lesions on credit assignment and decision-making in humans. J Neurosci. 2017;37:7023–35.
Mansouri FA, Buckley MJ, Tanaka K. The essential role of primate orbitofrontal cortex in conflict-induced executive control adjustment. J Neurosci. 2014;34:11016–31.
Iversen SD, Mishkin M. Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp Brain Res. 1970;11:376–86.
Murray EA, Rudebeck PH. Specializations for reward-guided decision-making in the primate ventral prefrontal cortex. Nat Rev Neurosci. 2018;19:404–17.
Gallagher M, McMahan RW, Schoenbaum G. Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci. 1999;19:6610–4.
Carmichael ST, Price JL. Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol. 1996;371:179–207.
Kondo H, Saleem KS, Price JL. Differential connections of the perirhinal and parahippocampal cortex with the orbital and medial prefrontal networks in macaque monkeys. J Comp Neurol. 2005;493:479–509.
Saleem KS, Kondo H, Price JL. Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey. J Comp Neurol. 2008;506:659–93.
Murray EA, Wise SP, Graham KS. The evolution of memory systems: ancestors, anatomy, and adaptations. Oxford: Oxford University Press; 2017.
Holland PC, Straub JJ. Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning. J Exp Psychol Anim Behav Process. 1979;5:65–78.
Malkova L, Gaffan D, Murray EA. Excitotoxic lesions of the amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J Neurosci. 1997;17:6011–20.
Critchley HD, Rolls ET. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol. 1996;75:1673–86.
Pritchard TC, Nedderman EN, Edwards EM, Petticoffer AC, Schwartz GJ, Scott TR. Satiety-responsive neurons in the medial orbitofrontal cortex of the macaque. Behav Neurosci. 2008;122:174–82.
Howard JD, Kahnt T. Identity-specific reward representations in orbitofrontal cortex are modulated by selective devaluation. J Neurosci. 2017;37:2627–38.
Reber J, Feinstein JS, O'Doherty JP, Liljeholm M, Adolphs R, Tranel D. Selective impairment of goal-directed decision-making following lesions to the human ventromedial prefrontal cortex. Brain. 2017;140:1743–56.
Lichtenberg NT, Pennington ZT, Holley SM, Greenfield VY, Cepeda C, Levine MS, et al. Basolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations. J Neurosci. 2017;37:8374–84.
Baxter MG, Parker A, Lindner CC, Izquierdo AD, Murray EA. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J Neurosci. 2000;20:4311–9.
Gottfried JA, O’Doherty J, Dolan RJ. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science. 2003;301:1104–7.
Ongur D, Price JL. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex. 2000;10:206–19.
Hart EE, Sharpe MJ, Gardner MP, Schoenbaum G. Responding to preconditioned cues is devaluation sensitive and requires orbitofrontal cortex during cue-cue learning. Elife. 2020;9:e59998.
Balleine BW, Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology. 1998;37:407–19.
Ostlund SB, Balleine BW. Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J Neurosci. 2007;27:4819–25.
Rudebeck PH, Behrens TE, Kennerley SW, Baxter MG, Buckley MJ, Walton ME, et al. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci. 2008;28:13775–85.
Rhodes SE, Murray EA. Differential effects of amygdala, orbital prefrontal cortex, and prelimbic cortex lesions on goal-directed behavior in rhesus macaques. J Neurosci. 2013;33:3380–9.
Fiuzat EC, Rhodes SE, Murray EA. The role of orbitofrontal-amygdala interactions in updating action-outcome valuations in macaques. J Neurosci. 2017;37:2463–70.
Izquierdo A. Functional heterogeneity within rat orbitofrontal cortex in reward learning and decision making. J Neurosci. 2017;37:10529–40.
Barreiros IV, Panayi MC, Walton ME. Organization of afferents along the anterior-posterior and medial-lateral axes of the rat orbitofrontal cortex. Neuroscience. 2021;460:53–68.
Rempel-Clower NL. Role of orbitofrontal cortex connections in emotion. Ann NY Acad Sci. 2007;1121:72–86.
Aggleton JP, Wright NF, Rosene DL, Saunders RC. Complementary patterns of direct amygdala and hippocampal projections to the macaque prefrontal cortex. Cereb Cortex. 2015;25:4351–73.
Bedwell SA, Billett EE, Crofts JJ, Tinsley CJ. Differences in anatomical connections across distinct areas in the rodent prefrontal cortex. Eur J Neurosci. 2017;45:859–73.
Ostlund SB, Balline BW. Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learn Behav. 2007;35:43–52.
Bradfield LA, Dezfouli A, van Holstein M, Chieng B, Balleine BW. Medial orbitofrontal cortex mediates outcome retrieval in partially observable task situations. Neuron. 2015;88:1268–80.
Bradfield LA, Hart G, Balleine BW. Inferring action-dependent outcome representations depends on anterior but not posterior medial orbitofrontal cortex. Neurobiol Learn Mem. 2018;155:463–73.
Ghashghaei HT, Hilgetag CC, Barbas H. Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage. 2007;34:905–23.
Panayi MC, Killcross S. Functional heterogeneity within the rodent lateral orbitofrontal cortex dissociates outcome devaluation and reversal learning deficits. Elife. 2018;7:e37357.
Pickens CL, Saddoris MP, Setlow B, Gallagher M, Holland PC, Schoenbaum G. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci. 2003;23:11078–84.
Malvaez M, Shieh C, Murphy MD, Greenfield VY, Wassum KM. Distinct cortical-amygdala projections drive reward value encoding and retrieval. Nat Neurosci. 2019;22:762–9.
Paus T. Primate anterior cingulate cortex: where motor control, drive and cognition interface. Nat Rev Neurosci. 2001;2:417–24.
Shenhav A, Botvinick MM, Cohen JD. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron. 2013;79:217–40.
Procyk E, Tanaka YL, Joseph JP. Anterior cingulate activity during routine and non-routine sequential behaviors in macaques. Nat Neurosci. 2000;3:502–8.
Shidara M, Richmond BJ. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science. 2002;296:1709–11.
Hayden BY, Pearson JM, Platt ML. Fictive reward signals in the anterior cingulate cortex. Science. 2009;324:948–50.
Seo H, Lee D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J Neurosci. 2007;27:8366–77.
Shima K, Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science. 1998;282:1335–8.
Ito S, Stuphorn V, Brown JW, Schall JD. Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science. 2003;302:120–2.
Bernacchia A, Seo H, Lee D, Wang XJ. A reservoir of time constants for memory traces in cortical neurons. Nat Neurosci. 2011;14:366–72.
Mashhoori A, Hashemnia S, McNaughton BL, Euston DR, Gruber AJ. Rat anterior cingulate cortex recalls features of remote reward locations after disfavoured reinforcements. Elife. 2018;7:e29793.
Dum RP, Strick PL. Spinal cord terminations of the medial wall motor areas in macaque monkeys. J Neurosci. 1996;16:6513–25.
Stolyarova A, Rakhshan M, Hart EE, O'Dell TJ, Peters M, Lau H, et al. Contributions of anterior cingulate cortex and basolateral amygdala to decision confidence and learning under uncertainty. Nat Commun. 2019;10:4704.
Fusi S, Miller EK, Rigotti M. Why neurons mix: high dimensionality for higher cognition. Curr Opin Neurobiol. 2016;37:66–74.
Saez A, Rigotti M, Ostojic S, Fusi S, Salzman CD. Abstract context representations in primate amygdala and prefrontal cortex. Neuron. 2015;87:869–81.
Tervo DGR, Proskurin M, Manakov M, Kabra M, Vollmer A, Branson K, et al. Behavioral variability through stochastic choice and its gating by anterior cingulate cortex. Cell. 2014;159:21–32.
Matsumoto M, Matsumoto K, Abe H, Tanaka K. Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci. 2007;10:647–56.
Quilodran R, Rothe M, Procyk E. Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron. 2008;57:314–25.
Sul JH, Kim H, Huh N, Lee D, Jung MW. Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron. 2010;66:449–60.
Stalnaker TA, Liu TL, Takahashi YK, Schoenbaum G. Orbitofrontal neurons signal reward predictions, not reward prediction errors. Neurobiol Learn Mem. 2018;153:137–43.
Stalnaker TA, Cooch NK, Schoenbaum G. What the orbitofrontal cortex does not do. Nat Neurosci. 2015;18:620–7.
Duan LY, Horst NK, Cranmore SAW, Horiguchi N, Cardinal RN, Roberts AC, et al. Controlling one’s world: identification of sub-regions of primate PFC underlying goal-directed behavior. Neuron. 2021. https://doi.org/10.1016/j.neuron.2021.06.003.
Winstanley CA, Floresco SB. Deciphering decision making: variation in animal models of effort- and uncertainty-based choice reveals distinct neural circuitries underlying core cognitive processes. J Neurosci. 2016;36:12069–79.
Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, et al. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology. 2002;160:290–8.
Noonan MP, Walton ME, Behrens TE, Sallet J, Buckley MJ, Rushworth MF. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci USA. 2010;107:20547–52.
Hervig ME, Fiddian L, Piilgaard L, Božič T, Blanco-Pozo M, Knudsen C, et al. Dissociable and paradoxical roles of rat medial and lateral orbitofrontal cortex in visual serial reversal learning. Cereb Cortex. 2020;30:1016–29.
Harris C, Aguirre GC, Kolli S, Das K, Izquierdo A, Soltani A. Unique features of stimulus-based probabilistic reversal learning. bioRxiv. 2020. https://doi.org/10.1101/2020.09.24.310771.
Riceberg JS, Shapiro ML. Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior. J Neurosci. 2012;32:16402–9.
Meder D, Kolling N, Verhagen L, Wittmann MK, Scholl J, Madsen KH, et al. Simultaneous representation of a spectrum of dynamically changing value estimates during decision making. Nat Commun. 2017;8:1942.
Farashahi S, Donahue CH, Khorsand P, Seo H, Lee D, Soltani A. Metaplasticity as a neural substrate for adaptive learning and choice under uncertainty. Neuron. 2017;94:401–414 e6.
Grattan LE, Glimcher PW. Absence of spatial tuning in the orbitofrontal cortex. PLoS ONE. 2014;9:e112750.
Young JJ, Shapiro ML. The orbitofrontal cortex and response selection. Ann NY Acad Sci. 2011;1239:25–32.
Tinbergen N. On aims and methods of ethology. Z für tierpsychologie. 1963;20:410–33.
Jezzini A, Bromberg-Martin ES, Trambaiolli LR, Haber SN, Monosov IE. A prefrontal network integrates preferences for advance information about uncertain rewards and punishments. Neuron. 2021;109:2339–2352.e5.
Baraduc P, Duhamel JR, Wirth S. Schema cells in the macaque hippocampus. Science. 2019;363:635–9.
Knudsen E, Wallis J. Hippocampal neurons construct a map of an abstract value space. bioRxiv. 2020. https://doi.org/10.1101/2020.12.17.423272.
Funding
We thank Zachary Zeisler for helpful comments on an earlier version of the manuscript. PHR is supported by NIH grants R01MH110822, R34NS122050, and R01MH118638 as well as NSF grant L02606277. AI is supported by NIH grants R01DA047870, R21MH122800, and UCLA Division of Life Sciences Retention Funds.
Author information
Authors and Affiliations
Contributions
Both authors contributed equally to this work including literature searches, interpretation of data, writing (to include initial drafts and revisions), and preparation of the figures. Both authors have approved of the submitted version.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Rudebeck, P.H., Izquierdo, A. Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior. Neuropsychopharmacol. 47, 134–146 (2022). https://doi.org/10.1038/s41386-021-01140-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41386-021-01140-0