Addiction was suggested to emerge from the progressive dominance of habits over goal-directed behaviors. However, it is generally assumed that habits do not persist in choice settings. Therefore, it is unclear how drug habits may persist in real-world scenarios where this factor predominates. Here, we discuss the poor translational validity of the habit construct, which impedes our ability to determine its role in addiction. New evidence of habitual behavior in a drug choice setting are then described and discussed. Interestingly, habitual preference did not promote drug choice but instead favored abstinence. Here, we propose several clues to reconcile these unexpected results with the habit theory of addiction, and we highlight the need in experimental research to face the complexity of drug addicts’ decision-making environments by investigating drug habits in the context of choice and in the presence of cues. On a theoretical level, we need to consider more complex frameworks, taking into account continuous interactions between goal-directed and habitual systems, and alternative decision-making models more representative of real-world conditions.
Subscribe to Journal
Get full journal access for 1 year
only $38.38 per issue
All prices are NET prices.
VAT will be added later in the checkout.
Rent or Buy article
Get time limited or full article access on ReadCube.
All prices are NET prices.
Redish AD, Jensen S, Johnson A. A unified framework for addiction: vulnerabilities in the decision process. Behav Brain Sci. 2008;31:415–87.
Everitt BJ, Robbins TW. Drug addiction: updating actions to habits to compulsions ten years on. Annu Rev Psychol. 2016;67:23–50.
Everitt BJ, Robbins TW. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci. 2005;8:1481–9.
Tiffany ST. A cognitive model of drug urges and drug-use behavior: role of automatic and nonautomatic processes. Psychol Rev. 1990;97:147–68.
Heather N. Is the concept of compulsion useful in the explanation or description of addictive behaviour and experience? Addict Behav Rep. 2017;6:15–38.
Ostlund SB, Balleine BW. On habits and addiction: an associative analysis of compulsive drug seeking. Drug Discov Today Dis Model 2008;5:235–45.
Dickinson A, Balleine B. Motivational control of instrumental action. Anim Learn Behav. 1994;22:1–18.
Balleine BW, Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology. 1998;37:407–19.
Hogarth L, Lam-Cassettari C, Pacitti H, Currah T, Mahlberg J, Hartley L, et al. Intact goal-directed control in treatment-seeking drug users indexed by outcome-devaluation and Pavlovian to instrumental transfer: critique of habit theory. Eur J Neurosci. 2018;50:2513–2525.
Hogarth L. Addiction is driven by excessive goal-directed drug choice under negative affect: translational critique of habit and compulsion theory. Neuropsychopharmacology. 2020;45:720–735. https://doi.org/10.1038/s41386-020-0600-8.
Corbit L, Nie H, Janak P. Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol Psychiatry. 2012;72:389–95.
Barker JM, Zhang H, Villafane JJ, Wang TL, Torregrossa MM, Taylor JR. Epigenetic and pharmacological regulation of 5HT3 receptors controls compulsive ethanol seeking in mice. Eur J Neurosci. 2014;39:999–1008.
Dickinson A, Wood N, Smith JW. Alcohol seeking by rats: action or habit? Q J Exp Psychol B 2002;55:331–48.
Lopez MF, Becker HC, Chandler LJ. Repeated episodes of chronic intermittent ethanol promote insensitivity to devaluation of the reinforcing effect of ethanol. Alcohol. 2014;48:639–45.
Mangieri RA, Cofresí RU, Gonzales RA. Ethanol seeking by long evans rats is not always a goal-directed behavior. PLoS ONE. 2012;7:1–13.
Mangieri RA, Cofresí RU, Gonzales RA. Ethanol exposure interacts with training conditions to influence behavioral adaptation to a negative instrumental contingency. Front Behav Neurosci. 2014;8:220.
Corbit LH, Nie H, Janak PH. Habitual responding for alcohol depends upon both AMPA and D2 receptor signaling in the dorsolateral striatum. Front Behav Neurosci. 2014;8:1–9.
Miles FJ, Everitt BJ, Dickinson A. Oral cocaine seeking by rats: action or habit? Behav Neurosci. 2003;117:927–38.
Leong KC, Berini CR, Ghee SM, Reichel CM. Extended cocaine-seeking produces a shift from goal-directed to habitual responding in rats. Physiol Behav. 2016;164:330–5.
Clemens KJ, Lay BP, Holmes NM. Extended nicotine self-administration increases sensitivity to nicotine, motivation to seek nicotine and the reinforcing properties of nicotine-paired cues. Addict Biol. 2015;22:400–410.
Loughlin A, Funk D, Coen K, Lê AD. Habitual nicotine-seeking in rats following limited training. Psychopharmacology. 2017;234:2619–2629.
Olmstead MC, Lafonda MV, Everittb BJ, Dickinsonb A. Cocaine seeking by rats is a goal-directed action. Behav Neurosci. 2001;115:394–402.
Hutcheson DM, Everitt BJ, Robbins TW, Dickinson A. The role of withdrawal in heroin addiction: enhances reward or promotes avoidance? Nat Neurosci. 2001;4:943–7.
Zapata A, Minney VL, Shippenberg TS. Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J Neurosci. 2010;30:15457–63.
Renteria R, Baltz ET, Gremel CM. Chronic alcohol exposure disrupts top-down control over basal ganglia action selection to produce habits. Nat Commun. 2018;9:1–11.
Corbit LH, Chieng BC, Balleine BW. Effects of repeated cocaine exposure on habit learning and reversal by N-acetylcysteine. Neuropsychopharmacology. 2014;39:1893–901.
LeBlanc KH, Maidment NT, Ostlund SB. Repeated cocaine exposure facilitates the expression of incentive motivation and induces habitual control in rats. PLoS ONE. 2013;8:e61355:1-10.
Nelson A, Killcross S. Amphetamine exposure enhances habit formation. J Neurosci. 2006;26:3805–12.
Nordquist RE, Voorn P, de Mooij-van Malsen JG, Joosten RNJMA, Pennartz CMA, Vanderschuren LJMJ. Augmented reinforcer value and accelerated habit formation after repeated amphetamine treatment. Eur Neuropsychopharmacol. 2007;17:532–40.
Nelson AJD, Killcross S, Leblanc KH. Accelerated habit formation following amphetamine exposure is reversed by D 1, but enhanced by D 2, receptor antagonists. Front Neurosci. 2013;7:1–13.
Schmitzer-Torbert N, Apostolidis S, Amoa R, O’Rear C, Kaster M, Stowers J, et al. Post-training cocaine administration facilitates habit learning and requires the infralimbic cortex and dorsolateral striatum. Neurobiol Learn Mem. 2015;118:105–12.
Shiflett MW. The effects of amphetamine exposure on outcome-selective Pavlovian-instrumental transfer in rats. Psychopharmacology. 2012;223:361–70.
Gourley SL, Olevska A, Gordon J, Taylor JR. Cytoskeletal determinants of stimulus-response habits. J Neurosci. 2013;33:11811–6.
Halbout B, Liu AT, Ostlund SB. A closer look at the effects of repeated cocaine exposure on adaptive decision-making under conditions that promote goal-directed control. Front Psychiatry. 2016;7:1–12.
Phillips GD, Vugler A. Effects of sensitization on the detection of an instrumental contingency. Pharmacol Biochem Behav. 2011;100:48–58.
Son JH, Latimer C, Keefe KA. Impaired formation of stimulus-response, but not action-outcome, associations in rats with methamphetamine-induced neurotoxicity. Neuropsychopharmacology. 2011;36:2441–51.
Dickinson A, Nicholas DJ, Adams CD. The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Q J Exp Psychol Sect B. 1983;35:35–51.
Derusso AL, Fan D, Gupta J, Shelest O, Costa RM, Yin HH. Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement. Front Integr Neurosci. 2010;4:1–8.
Urcelay GP, Jonkman S. Delayed rewards facilitate habit formation delayed rewards facilitate habit formation. J Exp Psychol Anim Learn Cogn. 2019;45:413–421.
Adams CD. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q J Exp Psychol Sect B. 1982;34:77–98.
Dickinson A. Actions and habits: the development of behavioural autonomy. Philos Trans R Soc B Biol Sci. 1985;308:67–78.
Holland PC. Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J Exp Psychol Anim Behav Process. 2004;30:104–17.
Colwill RM, Triola SM. Instrumental responding remains under the control of the consequent outcome after extended training. Behav Process. 2002;57:51–64.
Kosaki Y, Dickinson A. Choice and contingency in the development of behavioral autonomy during instrumental conditioning. J Exp Psychol Anim Behav Process. 2010;36:334–42.
Trask S, Shipman ML, Green JT, Bouton ME. Some factors that restore goal-direction to a habitual behavior. Neurobiol Learn Mem. 2020;169:107161.
Bouton ME, Broomer MC, Rey CN, Thrailkill EA. Unexpected food outcomes can return a habit to goal-directed action. Neurobiol Learn Mem. 2020;169:1–9.
Thrailkill EA, Trask S, Vidal P, Alcalá JA, Bouton ME. Stimulus control of actions and habits: a role for reinforcer predictability and attention in the development of habitual behavior. J Exp Psychol Anim Learn Cogn. 2018;44:370–84.
Dolan RJ, Dayan P. Goals and habits in the brain. Neuron. 2013;80:312–25.
Keramati M, Smittenaar P, Dolan RJ, Dayan P. Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum. Proc Natl Acad Sci USA. 2016;113:12868–73.
Vandaele Y, Guillem K, Ahmed SH, Ahmed SH. Habitual preference for the nondrug reward in a drug choice setting. Front Behav Neurosci. 2020;14:1–9.
Vandaele Y, Vouillac-Mendoza C, Ahmed SH. Inflexible habitual decision-making during choice between cocaine and a nondrug alternative. Transl Psychiatry. 2019;9:109.
Daw ND, Niv Y, Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci. 2005;8:1704–11.
Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ. Model-based influences on humans’ choices and striatal prediction errors. Neuron. 2011;69:1204–15.
Doya K, Samejima K, Katagiri K, Kawato M. Multiple model-based reinforcement learning. Neural Comput. 2002;14:1347–69.
Vandaele Y, Pribut HJ, Janak PH. Lever insertion as a salient stimulus promoting insensitivity to outcome devaluation. Front Integr Neurosci. 2017;11:1–13.
Vandaele Y, Mahajan NR, Ottenheimer DJ, Richard JM, Mysore SP, Janak PH. Distinct recruitment of dorsomedial and dorsolateral striatum erodes with extended training. Elife. 2019;8:1–29.
Lee SW, Shimojo S, O’Doherty JP. Neural computations underlying arbitration between model-based and model-free learning. Neuron. 2014;81:687–99.
Colwill RM, Rescorla RA. Instrumental responding remains sensitive to reinforcer devaluation after extensive training. J Exp Psychol Anim Behav Process. 1985;11:520–36.
Parkes SL, Balleine BW. Incentive memory: evidence the basolateral amygdala encodes and the insular cortex retrieves outcome values to guide choice between goal-directed actions. J Neurosci. 2013;33:8753–63.
Parkes SL, Bradfield LA, Balleine BW. Interaction of insular cortex and ventral striatum mediates the effect of incentive memory on choice between goal-directed actions. J Neurosci. 2015;35:6464–71.
Balleine BW, Killcross AS, Dickinson A. The effect oflesions ofthe basolateral amygdala on instrumental conditioning. J Neurosci. 2003;23:666–75.
Corbit LH, Balleine BW. The role of prelimbic cortex in instrumental conditioning. Behav Brain Res. 2003;146:145–57.
Glimcher PW, Rustichini A. Neuroeconomics: the consilience of brain and decision. Science. 2004;306:447–52.
Rangel A, Camerer C, Montague PR. A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci. 2008;9:545–56.
Rushworth MF, Mars RB, Summerfield C. General mechanisms for making decisions? Curr Opin Neurobiol. 2009;19:75–83.
Rangel A, Hare T. Neural computations associated with goal-directed choice. Curr Opin Neurobiol. 2010;20:262–70.
Keramati M, Dezfouli A, Piray P. Speed/accuracy trade-off between the habitual and the goal-directed processes. PLoS Comput Biol. 2011;7:e1002055.
Lenoir M, Augier E, Vouillac C, Ahmed SH. A choice-based screening method for compulsive drug users in rats. Curr Protoc Neurosci. 2013;1:1–17.
Cantin L, Lenoir M, Augier E, Vanhille N, Dubreucq S, Serre F, et al. Cocaine is low on the value ladder of rats: Possible evidence for resilience to addiction. PLoS ONE. 2010;5:e11592:1–14.
Lenoir M, Serre F, Cantin L, Ahmed SH. Intense sweetness surpasses cocaine reward. PLoS ONE. 2007;2:e698:1–10.
Ahmed SH. The science of making drug-addicted animals. Neuroscience. 2012;211:107–25.
Namba MD, Tomek SE, Olive MF, Beckmann JS, Gipson CD. The winding road to relapse: forging a new understanding of cue-induced reinstatement models and their associated neural mechanisms. Front Behav Neurosci. 2018;12:1–22.
Weiss F, Maldonado-Vlaar CS, Parsons LH, Kerr TM, Smith DL, Ben-Shahar O. Control of cocaine-seeking behavior by drug-associated stimuli in rats: Effects on recovery of extinguished operant-responding and extracellular dopamine levels in amygdala and nucleus accumbens. Proc Natl Acad Sci USA. 2000;97:4321–6.
Weiss F, Martin-Fardon R, Ciccocioppo R, Kerr TM, Smith DL, Ben-Shahar O. Enduring resistance to extinction of cocaine-seeking behavior induced by drug-related cues. Neuropsychopharmacology. 2001;25:361–72.
Shaham Y, Shalev U, Lu L, de Wit H, Stewart J. The reinstatement model of drug relapse: history, methodology and major findings. Psychopharmacology. 2003;168:3–20.
Crombag HS, Bossert JM, Koya E, Shaham Y. Context-induced relapse to drug seeking: a review. Philos Trans R Soc B Biol Sci. 2008;363:3233–43.
Hogarth L, Chase HW. Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability. J Exp Psychol Anim Behav Process. 2011;37:261–76.
Hogarth L. Goal-directed and transfer-cue-elicited drug-seeking are dissociated by pharmacotherapy: evidence for independent additive controllers. J Exp Psychol Anim Behav Process. 2012;38:266–78.
Corbit LH, Janak PH, Balleine BW. General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. Eur J Neurosci. 2007;26:3141–9.
Rescorla RA. Transfer of instrumental control mediated by a devalued outcome. Anim Learn Behav. 1994;22:27–33.
Watson P, Wiers RW, Hommel B, de Wit S. Working for food you don’t desire. Cues interfere with goal-directed food-seeking. Appetite 2014;79:139–48.
Van Steenbergen H, Watson P, Wiers RW, Hommel B, de Wit S. Dissociable corticostriatal circuits underlie goal-directed vs. cue-elicited habitual food seeking after satiation: evidence from a multimodal MRI study. Eur J Neurosci. 2017;46:1815–1827.
Lamb RJ, Schindler W, Pinkston JW. Conditioned stimuli’s role in relapse: pre-clinical research on pavlovian instrumental transfer. Psychopharmacology. 2016;233:1933–44.
Kelleher RT, Gollub LR. A review of positive conditioned reinforcement. J Exp Anal Behav. 1962;5:543–97.
Bossert JM, Marchant NJ, Calu DJ, Shaham Y. The reinstatement model of drug relapse: recent neurobiological findings, emerging research topics, and translational research. Psychopharmacology. 2013;229:453–76.
Hu Y, Salmeron BJ, Krasnova IN, Gu H, Lu H, Bonci A, et al. Compulsive drug use is associated with imbalance of orbitofrontal- And prelimbic-striatal circuits in punishment-resistant individuals. Proc Natl Acad Sci USA. 2019;116:9066–71.
Pascoli V, Terrier J, Hiver A, Lüscher C. Sufficiency of mesolimbic dopamine neuron stimulation for the progression to addiction. Neuron. 2015;88:1054–66.
Pascoli V, Hiver A, Van Zessen R, Loureiro M, Achargui R, Harada M, et al. Stochastic synaptic plasticity underlying compulsion in a model of addiction. Nature. 2018;564:366–71.
Lüscher C, Robbins TW, Everitt BJ. The transition to compulsion in addiction. Nat Rev Neurosci. 2020;21:247–63.
Goldstein RZ, Volkow ND. Dysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications. Nat Rev Neurosci. 2012;12:652–69.
Baler RD, Volkow ND. Drug addiction: the neurobiology of disrupted self-control. Trends Mol Med. 2006;12:559–66.
Belin D, Everitt BJ. Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron. 2008;57:432–41.
Willuhn I, Burgeno LM, Everitt BJ, Phillips PEM. Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proc Natl Acad Sci USA. 2012;109:20703–8.
Yin HH, Ostlund SB, Knowlton BJ, Balleine BW. The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci. 2005;22:513–23.
Yin HH, Knowlton BJ, Balleine BW. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci. 2004;19:181–9.
Yin HH, Knowlton BJ. The role of the basal ganglia in habit formation. Nat Rev Neurosci. 2006;7:464–76.
Balleine BW, Liljeholm M, Ostlund SB. The integrative function of the basal ganglia in instrumental conditioning. Behav Brain Res. 2009;199:43–52.
Murray JE, Belin D, Everitt BJ. Double dissociation of the dorsomedial and dorsolateral striatal control over the acquisition and performance of cocaine seeking. Neuropsychopharmacology. 2012;37:2456–66.
Preble E. Taking care of business—the heroin user’ s life on the street. Int J Addict. 1969;4:1–24.
Schreiner DC, Renteria R, Gremel CM. Fractionating the all-or-nothing definition of goal-directed and habitual decision-making. J Neurosci Res. 2019;98:998–1006.
Feher da Silva C, Hare TA. Humans primarily use model-based inference in the two-stage task. Nat Hum Behav. 2020. https://doi.org/10.1038/s41562-020-0905-y.
Byrne KA, Otto AR, Pang B, Patrick CJ, Worthy DA. Substance use is associated with reduced devaluation sensitivity. Cogn Affect Behav Neurosci. 2019;19:40–55.
Gillan CM, Kosinski M, Whelan R, Phelps EA, Daw ND. Characterizing a psychiatric symptom dimension related to deficits in goal-directed control. Elife. 2016;5:e11305:1–24.
Miller KJ, Botvinick MM, Brody CD. Dorsal hippocampus contributes to model-based planning. Nat Neurosci. 2017;20:1269–76.
Groman SM, Massi B, Mathias SR, Lee D, Taylor JR. Model-free and model-based influences in addiction-related behaviors. Biol Psychiatry. 2019;85:936–45.
Groman SM, Massi B, Mathias SR, Curry DW, Lee D, Taylor JR. Neurochemical and behavioral dissections of decision-making in a rodent multistage task. J Neurosci. 2019;39:295–306.
Fraser KM, Janak PH. How does drug use shift the balance between model-based and model-free control of decision making? Biol Psychiatry. 2019;85:886–8.
Otto AR, Gershman SJ, Markman AB, Daw ND. The curse of planning. Psychol Sci. 2013;24:751–61.
Dezfouli A, Balleine BW. Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized. PLoS Comput Biol. 2013;9:e1003364.
Dezfouli A, Balleine BW. Habits, action sequences and reinforcement learning. Eur J Neurosci. 2012;35:1036–51. https://doi.org/10.1038/s41386-020-0600-8.
Dezfouli A, Lingawi NW, Balleine BW. Habits as action sequences: hierarchical action control and changes in outcome value. Philos Trans R Soc L B Biol Sci. 2014;369:20130482.
Balleine BW, Dezfouli A. Hierarchical action control: adaptive collaboration between actions and habits. Front Psychol. 2019;10:1–13.
Cushman F, Morris A. Habitual control of goal selection in humans. Proc Natl Acad Sci USA. 2015;112:13817–22.
Wood W, Neal DT. A new look at habits and the habit—goal interface. Psychol Rev. 2007;114:843–63.
Kruglanski AW, Szumowska E. Habitual behavior is goal-driven. Perspect Psychol Sci. 2020. https://doi.org/10.1177/1745691620917676.
Huys QJM, Eshel N, O’Nions E, Sheridan L, Dayan P, Roiser JP. Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees. PLoS Comput Biol. 2012;8:1–13.
Vandaele Y, Vouillac-Mendoza C, Ahmed SH. Cocaine falls into oblivion during volitional initiation of choice trials. Addict Biol. 2020. In press.
Shapiro MS, Siller S, Kacelnik A. Simultaneous and sequential choice as a function of reward delay and magnitude: normative, descriptive and process-based models tested in the European Starling (Sturnus vulgaris). J Exp Psychol Anim Behav Process. 2008;34:75–93.
Freidin E, Aw J, Kacelnik A. Sequential and simultaneous choices: testing the diet selection and sequential choice models. Behav Process. 2009;80:218–23.
Freidin E, Kacelnik A. Rational choice, context dependence, and the value of information in European starlings (Sturnus vulgaris). Science. 2011;334:1000–2.
Vasconcelos M, Monteiro T, Aw J, Kacelnik A. Choice in multi-alternative environments: a trial-by-trial implementation of the sequential choice model. Behav Process. 2010;84:435–9.
Vasconcelos M, Monteiro T, Kacelnik A. Context-dependent preferences in starlings: linking ecology, foraging and choice. PLoS ONE. 2013;8:1–8.
Mobbs D, Trimmer PC, Blumstein DT, Dayan P. Foraging for foundations in decision neuroscience: insights from ethology. Nat Rev Neurosci. 2018;19:419–27.
Grace RC. Acquisition of choice in concurrent chains: assessing the cumulative decision model. Behav Process. 2016;126:82–93.
Singer BF, Fadanelli M, Kawa AB, Robinson TE. Are cocaine-seeking “ habits” necessary for the development of addiction-like behavior in rats? J Neurosci. 2017;38:60–73.
Colwill RM. An associative analysis of instrumental learning. Curr Dir Psychol Sci. 1993;2:111–6.
Dickinson A, Mulatero CW. Reinforcer specificity of the suppression of instrumental performance on a non-contingent schedule. Behav Processes. 1989;19:167–80.
Rescorla RA. A Pavlovian analysis of goal-directed behavior. American Psychologist 1987;42:119–29.
Adams CD, Dickinson A. Instrumental responding following reinforcer devaluation. Q J Exp Psychol Sect B Comp Physiol Psychol. 1981;33:109–121.
Gläscher J, Daw N, Dayan P, O'Doherty JP. States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning. Neuron 2010;66:585–95.
We thank Christophe Bernard, Mathieu Louvet, and Eric Wattelet for administrative assistance. We also thank Dr. Patricia Janak for her helpful comments on a previous version of the review, and Emma Chaloux-Pinette for proofreading the paper.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Vandaele, Y., Ahmed, S.H. Habit, choice, and addiction. Neuropsychopharmacol. (2020). https://doi.org/10.1038/s41386-020-00899-y