Letter | Published:

Covert skill learning in a cortical-basal ganglia circuit

Nature volume 486, pages 251255 (14 June 2012) | Download Citation

Abstract

We learn complex skills such as speech and dance through a gradual process of trial and error. Cortical-basal ganglia circuits have an important yet unresolved function in this trial-and-error skill learning1; influential ‘actor–critic’ models propose that basal ganglia circuits generate a variety of behaviours during training and learn to implement the successful behaviours in their repertoire2,3. Here we show that the anterior forebrain pathway (AFP), a cortical-basal ganglia circuit4, contributes to skill learning even when it does not contribute to such ‘exploratory’ variation in behavioural performance during training. Blocking the output of the AFP while training Bengalese finches to modify their songs prevented the gradual improvement that normally occurs in this complex skill during training. However, unblocking the output of the AFP after training caused an immediate transition from naive performance to excellent performance, indicating that the AFP covertly gained the ability to implement learned skill performance without contributing to skill practice. In contrast, inactivating the output nucleus of the AFP during training completely prevented learning, indicating that learning requires activity within the AFP during training. Our results suggest a revised model of skill learning: basal ganglia circuits can monitor the consequences of behavioural variation produced by other brain regions and then direct those brain regions to implement more successful behaviours. The ability of the AFP to identify successful performances generated by other brain regions indicates that basal ganglia circuits receive a detailed efference copy of premotor activity in those regions. The capacity of the AFP to implement successful performances that were initially produced by other brain regions indicates precise functional connections between basal ganglia circuits and the motor regions that directly control performance.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    , , & Central mechanisms of motor skill learning. Curr. Opin. Neurobiol. 12, 217–222 (2002)

  2. 2.

    , & in Models of Information Processing in the Basal Ganglia (eds , & ) 249–270 (MIT Press, 1995)

  3. 3.

    & A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91, 871–890 (1999)

  4. 4.

    Neural mechanisms for learned birdsong. Learn. Mem. 16, 655–669 (2009)

  5. 5.

    & Performance variability enables adaptive plasticity of ‘crystallized’ adult birdsong. Nature 450, 1240–1244 (2007)

  6. 6.

    , , & Learning the microstructure of successful behavior. Nature Neurosci. 14, 373–380 (2011)

  7. 7.

    & Reinforcement Learning: An Introduction (MIT Press, 1998)

  8. 8.

    , & A neural substrate of prediction and reward. Science 275, 1593–1599 (1997)

  9. 9.

    , & A cellular mechanism of reward-related learning. Nature 413, 67–70 (2001)

  10. 10.

    & A hypothesis for basal ganglia-dependent reinforcement learning in the songbird. Neuroscience 198, 152–170 (2011)

  11. 11.

    , & Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. J. Neurophysiol. 98, 2038–2057 (2007)

  12. 12.

    & in The New Cognitive Neurosciences (ed. ) 469–482 (MIT Press, 2000)

  13. 13.

    & A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors. Proc. Natl Acad. Sci. USA 106, 12518–12523 (2009)

  14. 14.

    , , & Mechanisms and time course of vocal learning and consolidation in the adult songbird. J. Neurophysiol. 106, 1806–1821 (2011)

  15. 15.

    , & Vocal experimentation in the juvenile songbird requires a basal ganglia circuit. PLoS Biol. 3, e153 (2005)

  16. 16.

    , & An avian basal ganglia-forebrain circuit contributes differentially to syllable versus sequence variability of adult Bengalese finch song. J. Neurophysiol. 101, 3235–3245 (2009)

  17. 17.

    , & Localization of a memory trace in the mammalian brain. Science 260, 989–991 (1993)

  18. 18.

    , , & Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nature Neurosci. 10, 126–131 (2007)

  19. 19.

    & Still at the choice-point: action selection and initiation in instrumental conditioning. Ann. NY Acad. Sci. 1104, 147–171 (2007)

  20. 20.

    & Corollary discharge across the animal kingdom. Nature Rev. Neurosci. 9, 587–600 (2008)

  21. 21.

    , , , & Changes in the neural control of a complex motor sequence during learning. J. Neurophysiol. 106, 386–397 (2011)

  22. 22.

    , & Central contributions to acoustic variation in birdsong. J. Neurosci. 28, 10370–10379 (2008)

  23. 23.

    Experimental test of the birdsong error-correction model. Proc. Natl Acad. Sci. USA 101, 16935–16940 (2004)

  24. 24.

    , & Reafferent thalamo-‘cortical’ loops in the song system of oscine songbirds. J. Comp. Neurol. 380, 275–290 (1997)

  25. 25.

    & A cortical motor nucleus drives the basal ganglia-recipient thalamus in singing birds. Nature Neurosci. 15, 620–627 (2012)

  26. 26.

    & The short-latency dopamine signal: a role in discovering novel actions? Nature Rev. Neurosci. 7, 967–975 (2006)

  27. 27.

    & Basal ganglia contributions to motor control: a vigorous tutor. Curr. Opin. Neurobiol. 20, 704–716 (2010)

  28. 28.

    Computational models of motivated action selection in corticostriatal circuits. Curr. Opin. Neurobiol. 21, 381–386 (2011)

Download references

Acknowledgements

We thank L. Frank, A. Doupe, M. Stryker and D. Mets for discussion and comments on the manuscript. This work was supported by National Institutes of Health grant NIDCD R01 and National Institute of Mental Health grant P50. J.D.C. and T.L.W. were supported by National Science Foundation graduate fellowships.

Author information

Affiliations

  1. W. M. Keck Center for Integrative Neuroscience, Department of Physiology, and the Neuroscience Graduate Program, University of California, San Francisco, California 94143, USA

    • Jonathan D. Charlesworth
    • , Timothy L. Warren
    •  & Michael S. Brainard

Authors

  1. Search for Jonathan D. Charlesworth in:

  2. Search for Timothy L. Warren in:

  3. Search for Michael S. Brainard in:

Contributions

J.D.C., T.L.W. and M.S.B. designed the experiments. J.D.C. performed the experiments with APV in RA, and T.L.W. performed the experiments with LMAN inactivations. J.D.C. analysed the data. J.D.C. prepared the manuscript, with input from the other authors.

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to Jonathan D. Charlesworth.

Supplementary information

PDF files

  1. 1.

    Supplementary Information

    This file contains Supplementary Figures 1-4.

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/nature11078

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.