Article | Published:

Hippocampal place-cell sequences depict future paths to remembered goals

Nature volume 497, pages 7479 (02 May 2013) | Download Citation

Abstract

Effective navigation requires planning extended routes to remembered goal locations. Hippocampal place cells have been proposed to have a role in navigational planning, but direct evidence has been lacking. Here we show that before goal-directed navigation in an open arena, the rat hippocampus generates brief sequences encoding spatial trajectories strongly biased to progress from the subject’s current location to a known goal location. These sequences predict immediate future behaviour, even in cases in which the specific combination of start and goal locations is novel. These results indicate that hippocampal sequence events characterized previously in linearly constrained environments as ‘replay’ are also capable of supporting a goal-directed, trajectory-finding mechanism, which identifies important places and relevant behavioural paths, at specific times when memory retrieval is required, and in a manner that could be used to control subsequent navigational behaviour.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    & The Hippocampus As A Cognitive Map. (Clarendon, 1978)

  2. 2.

    , , & Place navigation impaired in rats with hippocampal lesions. Nature 297, 681–683 (1982)

  3. 3.

    & Loss of recent memory after bilateral hippocampal lesions. J. Neurol. Neurosurg. Psychiatry 20, 11–21 (1957)

  4. 4.

    & Remembrance of places past: spatial memory in rats. J. Exp. Psychol. Anim. Behav. Process. 2, 97–116 (1976)

  5. 5.

    A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal-like tasks. Hippocampus 6, 579–590 (1996)

  6. 6.

    & The role of the hippocampus in solving the Morris water maze. Neural Comput. 10, 73–111 (1998)

  7. 7.

    , , & Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation. Neural Netw. 16, 577–584 (2003)

  8. 8.

    & Sequence learning and the role of the hippocampus in rodent navigation. Curr. Opin. Neurobiol. 22, 294–300 (2012)

  9. 9.

    et al. Goal-related activity in hippocampal place cells. J. Neurosci. 27, 472–482 (2007)

  10. 10.

    , , & Hippocampal neurons encode information about different types of memory episodes occurring in the same location. Neuron 27, 623–633 (2000)

  11. 11.

    & Prospective and retrospective memory coding in the hippocampus. Neuron 40, 1227–1239 (2003)

  12. 12.

    & Dynamics of the hippocampal ensemble code for space. Science 261, 1055–1058 (1993)

  13. 13.

    & Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus 3, 317–330 (1993)

  14. 14.

    & The firing of hippocampal place cells predicts the future position of freely moving rats. J. Neurosci. 9, 4101–4110 (1989)

  15. 15.

    , , & Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus 6, 149–172 (1996)

  16. 16.

    & Hippocampal CA3 region predicts memory sequences: accounting for the phase precession of place cells. Learn. Mem. 3, 279–287 (1996)

  17. 17.

    & Hippocampal theta sequences. Hippocampus 17, 1093–1099 (2007)

  18. 18.

    & Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27, 12176–12189 (2007)

  19. 19.

    , & Integrating hippocampus and striatum in decision-making. Curr. Opin. Neurobiol. 17, 692–697 (2007)

  20. 20.

    & Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron 29, 145–156 (2001)

  21. 21.

    & Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36, 1183–1194 (2002)

  22. 22.

    & Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440, 680–683 (2006)

  23. 23.

    , & Hippocampal replay of extended experience. Neuron 63, 497–507 (2009)

  24. 24.

    & Forward and reverse hippocampal place-cell sequences during ripples. Nature Neurosci. 10, 1241–1242 (2007)

  25. 25.

    & Awake replay of remote experiences in the hippocampus. Nature Neurosci. 12, 913–918 (2009)

  26. 26.

    , , & Hippocampal replay is not a simple function of experience. Neuron 65, 695–705 (2010)

  27. 27.

    & Delay-dependent impairment of a matching-to-place task with chronic and intrahippocampal infusion of the NMDA-antagonist D-AP5. Hippocampus 9, 118–136 (1999)

  28. 28.

    , & Properties of the extra-positional signal in hippocampal place cell discharge derived from the overdispersion in location-specific firing. Neuroscience 111, 553–566 (2002)

  29. 29.

    , , , & Increased attention to spatial context increases both place field stability and spatial memory. Neuron 42, 283–295 (2004)

  30. 30.

    , & The hippocampus–what does it do? Behav. Neural Biol. 57, 2–36 (1992)

  31. 31.

    , & A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10, 1–16 (2000)

  32. 32.

    , , , & Quantitative measures of cluster quality for use in extracellular recordings. Neuroscience 131, 1–11 (2005)

  33. 33.

    , , & Place-selective firing contributes to the reverse-order reactivation of CA1 pyramidal cells during sharp waves in open-field exploration. Eur. J. Neurosci. 26, 704–716 (2007)

  34. 34.

    , , , & Selective suppression of hippocampal ripples impairs spatial memory. Nature Neurosci. 12, 1222–1223 (2009)

  35. 35.

    & Disruption of ripple-associated hippocampal activity during rest impairs spatial learning in the rat. Hippocampus 20, 1–10 (2010)

  36. 36.

    , , & Awake hippocampal sharp-wave ripples support spatial memory. Science 336, 1454–1458 (2012)

  37. 37.

    & Network dynamics of hippocampal cell-assemblies resemble multiple spatial maps within single tasks. Hippocampus 17, 1209–1229 (2007)

  38. 38.

    Two-stage model of memory trace formation: a role for “noisy” brain states. Neuroscience 31, 551–570 (1989)

  39. 39.

    , & Role of experience and oscillations in transforming a rate code into a temporal code. Nature 417, 741–746 (2002)

  40. 40.

    & Learning navigational maps through potentiation and modulation of hippocampal place cells. J. Comput. Neurosci. 4, 79–94 (1997)

  41. 41.

    , & Route planning in cats, in relation to the visibility of the goal. Anim. Behav. 31, 594–599 (1983)

  42. 42.

    & Structure in the space of value functions. Mach. Learn. 49, 325–346 (2002)

  43. 43.

    in Neural Networks for Control (eds Miller, T., Sutton, R. S. & Werbos, P.) Ch. 8 (MIT Press, 1990)

  44. 44.

    , & A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936–1947 (1996)

  45. 45.

    , , , & Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol. 7, e1000173 (2009)

  46. 46.

    , , & Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron 67, 25–32 (2010)

  47. 47.

    Episodic memory: from mind to brain. Annu. Rev. Psychol. 53, 1–25 (2002)

  48. 48.

    , , & Patients with hippocampal amnesia cannot imagine new experiences. Proc. Natl Acad. Sci. USA 104, 1726–1731 (2007)

  49. 49.

    The role of the hippocampus in prediction and imagination. Annu. Rev. Psychol. 61, 27–48 (2010)

  50. 50.

    Purposive Behavior in Animals and Men (The Century Co., 1932)

Download references

Acknowledgements

This work was supported by the Alfred P. Sloan Foundation, The Brain and Behavior Research Foundation (NARSAD Young Investigator Grant) and the National Institutes of Health grant MH085823.

Author information

Affiliations

  1. Solomon H Snyder Department of Neuroscience, Johns Hopkins University School Of Medicine, Baltimore, Maryland 21205, USA

    • Brad E. Pfeiffer
    •  & David J. Foster

Authors

  1. Search for Brad E. Pfeiffer in:

  2. Search for David J. Foster in:

Contributions

B.E.P. and D.J.F. designed the experiment and analyses, B.E.P. collected the data, B.E.P. and D.J.F. wrote the paper.

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to David J. Foster.

Supplementary information

PDF files

  1. 1.

    Supplementary Information

    This file contains Supplementary Figures 1-12 and Supplementary Table 1.

Videos

  1. 1.

    Behavioural decoding accuracy during a representative epoch for rat 1, day 1

    The video demonstrates the accuracy of position decoding during behaviour. Each frame depicts the predicted position of the rat (posterior probability) within the 2 m x 2 m arena given the unit firing patterns that occurred during that frame. The posterior probabilities are shown as a colourmap, which ranges from black (0) to white (0.1). Each frame represents 400 ms, and each frame is advanced from the previous by 100 ms. The rat's physical location and head direction are depicted by the cartoon white rat, and the locations of the 36 wells in the floor of the arena are shown as white squares. The HOME well location is coloured in cyan. If a RANDOM well is active (filled with chocolate) or if the rat is currently at the RANDOM well consuming the reward, it is coloured in green. If the HOME well is active or if the rat is currently at the HOME well consuming the reward, the previous RANDOM well is coloured in red. The time (from the beginning of the session) is depicted at the bottom of the video.

  2. 2.

    Representative trajectory events depicted in figure 2c demonstrating how the events progress across the arena through time

    This video depicts three general 'types' of trajectory events: home-events (events which occur while the rat is at the HOME well), away-events (events which occur while the rat is away from the HOME well) that demonstrate a trajectory that ends at HOME, and away-events that demonstrate a trajectory that does not end at or cross HOME. Note the wide variety of paths encoded by the trajectory events and the smoothness of the trajectory. Each frame depicts the predicted position of the rat (posterior probability) within the 2 m x 2 m arena given the unit firing patterns that occurred during that frame. The posterior probabilities are shown as a colourmap, which ranges from black (0) to white (0.1). Each frame spans 20 ms, and is advanced from the previous by 5 ms. The time from the start of each event is depicted at the bottom of the video. The rat's physical position and head direction throughout each event are depicted by the cartoon white rat, and the locations of the 36 wells in the floor of the arena are shown as white squares. The HOME well location is coloured in cyan. If a RANDOM well is active (filled with chocolate) or if the rat is currently at the RANDOM well consuming the reward, it is coloured in green. If the HOME well is active or if the rat is currently at the HOME well consuming the reward, the previously active RANDOM well is coloured in red. The cyan line connects the peak posterior probabilities for each frame. At the end of each trajectory sequence, the entire event is shown collapsed across time as in Figure 2c.

  3. 3.

    Representative episodes consisting of both exploratory behaviour and trajectory events

    As video 1, but showing a representative episode consisting of both running periods and periods when the rat is stationary and trajectory events are occurring. Successive running and trajectory events within the episode are shown, allowing comparison between paths depicted by trajectory events and those previously and subsequently taken by the animal. During trajectory events, the speed of the video is slowed by a factor of 20 (each frame represents 20 ms, advanced in 5 ms increments) and a solid white border is drawn around the arena to indicate that the decoding is for a trajectory event rather than behaviour. Note that this video demonstrates trajectory events that encode a path from the rat's current location to the HOME well shortly before the rat navigates to HOME following a strikingly similar path. The episode occurred during the first 19 trials, when the specific RANDOM-HOME combinations were novel.

  4. 4.

    Representative episodes consisting of both exploratory behaviour and trajectory events

    As video 3, for a second representative episode, also from within the first 19 trials.

  5. 5.

    Representative episodes consisting of both exploratory behaviour and trajectory events

    As video 3, for a third representative episode, also from within the first 19 trials.

  6. 6.

    Representative episodes consisting of both exploratory behaviour and trajectory events

    As video 3, for a fourth representative episode, also from within the first 19 trials.

  7. 7.

    Representative episodes consisting of both exploratory behaviour and trajectory events

    As video 3, for a fifth representative episode, also from within the first 19 trials.

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/nature12112

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.