Sustained activity encoding visual working memory representations has been observed in several cortical areas of primates. Where along the visual pathways this activity emerges remains unknown. Here we show in macaques that sustained spiking activity encoding memorized visual motion directions is absent in direction-selective neurons in early visual area middle temporal (MT). However, it is robustly present immediately downstream, in multimodal association area medial superior temporal (MST), as well as and in the lateral prefrontal cortex (LPFC). This sharp emergence of sustained activity along the dorsal visual pathway suggests a functional boundary between early visual areas, which encode sensory inputs, and downstream association areas, which additionally encode mnemonic representations. Moreover, local field potential oscillations in MT encoded the memorized directions and, in the low frequencies, were phase-coherent with LPFC spikes. This suggests that LPFC sustained activity modulates synaptic activity in MT, a putative top-down mechanism by which memory signals influence stimulus processing in early visual cortex.
This is a preview of subscription content
Subscribe to Journal
Get full journal access for 1 year
only $4.92 per issue
All prices are NET prices.
VAT will be added later in the checkout.
Tax calculation will be finalised during checkout.
Get time limited or full article access on ReadCube.
All prices are NET prices.
Baddeley, A. Working memory: theories, models, and controversies. Annu. Rev. Psychol. 63, 1–29 (2012).
Funahashi, S., Bruce, C.J. & Goldman-Rakic, P.S. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J. Neurophysiol. 61, 331–349 (1989).
Miller, E., Erickson, C. & Desimone, R. Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J. Neurosci. 16, 5154–5167 (1996).
Andersen, R.A., Essick, G.K. & Siegel, R.M. Neurons of area 7 activated by both visual stimuli and oculomotor behavior. Exp. Brain Res. 67, 316–322 (1987).
Miller, E.K., Li, L. & Desimone, R. A neural mechanism for working and recognition memory in inferior temporal cortex. Science 254, 1377–1379 (1991).
Constantinidis, C. & Procyk, E. The primate working memory networks. Cogn. Affect. Behav. Neurosci. 4, 444–465 (2004).
Pasternak, T. & Greenlee, M.W. Working memory in primate sensory systems. Nat. Rev. Neurosci. 6, 97–107 (2005).
Harrison, S.A. & Tong, F. Decoding reveals the contents of visual working memory in early visual areas. Nature 458, 632–635 (2009).
Bisley, J.W., Zaksas, D., Droll, J.A. & Pasternak, T. Activity of neurons in cortical area MT during a memory for motion task. J. Neurophysiol. 91, 286–300 (2004).
Zaksas, D. & Pasternak, T. Directional signals in the prefrontal cortex and in area MT during a working memory for visual motion task. J. Neurosci. 26, 11726–11742 (2006).
Ferrera, V.P., Rudolph, K.K. & Maunsell, J.H. Responses of neurons in the parietal and temporal visual pathways during a motion task. J. Neurosci. 14, 6171–6186 (1994).
Lee, H., Simpson, G.V., Logothetis, N.K. & Rainer, G. Phase locking of single neuron activity to theta oscillations during working memory in monkey extrastriate visual cortex. Neuron 45, 147–156 (2005).
Super, H., Spekreijse, H. & Lamme, V.A. A neural correlate of working memory in the monkey primary visual cortex. Science 293, 120–124 (2001).
Sneve, M.H., Alnaes, D., Endestad, T., Greenlee, M.W. & Magnussen, S. Visual short-term memory: activity supporting encoding and maintenance in retinotopic visual cortex. Neuroimage 63, 166–178 (2012).
Riggall, A.C. & Postle, B.R. The relationship between working memory storage and elevated activity as measured with functional magnetic resonance imaging. J. Neurosci. 32, 12990–12998 (2012).
Born, R.T. & Bradley, D.C. Structure and function of visual area MT. Annu. Rev. Neurosci. 28, 157–189 (2005).
Saito, H. et al. Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey. J. Neurosci. 6, 145–157 (1986).
Boussaoud, D., Ungerleider, L.G. & Desimone, R. Pathways for motion analysis: cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. J. Comp. Neurol. 296, 462–495 (1990).
Angelaki, D.E., Gu, Y. & Deangelis, G.C. Visual and vestibular cue integration for heading perception in extrastriate visual cortex. J. Physiol. (Lond.) 589, 825–833 (2011).
Petrides, M. Lateral prefrontal cortex: architectonic and functional organization. Phil. Trans. R. Soc. Lond. B 360, 781–795 (2005).
Lennert, T. & Martinez-Trujillo, J. Strength of response suppression to distracter stimuli determines attentional-filtering performance in primate prefrontal neurons. Neuron 70, 141–152 (2011).
Van Wezel, R.J. & Britten, K.H. Motion adaptation in area MT. J. Neurophysiol. 88, 3469–3476 (2002).
Glasser, D.M., Tsui, J.M., Pack, C.C. & Tadin, D. Perceptual and neural consequences of rapid motion adaptation. Proc. Natl. Acad. Sci. USA 108, E1080–E1088 (2011).
Britten, K.H., Newsome, W.T., Shadlen, M.N., Celebrini, S. & Movshon, J.A. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis. Neurosci. 13, 87–100 (1996).
Ninomiya, T., Sawamura, H., Inoue, K. & Takada, M. Segregated pathways carrying frontally derived top-down signals to visual areas MT and V4 in macaques. J. Neurosci. 32, 6851–6858 (2012).
Khawaja, F.A., Tsui, J.M. & Pack, C.C. Pattern motion selectivity of spiking outputs and local field potentials in macaque visual cortex. J. Neurosci. 29, 13702–13709 (2009).
Liebe, S., Hoerzer, G.M., Logothetis, N.K. & Rainer, G. Theta coupling between V4 and prefrontal cortex predicts visual short-term memory performance. Nat. Neurosci. 15, 456–462 (2012).
Salazar, R.F., Dotson, N.M., Bressler, S.L. & Gray, C.M. Content-specific fronto-parietal synchronization during visual working memory. Science 338, 1097–1100 (2012).
Hussar, C.R. & Pasternak, T. Common rules guide comparisons of speed and direction of motion in the dorsolateral prefrontal cortex. J. Neurosci. 33, 972–986 (2013).
Hernandez, A. et al. Decoding a perceptual decision process across cortex. Neuron 66, 300–314 (2010).
Priebe, N.J., Churchland, M.M. & Lisberger, S.G. Constraints on the source of short-term motion adaptation in macaque area MT. I. the role of input and intrinsic mechanisms. J. Neurophysiol. 88, 354–369 (2002).
Osborne, L.C., Bialek, W. & Lisberger, S.G. Time course of information about motion direction in visual area MT of macaque monkeys. J. Neurosci. 24, 3210–3222 (2004).
Lebedev, M.A., Messinger, A., Kralik, J.D. & Wise, S.P. Representation of attended versus remembered locations in prefrontal cortex. PLoS Biol. 2, e365 (2004).
Nobre, A.C. et al. Orienting attention to locations in perceptual versus mental representations. J. Cogn. Neurosci. 16, 363–373 (2004).
Chafee, M.V. & Goldman-Rakic, P.S. Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task. J. Neurophysiol. 79, 2919–2940 (1998).
Swaminathan, S.K. & Freedman, D.J. Preferential encoding of visual categories in parietal cortex compared with prefrontal cortex. Nat. Neurosci. 15, 315–320 (2012).
Suzuki, M. & Gottlieb, J. Distinct neural mechanisms of distractor suppression in the frontal and parietal lobe. Nat. Neurosci. 16, 98–104 (2013).
Cohen, M.R. & Newsome, W.T. Estimates of the contribution of single neurons to perception depend on timescale and noise correlation. J. Neurosci. 29, 6635–6648 (2009).
Mitzdorf, U. Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena. Physiol. Rev. 65, 37–100 (1985).
Bartolo, M.J. et al. Stimulus-induced dissociation of neuronal firing rates and local field potential gamma power and its relationship to the resonance blood oxygen level-dependent signal in macaque primary visual cortex. Eur. J. Neurosci. 34, 1857–1870 (2011).
Denker, M. et al. The local field potential reflects surplus spike synchrony. Cereb. Cortex 21, 2681–2695 (2011).
Lui, L.L. & Pasternak, T. Representation of comparison signals in cortical area MT during a delayed direction discrimination task. J. Neurophysiol. 106, 1260–1273 (2011).
Mendoza, D., Schneiderman, M., Kaul, C. & Martinez-Trujillo, J. Combined effects of feature-based working memory and feature-based attention on the perception of visual motion direction. J. Vision 11, 1–15 (2011).
Treue, S. & Martinez Trujillo, J.C. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399, 575–579 (1999).
McAdams, C.J. & Maunsell, J.H. Effects of attention on the reliability of individual neurons in monkey visual cortex. Neuron 23, 765–773 (1999).
Magri, C., Schridde, U., Murayama, Y., Panzeri, S. & Logothetis, N.K. The amplitude and timing of the BOLD signal reflects the relationship between local field potential power at different frequencies. J. Neurosci. 32, 1395–1407 (2012).
Ardid, S., Wang, X.J. & Compte, A. An integrated microcircuit model of attentional processing in the neocortex. J. Neurosci. 27, 8486–8495 (2007).
Goldman-Rakic, P.S. Cellular basis of working memory. Neuron 14, 477–485 (1995).
Lim, S. & Goldman, M.S. Balanced cortical microcircuitry for maintaining information in working memory. Nat. Neurosci. 16, 1306–1314 (2013).
Haider, B., Hausser, M. & Carandini, M. Inhibition dominates sensory responses in the awake cortex. Nature 493, 97–100 (2013).
This study was supported by grants awarded to J.C.M.-T. from the Canadian Institutes of Health Research (CIHR), the Canada Research Chairs Program (CRC) and the EJLB Foundation. We thank M. Schneiderman for assistance with electrophysiological recordings, and W. Kucharski and S. Nuara for technical assistance.
The authors declare no competing financial interests.
Integrated supplementary information
Histogram showing the distribution of receptive field diameters (in degrees of visual field) for neurons recorded in MT (green) and MST (blue).
Percentage of selective neurons with sensory selectivity (upright solid bars), and delay selectivity (inverted hashed bars) in MT (green), MST (blue) and LPFC (red), measured separately for each of the two monkeys (a,b), and measured with a one-factor ANOVA testing a significant main effect of motion direction on mean firing rates across each task period (c). (d) Percentage of selective neurons with delay selectivity measured excluding the first 240 ms (light colors) or 480 ms (dark colors) of the delay.
Supplementary Figure 3 Distribution of duration of discriminability across the population of recorded neurons.
Cumulative histograms showing the percentage of selective neurons in MT (green), MST (blue) and LPFC (red) that exceeded each duration of discriminability during the sample (a,b) and the delay (c,d) periods, measured for each neuron as the percentage of bins with significant discriminability (a,c) or as the maximum percentage of consecutive significant bins (b,d).
Mean choice probability (± standard error) across delay-selective neurons in MST (a) and LPFC (b) over time during the delay period. Horizontal axis shows time after sample offset. Dashed line shows chance level of choice probability.
Supplementary Figure 5 Direction discriminability of LFP power in MST and LPFC during the delay period.
(a,b) For each frequency band, percentage of LFP sites in MST (a) and LPFC (b) for which the LFP power auROC in the delay period was significantly higher than expected by chance. (c,d) Mean auROC (± standard error) among selective sites in MST (c) and LPFC (d).
Supplementary Figure 6 Randomized surrogate spike-field synchrony between LPFC and MT during the delay period.
(a) Randomized surrogate phase coherence between LPFC spikes and MT LFPs during the delay period (computed from data with shuffled trial labels) as a function of LFP frequency for all significantly coherent LPFC-MT pairs, sorted in the same order as in Fig. 8b. (b) Percentage of coherent pairs for which the corresponding randomized surrogate coherence reached significance at each frequency. Frequency bands are color-coded.
About this article
Cite this article
Mendoza-Halliday, D., Torres, S. & Martinez-Trujillo, J. Sharp emergence of feature-selective sustained activity along the dorsal visual pathway. Nat Neurosci 17, 1255–1262 (2014). https://doi.org/10.1038/nn.3785
Brain Structure and Function (2022)
Scientific Reports (2021)
Nature Communications (2021)
Nature Communications (2021)
Dynamics of coherent activity between cortical areas defines a two-stage process of top-down attention
Experimental Brain Research (2021)