Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

Independent generation of sequence elements by motor cortex

A Publisher Correction to this article was published on 16 March 2022

This article has been updated

Abstract

Rapid execution of motor sequences is believed to depend on fusing movement elements into cohesive units that are executed holistically. We sought to determine the contribution of primary motor and dorsal premotor cortex to this ability. Monkeys performed highly practiced two-reach sequences, interleaved with matched reaches performed alone or separated by a delay. We partitioned neural population activity into components pertaining to preparation, initiation and execution. The hypothesis that movement elements fuse makes specific predictions regarding all three forms of activity. We observed none of these predicted effects. Rapid two-reach sequences involved the same set of neural events as individual reaches but with preparation for the second reach occurring as the first was in flight. Thus, at the level of dorsal premotor and primary motor cortex, skillfully executing a rapid sequence depends not on fusing elements, but on the ability to perform two key processes at the same time.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Task structure.
Fig. 2: Potential strategies for generating compound reaches.
Fig. 3: Single-neuron responses.
Fig. 4: Time-course of activity in preparatory dimensions.
Fig. 5: Patterns of preparatory activity.
Fig. 6: Evolution of the CIS.
Fig. 7: A recurrent network trained to generate reach sequences.
Fig. 8: Similarities between motor cortical activity and network activity.

Similar content being viewed by others

Data availability

All relevant data are available from the authors upon reasonable request.

Code availability

The trained RNN used in Figs. 7 and 8 is available at Figshare (https://doi.org/10.34747/n3rs-9w57).

Change history

References

  1. Sakai, K., Kitaguchi, K. & Hikosaka, O. Chunking during human visuomotor sequence learning. Exp. Brain Res. 152, 229–242 (2003).

    Article  PubMed  Google Scholar 

  2. Rosenbaum, D. A., Kenny, S. B. & Derr, M. A. Hierarchical control of rapid movement sequences. J. Exp. Psych. 9, 86–102 (1983).

    CAS  Google Scholar 

  3. Abrahamse, E. L., Ruitenberg, M. F., de Kleine, E. & Verwey, W. B. Control of automated behavior: insights from the discrete sequence production task. Front. Hum. Neurosci. 7, 82 (2013).

    Article  PubMed  PubMed Central  Google Scholar 

  4. Ramkumar, P. et al. Chunking as the result of an efficiency computation trade-off. Nat. Commun. 7, 12176 (2016).

    Article  PubMed  PubMed Central  Google Scholar 

  5. Verwey, W. B. Buffer loading and chunking in sequential keypressing. J. Exp. Psych. 22, 544 (1996).

    Google Scholar 

  6. Stadler, M. A. Implicit serial learning: questions inspired by Hebb (1961). Memory Cognition 21, 819–827 (1993).

    Article  CAS  PubMed  Google Scholar 

  7. Krakauer, J. W., Hadjiosif, A. M., Xu, J., Wong, A. L. & Haith, A. M. Motor learning. Comp. Physiol. 9, 613–663 (2019).

    Article  Google Scholar 

  8. Wong, A. L., Lindquist, M. A., Haith, A. M. & Krakauer, J. W. Explicit knowledge enhances motor vigor and performance: motivation versus practice in sequence tasks. J. Neurophysiol. 114, 219–232 (2015).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Ben-Shaul, Y. et al. Neuronal activity in motor cortical areas reflects the sequential context of movement. J. Neurophysiol. 91, 1748–1762 (2004).

    Article  PubMed  Google Scholar 

  10. Lu, X. & Ashe, J. Anticipatory activity in primary motor cortex codes memorized movement sequences. Neuron 45, 967–973 (2005).

    Article  CAS  PubMed  Google Scholar 

  11. Hatsopoulos, N. G., Paninski, L. & Donoghue, J. P. Sequential movement representations based on correlated neuronal activity. Exp. Brain Res. 149, 478–486 (2003).

    Article  PubMed  Google Scholar 

  12. Yokoi, A. & Diedrichsen, J. Neural organization of hierarchical motor sequence representations in the human neocortex. Neuron 103, 1178–1190.e1177 (2019).

    Article  CAS  PubMed  Google Scholar 

  13. Weinrich, M., Wise, S. P. & Mauritz, K. H. A neurophysiological study of the premotor cortex in the rhesus monkey. Brain 107, 385–414 (1984).

    Article  PubMed  Google Scholar 

  14. Crammond, D. J. & Kalaska, J. F. Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. J. Neurophysiol. 84, 986–1005 (2000).

    Article  CAS  PubMed  Google Scholar 

  15. Pastor-Bernier, A., Tremblay, E. & Cisek, P. Dorsal premotor cortex is involved in switching motor plans. Front. Neuroeng. 5, https://doi.org/10.3389/fneng.2012.00005 (2012).

  16. Churchland, M. M., Cunningham, J. P., Kaufman, M. T., Ryu, S. I. & Shenoy, K. V. Cortical preparatory activity: representation of movement or first cog in a dynamical machine? Neuron 68, 387–400 (2010).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Churchland, M. M., Yu, B. M., Ryu, S. I., Santhanam, G. & Shenoy, K. V. Neural variability in premotor cortex provides a signature of motor preparation. J. Neurosci. 26, 3697–3712 (2006).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Vyas, S., Golub, M. D., Sussillo, D. & Shenoy, K. Computation through neural population dynamics. Annu. Rev. Neurosci. 43, 249–227 (2020).

  19. Moran, D. W. & Schwartz, A. B. Motor cortical representation of speed and direction during reaching. J. Neurophysiol. 82, 2676–2692 (1999).

    Article  CAS  PubMed  Google Scholar 

  20. Kaufman, M. T. et al. The largest response component in the motor cortex reflects movement timing but not movement type. eNeuro 3, https://doi.org/10.1523/ENEURO.0085-16.2016 (2016).

  21. Lara, A. H., Cunningham, J. P. & Churchland, M. M. Different population dynamics in the supplementary motor area and motor cortex during reaching. Nat. Commun. 9, 2754 (2018).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. Ames, K. C., Ryu, S. I. & Shenoy, K. V. Simultaneous motor preparation and execution in a last-moment reach correction task. Nat. Commun. 10, 2718 (2019).

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  23. Sergio, L. E., Hamel-Paquet, C. & Kalaska, J. F. Motor cortex neural correlates of output kinematics and kinetics during isometric-force and arm-reaching tasks. J. Neurophysiol. 94, 2353–2378 (2005).

    Article  PubMed  Google Scholar 

  24. Churchland, M. M. & Shenoy, K. V. Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. J. Neurophysiol. 97, 4235–4257 (2007).

    Article  PubMed  Google Scholar 

  25. Lara, A. H., Elsayed, G. F., Zimnik, A. J., Cunningham, J. & Churchland, M. M. Conservation of preparatory neural events in monkey motor cortex regardless of how movement is initiated. eLife 7, https://doi.org/10.7554/eLife.31826 (2018).

  26. Matsuzaka, Y., Picard, N. & Strick, P. L. Skill representation in the primary motor cortex after long-term practice. J. Neurophysiol. 97, 1819–1832 (2007).

    Article  PubMed  Google Scholar 

  27. Kettner, R. E., Marcario, J. K. & Clark-Phelps, M. C. Control of remembered reaching sequences in monkey. I. Activity during movement in motor and premotor cortex. Exp. Brain Res. 112, 335–346 (1996).

    Article  CAS  PubMed  Google Scholar 

  28. Kalaska, J. F., Scott, S. H., Cisek, P. & Sergio, L. E. Cortical control of reaching movements. Curr. Opin. Neurobiol. 7, 849–859 (1997).

    Article  CAS  PubMed  Google Scholar 

  29. Scott, S. H. Inconvenient truths about neural processing in primary motor cortex. J. Physiol. 586, 1217–1224 (2008).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Wise, S. P. The primate premotor cortex: past, present, and preparatory. Annu. Rev. Neurosci. 8, 1–19 (1985).

    Article  CAS  PubMed  Google Scholar 

  31. Sussillo, D., Churchland, M. M., Kaufman, M. T. & Shenoy, K. V. A neural network that finds a naturalistic solution for the production of muscle activity. Nat. Neurosci. 18, 1025–1033 (2015).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Dacre, J. et al. Cerebellar-recipient motor thalamus drives behavioral context-specific movement initiation. Preprint at bioRxiv https://doi.org/10.1101/802124 (2019).

  33. Sauerbrei, B. A. et al. Cortical pattern generation during dexterous movement is input-driven. Nature 577, 386–391 (2020).

    Article  CAS  PubMed  Google Scholar 

  34. Elsayed, G. F., Lara, A. H., Kaufman, M. T., Churchland, M. M. & Cunningham, J. P. Reorganization between preparatory and movement population responses in motor cortex. Nat. Commun. 7, 13239 (2016).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Churchland, M. M. et al. Neural population dynamics during reaching. Nature 487, 51–56 (2012).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Riehle, A. & Requin, J. The predictive value for performance speed of preparatory changes in neuronal activity of the monkey motor and premotor cortex. Behav. Brain Res. 53, 35–49 (1993).

    Article  CAS  PubMed  Google Scholar 

  37. Kaufman, M. T., Churchland, M. M., Ryu, S. I. & Shenoy, K. V. Cortical activity in the null space: permitting preparation without movement. Nat. Neurosci. 17, 440–448 (2014).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Duncker, L., O’Shea, D., Goo, E. W., Shenoy, K. & Sahani, E. M. T-29. Low-rank non-stationary population dynamics can account for robustness to optogenetic stimulation. COSYNE abstract T-29 http://cosyne.org/cosyne17/Cosyne2017_program_book.pdf (2017).

  39. Ariani, G. & Diedrichsen, J. Sequence learning is driven by improvements in motor planning. J. Neurophysiol. 121, 2088–2100 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  40. Rosenbaum, D. A. Human movement initiation: specification of arm, direction, and extent. J. Exp. Psychol. Gen. 109, 444–474 (1980).

    Article  CAS  PubMed  Google Scholar 

  41. Haith, A. M., Pakpoor, J. & Krakauer, J. W. Independence of movement preparation and movement initiation. J. Neurosci. 36, 3007–3015 (2016).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Flash, T. & Henis, E. Arm trajectory modifications during reaching towards visual targets. J. Cogn. Neurosci. 3, 220–230 (1991).

    Article  CAS  PubMed  Google Scholar 

  43. Stavisky, S. D., Kao, J. C., Ryu, S. I. & Shenoy, K. V. Motor cortical visuomotor feedback activity is initially isolated from downstream targets in output-null neural state space dimensions. Neuron 95, 195–208.e9 (2017).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Kao, T.-C., Sadabadi, M. S. & Hennequin, G. Optimal anticipatory control as a theory of motor preparation: a thalamo-cortical circuit model. Preprint at bioRxiv https://doi.org/10.1101/2020.02.02.931246 (2020).

  45. Tanji, J. Sequential organization of multiple movements: involvement of cortical motor areas. Annu. Rev. Neurosci. 24, 631–651 (2001).

    Article  CAS  PubMed  Google Scholar 

  46. Picard, N. & Strick, P. L. Activation on the medial wall during remembered sequences of reaching movements in monkeys. J. Neurophysiol. 77, 2197–2201 (1997).

    Article  CAS  PubMed  Google Scholar 

  47. Kornysheva, K. et al. Neural competitive queuing of ordinal structure underlies skilled sequential action. Neuron. 101, 1166–1180.e1163 (2019).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Jin, X., Tecuapetla, F. & Costa, R. M. Basal ganglia subcircuits distinctively encode the parsing and concatenation of action sequences. Nat. Neurosci. 17, 423–430 (2014).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Averbeck, B. B., Chafee, M. V., Crowe, D. A. & Georgopoulos, A. P. Parallel processing of serial movements in prefrontal cortex. Proc. Natl Acad. Sci. USA 99, 13172–13177 (2002).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Botvinick, M. & Plaut, D. C. Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. Psychol. Rev. 111, 395–429 (2004).

    Article  PubMed  Google Scholar 

  51. Pachitariu, M., Steinmetz, N. A., Kadir, S. N., Carandini, M. & Harris, K. D. Fast and accurate spike sorting of high-channel count probes with KiloSort. Adv. Neural Infor. Process. Syst. 29, 4455–4464 (2016).

    Google Scholar 

  52. Trautmann, E. M. et al. Accurate estimation of neural population dynamics without spike sorting. Neuron 103, 292–308.e294 (2019).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Kobak, D. et al. Demixed principal component analysis of neural population data. eLife 5, https://doi.org/10.7554/eLife.10989 (2016).

  54. Brendel, W., Romo, R. & Machens, C. Demixed principal component analysis. Adv. Neural Infor. Process. Syst. 24, 2654–2662 (2011).

    Google Scholar 

Download references

Acknowledgements

We thank Y. Pavlova for excellent animal care. This work was supported by the Grossman Center for the Statistics of Mind, the Simons Foundation (M.M.C.), the McKnight Foundation (M.M.C.), NIH Director’s New Innovator Award DP2 NS083037 (M.M.C.), NIH CRCNS R01NS100066 (M.M.C.), NIH 1U19NS104649 (M.M.C.), P30 EY019007 (M.M.C.), the National Science Foundation (A.J.Z.) and the Kavli Foundation (M.M.C.).

Author information

Authors and Affiliations

Authors

Contributions

A.J.Z. and M.M.C. conceived the experiments, designed the data analyses and wrote and edited the manuscript. A.J.Z. collected the data and performed the analyses.

Corresponding author

Correspondence to Mark M. Churchland.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Peer review information Nature Neuroscience thanks Paul Cisek and Katja Kornysheva for their contribution to the peer review of this work.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Extended data

Extended Data Fig. 1 Single and compound-reach conditions.

a, Reach paths for single-reach conditions (same as in Fig. 1a) for Monkey B. Paths are averaged across all trials and sessions. b, Reach paths for all compound-reach conditions performed by monkey B (a superset of those in Fig. 1a). Most first-target locations were used for only one compound-reach condition, to maintain a reasonable trial-counts. This was necessary because monkey B performed delayed double-reach conditions using three instructed pauses, which added to the total number of conditions performed. For similar reasons, delayed double-reach conditions employed a subset of the two-target combinations (those in red and blue) that were employed during compound reaches. c, Same as a, but for monkey H. For monkey H, the bottom-right and top-right targets were shifted slightly to the right and left (respectively) compared to the locations used for monkey B. This shift was necessary to prevent the animal’s arm from blocking sight of the second target during certain conditions (the two monkeys were of different sizes and employed slightly different postures when reaching). d, Same as b, but for monkey H. Monkey H performed a greater number of compound reach conditions than monkey B.

Extended Data Fig. 2 Activity of neuron 066 (Monkey B) across all conditions.

a, Response during single-reach conditions, as in Fig. 3a, but for all single reaches. Circles indicate the time of target onset (t), reach onset (r), and reach end (e). b, Response during delayed double reaches with a 600 ms instructed pause, as in Fig. 3b. c, Response during delayed double-reaches with a 300 ms instructed pause. d, Response during delayed double-reaches with a 100 ms instructed pause. e, Response during all compound reach conditions, as in Fig. 3c, but for all conditions.

Extended Data Fig. 3 Responses of four exemplar motor cortex units.

a, Response of neuron 322, recorded from Monkey H. Same as in Fig. 3d–f, but for all single reaches and all two-reach combinations. Circles indicate the time of target onset (t), reach onset (r), and reach end (e). bd, Responses of three additional example units. As is typical, these units are active during both the delay and execution-epochs of single reaches. It is thus difficult to determine via inspection whether there is a second bout of preparation during compound reaches.

Extended Data Fig. 4 Time-course of activity in preparatory dimensions during all conditions, monkey B.

Same as in Fig. 4a–f, but with the addition of data for delayed double reaches with 300 and 100 ms pauses. a, Same data shown in Fig. 4a: projections of population activity during single reach conditions onto the first preparatory dimension. Circles indicate the time of target onset (t), reach onset (r), and reach end (e). bd, Activity in the first preparatory dimension during delayed double-reach conditions with an instructed pause of 600 ms (b), 300 ms (c) and 100 ms (d). e, Activity in the first preparatory dimension during compound reach conditions, as in Fig. 4c. f, Occupancy of all 20 preparatory dimensions during single reach conditions. This panel plots the same data shown in Fig. 4d. Shaded regions indicate the standard deviation of the sampling error estimated by resampling individual units (n = 1,000 resampled populations). gi, Occupancy of preparatory dimensions during delayed double-reach conditions with an instructed pause of 600 ms (g), 300 ms (h) and 100 ms (i). j, Occupancy of preparatory dimensions during compound reach conditions, as in Fig. 4f.

Extended Data Fig. 5 Defining the preparatory dimensions using all preparatory epochs.

Same analysis as in Fig. 4d,e,f,k,l,m, but identification of dimensions employed an epoch of dwell-period activity from compound reach conditions (activity within a 40 ms window beginning 140 ms before the onset of the second reach) in addition to the epochs contributed by single and delayed-double reaches. a, Occupancy (of 20 preparatory dimensions) during single reaches for monkey B. Circles indicate the time of target onset (t), reach onset (r), and reach end (e). Shaded regions indicate the standard deviation of the sampling error estimated by resampling individual units (n = 1000 resampled populations). b, Occupancy of the same preparatory dimensions during delayed double reaches. c, Occupancy of the same preparatory dimensions during compound reaches. This panel plots the same data shown in Fig. 4g. df, Same as ac, but for monkey H.

Extended Data Fig. 6 Patterns of execution-related activity.

Analysis is similar to that in Fig. 5, but was applied to activity during movement. a, Comparison between single and compound reaches. Each marker plots the activity (in 1 of 10 execution dimensions, at a single point in time) for a pair of conditions that share a first reach. Because execution activity (unlike preparatory activity) is strongly time-varying, we include activity from 4 time points (50 ms intervals, starting 25 ms before reach onset). Data are from monkey B. b, same but for monkey H.

Extended Data Fig. 7 The ability to predict preparatory activity from first-reach muscle activity does not differ for compound reaches, relative to single and delayed double-reaches.

The holistic hypothesis predicts that preparatory activity, during the instructed delay, should reflect the full compound reach. If so, it should not be readily predicted from the characteristics of the first reach alone. We thus asked whether the ability to predict preparatory activity from first-reach muscle activity was reduced for compound reaches. We used dimensionality reduction to summarize muscle activity via a small number of variables, and used these as regressors to predict the low-dimensional preparatory state (see Methods for full details). Prediction performance was quantified using cross-validation. a, Results for monkey B. Gray circles plot leave-one-out cross-validation performance for each individual condition. Red circles and error bars show the median and the median absolute deviation. Performance for compound reach conditions was not significantly lower than that for single and delayed-double reach conditions. Indeed it was slightly higher. Median R2 = 0.92 and 0.95 for single/delayed-double and compound reach conditions, respectively (p = 0.92, Mann-Whitney one-tailed test; n = 12 and 10). b, Same as a, but for monkey H. Performance for compound reach conditions was not significantly lower than that for single and delayed-double reach conditions. Median R2 = 0.97 and 0.95 for single/delayed-double and compound-reach conditions, respectively (p = 0.07, Mann-Whitney one-tailed test; n = 22 and 16).

Extended Data Fig. 8 Individual-unit delay-period activity is similar before compound reaches and corresponding single reaches.

a, The trial-averaged firing rate of each unit, for each condition, was calculated during a 100 ms window, beginning 170 ms prior to reach onset. For each recorded unit, we then correlated the firing rates before compound reaches with those before corresponding single reaches. A unity correlation indicates that firing rates depended only on the identity of the first reach. A correlation less than unit could indicate either the influence of the second reach (as proposed by the holistic hypothesis) or the influence of measurement noise. The latter is relevant because many units had weak-to-modest ‘preparatory tuning’ (the range of firing rates across conditions), making strong correlations unlikely given measurement noise. We thus plotted the correlation versus the strength of preparatory tuning. Each light gray marker represents an individual unit. To improve visibility, marker size increases with tuning strength. Error bars represent the 95% confidence interval of the correlation for each unit, calculated by resampling individual trials with replacement (n = 1000 resampled populations). The correlation between the delay-period activity of single and compound reaches increases sharply with tuning strength (red trace) and plateaued near unity, consistent with the independent hypothesis. Data were fit with a hyperbolic tangent with a single free parameter that determined the slope of the function. Data are for monkey B. b, Distribution of correlations for all individual units from monkey B (median ρ = 0.77). c, Same but for units with stronger preparatory tuning (top tertile; median ρ = 0.94). d–f, Same as a–c, but for monkey H. Median ρ was 0.74 and 0.90 for the two distributions.

Extended Data Fig. 9 Activity within condition-invariant dimensions during all conditions, monkey B.

Same as in Fig. 6a–c, but with the addition of data for delayed double reaches with 300 and 100 ms pauses. The added analyses are in panels c and h (300 ms pause) and d and i (100 ms pause). The other panels are reproduced from Fig. 6. Traces are colored to highlight peri-reach activity. Circles indicate the time of target onset (t), reach onset (r), and reach end (e). The pattern displayed by the condition-invariant signal, during compound reaches (e and j) lay on a continuum with the pattern during delayed double-reaches (bi).

Extended Data Fig. 10 Both PMd and M1 populations obey the predictions of the independent hypothesis.

a,b, Same analysis as Fig. 4d–f, performed for units recorded from rostral (a) and caudal (b) burr holes of monkey B (n = 138 and 89, respectively). Shaded regions indicate the standard deviation of the sampling error estimated by resampling individual units (n = 1000 resampled populations). Circles indicate the time of target onset (t), reach onset (r), and reach end (e). c,d, Same analysis as Fig. 5c (ρ = 0.97 and 0.89, respectively). e,f, Same analysis as Fig. 6a–c. A notable quantitative difference is that delay-period activity was stronger (relative to movement-epoch activity) for the rostral subpopulation. This indicates that the two subpopulations likely made differently sized contributions to the preparatory and execution-related dimensions in the original analysis of the full population. This was indeed the case. Preparatory weights for caudal units were modestly smaller (69% on average) than those of rostral units. Conversely, execution weights for the rostral units were modestly smaller (79%) than those of caudal units.

Supplementary information

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zimnik, A.J., Churchland, M.M. Independent generation of sequence elements by motor cortex. Nat Neurosci 24, 412–424 (2021). https://doi.org/10.1038/s41593-021-00798-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41593-021-00798-5

This article is cited by

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing