Brain decoders use neural recordings to infer the activity or intent of a user. To train a decoder, one generally needs to infer the measured variables of interest (covariates) from simultaneously measured neural activity. However, there are cases for which obtaining supervised data is difficult or impossible. Here, we describe an approach for movement decoding that does not require access to simultaneously measured neural activity and motor outputs. We use the statistics of movement—much like cryptographers use the statistics of language—to find a mapping between neural activity and motor variables, and then align the distribution of decoder outputs with the typical distribution of motor outputs by minimizing their Kullback–Leibler divergence. By using datasets collected from the motor cortex of three non-human primates performing either a reaching task or an isometric force-production task, we show that the performance of such a distribution-alignment decoding algorithm is comparable to the performance of supervised approaches. Distribution-alignment decoding promises to broaden the set of potential applications of brain decoding.
This is a preview of subscription content, access via your institution
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 digital issues and online access to articles
$99.00 per year
only $8.25 per issue
Rent or buy this article
Prices vary by article type
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
Kay, K. N. et al. Identifying natural images from human brain activity. Nature452, 352–355 (2008).
Cowen, A. S. et al. Neural portraits of perception: reconstructing face images from evoked brain activity. Neuroimage94, 12–22 (2014).
Mitchell, T. M. et al. Predicting human brain activity associated with the meanings of nouns. Science320, 1191–1195 (2008).
Haynes, J. et al. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci.7, 523–534 (2006).
Serruya, M. D. et al. Brain–machine interface: instant neural control of a movement signal. Nature416, 141–142 (2002).
Kemere, C. et al. Model-based neural decoding of reaching movements: a maximum likelihood approach. IEEE Trans. Biomed. Eng.51, 925–932 (2004).
Tkach, D. et al. Observation-based learning for brain–machine interfaces. Curr. Opin. Neurobiol.18, 589–594 (2008).
Anderson, D. J. et al. Toward a science of computational ethology. Neuron84, 18–31 (2014).
Donoghue, J. P. Connecting cortex to machines: recent advances in brain interfaces. Nat. Neurosci.5, 1085–1088 (2002).
Bose, R. Information Theory, Coding and Cryptography (McGraw-Hill Education, New Delhi, India, 2008).
Chaudhari, M. P. et al. A survey on cryptography algorithms. Int. J. Adv. Res. Comput. Sci. Manag. Stud.2, 100–104 (2014).
Wang, L. et al. Automatic gait recognition based on statistical shape analysis. IEEE Trans. Image Process.12, 1120–1131 (2003).
Belić, J. J. et al. Decoding of human hand actions to handle missing limbs in neuroprosthetics. Front. Comput. Neuro. https://doi.org/10.3389/fncom.2015.00027.
Ishiduka, S. et al. Kinematic analysis of low dimensional structure in walking and running. In 2015 International Symposium on Micro-NanoMechatronics and Human Science (MHS) 1–6 (IEEE, 2015).
Damavsevivcius, R. et al. Smartphone user identity verification using gait characteristics. Symmetry8, 100 (2016).
Kaufman, M. T. et al. The largest response component in the motor cortex reflects movement timing but not movement type. eNeuro3, ENEURO–0085 (2016).
Marblestone, A. H. et al. Physical principles for scalable neural recording. Front. Comput. Neurosci. https://doi.org/10.3389/fncom.2013.00137.
Georgopoulos, A. P. et al. Neuronal population coding of movement direction. Science233, 1416–1419 (1986).
Pillow, J. W. et al. Spatio-temporal correlations and visual signaling in a complete neuronal population. Nature454, 995–999 (2008).
Dyer, E. L. et al. Greedy feature selection for subspace clustering. J. Mach. Learn. Res.14, 2487–2517 (2013).
Schölkopf, B. et al. Kernel Methods in Computational Biology (MIT Press, Cambridge, MA, USA, 2004).
Ingram, J. N. et al. The statistics of natural hand movements. Exp. Brain Res.188, 223–236 (2008).
Ejaz, N. et al. Hand use predicts the structure of representations in sensorimotor cortex. Nat. Neurosci. 18, 1034–1040 (2015).
Byron, M. Y. et al. Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. In Advances in Neural Information Processing Systems (eds Koller, D. et al.) 1881–1888 (MIT Press, 2009).
Fernandes, H. L. et al. Saliency and saccade encoding in the frontal eye field during natural scene search. Cereb. Cortex24, 3232–3245 (2014).
Li, Z. et al. Adaptive decoding for brain–machine interfaces through Bayesian parameter updates. Neural Comput.23, 3162–3204 (2011).
Gilja, V. et al. A high-performance neural prosthesis enabled by control algorithm design. Nat. Neurosci.15, 1752–1757 (2012).
Orsborn, A. L. et al. Closed-loop decoder adaptation on intermediate time-scales facilitates rapid bmi performance improvements independent of decoder initialization conditions. IEEE Trans. Neural Syst. Rehabil. Eng.20, 468–477 (2012).
Orsborn, A. L. et al. Closed-loop decoder adaptation shapes neural plasticity for skillful neuroprosthetic control. Neuron82, 1380–1393 (2014).
Ashe, J. et al. Movement parameters and neural activity in motor cortex and area 5. Cereb. Cortex4, 590–600 (1994).
Averbeck, B. B. et al. Parietal representation of hand velocity in a copy task. J. Neurophysio.93, 508–518 (2005).
Stevenson, I. H. et al. Statistical assessment of the stability of neural movement representations. J. Neurophysio. 106, 764–774 (2011).
Stevenson, I. H. et al. Functional connectivity and tuning curves in populations of simultaneously recorded neurons. PLoS Comput. Biol.8, e1002775 (2012).
Jagabathula, S. et al. Inferring rankings using constrained sensing. IEEE Trans. Inform. Theory57, 7288–7306 (2011).
Van Der Maaten, L. et al. Dimensionality reduction: a comparative. J. Mach. Learn. Res.10, 66–71 (2009).
Tenenbaum, J. B. et al. A global geometric framework for nonlinear dimensionality reduction. Science290, 2319–2323 (2000).
van der Maaten, L. et al. Visualizing data using t-sne. J. Mach. Learn. Res.9, 2579–2605 (2008).
Bishop, C. M. Bayesian PCA. In Advances in Neural Information Processing Systems (eds Kearns, M. J. et al.) 382–388 (MIT Press, 1999).
Macke, J. H. et al. Empirical models of spiking in neural populations. In Advances in Neural Information Processing Systems (eds Shawe-Taylor, J. et al.) 1350–1358 (MIT Press, 2011).
Póczos, B. et al. On the estimation of alpha-divergences. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics 609–617 (2011).
Loftsgaarden, D. O. et al. A nonparametric estimate of a multivariate density function. Ann. Math. Stat.36, 1049–1051 (1965).
The authors would like to thank B. Dekleva, P. Ramkumar, J. Glaser, D. Acuna, P. Lawlor, S. Saeb, L. Lonini, S. Solla and B. Yu for discussions and advice. This work was supported by NINDS R01 NS053603, NINDS R01 NS074044, U01 MH109100 and R01 NS074044.
The authors declare no competing financial interests.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Dyer, E.L., Gheshlaghi Azar, M., Perich, M.G. et al. A cryptography-based approach for movement decoding. Nat Biomed Eng 1, 967–976 (2017). https://doi.org/10.1038/s41551-017-0169-7
This article is cited by
Nature Biomedical Engineering (2022)
Rapid adaptation of brain–computer interfaces to new neuronal ensembles or participants via generative modelling
Nature Biomedical Engineering (2021)