Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Volume 1 Issue 9, September 2019

Balancing user and robotic control

Brain–machine interfaces can augment human capabilities and restore functions. In the past decade, advances in materials engineering, robotics and machine learning are opening up new possibilities in this area. In work by Katy Z. Zhuang et al. a robotic hand prosthesis is developed that allows not only user-controlled movement but also assisted grasping in a shared control scheme. This is accomplished by first decoding myoelectric signals with a machine learning method to control individual fingers. This proportional control of fine movements is combined with an algorithmic controller to assist stable grasping by maximizing the area of contact between a prosthetic hand and an object. Elsewhere in this issue, Musa Mahmood et al. demonstrate a portable, wireless, flexible scalp electroencephalography system, implementing state-of-the-art flexible electronics approaches and convolutional neural networks for real-time neural signal classification. In our Editorial, we look at some of the history of brain–machine interfaces, going back to Norbert Wiener’s cybernetics.

See Zhuang et al., Mahmood et al. and Editorial

Image: Albert Shakirov / Alamy Stock Photo. Cover design: Karen Moore

Editorial

  • Brain–machine interfaces were envisioned already in the 1940s by Norbert Wiener, the father of cybernetics. The opportunities for enhancing human capabilities and restoring functions are now quickly expanding with a combination of advances in machine learning, smart materials and robotics.

    Editorial

    Advertisement

Top of page ⤴

Comment & Opinion

  • In order for the neuromorphic research field to advance into the mainstream of computing, it needs to start quantifying gains, standardize on benchmarks and focus on feasible application challenges.

    • Mike Davies
    Comment
Top of page ⤴

Reviews

  • As AI technology develops rapidly, it is widely recognized that ethical guidelines are required for safe and fair implementation in society. But is it possible to agree on what is ‘ethical AI’? A detailed analysis of 84 AI ethics reports around the world, from national and international organizations, companies and institutes, explores this question, finding a convergence around core principles but substantial divergence on practical implementation.

    • Anna Jobin
    • Marcello Ienca
    • Effy Vayena
    Perspective
Top of page ⤴

Research

  • A combination of engineering advances shows promise for myoelectric prosthetic hands that are controlled by a user’s remaining muscle activity. Fine finger movements are decoded from surface electromyograms with machine learning algorithms and this is combined with a robotic controller that is active only during object grasping to assist in maximizing contact. This shared control scheme allows user-controlled movements when high dexterity is desired, but also assisted grasping when robustness is required.

    • Katie Z. Zhuang
    • Nicolas Sommer
    • Silvestro Micera
    Article
  • Brain–machine interfaces using steady-state visually evoked potentials (SSVEPs) show promise in therapeutic applications. With a combination of innovations in flexible and soft electronics and in deep learning approaches to classify potentials from two channels and from any subject, a compact, wireless and universal SSVEP interface is designed. Subjects can operate a wheelchair in real time with eye movements while wearing the new brain–machine interface.

    • Musa Mahmood
    • Deogratias Mzurikwao
    • Woon-Hong Yeo
    Article
  • Controlling the flow and representation of information in deep neural networks is fundamental to making networks intelligible. Bergomi et al introduce a mathematical framework in which the space of possible operators representing the data is constrained by using symmetries. This constrained space is still suitable for machine learning: operators can be efficiently computed, approximated and parameterized for optimization.

    • Mattia G. Bergomi
    • Patrizio Frosini
    • Nicola Quercioli
    Article
  • Memristive devices can provide energy-efficient neural network implementations, but they must be tailored to suit different network architectures. Wang et al. develop a trainable weight-sharing mechanism for memristor-based CNNs and ConvLSTMs, achieving a 75% reduction in weights without compromising accuracy.

    • Zhongrui Wang
    • Can Li
    • J. Joshua Yang
    Article
Top of page ⤴

Challenge Accepted

  • To safely operate in the real world, robots need to evaluate how confident they are about what they see. A new competition challenges computer vision algorithms to not just detect and localize objects, but also report how certain they are.

    • Niko Sünderhauf
    • Feras Dayoub
    • Peter Corke
    Challenge Accepted
Top of page ⤴

Search

Quick links