Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Volume 4 Issue 6, June 2022

Tool cognition for robots

Tool use is one of the hallmarks of intelligence. Although robots can be programmed or trained to use a specific tool effectively, using a previously unknown tool is challenging. The robot shown on the cover uses a skill transfer approach developed by Keng Peng Tee et al. to manipulate the object on the table using a tool it has not seen or learnt about before. This skill transfer approach relies solely on experience that the robot has gathered from previous manipulation of objects with its own limbs, which is analogous to tool use in humans. Photos and videos of the Olivia III robot using and shaping previously unseen tools to manipulate objects can be found in the Article.

See Keng Peng Tee et al.

Image: Visual by Vincent Cadilhon (Pinata Studio), representing the work by I2R ASTAR Singapore and CNRS France. Cover Design: Lauren Heslop

Editorial

  • Soon into the COVID-19 pandemic, civil-rights groups raised the alarm over the increase in digital surveillance infringing on individual rights. But there are other potential harms as tech companies accelerate their expansion into new areas essential to public-service provision.

    Editorial

    Advertisement

Top of page ⤴

Correspondence

Top of page ⤴

Reviews

  • Unsupervised machine learning algorithms reduce the dependence on curated, labeled datasets that are characteristic of supervised machine learning. The authors argue that the developmental science of infant cognition could inform the design of unsupervised machine learning approaches.

    • Lorijn Zaadnoordijk
    • Tarek R. Besold
    • Rhodri Cusack
    Perspective
  • Both proteins and natural language are essentially based on a sequential code, but feature complex interactions at multiple scales, which can be useful when transferring machine learning models from one domain to another. In this Review, Ferruz and Höcker summarize recent advances in language models, such as transformers, and their application to protein design.

    • Noelia Ferruz
    • Birte Höcker
    Review Article
Top of page ⤴

Research

  • Robots usually learn to use tools from direct experience or from observing the use of a tool. While knowledge can be transferred between similar tools, novel and creative use of tools is challenging. Tee and colleagues present a method where skill transfer does not come from experience of using other tools but from using the robot’s own limbs.

    • Keng Peng Tee
    • Samuel Cheong
    • Gowrishankar Ganesh
    Article
  • While reinforcement learning can be a powerful tool for complex design tasks such as molecular design, training can be slow when problems are either too hard or too easy, as little is learned in these cases. Jeff Guo and colleagues provide a curriculum learning extension to the REINVENT de novo molecular design framework that provides problems of increasing difficulty over epochs such that the training process is more efficient.

    • Jeff Guo
    • Vendy Fialková
    • Atanas Patronov
    Article
  • Exoskeletons can assist movement in upper limb impairments to recover mobility and independence, but rigid or heavy exoskeletons can be impractical. Georgarakis and colleagues have developed a soft, tendon-driven device that assists shoulder movements and counteracts gravity to reduce muscle fatigue.

    • Anna-Maria Georgarakis
    • Michele Xiloyannis
    • Robert Riener
    Article
  • B-cell receptors (BCRs) and their impact on B cells play a vital role in our immune system; however, the manner in which B cells are activated by BCRs are still poorly understood. Ze Zhang and colleagues present a graph-based method that connects BCR and single B-cell RNA sequencing data and identifies notable coupling between BCR and B-cell expression in COVID-19.

    • Ze Zhang
    • Woo Yong Chang
    • Tao Wang
    Article
Top of page ⤴

Search

Quick links