Physically interacting individuals estimate the partner’s goal to enhance their movements

Abstract

From a parent helping to guide their child during their first steps, to a therapist supporting a patient, physical assistance enabled by haptic interaction is a fundamental modus for improving motor abilities. However, what movement information is exchanged between partners during haptic interaction, and how this information is used to coordinate and assist others, remains unclear1. Here, we propose a model in which haptic information, provided by touch and proprioception2, enables interacting individuals to estimate the partner’s movement goal and use it to improve their own motor performance. We use an empirical physical interaction task3 to show that our model can explain human behaviours better than existing models of interaction in literature48. Furthermore, we experimentally verify our model by embodying it in a robot partner and checking that it induces the same improvements in motor performance and learning in a human individual as interacting with a human partner. These results promise collaborative robots that provide human-like assistance, and suggest that movement goal exchange is the key to physical assistance.

Access options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

Figure 1: Computational framework to test four models of haptic interaction for comparison against experimental data.
Figure 2: Simulations of four representative models of haptic interaction reveal that the ‘interpersonal goal integration’ model has the most predictive power.
Figure 3: A robot partner embodying the ‘interpersonal goal integration’ model physically assists human users as human partners do.

References

  1. 1

    Sebanz, N., Bekkering, H. & Knoblich, G. Joint action: bodies and minds moving together. Trends Cogn. Sci. 10, 70–76 (2006).

    Article  Google Scholar 

  2. 2

    Lederman, S. J. & Klatzky, R. L. Haptic perception: a tutorial. Atten. Percept. Psychophys. 71, 1439–1459 (2009).

    CAS  Article  Google Scholar 

  3. 3

    Ganesh, G. et al. Two is better than one: physical interactions improve motor performance in humans. Sci. Rep. 4, (2014).

  4. 4

    Jarrassé, N., Charalambous, T. & Burdet, E. A framework to describe, analyze and generate interactive motor behaviors. PLoS ONE 7, e49945 (2012).

    Article  Google Scholar 

  5. 5

    Laughlin, P. R. & Ellis, A. L. Demonstrability and social combination processes on mathematical intellective tasks. J. Exp. Soc. Psychol. 22, 177–189 (1986).

    Article  Google Scholar 

  6. 6

    Hastie, R. & Kameda, T. The robust beauty of majority rules in group decisions. Psychol. Rev. 112, 494–508 (2005).

    Article  Google Scholar 

  7. 7

    Ernst, M. O. & Banks, M. S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429–433 (2002).

    CAS  Article  Google Scholar 

  8. 8

    Körding, K. P. & Wolpert, D. M. Bayesian integration in sensorimotor learning. Nature 427, 244–247 (2004).

    Article  Google Scholar 

  9. 9

    Reed, K. et al. Haptically linked dyads: are two motor-control systems better than one? Psychol. Sci. 17, 365–366 (2006).

    Article  Google Scholar 

  10. 10

    van der Wel, R. P. R. D., Knoblich, G. & Sebanz, N. Let the force be with us: dyads exploit haptic coupling for coordination. J. Exp. Psychol. Hum. Percept. Perform. 37, 1420–1431 (2011).

    Article  Google Scholar 

  11. 11

    Melendez-Calderon, A., Komisar, V. & Burdet, E. Interpersonal strategies for disturbance attenuation during a rhythmic joint motor action. Physiol. Behav. 147, 348–358 (2015).

    CAS  Article  Google Scholar 

  12. 12

    Basdogan, C., Ho, C.-H., Srinivasan, M. A. & Slater, M. An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput. Hum. Interact. 7, 443–460 (2000).

    Article  Google Scholar 

  13. 13

    Malysz, P. & Sirouspour, S. Task performance evaluation of asymmetric semiautonomous teleoperation of mobile twin-arm robotic manipulators. IEEE Trans. Haptics 6, 484–495 (2013).

    Google Scholar 

  14. 14

    Bosga, J. & Meulenbroek, R. G. Joint-action coordination of redundant force contributions in a virtual lifting task. Motor Control 11, 235–258 (2007).

    Article  Google Scholar 

  15. 15

    Newmannorlund, R., Bosga, J., Meulenbroek, R. & Bekkering, H. Anatomical substrates of cooperative joint-action in a continuous motor task: virtual lifting and balancing. NeuroImage 41, 169–177 (2008).

    Article  Google Scholar 

  16. 16

    van der Wel, R. P. R. D., Sebanz, N. & Knoblich, G. The sense of agency during skill learning in individuals and dyads. Conscious. Cogn. 21, 1267–1279 (2012).

    Article  Google Scholar 

  17. 17

    Bahrami, B. et al. Optimally interacting minds. Science 329, 1081–1085 (2010).

    CAS  Article  Google Scholar 

  18. 18

    Giese, M. A. & Rizzolatti, G. Neural and computational mechanisms of action processing: interaction between visual and motor representations. Neuron 88, 167–180 (2015).

    CAS  Article  Google Scholar 

  19. 19

    Gergely, G. & Csibra, G. Teleological reasoning in infancy: the naïve theory of rational action. Trends Cogn. Sci. 7, 287–292 (2003).

    Article  Google Scholar 

  20. 20

    Kilner, J. M., Friston, K. J. & Frith, C. D. Predictive coding: an account of the mirror neuron system. Cogn. Process. 8, 159–166 (2007).

    Article  Google Scholar 

  21. 21

    Wolpert, D. M., Doya, K. & Kawato, M. A unifying computational framework for motor control and social interaction. Phil. Trans. R. Soc. Lond. B 358, 593–602 (2003).

    Article  Google Scholar 

  22. 22

    Ikegami, T. & Ganesh, G. Watching novice action degrades expert motor performance: causation between action production and outcome prediction of observed actions by humans. Sci. Rep. 4, 6989 (2014).

    CAS  Article  Google Scholar 

  23. 23

    Kawato, M. Internal models for motor control and trajectory planning. Curr. Opin. Neurobiol. 9, 718–727 (1999).

    CAS  Article  Google Scholar 

  24. 24

    Blakemore, S.-J., Wolpert, D. M. & Frith, C. D. Central cancellation of self-produced tickle sensation. Nat. Neurosci. 1, 635–640 (1998).

    CAS  Article  Google Scholar 

  25. 25

    Jarrassé, N., Sanguineti, V. & Burdet, E. Slaves no longer: review on role assignment for human–robot joint motor action. Adapt. Behav. 22, 70–82 (2014).

    Article  Google Scholar 

  26. 26

    Diaz et al. Lower-limb robotic rehabilitation: literature review and challenges. J. Robot. 2011, e759764 (2011).

    Google Scholar 

  27. 27

    Marchal-Crespo, L. & Reinkensmeyer, D. J. Review of control strategies for robotic movement training after neurologic injury. J. NeuroEng. Rehabil. 6, 20 (2009).

    Article  Google Scholar 

  28. 28

    Morimoto, J. & Kawato, M. Creating the brain and interacting with the brain: an integrated approach to understanding the brain. J. R. Soc. Interface 12, 20141250 (2015).

    Article  Google Scholar 

  29. 29

    Gelb, A. Applied Optimal Estimation (MIT Press, 1974).

    Google Scholar 

  30. 30

    Ljung, L. Asymptotic behavior of the extended Kalman filter as a parameter estimator for linear systems. IEEE Trans. Autom. Control 24, 36–50 (1979).

    Article  Google Scholar 

Download references

Acknowledgements

We thank C. Clopath, P. Bentley, S. Mussa-Ivaldi, Y. Sasaki and T. Watanabe for their comments on an earlier version of this manuscript. This work was funded in part by the EU-FP7 grants ICT-231554 HUMOUR, ICT-601003 BALANCE, ICT-611626 SYMBITRON, EU-H2020 ICT-644727 COGIMON, UK EPSRC MOTION grant EP/NO29003/1 and by the Great Britain Sasakawa Foundation. This work was also partially supported by a contract with the National Institute of Information and Communications Technology entitled “Development of Network Dynamics Modelling Methods for Human Brain Data Simulation Systems”, and by “Development of BMI Technologies for Clinical Application” of the Strategic Research Program for Brain Sciences supported by the Japan Agency for Medical Research and Development (AMED). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Affiliations

Authors

Contributions

A.T., G.G., M.K. and E.B developed the computational model. G.G. and T.Y. conducted the empirical experiments with human pairs, and A.T. and T.Y. tested human users with the robot assistant. A.T. and G.G. analysed the data and simulated the models. A.T., G.G., M.K. and E.B. wrote and edited the manuscript.

Corresponding authors

Correspondence to Atsushi Takagi or Etienne Burdet.

Ethics declarations

Competing interests

The authors declare no competing interests.

Supplementary information

Supplementary Information

Supplementary Methods; Supplementary Figures. (PDF 408 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Takagi, A., Ganesh, G., Yoshioka, T. et al. Physically interacting individuals estimate the partner’s goal to enhance their movements. Nat Hum Behav 1, 0054 (2017). https://doi.org/10.1038/s41562-017-0054

Download citation

Further reading

Search

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing