Article | Published:

Electronic-skin compasses for geomagnetic field-driven artificial magnetoreception and interactive electronics

Abstract

Magnetoreception is the ability to detect and respond to magnetic fields that allows certain organisms to orientate themselves with respect to the Earth’s magnetic field for navigation purposes. The development of an artificial magnetoreception, which is based solely on an interaction with geomagnetic fields and can be used by humans, has, however, proved challenging. Here we report a compliant and mechanically robust electronic-skin compass system that allows a person to orient with respect to Earth’s magnetic field. The compass is fabricated on 6-μm-thick polymeric foils and accommodates magnetic field sensors based on the anisotropic magnetoresistance effect. The response of the sensor is tailored to be linear and, by arranging the sensors in a Wheatstone bridge configuration, a maximum sensitivity around the Earth’s magnetic field is achieved. Our approach can also be used to create interactive devices for virtual and augmented-reality applications, and we illustrate the potential of this by using our electronic-skin compass in the touchless control of virtual units in a game engine.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

Data availability

The data that support the plots within this paper and other findings of this study are available from the corresponding author upon reasonable request.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Someya, T. et al. A large-area, flexible pressure sensor matrix with organic field-effect transistors for artificial skin applications. Proc. Natl Acad. Sci. USA 101, 9966–9970 (2004).

  2. 2.

    Kim, D.-H. et al. Epidermal electronics. Science 333, 838–843 (2011).

  3. 3.

    Bauer, S. et al. 25th Anniversary Article: A soft future: From robots and sensor skin to energy harvesters. Adv. Mater. 26, 149–162 (2014).

  4. 4.

    Lee, S. et al. A transparent bending-insensitive pressure sensor. Nat. Nanotech. 11, 472–478 (2016).

  5. 5.

    Ren, X. et al. A low-operating-power and flexible active-matrix organic-transistor temperature-sensor array. Adv. Mater. 28, 4832–4838 (2016).

  6. 6.

    Hines, L., Petersen, K., Lum, G. Z. & Sitti, M. Soft actuators for small-scale robotics. Adv. Mater. 29, 1603483 (2017).

  7. 7.

    Carpi, F. et al. Standards for dielectric elastomer transducers. Smart Mater. Struct. 24, 105025 (2015).

  8. 8.

    Gisby, T. A., O’Brien, B. M. & Anderson, I. A. Self sensing feedback for dielectric elastomer actuators. Appl. Phys. Lett. 102, 193703 (2013).

  9. 9.

    Anderson, I. A., Gisby, T. A., McKay, T. G., O’Brien, B. M. & Calius, E. P. Multi-functional dielectric elastomer artificial muscles for soft and smart machines. J. Appl. Phys. 112, 041101 (2012).

  10. 10.

    Miriyev, A., Stack, K. & Lipson, H. Soft material for soft actuators. Nat. Commun. 8, 596 (2017).

  11. 11.

    Choi, M. K. et al. Extremely vivid, highly transparent, and ultrathin quantum dot light-emitting diodes. Adv. Mater. 30, 1703279 (2018).

  12. 12.

    Someya, T., Bauer, S. & Kaltenbrunner, M. Imperceptible organic electronics. MRS Bull. 42, 124–130 (2017).

  13. 13.

    Kim, J. et al. Ultrathin quantum dot display integrated with wearable electronics. Adv. Mater. 29, 1700217 (2017).

  14. 14.

    Miyamoto, A. et al. Inflammation-free, gas-permeable, lightweight, stretchable on-skin electronics with nanomeshes. Nat. Nanotech. 12, 907–913 (2017).

  15. 15.

    Lei, T. et al. Biocompatible and totally disintegrable semiconducting polymer for ultrathin and ultralightweight transient electronics. Proc. Natl Acad. Sci. USA 114, 5107–5112 (2017).

  16. 16.

    Nawrocki, R. A., Matsuhisa, N., Yokota, T. & Someya, T. 300-nm imperceptible, ultraflexible, and biocompatible e-skin fit with tactile sensors and organic transistors. Adv. Electron. Mater. 2, 1500452 (2016).

  17. 17.

    Kaltenbrunner, M. et al. Flexible high power-per-weight perovskite solar cells with chromium oxide–metal contacts for improved stability in air. Nat. Mater. 14, 1032–1039 (2015).

  18. 18.

    Kaltenbrunner, M. et al. An ultra-lightweight design for imperceptible plastic electronics. Nature 499, 458–463 (2013).

  19. 19.

    Electromagnetic tracking systems. Polhemus https://polhemus.com/applications/electromagnetics/ (accessed 11 June 2018).

  20. 20.

    3DCoilCube – Electromagnetic VR motion tracking sensors. Premo https://3dcoil.grupopremo.com/ (accessed 11 June 2018).

  21. 21.

    OMMO. OMMO https://www.ommo.co/ (accessed 11 June 2018).

  22. 22.

    Monks, K. Forget wearable tech, embeddable implants are already here. CNN (9 April 2014); https://go.nature.com/2AnXjlf

  23. 23.

    North Paw. Sensebridge https://sensebridge.net/projects/northpaw/ (accessed 11 June 2018).

  24. 24.

    Biomagnets. Dangerous Things https://dangerousthings.com/biomagnets/ (accessed 11 June 2018).

  25. 25.

    Meltzer, M. et al. Imperceptible magnetoelectronics. Nat. Commun. 6, 6080 (2015).

  26. 26.

    Cañón Bermúdez, G. S. et al. Magnetosensitive e-skins with directional perception for augmented reality. Sci. Adv. 4, eaao2623 (2018).

  27. 27.

    Melzer, M. et al. Wearable magnetic field sensors for flexible electronics. Adv. Mater. 27, 1274–1280 (2015).

  28. 28.

    Alfadhel, A. & Kosel, J. Magnetic nanocomposite cilia tactile sensor. Adv. Mater. 27, 7888–7892 (2015).

  29. 29.

    Münzenrieder, N. et al. Entirely flexible on-site conditioned magnetic sensorics. Adv. Electron. Mater. 2, 1600188 (2016).

  30. 30.

    Makarov, D., Melzer, M., Karnaushenko, D. & Schmidt, O. G. Shapeable magnetoelectronics. Appl. Phys. Rev. 3, 011101 (2016).

  31. 31.

    Melzer, M. et al. Stretchable magnetoelectronics. Nano. Lett. 11, 2522–2526 (2011).

  32. 32.

    Parkin, S. S. P. Flexible giant magnetoresistance sensors. Appl. Phys. Lett. 69, 3092–3094 (1996).

  33. 33.

    Uhrmann, T. et al. Magnetostrictive GMR sensor on flexible polyimide substrates. J. Magn. Magn. Mater. 307, 209–211 (2006).

  34. 34.

    Chen, Y. et al. Towards flexible magnetoelectronics: Buffer-enhanced and mechanically tunable GMR of Co/Cu multilayers on plastic substrates. Adv. Mater. 20, 3224–3228 (2008).

  35. 35.

    Pérez, N. et al. High-performance giant magnetoresistive sensorics on flexible Si membranes. Appl. Phys. Lett. 106, 153501 (2015).

  36. 36.

    Barraud, C. et al. Magnetoresistance in magnetic tunnel junctions grown on flexible organic substrates. Appl. Phys. Lett. 96, 072502 (2010).

  37. 37.

    Bedoya-Pinto, A., Donolato, M., Gobbi, M., Hueso, L. E. & Vavassori, P. Flexible spintronic devices on Kapton. Appl. Phys. Lett. 104, 062412 (2014).

  38. 38.

    Griesbach, T., Wurz, M. C. & Rissing, L. Design, fabrication, and testing of a modular magnetic field microsensor on a flexible polymer foil. IEEE Trans. Magn. 48, 3843–3846 (2012).

  39. 39.

    Wang, Z. et al. Highly sensitive flexible magnetic sensor based on anisotropic magnetoresistance effect. Adv. Mater. 28, 9370–9377 (2016).

  40. 40.

    Li, B., Kavaldzhiev, M. N. & Kosel, J. Flexible magnetoimpedance sensor. J. Magn. Magn. Mater. 378, 499–505 (2015).

  41. 41.

    Wang, Z., Shaygan, M., Otto, M., Schall, D. & Neumaier, D. Flexible Hall sensors based on graphene. Nanoscale 8, 7683–7687 (2016).

  42. 42.

    Heidari, H., Bonizzoni, E., Gatti, U., Maloberti, F. & Dahiya, R. CMOS vertical Hall magnetic sensors on flexible substrate. IEEE Sens. J. 16, 8736–8743 (2016).

  43. 43.

    Monch, I. J. et al. Flexible Hall sensorics for flux-based control of magnetic levitation. IEEE Trans. Magn. 51, 4004004 (2015).

  44. 44.

    Melzer, M. et al. Direct transfer of magnetic sensor devices to elastomeric supports for stretchable electronics. Adv. Mater. 27, 1333–1338 (2015).

  45. 45.

    Melzer, M., Lin, G., Makarov, D. & Schmidt, O. G. Stretchable spin valves on elastomer membranes by predetermined periodic fracture and random wrinkling. Adv. Mater. 24, 6468–6472 (2012).

  46. 46.

    Li, H. et al. Stretchable spin valve with stable magnetic field sensitivity by ribbon-patterned periodic wrinkles. ACS Nano 10, 4403–4409 (2016).

  47. 47.

    Liu, Y.-W., Zhan, Q.-F. & Li, R.-W. Fabrication, properties, and applications of flexible magnetic films. Chin. Phys. B 22, 127502 (2013).

  48. 48.

    Jogschies, L. et al. Recent developments of magnetoresistive sensors for industrial applications. Sensors 15, 28665–28689 (2015).

  49. 49.

    Suo, Z., Ma, E. Y., Gleskova, H. & Wagner, S. Mechanics of rollable and foldable film-on-foil electronics. Appl. Phys. Lett. 74, 1177–1179 (1999).

  50. 50.

    Rottmann, F. & Dettmann, F. New magnetoresistive sensors: Engineering and applications. Sens. Actuators A: Phys. 27, 763–766 (1991).

  51. 51.

    Caruso, M. J., Bratland, T., Smith, C. H. & Schneider, R. A New Perspective on Magnetic Field Sensing (Honeywell, 1998).

  52. 52.

    1- and 2-Axis Magnetic Sensors HMC1001/1002/1021/1022 (Honeywell, 2008); https://go.nature.com/2Jawa8l

  53. 53.

    Panda3D. Carnegie Mellon University https://www.panda3d.org/ (accessed 26 May 2018).

  54. 54.

    Wiltschko, W. & Wiltschko, R. Magnetic orientation and magnetoreception in birds and other animals. J. Comp. Physiol. A 191, 675–693 (2005).

  55. 55.

    Mohamadabadi, K. Anisotropic Magnetoresistance Magnetometer for Inertial Navigation Systems. PhD thesis, Ecole Polytechnique X (2013).

  56. 56.

    Li, X., Ding, G., Ando, T., Shikida, M. & Sato, K. Micromechanical characterization of electroplated permalloy films for MEMS. Microsyst. Technol. 14, 131–134 (2007).

  57. 57.

    Jeong, C. K. et al. Self-powered fully-flexible light-emitting system enabled by flexible energy harvester. Energy Environ. Sci. 7, 4035–4043 (2014).

Download references

Acknowledgements

We acknowledge insightful discussions with T. Kosub and J. Ge (both of HZDR). We thank B. Scheumann, R. Kaltofen and J.I. Mönch (all of HZDR) for the deposition of metal layer stacks. Support by the Structural Characterization Facilities Rossendorf at the Ion Beam Center (IBC) at the HZDR is greatly appreciated. This work is financed in part via the European Research Council within the European Union´s Seventh Framework Programme (FP7/2007–2013)/ERC grant agreement no. 306277 and German Research Foundation (DFG) Grant MA 5144/9-1.

Author information

G.S.C.B. designed and fabricated the sensors and conducted the experiments. G.S.C.B and D.M. analysed the data and prepared figures with contributions from all authors. H.F. wrote the scripts to interface the game engine with the acquired data. L.B. carried out structural characterization of the samples. G.S.C.B. and D.M. wrote the manuscript with comments from all authors. All co-authors edited the manuscript. D.M. and J.F. conceived the project.

Competing interests

The authors declare no competing interests.

Correspondence to Gilbert Santiago Cañón Bermúdez or Denys Makarov.

Supplementary information

  1. Supplementary Information

    Supplementary Figures 1–10

  2. Supplementary Video 1

    The e-skin compass is mounted on a flat sample holder. Upon rotation of the holder, the detected output voltage on the computer screen reaches a minimum when the sensor axis (signalled by a black arrow) aligns with the geomagnetic field orientation. A nearby compass reference verifies the orientation of the magnetic north.

  3. Supplementary Video 2

    The e-skin compass is mounted on a motorized sample holder driven by a stepper motor, which rotates the compass counter-clockwise across the location of the magnetic north starting from three different initial positions. These starting positions are defined arbitrarily as having 0, 90 and –90° offsets with 0° indicating the case where the sensor axis (black arrow) points to the computer screen (about –108° with respect to magnetic north). The maxima in the signal readout, corresponding to the alignment of the sensor axis with the geomagnetic field, always arise at the same angular position irrespective of the initial offset. This indicates the absolute nature of the geomagnetic field orientation readout using the e-skin compass.

  4. Supplementary Video 3

    Analogously to Supplementary Video 2, the e-skin compass is rotated by a stepper motor. However, in this case, a biasing external magnetic field pointing to the right is generated with a Helmholtz coil (the strength of the field is 43 μT; orientation with respect to the magnetic north is 163 ± 1°). Due to this magnetic disturbance, the detected maxima change their angular positions and now happen at 72 ± 1° with respect to the magnetic north. From the magnitude of the measured signal and the angular location of the extrema it is possible to reconstruct the magnitude and orientation of the geomagnetic field by vector subtraction. Measuring with the coil OFF yields again the same magnitude and orientation as seen in Supplementary Video 2 and corroborates the reconstructed field (Supplementary Figure 5).

  5. Supplementary Video 4

    A person wears the e-skin compass on his finger and rotates about himself while pointing. The output data of the sensor is collected by a nearby computer and visualized as a trace and a virtual compass on screen. As the person points to magnetic north (south), the trace reaches its maximum (minimum) and the virtual compass shows north (south). Two cameras record the experiment simultaneously filming the computer screen and the full body motion of the person.

  6. Supplementary Video 5

    The e-skin compass is attached on the middle finger of a person. As the person moves his hand, the compass axis changes its relative orientation to the geomagnetic field. Thereby, a change in the output voltage is produced, which is related to the current hand position. The voltage signal is acquired by a computer, where a virtual panda is programmed to move forward at a constant speed. Particular hand positions are encoded to specific angular positions in the computer, instructing the virtual panda in which direction to move. Sequences of hand movements can control the motion of the panda at will and define trajectories within the virtual environment.

  7. Supplementary Video 6

    An AMR meander sensor is fixed on a mechanical stretcher, where it is bent from its flat state down to a curvature radius of 1 mm. The sensor resistance is continuously recorded during the bending process. An external magnet, attached to a rod, is placed in close vicinity of the sensor in such a way that the magnetic field is parallel to the plane of the sensor. Upon removal of the external magnetic stimulus, the resistance drops back to its baseline level.

Rights and permissions

To obtain permission to re-use content from this article visit RightsLink.

About this article

Further reading

Fig. 1: Fabrication and mechanical performance of the e-skin compass.
Fig. 2: Magnetoelectric characterization of the e-skin compass.
Fig. 3: Outdoor geomagnetic detection.
Fig. 4: Geomagnetic interaction with a virtual reality environment.