Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

Electronic-skin compasses for geomagnetic field-driven artificial magnetoreception and interactive electronics

Abstract

Magnetoreception is the ability to detect and respond to magnetic fields that allows certain organisms to orientate themselves with respect to the Earth’s magnetic field for navigation purposes. The development of an artificial magnetoreception, which is based solely on an interaction with geomagnetic fields and can be used by humans, has, however, proved challenging. Here we report a compliant and mechanically robust electronic-skin compass system that allows a person to orient with respect to Earth’s magnetic field. The compass is fabricated on 6-μm-thick polymeric foils and accommodates magnetic field sensors based on the anisotropic magnetoresistance effect. The response of the sensor is tailored to be linear and, by arranging the sensors in a Wheatstone bridge configuration, a maximum sensitivity around the Earth’s magnetic field is achieved. Our approach can also be used to create interactive devices for virtual and augmented-reality applications, and we illustrate the potential of this by using our electronic-skin compass in the touchless control of virtual units in a game engine.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Fabrication and mechanical performance of the e-skin compass.
Fig. 2: Magnetoelectric characterization of the e-skin compass.
Fig. 3: Outdoor geomagnetic detection.
Fig. 4: Geomagnetic interaction with a virtual reality environment.

Similar content being viewed by others

Data availability

The data that support the plots within this paper and other findings of this study are available from the corresponding author upon reasonable request.

References

  1. Someya, T. et al. A large-area, flexible pressure sensor matrix with organic field-effect transistors for artificial skin applications. Proc. Natl Acad. Sci. USA 101, 9966–9970 (2004).

    Article  Google Scholar 

  2. Kim, D.-H. et al. Epidermal electronics. Science 333, 838–843 (2011).

    Article  Google Scholar 

  3. Bauer, S. et al. 25th Anniversary Article: A soft future: From robots and sensor skin to energy harvesters. Adv. Mater. 26, 149–162 (2014).

    Article  Google Scholar 

  4. Lee, S. et al. A transparent bending-insensitive pressure sensor. Nat. Nanotech. 11, 472–478 (2016).

    Article  Google Scholar 

  5. Ren, X. et al. A low-operating-power and flexible active-matrix organic-transistor temperature-sensor array. Adv. Mater. 28, 4832–4838 (2016).

    Article  Google Scholar 

  6. Hines, L., Petersen, K., Lum, G. Z. & Sitti, M. Soft actuators for small-scale robotics. Adv. Mater. 29, 1603483 (2017).

    Article  Google Scholar 

  7. Carpi, F. et al. Standards for dielectric elastomer transducers. Smart Mater. Struct. 24, 105025 (2015).

    Article  Google Scholar 

  8. Gisby, T. A., O’Brien, B. M. & Anderson, I. A. Self sensing feedback for dielectric elastomer actuators. Appl. Phys. Lett. 102, 193703 (2013).

    Article  Google Scholar 

  9. Anderson, I. A., Gisby, T. A., McKay, T. G., O’Brien, B. M. & Calius, E. P. Multi-functional dielectric elastomer artificial muscles for soft and smart machines. J. Appl. Phys. 112, 041101 (2012).

    Article  Google Scholar 

  10. Miriyev, A., Stack, K. & Lipson, H. Soft material for soft actuators. Nat. Commun. 8, 596 (2017).

    Article  Google Scholar 

  11. Choi, M. K. et al. Extremely vivid, highly transparent, and ultrathin quantum dot light-emitting diodes. Adv. Mater. 30, 1703279 (2018).

    Article  Google Scholar 

  12. Someya, T., Bauer, S. & Kaltenbrunner, M. Imperceptible organic electronics. MRS Bull. 42, 124–130 (2017).

    Article  Google Scholar 

  13. Kim, J. et al. Ultrathin quantum dot display integrated with wearable electronics. Adv. Mater. 29, 1700217 (2017).

    Article  Google Scholar 

  14. Miyamoto, A. et al. Inflammation-free, gas-permeable, lightweight, stretchable on-skin electronics with nanomeshes. Nat. Nanotech. 12, 907–913 (2017).

    Article  Google Scholar 

  15. Lei, T. et al. Biocompatible and totally disintegrable semiconducting polymer for ultrathin and ultralightweight transient electronics. Proc. Natl Acad. Sci. USA 114, 5107–5112 (2017).

    Article  Google Scholar 

  16. Nawrocki, R. A., Matsuhisa, N., Yokota, T. & Someya, T. 300-nm imperceptible, ultraflexible, and biocompatible e-skin fit with tactile sensors and organic transistors. Adv. Electron. Mater. 2, 1500452 (2016).

    Article  Google Scholar 

  17. Kaltenbrunner, M. et al. Flexible high power-per-weight perovskite solar cells with chromium oxide–metal contacts for improved stability in air. Nat. Mater. 14, 1032–1039 (2015).

    Article  Google Scholar 

  18. Kaltenbrunner, M. et al. An ultra-lightweight design for imperceptible plastic electronics. Nature 499, 458–463 (2013).

    Article  Google Scholar 

  19. Electromagnetic tracking systems. Polhemus https://polhemus.com/applications/electromagnetics/ (accessed 11 June 2018).

  20. 3DCoilCube – Electromagnetic VR motion tracking sensors. Premo https://3dcoil.grupopremo.com/ (accessed 11 June 2018).

  21. OMMO. OMMO https://www.ommo.co/ (accessed 11 June 2018).

  22. Monks, K. Forget wearable tech, embeddable implants are already here. CNN (9 April 2014); https://go.nature.com/2AnXjlf

  23. North Paw. Sensebridge https://sensebridge.net/projects/northpaw/ (accessed 11 June 2018).

  24. Biomagnets. Dangerous Things https://dangerousthings.com/biomagnets/ (accessed 11 June 2018).

  25. Meltzer, M. et al. Imperceptible magnetoelectronics. Nat. Commun. 6, 6080 (2015).

    Article  Google Scholar 

  26. Cañón Bermúdez, G. S. et al. Magnetosensitive e-skins with directional perception for augmented reality. Sci. Adv. 4, eaao2623 (2018).

    Article  Google Scholar 

  27. Melzer, M. et al. Wearable magnetic field sensors for flexible electronics. Adv. Mater. 27, 1274–1280 (2015).

    Article  Google Scholar 

  28. Alfadhel, A. & Kosel, J. Magnetic nanocomposite cilia tactile sensor. Adv. Mater. 27, 7888–7892 (2015).

    Article  Google Scholar 

  29. Münzenrieder, N. et al. Entirely flexible on-site conditioned magnetic sensorics. Adv. Electron. Mater. 2, 1600188 (2016).

    Article  Google Scholar 

  30. Makarov, D., Melzer, M., Karnaushenko, D. & Schmidt, O. G. Shapeable magnetoelectronics. Appl. Phys. Rev. 3, 011101 (2016).

    Article  Google Scholar 

  31. Melzer, M. et al. Stretchable magnetoelectronics. Nano. Lett. 11, 2522–2526 (2011).

    Article  Google Scholar 

  32. Parkin, S. S. P. Flexible giant magnetoresistance sensors. Appl. Phys. Lett. 69, 3092–3094 (1996).

    Article  Google Scholar 

  33. Uhrmann, T. et al. Magnetostrictive GMR sensor on flexible polyimide substrates. J. Magn. Magn. Mater. 307, 209–211 (2006).

    Article  Google Scholar 

  34. Chen, Y. et al. Towards flexible magnetoelectronics: Buffer-enhanced and mechanically tunable GMR of Co/Cu multilayers on plastic substrates. Adv. Mater. 20, 3224–3228 (2008).

    Article  Google Scholar 

  35. Pérez, N. et al. High-performance giant magnetoresistive sensorics on flexible Si membranes. Appl. Phys. Lett. 106, 153501 (2015).

    Article  Google Scholar 

  36. Barraud, C. et al. Magnetoresistance in magnetic tunnel junctions grown on flexible organic substrates. Appl. Phys. Lett. 96, 072502 (2010).

    Article  Google Scholar 

  37. Bedoya-Pinto, A., Donolato, M., Gobbi, M., Hueso, L. E. & Vavassori, P. Flexible spintronic devices on Kapton. Appl. Phys. Lett. 104, 062412 (2014).

    Article  Google Scholar 

  38. Griesbach, T., Wurz, M. C. & Rissing, L. Design, fabrication, and testing of a modular magnetic field microsensor on a flexible polymer foil. IEEE Trans. Magn. 48, 3843–3846 (2012).

    Article  Google Scholar 

  39. Wang, Z. et al. Highly sensitive flexible magnetic sensor based on anisotropic magnetoresistance effect. Adv. Mater. 28, 9370–9377 (2016).

    Article  Google Scholar 

  40. Li, B., Kavaldzhiev, M. N. & Kosel, J. Flexible magnetoimpedance sensor. J. Magn. Magn. Mater. 378, 499–505 (2015).

    Article  Google Scholar 

  41. Wang, Z., Shaygan, M., Otto, M., Schall, D. & Neumaier, D. Flexible Hall sensors based on graphene. Nanoscale 8, 7683–7687 (2016).

    Article  Google Scholar 

  42. Heidari, H., Bonizzoni, E., Gatti, U., Maloberti, F. & Dahiya, R. CMOS vertical Hall magnetic sensors on flexible substrate. IEEE Sens. J. 16, 8736–8743 (2016).

    Article  Google Scholar 

  43. Monch, I. J. et al. Flexible Hall sensorics for flux-based control of magnetic levitation. IEEE Trans. Magn. 51, 4004004 (2015).

    Article  Google Scholar 

  44. Melzer, M. et al. Direct transfer of magnetic sensor devices to elastomeric supports for stretchable electronics. Adv. Mater. 27, 1333–1338 (2015).

    Article  Google Scholar 

  45. Melzer, M., Lin, G., Makarov, D. & Schmidt, O. G. Stretchable spin valves on elastomer membranes by predetermined periodic fracture and random wrinkling. Adv. Mater. 24, 6468–6472 (2012).

    Article  Google Scholar 

  46. Li, H. et al. Stretchable spin valve with stable magnetic field sensitivity by ribbon-patterned periodic wrinkles. ACS Nano 10, 4403–4409 (2016).

    Article  Google Scholar 

  47. Liu, Y.-W., Zhan, Q.-F. & Li, R.-W. Fabrication, properties, and applications of flexible magnetic films. Chin. Phys. B 22, 127502 (2013).

    Article  Google Scholar 

  48. Jogschies, L. et al. Recent developments of magnetoresistive sensors for industrial applications. Sensors 15, 28665–28689 (2015).

    Article  Google Scholar 

  49. Suo, Z., Ma, E. Y., Gleskova, H. & Wagner, S. Mechanics of rollable and foldable film-on-foil electronics. Appl. Phys. Lett. 74, 1177–1179 (1999).

    Article  Google Scholar 

  50. Rottmann, F. & Dettmann, F. New magnetoresistive sensors: Engineering and applications. Sens. Actuators A: Phys. 27, 763–766 (1991).

    Article  Google Scholar 

  51. Caruso, M. J., Bratland, T., Smith, C. H. & Schneider, R. A New Perspective on Magnetic Field Sensing (Honeywell, 1998).

  52. 1- and 2-Axis Magnetic Sensors HMC1001/1002/1021/1022 (Honeywell, 2008); https://go.nature.com/2Jawa8l

  53. Panda3D. Carnegie Mellon University https://www.panda3d.org/ (accessed 26 May 2018).

  54. Wiltschko, W. & Wiltschko, R. Magnetic orientation and magnetoreception in birds and other animals. J. Comp. Physiol. A 191, 675–693 (2005).

    Article  Google Scholar 

  55. Mohamadabadi, K. Anisotropic Magnetoresistance Magnetometer for Inertial Navigation Systems. PhD thesis, Ecole Polytechnique X (2013).

  56. Li, X., Ding, G., Ando, T., Shikida, M. & Sato, K. Micromechanical characterization of electroplated permalloy films for MEMS. Microsyst. Technol. 14, 131–134 (2007).

    Article  Google Scholar 

  57. Jeong, C. K. et al. Self-powered fully-flexible light-emitting system enabled by flexible energy harvester. Energy Environ. Sci. 7, 4035–4043 (2014).

    Article  Google Scholar 

Download references

Acknowledgements

We acknowledge insightful discussions with T. Kosub and J. Ge (both of HZDR). We thank B. Scheumann, R. Kaltofen and J.I. Mönch (all of HZDR) for the deposition of metal layer stacks. Support by the Structural Characterization Facilities Rossendorf at the Ion Beam Center (IBC) at the HZDR is greatly appreciated. This work is financed in part via the European Research Council within the European Union´s Seventh Framework Programme (FP7/2007–2013)/ERC grant agreement no. 306277 and German Research Foundation (DFG) Grant MA 5144/9-1.

Author information

Authors and Affiliations

Authors

Contributions

G.S.C.B. designed and fabricated the sensors and conducted the experiments. G.S.C.B and D.M. analysed the data and prepared figures with contributions from all authors. H.F. wrote the scripts to interface the game engine with the acquired data. L.B. carried out structural characterization of the samples. G.S.C.B. and D.M. wrote the manuscript with comments from all authors. All co-authors edited the manuscript. D.M. and J.F. conceived the project.

Corresponding authors

Correspondence to Gilbert Santiago Cañón Bermúdez or Denys Makarov.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary Information

Supplementary Figures 1–10

Supplementary Video 1

The e-skin compass is mounted on a flat sample holder. Upon rotation of the holder, the detected output voltage on the computer screen reaches a minimum when the sensor axis (signalled by a black arrow) aligns with the geomagnetic field orientation. A nearby compass reference verifies the orientation of the magnetic north.

Supplementary Video 2

The e-skin compass is mounted on a motorized sample holder driven by a stepper motor, which rotates the compass counter-clockwise across the location of the magnetic north starting from three different initial positions. These starting positions are defined arbitrarily as having 0, 90 and –90° offsets with 0° indicating the case where the sensor axis (black arrow) points to the computer screen (about –108° with respect to magnetic north). The maxima in the signal readout, corresponding to the alignment of the sensor axis with the geomagnetic field, always arise at the same angular position irrespective of the initial offset. This indicates the absolute nature of the geomagnetic field orientation readout using the e-skin compass.

Supplementary Video 3

Analogously to Supplementary Video 2, the e-skin compass is rotated by a stepper motor. However, in this case, a biasing external magnetic field pointing to the right is generated with a Helmholtz coil (the strength of the field is 43 μT; orientation with respect to the magnetic north is 163 ± 1°). Due to this magnetic disturbance, the detected maxima change their angular positions and now happen at 72 ± 1° with respect to the magnetic north. From the magnitude of the measured signal and the angular location of the extrema it is possible to reconstruct the magnitude and orientation of the geomagnetic field by vector subtraction. Measuring with the coil OFF yields again the same magnitude and orientation as seen in Supplementary Video 2 and corroborates the reconstructed field (Supplementary Figure 5).

Supplementary Video 4

A person wears the e-skin compass on his finger and rotates about himself while pointing. The output data of the sensor is collected by a nearby computer and visualized as a trace and a virtual compass on screen. As the person points to magnetic north (south), the trace reaches its maximum (minimum) and the virtual compass shows north (south). Two cameras record the experiment simultaneously filming the computer screen and the full body motion of the person.

Supplementary Video 5

The e-skin compass is attached on the middle finger of a person. As the person moves his hand, the compass axis changes its relative orientation to the geomagnetic field. Thereby, a change in the output voltage is produced, which is related to the current hand position. The voltage signal is acquired by a computer, where a virtual panda is programmed to move forward at a constant speed. Particular hand positions are encoded to specific angular positions in the computer, instructing the virtual panda in which direction to move. Sequences of hand movements can control the motion of the panda at will and define trajectories within the virtual environment.

Supplementary Video 6

An AMR meander sensor is fixed on a mechanical stretcher, where it is bent from its flat state down to a curvature radius of 1 mm. The sensor resistance is continuously recorded during the bending process. An external magnet, attached to a rod, is placed in close vicinity of the sensor in such a way that the magnetic field is parallel to the plane of the sensor. Upon removal of the external magnetic stimulus, the resistance drops back to its baseline level.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cañón Bermúdez, G.S., Fuchs, H., Bischoff, L. et al. Electronic-skin compasses for geomagnetic field-driven artificial magnetoreception and interactive electronics. Nat Electron 1, 589–595 (2018). https://doi.org/10.1038/s41928-018-0161-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41928-018-0161-6

This article is cited by

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing