Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Soft robotic shell with active thermal display

Abstract

Almost all robotic systems in use have hard shells, which is limiting in many ways their full potential of physical interaction with humans or their surrounding environment. Robots with soft-shell covers offer an alternative morphology which is more pleasant in both appearance and for haptic human interaction. A persisting challenge in such soft-shell robotic covers is the simultaneous realization of softness and heat-conducting properties. Such heat-conducting properties are important for enabling temperature-control of robotic covers in the range that is comfortable for human touch. The presented soft-shell robotic cover is composed of a linked two-layer structure: (1) The inner layer, with built-in pipes for water circulation, is soft and acts as a thermal-isolation layer between the cover and the robot structure, whereas (2) the outer layer, which can be patterned with a given desired texture and color, allows heat transfer from the circulating water of the inner part to the surface. Moreover, we demonstrate the ability to integrate our prototype cover with a humanoid robot equipped with capacitance sensors. This fabrication technique enables robotic cover possibilities, including tunable color, surface texture, and size, that are likely to have applications in a variety of robotic systems.

Introduction

Shells of robots used in industry are designed to cover internal mechanical structures (joints and linkages) as well as actuators, sensors and associated electronics and wiring. Such shells are also carefully designed to convey the manufacturing signature, i.e., the fabric mark. The trademarks of most existing robotic arms can be recognized at first sight. In manufacturing, robotic shells also withstand environmental influences, such as unexpected shocks or welding sparks, dust, and high humidity. Service robots have different requirements and different morphologies and shapes13, yet have covering shells that serve almost the same purpose as those in industrial robots. In the late nineteenth century, capabilities in terms of tactile sensing, located at the gripper “fingertips”, were investigated to increase robotic manipulation dexterity. With the rise of cobotics (robotics for “collaborative robots” called cobots), tactile sensing has been extended to the entire “robot body”, and several solutions have been proposed to make robots aware of external contact or touch; some of these solutions involve direct sensing using sensitized shells (called skins)49 and others involve indirect sensing by monitoring a subset of robot state residuals10. However, there does not appear to be a reason for a robotic shell to be systematically rigid. Robots can instead be covered by soft shells. Yet, why soft shells?

In fact, no large terrestrial moving animals with highly rigid shells (conceived by nature as exoskeletons) exist. Large terrestrial animals with rather rigid endoskeletons (bones) surrounded by soft matter (muscles, veins, skins…) have evolved in nature because such a structure gives vertebrates the equivalent of airbag protection in a car. Moreover, the soft-shells of relevant living species not only absorb impacts and allow dynamics through self-manipulated motion but can also be used to interact with the external environment; for instance, certain soft-shell animal skins can absorb liquids11, exchange thermal energy12, give a soft impression13, and provide a pleasant feeling to others14. In addition, many animals convey information that is useful for social interactions through their skin (e.g., chameleons change their skin color to protect themselves and express their feelings15). Such features can be applied to the robotic cover, expanding the possibilities to increase its capabilities in not only sensing, safety and communication functionalities but also tactile and visual aesthetics.

In particular, thermal impression in physical human–robot interaction is strongly related to human feeling such as sense of trust and friendship toward robots16,17, secure and comfort feelings18,19. We believe this feature is essential for a close human–robot relationship, and we aim at investigating soft shells with thermal capabilities for robots. The capability for rendering intended thermal stimuli is called thermal display, developing in telepresence haptics research2027 and virtual reality2830. Most of these studies use a thermoelectric module (called a Peltier device) as a thermal display, which can induce a temperature difference between the front and back sides of the device by means of the so-called Peltier effect31. Human-in-the-loop control strategies for the Peltier device have been investigated in many past studies and formulated as temperature-control problems3236, heat-flux control problems37, or a mixed temperature/heat flux bilateral-control problem21. However, the surface of a commercially available Peltier device is rigid because it is covered by hard ceramics. There are also flexible heaters and thermoelectric modules based on printed electronics techniques38,39, not yet applied to robotics. For instance, the stretchable resistive heater using Joule effect in40 uses air cooling. The skin-like thermo-haptic devices41,42, targeted for virtual reality applications, have both heating and cooling capabilities and are potentially very promising technologies. For the time being, their use in robotics would require an additional system to radiate the generated heat. Also the wiring might be an issue for large surfaces. In addition, the tactile impression of the surface tends to harden to some extent due to the semiconductor and liquid metal printed (or vapor deposited) on the modules.

Moreover, few materials exist that can simultaneously achieve the antagonistic characteristics of relatively low stiffness and high heat conductivity. That is, although lower density materials (e.g., silicone rubber and foam) can be used to design soft shells, heat transfer occurs by the motion of electrons and phonons in high-density materials. Thus, because of their low densities, most soft materials have no or very poor capability to be turned into thermal displays43,44. The few robotic systems embedded with thermal displays45 (or temperature control systems46) tend to have rigid shells.

To the best of our knowledge, no soft robotic cover exists that realizes “display” features that can both (1) serve aesthetic purposes (e.g., different colors and texture patterns are already possible on rigid covers, and extend to soft covers) and (2) be tuned with temperature to provide pleasant human touch without compromising other sensing technologies. Assembling or embedding a robotic soft cover with distributed small elements of Peltier devices is not conceivable. Obviously, the surface cannot be uniformly soft, and energy-wise it is certainly not a viable option. Overcoming these shortcomings, our robotic cover can display temperature using a closed-circuit water-circulation system inspired from human blood circulation. The proposed design, materials, and system construction achieve thermal rendering while maintaining a uniformly soft and smooth texture cover. The presented soft-shell robotic cover involves a combination of a foam layer and a gel layer with closed-circuit channels for water circulation. A novel water-circulation system is also developed, through which both heating and cooling of the cover are achieved within short response times. The cover was developed considering four kinds of features related to pleasant touch: stiffness47, surface texture patterns14,48, color49, and temperature18,50. Comparative studies are presented in Table 1. Moreover, the thickness, stiffness, roughness, and color of the proposed cover can be customized and optimized at will, according to the user or application demands. Finally, we test our proposed cover on the upper right arm of the humanoid robot HRP-4. Capacitance experiments demonstrate the ability to integrate a prototype cover with a humanoid robot equipped with capacitance sensors.

Table 1 The proposed robotic cover compared with the several studies.

Results

A novel soft cover design with thermal conductivity

Our robotic shell design is inspired in part by the human skin and blood circulation veins51. Blood flow under the skin surface plays a vital role in maintaining the balance between heat production and heat loss in many living organisms. The blood vessel diameter changes according to the external environment temperature to regulate the amount of blood flow. By analogy, we developed a water-circulation system using built-in pipes in composite soft materials, constituting a robotic cover (see Fig. 1). Our system includes temperature-controllable heat sources and a mini water-pump to regulate the water flow. The soft cover consists of two main layers. The inner layer is made of low-density foam in which the pipes are patterned as semicircular conduits for water circulation. The outer surface layer, assembled on top of the previous layer, is made of a gel mixed with boron nitride (BN) powder, which is covered by a polyurethane (PU) coating (see the next section for details). The inner foam material has low density, which means low stiffness (compliance with contact) and lightweight (to cover large areas of robots such as humanoids) but very low heat conductivity (isolation). Since the foam layer accounts for a major part of the cover, the thickness of the foam should be reasonable to avoid hindering robot kinematic motion ranges (6 mm for our prototype). The outer cover has higher heat conductivity relative to the inner part; hence, it also has a higher mass density. The thickness of the outer cover should be as thin as possible (we chose 1 mm). The thicknesses of the two layers can be tuned based on the robot design requirements and constraints (see Table 2). The built-in pipes allow heat transfer from the water circulating inside the shell to the robot surface through the outer layer. This solution permits higher performance and lower fabrication costs with respect to embedding separate pipes, as in our preliminary trials52. Because separate pipes add an additional layer to heat transfer and make the surface harder, we challenged not using pipes as a separate component.

Figure 1
figure 1

The developed robotic cover. The robotic prototype cover is designed to fit the rigid shell of the humanoid robot HRP-4 right upper arm; it has a -shaped to cast the upper arm. Thanks to the materials we used, the cover is deformable that can give a soft tactile impression. The water flow channels are built on the upper arm front side (contactable part by a human). The sides parts of the -shaped cover are left without heating for comparison purpose (see later the capacitive sensing part). The circulating water system for controlling the cover temperature was mounted on the HRP-4 backside.

Table 2 Physical properties of our robotic cover.

Our prototype is made to fit the upper arm of a humanoid robot we have because (1) it is already embedded with capacitive sensing (this is not the case for the forearms, forelegs, hands, and feet), (2) the cover prototype can be easily mounted and unmounted for trials. The final objective is covering the humanoid or any other collaborative robot body entirely. The system is thought to provide a complete solution to physical interaction for assistive purposes (see Figure S1 in “Supplementary material”). The study in53 also highlights use-cases of a humanoid-human assistance considering physical multi-contact with the robotic parts such as the upper arm and interactions that can occur on whole-body.

Material composition of the cover

The cover inner layer is made of molded PU foam, which is known for having a cushioning property and durability. This foam is used as a cushion in car seats, armrests in chairs or sofas, etc. This inner layer needs to enable the prevention of channel crushing under pressure in human interaction while keeping the surface soft and deformable. We chose 5 C hardness considering the balance between softness for tactile impression and hardness for maintaining the channel shape.

The cover outer layer is made of a gel mixed with BN powder known to have high heat conductivity and high electric insulation. The gel layer contains 40 pts.mass of BN to 111.67 pts.mass of polymeric components (that is 26.4% of BN). Thanks to the BN powder, the gel’s heat conductivity was improved from 0.2 W/mK (w/o BN) to 0.37 W/mK (w/BN), being higher than other soft materials while maintaining the cover soft (15 C hardness) (see Table 3).

Table 3 Heat conductivity of our robotic cover compared with other soft materials.

The gel layer is made as thin as possible while the surface remains smooth; if the layer is too thin, then the surface becomes rough due to the protrusion of the foam layer channels. In contrast, a thick gel layer could disturb heat transfer from the circulating water. The inner (foam) and outer (gel) layers are stacked using PU resin adhesive so that the attachment part can sustain low stiffness.

Semi-circular conduits embedded to the foam material

Since the foam material is liquid before it turns solid, it can be poured into a mold to achieve the desired shape. We designed a pipe pattern on the foam layer, as shown in Fig. 2A. The semicircular conduits (pipes) were designed to branch into multiple lines, preventing water-flow blockage, e.g., when the robotic arm is firmly grasped by a human. We set the distance (10 mm) and the diameter (3 mm) of each pipe based on the density of the thermal receptors present at the human fingertip (1.6 points/cm2 for warm spots and 2–4 points/cm2 for cold spots58). The pipe surface was coated with a 400 μm thick thermoplastic polyurethane (TPU) film to avoid water leakage. Moreover, a specific structure of connecting parts was applied to the cover exit and entrance using 3D printing; one end is round, and the other end is half-moon shaped (see Fig. 2B) to reduce the pressure at the parts flowing into and out of the cover. Both the TPU film and the connecting part can withstand a temperature of 90 °C, allowing circulation of up to 90 °C hot water inside the cover.

Figure 2
figure 2

The structure of the robotic cover. (A) The cover consists of three sides: (1) the foam layer molded channels with the gel layer (proposed one), (2) the foam layer without channels covering the gel layer, and (3) the foam layer itself. The channels embedded with the foam layer are designed as branched into multiple lines to prevent water blockage. (B) Specific connectors are developed by 3D printing for the cover’s entrance and exit; the end in the robotic cover side is half-moon shape, smoothly circulating the water through the cover. The semi-circular channels’ surface built in the foam is coated by Thermoplastic Polyurethane (TPU) film (400 μm thickness) with PU coating (20–40 μm thickness), avoiding permeating the water into the foam layer. (C) Because the gel is transparent, the layer reflects an ambient light; it makes the surface glossy. Therefore, the PU coating has an embossed surface to absorb light so that the surface becomes smooth appearance.

Surface processing

In addition to thermal display, the cover’s surface can convey other features, such as an engaging appearance, and be patterned with a texture that is pleasant to touch. Because the gel is transparent, the layer reflects ambient light. This makes the surface glossy and unpleasant to both sight and touch. Therefore, the gel layer was coated with PU of 20–40 μm thickness. As the PU coating has an embossed surface to absorb light, the surface becomes smooth in appearance (see Fig. 2C). Moreover, the coating protects against corrosion.

What we propose is a basic design for simultaneously realizing thermal display capability and softness, and the dimensions we chose in this paper are one option among many. To meet varying user or application demands and specifications, the cover thickness, stiffness, surface texture, and color can be customized and optimized at will (see in Table 4). In particular, Mitsui Chemicals has several techniques for post-processing (e.g., coating59, painting, and cutting), and the tactile impression of the cover surface can be easily changed.

Table 4 The range of the customizable characteristics of the cover provided by Mitsui Chemicals.

Robot embedded with a water-circulation system

We chose water as a circulating fluid because its thermal conductivity is much higher than that of other fluids. For example, water has a thermal conductivity of 0.604 W/mK (21.11 °C), whereas other liquids commonly used for cooling have values of 0.05–0.6 W/mK (20 °C) (see the detail in Table S7). Although molten metals have high heat conductivities (e.g., mercury has a value of 8.69 W/mK at 20 °C), they are dangerous, inflammable, and require special treatment or conditioning. In contrast, water is ubiquitous, non inflammable, inexpensive, and used in many other heating/cooling systems (including robot actuator cooling60). Hence, water is an appropriate liquid for use in our new robotic shell.

We designed a closed-circuit water-circulation system that can be mounted on any robot (see Supplementary Note S1, Figs. 1 and 4 for prototype mounting on an HRP-4 humanoid). One conventional method for achieving the intended temperature is to mix precooled and preheated water using two tanks61,62 (similar to the temperature regulation of tap water and showers). In this case, the system becomes too large to mount on the robot. Therefore, we devised an original small-size water tank (see Fig. 3) considering the thermal properties of water, enabling both heating and cooling. The originality of our design lies in the double-faced heating and cooling tank sources; the top and bottom faces are made of Peltier devices themselves so that water can be heated and cooled by direct contact with the Peltier device’s ceramics. Additionally, the tank is made of a resin monomer (see the details in Materials and Methods) that inherently has a low heat conductivity (0.15–0.25 W/mK63), preventing heat loss from the tank sides. The installation of a water supply port ensures that air is completely removed from the closed-loop circulating water. The tank, the supply port, and the cover are connected by a silicone pipe (also to avoid heat loss to occur outside the robot shell), the inner diameter and whole length of which are 2.5 mm and 1.46 m, respectively.

Figure 3
figure 3

Design of the water tank. (A) The customized tank comprises two heat sinks integrated with fans, 3D printed tank, and two Peltier devices. The tank has double-faced heat (and cold) sources; the top and bottom faces are made of the Peltier devices themselves so that water can be heated and cooled directly. The gaskets are put between the tank and heat sink to avoid water leakage. There are five holes to attach thermocouples; two are for measuring Peltier devices’ temperature, three are for water (upper side, middle, and lower side). The extrusion inside the tank covers the middle sensor for measuring water temperature to avoid contact with the Peltier devices. (B) The water storage part (pink part of this figure) is built by a 3D printer, designed to embed the Peltier devices and sandwich them using heat sinks from above and below. The part is made of a resin monomer, of which heat conductivity is low that can avoid heat loss from the tank wall.

Thermal display capability

The water-circulation system consists of a micro water pump, a customized water tank, two Peltier devices, and thermocouples (see Fig. 4). These components are essential for real-time control of the robot cover temperature. As stated previously, the Peltier devices are mounted on both sides of the water tank, hence each of the other ceramic surfaces is in direct contact with its heat dissipator. Heat is transferred to the cover by means of (1) convection through the circulating water and (2) conduction through the cover surface layer (see Supplementary Note S2). The Peltier device’s temperature and the water pump’s output (velocity of the circulating water) are controlled based on a model predictive control (MPC) formulation so that the robot surface temperature tracks the desired one (see Supplementary Note S3). Active temperature control is needed to regulate (in the sense of control) the cover’s temperature to any desired one. This process requires decreasing (cooling) or increasing (heating) to reach the temperature of the cover according to the will or preference of the user. In brief, the water needs to be cooled or heated to track the temperature profile.

Figure 4
figure 4

The circulating water system consists of the robotic cover, water supply port, Peltier devices embedded in the water tank and the micro water pump. There are three types of thermal effects in the system: absorbing/generating heat from Peltier devices based on a Peltier effect, heat convection through the circulating water (1), and heat conduction through the surface layer (gel) of the robotic cover (2). The water temperature is controlled by Peltier devices so that the robotic cover’s temperature matches the desired one.

The cover temperature range can be set according to studies on touch pleasantness found in the neuroscience field. According to the literature18,19, humans tend to feel pleasantness induced by hand stimuli at approximately 32–41 °C (about 10–15 °C higher than a standard room temperature). It indicates that humans feel comfortable when they are touched by something with human body temperature. In addition, comfortable temperature changes depend on the environmental temperature: 40 °C is comfortable at a room temperature of 20 °C and 15 °C is comfortable at 40 °C64. Thus, a pleasant temperature to touch is subjective: it depends on individuals and environmental conditions. Note that the controllable temperature of the cover surface (see Fig. 5) includes this range. Considering safety and the electric power system limitation, we set the temperature range of the Peltier device’s command between 12 and 77 °C.

Figure 5
figure 5

The controllable temperature range of the robotic cover surface. The Peltier devices are controlled to maximum and minimum temperatures in our experimental setup (87 °C and 12 °C, see Supplementary Note S2). The temperature responses of the water (lower, middle, upper side of the tank) and that of the cover are monitored. The robotic cover surface is successfully cooled and heated from 15.8 to 66.6 °C. This range covers the temperature that are comfortable for humans18,19,64.

We conducted experiments to assess the thermal display capability of the cover using various temperature commands (see Supplementary Notes S4, S5, and S6). Figures 6 and 7 show the temperature responses of the Peltier devices, that of the cover, and the water pump voltage input. The cover temperature was monitored by thermocouples attached to the surface and a thermal imaging camera. The initial temperature was set to room temperature (22 °C), measured by an alcohol thermometer. In Fig. 6, the cover was heated to 51 °C (left figure) and cooled to 17 °C (right figure) with step inputs, maintaining each command for 60 s. The response time for the cover temperature to reach the desired temperature is less than 10 s. after the water is completely heated or cooled. Mixed temperature profiles with both heating and cooling (rectangular and sine waves) were set as commands in Fig. 7 (Supplementary Movie S1 shows the results of the lower left figure). These results indicate that the cover temperature can be regulated to the intended value using the closed-loop water-circulation system embedded in the robot. The thermal capability makes it possible to give the desired temperature to users according to environmental conditions and personal preferences. A disturbance from a human hand has little effect on the temperature controller because of the large thermal capacitance of water (see Fig. S8).

Figure 6
figure 6

The cover temperature is controlled with successively increasing or decreasing step temperatures. The responses of Peltier device’s temperature, water pump’s voltage input, and temperature of the cover surface are monitored. The cover temperature is heated by 3 °C (5 °C in the end) until 51 °C (left figure) and cooled by 1 °C until 17 °C (right figure), keeping each temperature command for 60 s. Each response speed is less than 10 s after completely heating/cooling the circulating water.

Figure 7
figure 7

The cover temperature controlled with any desired temperature profiles. The cover temperature is regulated to the predefined temperature using the small tank mounted on the humanoid robot. Due to the system’s total time constant, the time to reach the command takes more than 1 min to heat the cooled water and to cool the heated water. This is not critical for human–robot interaction, considering prolonged physical interaction such as hugging and holding.

When cold water was heated or hot water was cooled, the time to reach the command value took longer than that in Fig. 6 for the following reasons. The theoretical values of the water and cover time constants in our system are 32.001 s and 5.578 s, respectively (37.579 s in total, see Supplementary Note S2). Considering the Peltier device time constant and other elements that could disturb heat transfer, the total time constant becomes greater than 45 s. In addition, the water pump restarted the circulation of the cooled/heated water immediately after changing the command; this additionally cooled/heated the cover, diverting the response away from the command value for a moment. The response is slower than conventional thermal displays using Peltier devices because of the limiting thermal capacitance of water (e.g., the skin-like thermo-haptic device41 is 5 s, whereas our system took from 5 to 60 s to reach the temperature commands.) As previously mentioned, using two tanks61 is one possible solution to shorten the response time; yet, the system becomes too large to mount on the robot.

Our cover can offer an additional functionality suitable to the robotics domain: the circulating water system can also be used to transfer and dissipate heat generated by other inside robot features (namely the joint actuators). For example, in humanoid robots, these are made thanks to fans placed near each actuator. These fans generate noise and are not always very efficient. A system cooling in conjunction with our cover can use the same fluid to make it circulated around the actuators for cooling purposes, e.g.60. Note that the cover’s response speed is not critical for human–robot interaction; the thermal capability is designed for use in prolonged interactions such as holding, considering the frequency range of the human body thermal regulation system, and at providing secure and pleasant expression (For example, a dynamic temperature change (0.5 °C/s) is rated as less pleasant than static stimuli in50).

We conducted an endurance experiment by operating the system for 7 h (maximum time allowed in a laboratory with constant monitoring), with a continuous control of the cover temperature to 32°. The water did not leak from the cover, yet we have witnessed potential amelioration in the connections of other parts of the entire circuit.

Thermal display with concurrent capacitive sensing

Proximity sensors65, such as capacitive sensing, can make the robot aware of human closeness prior to contact. This is particularly useful in close human–robot interactions, where robot embedded cameras and existing human tracking fail to provide such information. We embedded our robot with a capacitive sensing system to operate in an industrial setting; see66 for more technical details. We therefore investigated whether our proposed thermal cover can be used concurrently with capacitive sensing. We cast our cover on the right arm of an HRP-4 humanoid embedded with four electrodes for capacitive sensing—one on each side of the arm (front, rear, left, and right sides). Capacitive sensing measures the electric capacitance between the surrounding conductive object and the sensor itself. The raw values are normalized and restricted from 0 to 1; the initial value without contact is set to 1 after calibration and approaches 0 when a conductive material (here, a human hand) approaches the sensor. At this stage, given our optimized prototype cover design, we wanted to evaluate the influence of each layer of our cover on capacitive sensing (this is the very reason it was shaped in -form). The front part of the cover is the complete cover with the water-circulation pipes (foam + channels + gel, with and without water); it acts on the front capacitive electrode of the arm. The close-to-torso side of the cover is constituted only by the cover outer and inner layers (foam + gel) without the pipe (and hence without water) layers of the cover and act on the left-side capacitive electrode of the arm. The remaining side of the cover is constituted only by foam and acts on the arm right-side electrode. We then investigated and compared the influence of each part of the cover on its associated capacitive electrode (front, left and right sides of the right arm) on each cover side (see Fig. 2A), fitting the cover on the robot while grasping (full hand touch) it (Fig. 8A). Figure 8B shows the mean and standard deviation (red line) of the sensor outputs recorded for 20 s without contact. Each of the cover side (foam + channels + gel, foam + gel, and foam) outputs in the three cases (naked arm and fitting the cover when it is empty inside and filled with water) are summarized as follows:

  • naked arm (w/o cover): 1.00 (standard deviation: 4.49 × 10−3)

  • foam: 0.946 (standard deviation: 3.21 × 10−3)

  • foam + gel: 0.940 (standard deviation: 4.88 × 10−3)

  • foam + channels + gel: 0.833 (standard deviation: 5.06 × 10−3)

  • foam + channels + gel + water: 0.563 (standard deviation:1.67 × 10−2)

Figure 8
figure 8

Concurrent thermal display and capacitive sensing. (A) We investigated the effect of the cover on humanoid’s capacitive sensing by grasping (full touch) the upper arm. (B) The capacitive sensor outputs were compared in three cases: (1) naked arm (without cover), (2) with the cover empty, and (3) with the cover filled with water. The three graphs show the average and the standard deviation (red line) of the capacitive sensor’s outputs recorded for 20 s without contact. Namely, the cover affects the capacitive sensing because the cover’s material itself and water are conductive. (C) We recalibrated after fitting the cover so that it does not affect the sensing. The outputs were monitored while heating and cooling the cover, grasping in 3 min except 20 s in the beginning and the end. These results suggest that our operating cover can be used concurrently with capacitive sensing.

The cover affects statically capacitive sensing because the cover material itself and water are conductive. Thus, a recalibration after fitting the cover was performed to get rid of subsequent off-set, as shown in Fig. 8C. The outputs were monitored while heating (controlled to 24 °C for 1 min) and cooling (controlled to 21 °C for 2 min) the cover, with grasping (full touch of the arm) for 3 min in total except for 20 s in the beginning and at the end. These results suggest that the temperature and water circulation do not affect capacitive sensing, allowing integration with the robot cover (Supplementary Movies S2 and S3 show examples for integrating our shell to the HRP-4). In each of these figure parts, an offset occurs with respect to the naked arm (w/o cover) because the cover thickness does not allow the electrodes to touch, as is the case in the bare (w/o cover) scenario.

Discussion

Most recent robotic shells have been developed with functional features such as sensing, impact absorption, and dust-or waterproofing. Additionally, the robot shell can also play a major role in social interactions. We propose a novel design for a lightweight robotic shell (i.e., cover) that is both soft and can be cooled or heated at will. Moreover, our cover can be patterned, colored, and optimized in stiffness and thickness. Our main contributions are the followings.

  1. 1.

    The soft cover has built-in pipes for water circulation, allowing desired changes in the robot cover temperature. The pipes (or channels) are built-in the inner part of the two-layer structure composing the cover; the material properties (thickness, stiffness…) in each layer can be chosen to fit user or application requirements.

  2. 2.

    We devised a closed-loop water-circulation system that can be embedded in a humanoid (or other) robot. The developed double-faced tank enables heating and cooling of the water directly and quickly by directly monitoring the water temperature.

  3. 3.

    We also conceived a control system for thermal rendering considering the robotic cover thermal properties.

The proposed design has been developed considering four kinds of features related to pleasant touch in human–robot physical interaction.

  • Stiffness: 5 C hardness (inner layer), 15 C hardness (outer layer) (see Table 2)

  • Surface texture patterns: smooth texture and appearance (see Fig. 2A,C)

  • Color: white (the material’s original color) for soft and natural impression (see Fig. 2C)

  • Temperature: actively controllable from 15.8 to 66.6 °C (see Figs. 5, 6 and 7)

In fact, the cover can be designed by varying several features and parameters. A thermal display on a robotic shell allows using robots for various applications where human trust is essential to promote interaction and acceptance.

Moreover, our cover does not hinder or compromise capacitive sensing (see “Results” section), which suggests that it can be applied to existing robots or machines that are equipped with capacitive sensing. Combined with other sensors, it can supply thermal information for superordinate-level techniques (detecting human interactions while providing a comfortable feeling, recognizing humans or materials that contact the cover, etc.). The cover design concept will also be extended to eventually embed other sensing modalities. It can be substantially enhanced with the promising developments in stretchable electronics67,68: one can easily imagine the possibility offered by on-line change of color or on-line change of texture patterns, together with enhanced tactile sensing modalities. We are also working to supplement our cover with a third inner layer that acts to modulate the robot shell stiffness on-line while having high impact absorption capabilities to increase safety. Investigation of the cover’s physical impression in terms of usability and human factors is also part of future work. We believe that our system is an innovative solution for promoting human–robot interaction and bringing technology closer to our daily lives and to safely deploy complex robots such as humanoids in domestic and human assistive systems.

Methods

The experimental setup

The circulating water system consists of the micro water pump (D200S, maximum flow rate: 80 ml/min, pressure: 11 psi), a 3D printed small water tank (see Fig. 3), two Peltier devices (ETH-127-14-11-S; maximum temperature difference: 72 °C, cooling capacity: 77.1 W, voltage: 15.7 V, current: 8.5 A, area: 40 cm × 40 cm), and thermocouples (T type, Exposed Junction Wire Thermocouple). The water supplying ports are connected by T-joint connection with 1/8 in. screw port. Each part composing the system is connected by a silicone pipe, of which the inner diameter and whole length are 2.5 mm and 1.46 m, respectively. The control system consists of a regular PC with Linux OS and 1.0 ms sampling time, 16 bit AD/DA boards, sensor amplifier (THAB-T-200), and three Micro-Power Motor Amplifiers (TA115, 150 W continuous, 325 W peak).

3D printed part of the water tank

The tank part (the pink part of Fig. 3B) was printed by AnyCubic 3D printing (Photon Mono X), using Colored UV Resin (color: black, main material: resin and photoinitiator, liquid density: 1.184 g/cm3, solid density: 1.100 g/cm3, hardness (D): 79.0).

Thermographic visualization

Thermal images and movies were captured by the thermal imaging camera (FLIR One Pro LT iOS; precision: ± 3 °C or ± 5%, temperature resolution: 0.1 °C).

References

  1. Sakagami, Y. et al. The intelligent asimo: System overview and integration. In IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, 2478–2483 (2002).

  2. Wada, K., Shibata, T., Musha, T. & Kimura, S. Robot therapy for elders affected by dementia. IEEE Eng. Medicine Biol. Mag. 27, 53–60 (2008).

    Article  Google Scholar 

  3. Geva, N., Uzefovsky, F. & Levy-Tzedek, S. Touching the social robot paro reduces pain perception and salivary oxytocin levels. Sci. Rep. 10, 1–15 (2020).

    Article  Google Scholar 

  4. Bartolozzi, C., Natale, L., Nori, F. & Metta, G. Robots with a sense of touch. Nat. Mater. 15, 921–925 https://doi.org/10.1038/nmat4731 (2016).

    ADS  CAS  Article  PubMed  Google Scholar 

  5. Tomo, T. P. et al. A new silicone structure for uskin-a soft, distributed, digital 3-axis skin sensor and its integration on the humanoid robot icub. IEEE Robot. Autom. Lett. 3, 2584–2591 (2018).

    Article  Google Scholar 

  6. Boutry, C. M. et al. A hierarchically patterned, bioinspirede-skinable to detect the direction of applied pressure for robotics. Sci. Robot. https://doi.org/10.1126/scirobotics.aau6914 (2018).

    Article  PubMed  Google Scholar 

  7. Kaplish, A. & Yamane, K. Motion retargeting and control for teleoperated physical human-robot interaction. In 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids), 723–730. https://doi.org/10.1109/Humanoids43949.2019.9035060 (2019).

  8. Ma, G. & Soleimani, M. A versatile 4d capacitive imaging array: A touchless skin and an obstacle-avoidance sensor for robotic applications. Sci. Rep. 10, 1–9 (2020).

    CAS  Article  Google Scholar 

  9. Bergner, F., Dean-Leon, E. & Cheng, G. Design and realization of an efficient large-area event-driven e-skin. Sensors 20, 1965 (2020).

    ADS  Article  PubMed Central  Google Scholar 

  10. Haddadin, S., De Luca, A. & Albu-Schäffer, A. Robot collisions: A survey on detection, isolation, and identification. IEEE Trans. Rob. 33, 1292–1312 (2017).

    Article  Google Scholar 

  11. Shrestha, P. & Stoeber, B. Fluid absorption by skin tissue during intradermal injections through hollow microneedles. Sci. Rep. 8, 1–13. https://doi.org/10.1038/s41598-018-32026-9 (2018).

    CAS  Article  Google Scholar 

  12. Rushmer, R. F., Buettner, K. J., Short, J. M. & Odland, G. F. The skin. Science 154(3747), 343–348 (1966).

  13. Arnold, T. & Scheutz, M. The tactile ethics of soft robotics: Designing wisely for human-robot interaction. Soft Robot. 4, 81–87. https://doi.org/10.1089/soro.2017.0032 (2017).

    Article  PubMed  Google Scholar 

  14. Klöcker, A., Wiertlewski, M., Théate, V., Hayward, V. & Thonnard, J.-L. Physical factors influencing pleasant touch during tactile exploration. PLoS ONE 8, 1–8. https://doi.org/10.1371/journal.pone.0079085 (2013).

    CAS  Article  Google Scholar 

  15. Teyssier, J., Saenko, S. V., Van Der Marel, D. & Milinkovitch, M. C. Photonic crystals cause active colour change in chameleons. Nat. Commun. 6, 1–7. https://doi.org/10.1038/ncomms7368 (2015).

    CAS  Article  Google Scholar 

  16. Nie, J., Park, M., Marin, A. L. & Sundar, S. S. Can you hold my hand? Physical warmth in human–robot interaction. In ACM/IEEE International Conference on Human–Robot Interaction, 201–202 (2012).

  17. Park, E. & Lee, J. I am a warm robot: The effects of temperature in physical human–robot interaction. Robotica 32, 133–142. https://doi.org/10.1017/S026357471300074X (2014).

    Article  Google Scholar 

  18. Ackerley, R. et al. Human c-tactile afferents are tuned to the temperature of a skin-stroking caress. J. Neurosci. 34, 2879–2883. https://doi.org/10.1523/JNEUROSCI.2847-13.2014 (2014).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  19. Rolls, E. T., Grabenhorst, F. & Parris, B. A. Warm pleasant feelings in the brain. Neuroimage 41, 1504–1513. https://doi.org/10.1016/j.neuroimage.2008.03.005 (2008).

    Article  PubMed  Google Scholar 

  20. Monkman, G. J. & Taylor, P. M. Thermal tactile sensing. IEEE Trans. Robot. Autom. 9, 313–318. https://doi.org/10.1109/70.240201 (1993).

    Article  Google Scholar 

  21. Drif, A., Citerin, J. & Kheddar, A. Thermal bilateral coupling in teleoperators. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 1301–1306. https://doi.org/10.1109/IROS.2005.1545403 (2005).

  22. Jones, L. A. & Ho, H. Warm or cool, large or small? The challenge of thermal displays. IEEE Trans. Haptics 1, 53–70. https://doi.org/10.1109/TOH.2008.2 (2008).

    CAS  Article  PubMed  Google Scholar 

  23. Guiatni, M., Benallegue, A. & Kheddar, A. Learning-based thermal rendering in telepresence. In Haptics: Perception, Devices and Scenarios (ed. Ferre, M.) 820–825 (Springer Berlin Heidelberg, 2008).

    Chapter  Google Scholar 

  24. Jones, L. A. Perspectives on the evolution of tactile, haptic, and thermal displays. Presence 25, 247–252 (2016).

    Article  Google Scholar 

  25. Sato, K. Thermal displays and sensors. In Pervasive Haptics, 167–181 (Springer, Japan, Tokyo, 2016).

  26. Osawa, Y. & Katsura, S. Thermal propagation control using a thermal diffusion equation. IEEE Trans. Ind. Electron. 65, 8809–8817. https://doi.org/10.1109/TIE.2018.2811363 (2018).

    Article  Google Scholar 

  27. Kajimoto, H. & Jones, L. A. Wearable tactile display based on thermal expansion of nichrome wire. IEEE Trans. Haptics 12, 257–268. https://doi.org/10.1109/TOH.2019.2912960 (2019).

    Article  PubMed  Google Scholar 

  28. Ino, S. et al. A tactile display for presenting quality of materials by changing the temperature of skin surface. In IEEE International Workshop on Robot and Human Communication, 220–224 (1993).

  29. Kron, A. & Schmidt, G. Multi-fingered tactile feedback from virtual and remote environments. In Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 16–23 (2003).

  30. Benali-Khoudjal, M., Hafez, M., Alexandre, J. M., Benachour, J. & Kheddar, A. Thermal feedback model for virtual reality. In International Symposium on Micromechatronics and Human Science, 153–158 (2003).

  31. Rowe, D. M. Thermoelectrics Handbook: Macro to Nano (CRC Press, 2018).

    Book  Google Scholar 

  32. Yamamoto, A., Cros, B., Hashimoto, H. & Higuchi, T. Control of thermal tactile display based on prediction of contact temperature. IEEE Int. Conf. Robot. Autom. 2, 1536–1541 (2004).

    Google Scholar 

  33. Citerin, J., Pocheville, A. & Kheddar, A. A touch rendering device in a virtual environment with kinesthetic and thermal feedback. In IEEE International Conference on Robotics and Automation, 3923–3928 (2006).

  34. Yang, G., Jones, L. A. & Kwon, D. Use of simulated thermal cues for material discrimination and identification with a multi-fingered display. Presence 17, 29–42 (2008).

    Article  Google Scholar 

  35. Ho, H.-N. & Jones, L. Development and evaluation of a thermal display for material identification and discrimination. ACM Trans. Appl. Percept. https://doi.org/10.1145/1265957.1265962 (2007).

    Article  Google Scholar 

  36. Osawa, Y., Morimitsu, H. & Katsura, S. Control of thermal conductance with detection of single contacting part for rendering thermal sensation. IEEJ J. Ind. Appl. 5, 101–107 (2016).

    Google Scholar 

  37. Guiatni, M., Benallegue, A. & Kheddar, A. Thermal display for telepresence based on neural identification and heat flux control. Presence 18, 156–169 (2009).

    Article  Google Scholar 

  38. Ding, T. et al. Scalable thermoelectric fibers for multifunctional textile-electronics. Nat. Commun. 11, 1–8 (2020).

    ADS  Google Scholar 

  39. Du, Y., Xu, J., Paul, B. & Eklund, P. Flexible thermoelectric materials and devices. Appl. Mater. Today 12, 366–388 (2018).

    Article  Google Scholar 

  40. Kim, D. et al. Highly stretchable and oxidation-resistive cu nanowire heater for replication of the feeling of heat in a virtual world. J. Mater. Chem. A 8, 8281–8291. https://doi.org/10.1039/D0TA00380H (2020).

    CAS  Article  Google Scholar 

  41. Lee, J. et al. Stretchable skin-like cooling/heating device for reconstruction of artificial thermal sensation in virtual reality. Adv. Funct. Mater. 30, 1909171. https://doi.org/10.1002/adfm.201909171 (2020).

    ADS  CAS  Article  Google Scholar 

  42. Lee, J., Kim, D., Sul, H. & Ko, S. H. Thermo-haptic materials and devices for wearable virtual and augmented reality. Adv. Funct. Mater. https://doi.org/10.1002/adfm.202007376 (2021).

    Article  PubMed  Google Scholar 

  43. Alspach, A., Kim, J. & Yamane, K. Design and fabrication of a soft robotic hand and arm system. In IEEE International Conference on Soft Robotics, 369–375 (2018).

  44. Ishiguro, H. Android Science: Toward a New Cross-Interdisciplinary Framework Vol. 28, 118–127 (Springer, 2007).

    MATH  Google Scholar 

  45. Peña, D. & Tanaka, F. Human perception of social robot’s emotional states via facial and thermal expressions. J. Hum.–Robot Interact. https://doi.org/10.1145/3388469 (2020).

    Article  Google Scholar 

  46. Kawaharazuka, K. et al. Estimation and control of motor core temperature with online learning of thermal model parameters: Application to musculoskeletal humanoids. IEEE Robot. Autom. Lett. 5, 4273–4280 (2020).

    Article  Google Scholar 

  47. Pasqualotto, A., Ng, M., Tan, Z. Y. & Kitada, R. Tactile perception of pleasantness in relation to perceived softness. Sci. Rep. 10, 1–10 (2020).

    Article  Google Scholar 

  48. Wiertlewski, M., Hudin, C. & Hayward, V. On the 1/f noise and non-integer harmonic decay of the interaction of a finger sliding on flat and sinusoidal surfaces. In IEEE World Haptics Conference, 25–30. https://doi.org/10.1109/WHC.2011.5945456 (2011).

  49. Valdez, P. & Mehrabian, A. Effects of color on emotions. J. Exp. Psychol. 123, 394 (1994).

    CAS  Article  Google Scholar 

  50. Salminen, K. et al. Cold or hot? How thermal stimuli are related to human emotional system? In Haptic and Audio Interaction Design (eds Oakley, I. & Brewster, S.) 20–29 (Springer Berlin Heidelberg, 2013).

    Chapter  Google Scholar 

  51. Parsons, K. Human Thermal Environments: The Effects of Hot, Moderate, and Cold Environments on Human Health, Comfort, and Performance 3rd edn. (CRC Press Inc., 2014).

    Book  Google Scholar 

  52. Osawa, Y. & Kheddar, A. A soft robotic cover with dual thermal display and sensing capabilities. In Experimental Robotics. ISER 2020. Springer Proceedings in Advanced Robotic, vol. 19. (Springer, 2021). https://doi.org/10.1007/978-3-030-71151-1_23.

  53. Bolotnikova, A., Courtois, S. & Kheddar, A. Multi-contact planning on humans for physical assistance by humanoid. IEEE Robot. Autom. Lett. 5, 135–142. https://doi.org/10.1109/LRA.2019.2947907 (2020).

    Article  Google Scholar 

  54. Song, J., Peng, Z. & Zhang, Y. Enhancement of thermal conductivity and mechanical properties of silicone rubber composites by using acrylate grafted siloxane copolymers. Chem. Eng. J. 391, 123476. https://doi.org/10.1016/j.cej.2019.123476 (2020).

    CAS  Article  Google Scholar 

  55. Yang, D. et al. Novel nitrile-butadiene rubber composites with enhanced thermal conductivity and high dielectric constant. Compos. Part A Appl. Sci. Manuf. 124, 105447. https://doi.org/10.1016/j.compositesa.2019.05.015 (2019).

    CAS  Article  Google Scholar 

  56. An, D. et al. Enhanced thermal conductivity of natural rubber based thermal interfacial materials by constructing covalent bonds and three-dimensional networks. Compos. Part A Appl. Sci. Manuf. 135, 105928. https://doi.org/10.1016/j.compositesa.2020.105928 (2020).

    CAS  Article  Google Scholar 

  57. Liu, Z., Zhang, H., Song, S. & Zhang, Y. Improving thermal conductivity of styrene-butadiene rubber composites by incorporating mesoporous silica@solvothermal reduced graphene oxide hybrid nanosheets with low graphene content. Compos. Sci. Technol. 150, 174–180. https://doi.org/10.1016/j.compscitech.2017.07.023 (2017).

    CAS  Article  Google Scholar 

  58. Hensel, H. Cutaneous thermoreceptors. In Somatosensory System, 79–110 (Springer, Berlin, Heidelberg, 1973).

  59. Hiroshi, K., Minoru, W., Makoto, k. & Satoshi, Y. Buffer Material, Buffer Material for Coating Robot, Robot with Buffer Material, and Coating Robot with Buffer Material (U.S. Patent and Trademark Office, Washington, DC, 2021). U.S. Patent No. 10,913,251.

  60. Urata, J., Nakanishi, Y., Okada, K. & Inaba, M. Design of high torque and high speed leg module for high power humanoid. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 4497–4502 https://doi.org/10.1109/IROS.2010.5649683 (2010).

  61. Sakaguchi, M., Imai, K. & Hayakawa, K. Development of high-speed thermal display using water flow. In Human Interface and the Management of Information. Information and Knowledge Design and Evaluation, Lecture Notes in Computer Science, vol. 8521. https://doi.org/10.1007/978-3-319-07731-4_24 (Springer, 2014).

  62. Goetz, D. T., Owusu-Antwi, D. K. & Culbertson, H. Patch: Pump-actuated thermal compression haptics. In IEEE Haptics Symposium, 643–649. https://doi.org/10.1109/HAPTICS45997.2020.ras.HAP20.32.c4048ec3 (2020).

  63. Garrett, K. W. & Rosenberg, H. M. The thermal conductivity of epoxy-resin/powder composite materials. J. Phys. D Appl. Phys. 7, 1247–1258. https://doi.org/10.1088/0022-3727/7/9/311 (1974).

    ADS  CAS  Article  Google Scholar 

  64. Attia, M. Thermal pleasantness and temperature regulation in man. Neurosci. Biobehav. Rev. 8, 335–342. https://doi.org/10.1016/0149-7634(84)90056-3 (1984).

    CAS  Article  PubMed  Google Scholar 

  65. Navarro, S. E. et al. Proximity perception in human-centered robotics: A survey on sensing systems and applications. Preprint at https://hal.inria.fr/hal-03156830 (2021).

  66. Kheddar, A. et al. Humanoid robots in aircraft manufacturing: The airbus use cases. IEEE Robot. Autom. Mag. 26, 30–45 (2019).

    Article  Google Scholar 

  67. Sim, K. et al. Metal oxide semiconductor nanomembrane-based soft unnoticeable multifunctional electronics for wearable human–machine interfaces. Sci. Adv. https://doi.org/10.1126/sciadv.aav9653 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  68. Wen, D.-L. et al. Recent progress in silk fibroin-based flexible electronics. Microsyst. Nanoeng. 7, 1–25 (2021).

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all colleagues (Tsutomu Tawa, Keiko Sakaguchi, Kazuaki Ichimura, Makoto Kajiura) involved with CNRS-Mitsui Chemicals collaborative work for realizing the robot cover. The authors also thank Olivier Tempier in CNRS-LIRMM France for manufacturing 3D printed water tank.

Funding

This work was supported by the CNRS-Mitsui Chemicals joint research agreement. Y.O. acknowledges postdoctoral fellowship support by JSPS Overseas Research Fellowships No. 201960463. CNRS and MITSUI CHEMICALS, INC. has filed patent applications (Filing No. FR2103637, Filing Date 09/04/2021).

Author information

Authors and Affiliations

Authors

Contributions

Y.O. and A.K. proposed the concept design of the robotic cover, Y.K., M.K., K.I., T.T., K.S., K.I., and M.K. assisted to realize the design. Y.K. and M.K. developed the cover, K.I. mediated the international collaboration, and Y.O. and A.K. conducted experiments and wrote the initial manuscript. All authors discussed the results and commented on the manuscript.

Corresponding authors

Correspondence to Yukiko Osawa or Abderrahmane Kheddar.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Supplementary Video S1.

Supplementary Video S2.

Supplementary Video S3.

Supplementary Information 1.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Osawa, Y., Kinbara, Y., Kageoka, M. et al. Soft robotic shell with active thermal display. Sci Rep 11, 20070 (2021). https://doi.org/10.1038/s41598-021-99117-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1038/s41598-021-99117-y

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing