Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Peripersonal space in the front, rear, left and right directions for audio-tactile multisensory integration

Abstract

Peripersonal space (PPS) is important for humans to perform body–environment interactions. However, many previous studies only focused on the specific direction of the PPS, such as the front space, despite suggesting that there were PPSs in all directions. We aimed to measure and compare the peri-trunk PPS in four directions (front, rear, left, and right). To measure the PPS, we used a tactile and an audio stimulus because auditory information is available at any time in all directions. We used the approaching and receding task-irrelevant sounds in the experiment. Observers were asked to respond as quickly as possible when a tactile stimulus was applied to a vibrator on their chest. We found that peri-trunk PPS representations exist with an approaching sound, irrespective of the direction.

Introduction

It is important for human and non-human primates to detect a sensory input that has a potential threat at present or in the near future and to perform body–environment interaction in the space immediately surrounding the body. This space is called the peripersonal space (PPS). The PPS is located between the body surface and the extrapersonal space that is far from the body. Normally, human and non-human primates cannot touch objects placed in the extrapersonal space1,2. The PPS clearly has a different role to the extrapersonal space because an event in this area is likely to be involved in human and non-human primates’ actions, such as grasping a doorknob or holding a baby in their hands. Many studies have been conducted on PPS, and all report various characteristic features of PPS.

Multiple studies on neurophysiology in monkeys have reported that there are multisensory neurons in the ventral premotor cortex representing visuo-tactile (visuo-somatic)3,4,5,6,7,8,9,10 or audio-tactile (visuo-audio-tactile)11,12 information surrounding the monkey’s bodies (PMv; F45,6,9,10), as well as in the ventral intraparietal (VIP) areas4,12, parietal areas (7b3), and the putamen7,8. Graziano & Cooke (2006) have summarized the findings on multisensory neurons in monkeys13. These neurons respond only when the information exists within the space immediately surrounding the body parts including the head4,6,9,11,12, face8,10, and arms (hands)5,7,8,9. Schlack et al. (2005)12 showed that macaque VIP neurons respond not only to visual stimuli, but also to auditory stimuli, and that these neurons are bi- or trimodal. Additionally, the PPS mapping varies dynamically in response to external factors14,15. Fogassi et al. (1996)14 showed that an increase in approaching stimulus velocity produces an expansion in the depth of the receptive field in most neurons in area F4, such that fast-moving stimuli are signaled earlier than slow-moving ones. Iriki et al. (1996)15 showed that neuron remapping occurs when trained macaque monkeys attempt to obtain food pellets using a rake. With training, the neuron map shifts to the rake position from the actual hand position to use the rake. However, in the study15, the visual stimuli were moved toward or away from the monkey’s hand in a centripetal or centrifugal fashion. Thus, some argue that it is difficult to conclude that the concentration of neuronal responses when the stimulus was near the hand reflects a neuronal response selective for stimuli presented within body-part-centered peripersonal space16. Taken together, PPS neurons respond to stimuli within the space immediately surrounding the body or body parts, and the responses change dynamically by external factors.

Behavioral and neurophysiological studies on human participants have reported that various external factors modulate the boundary of the PPS: tool-using17,18,19,20, wrist weight21, gravity or vestibular cues22,23, walking24, pseudo-walking25, grasping26, fear of the stimuli27,28, and social context29,30,31. For example, Noel et al. (2015)24 showed that the space of audio-tactile integration (i.e., the size of the PPS) expanded forward when walking, which it did not when staying in one position. Furthermore, the timescale of the PPS modulation was not only a long-term experience32, but also endured from trial-to-trial33,34. These facts suggest that, by changing the PPS, humans can adaptively perceive “the space close to themselves”, dynamically in real time, and integrate multisensory information in the space to address not only normal but also emergency situations. Recent studies have shown that the PPS is also effective in virtual environments35,36,37. For example, Serino et al. (2018)37 evaluated multisensory tasks in a mixed reality (MR) ecosystem using ecological validity conditions and showed that the results obtained with the MR environment are equivalent to those obtained within real environments. The PPS is related to the field of human factors. Cross-modal looming signals (visual, auditory, and tactile sensations) on human spatial attention of the front and rear near space have been investigated in the field of human factors38,39,40,41. The cross-modal attention to sounds in the rear (unseen) space is different from that in the front space41. These findings contribute to the design of human interfaces by providing appropriate warning signals for safe driving38.

Most studies focused on PPS only in the near area in front of the body27,29,30,32,42, although multisensory information is available in a variety of directions in the real world43,44,45,46. Indeed, there are empirical findings that the PPS exists not only in front of the body but also in other directions, as in the study of monkeys11 and human studies47,48. However, it is not clear whether the PPS is different or identical in all directions (see review49). Some studies measured PPS in the rear of the body using audio-tactile or visuo-tactile stimuli and concluded that PPS was asymmetric between the front and rear of the body, and that the PPS in front of the body was larger than that in the rear of the body50,51. For example, Kóbor et al. (2006)51 showed that non-musicians and pianists performed temporal order judgments between tactile stimuli in their left and right hands when they crossed or uncrossed their hands in front of or behind their body. Both participant groups showed a much reduced crossed-hand interference when they crossed their hands behind their bodies rather than at the front, suggesting that the spatiotemporal representation of the PPS is different between the front and rear spaces. On the other hand, Serino et al. (2015)52 investigated PPS representation around the trunk in the front and rear spaces with visuo-tactile stimuli and found that the peri-trunk PPS is symmetric between the front and rear of the body, in that the size of the PPS in front of the body is the same as that in the rear of the body. They also showed that there are three different body-part PPS representations (trunk, hand, and face), and the PPS size was smallest for the hand, larger for the face, and largest for the trunk. Although they did not investigate the hand PPS when the hand was located behind the trunk, hand PPS was modulated according to the relative position to the trunk. Thus, the trunk PPS is larger and more constant than the hand PPS52. PPS in the lateral areas (left and right) of the body has been investigated using audio-tactile stimuli23,53. Pfeiffer et al. (2018)23 showed that the PPS is symmetrical between the left and right spaces with right-handed participants. Hobeika et al. (2018)53 focused on handedness and showed that the PPS size of right-handed observers is larger in the left hemispace space than in the right hemispace space, while the PPS size of left-handed observers was the same between the left and right hemispheres. Thus, this anisotropy in the lateral PPS was observed in right-handed observers. The difference between these studies23,53 may be due to variations in the degree of handedness of participants and differences in stimuli and setups.

However, the PPS of all four directions (front, rear, left, and right) has not been compared using the same apparatus. We believe that it is important to investigate the PPS in four directions because humans must detect and perceive auditory and tactile information that occurs in various directions at all times. Thus, we hypothesized that the representation of the peri-trunk PPS for audio-tactile stimuli is a circle centered on the position of the human. To test this hypothesis, we compared the PPS for audio-tactile stimuli in the front of the body with the PPS in the other three directions (rear, left, and right) of the body (Fig. 1). Twenty participants were asked to detect the tactile stimulus on the chest as quickly as possible, irrespective of the auditory stimulus that was either approaching sound or receding sound. The tactile stimulus was presented at seven different temporal delays (Tbefore, T1, T2, T3, T4, T5, and Tafter). The T1 – T5 tactile stimuli were set at 300, 800, 1500, 2200, and 2700 ms from the sound onset. The Tbefore and Tafter tactile stimuli were set 700 ms before the sound onset and 700 ms after the sound offset, respectively.

Figure 1
figure 1

The schematic of the experiment. A virtual audio source was presented. The audio motion was presented toward the participant (approaching sound) or away from the participant (receding sound) in four body-relative directions (front, rear, left, and right). Participants were asked to detect a tactile stimulus presented on the chest as quickly as possible, irrespective of the sound stimulus. Timings of the tactile stimulus and the sound motion were systematically varied.

Results

We analyzed only the RTs in the bimodal and unimodal conditions. We eliminated missing responses (8.74%) from the analysis. We also eliminated the data when the RT was more than 1,300 ms and less than 100 ms (1.03%). We also applied the Grubbs’ test to find and remove outliers before the analysis (1.67%). In total, we excluded 11.4% of the data from the analysis. In catch trials, the false alarm rate was very low (0.96%).

Effect of body direction on peri-trunk PPS

We conducted a three-way repeated measures ANOVA on the mean RTs in four body-relative directions (front, rear, left, and right), two audio motions (approaching and receding sounds), and seven temporal delays (Tbefore, T1, T2, T3, T4, T5, and Tafter). The ANOVA revealed a significant main effect of temporal delays (F (6, 114) = 4.82, p = 0.0002, ηp2 = 0.20, 1-β (power) = 0.99) and a significant interaction of audio motion × temporal delay (F (6, 114) = 4.20, p = 0.0007, ηp2 = 0.18, 1-β = 0.97, shown in Fig. 2). The other main and interaction effects were not significant (body-relative direction, F (3, 57) = 1.11, p = 0.35, ηp2 = 0.06, 1-β = 0.31; audio motions, F (1, 19) = 0.03, p = 0.87, ηp2 = 0.001, 1-β = 0.05; body-relative directions × audio motions, F (3, 57) = 1.51, p = 0.22, ηp2 = 0.07, 1-β = 0.38; body-relative directions × temporal delays, F (18, 342) = 1.45, p = 0.10, ηp2 = 0.07, 1-β = 0.90; body-relative directions × audio motions × temporal delays, F (18, 342) = 0.81, p = 0.68, ηp2 = 0.04, 1-β = 0.60). The results suggest that the direction of sound relative to the body does not affect the PPS representation.

Figure 2
figure 2

The results of the Experiment RTs (ms) as a function of the temporal delays (ms). Circular and triangular symbols indicate the approaching and receding sounds, respectively. The gray area indicates the timing of the pink-noise emission. Error bars represent standard errors.

Differences in peri-trunk PPS between approaching and receding sounds

To compare the peri-trunk PPS for the approaching and receding sounds, we conducted an analysis of simple main effects for the significant interaction of audio motions × temporal delays (Fig. 3). The analysis revealed that the mean RTs for the approaching sound were significantly slower than for the receding sound at T1 (525 ms vs 509 ms; F (1, 19) = 5.08, p = 0.036, ηp2 = 0.21, 1-β = 0.57) and T2 (521 ms vs 495 ms; F (1, 19) = 11.3, p = 0.003, ηp2 = 0.37, 1-β = 0.89), while the RTs for the approaching sound were significantly faster than for the receding sound at T5 (483 ms vs 500 ms; F (1, 19) = 8.60, p = 0.009, ηp2 = 0.31, 1-β = 0.79). The results indicated that observers responded to the tactile stimulus faster when the sound position was close to the observers than when the sound position was further away. Thus, the participants could integrate multisensory stimuli (tactile and task-irrelevant audio stimuli) near the body.

Figure 3
figure 3

The results of the Experiment RTs (ms) as a function of the temporal delays (ms). The four direction conditions (front, rear, left, and right) were merged. The description of the figure is the same as in Fig. 2. The error bars represent standard errors. Asterisks represent significant differences (p < .05) between the RTs for the approaching sound and the receding sounds as a result of multiple comparisons (Shaffer's modified sequentially rejective Bonferroni procedure).

Effect of temporal delays on peri-trunk PPS at approaching or receding sounds

The analysis of simple main effects also revealed that the mean RTs for temporal delays in the approaching and receding sounds were significantly different (approaching: F (6, 114) = 6.10, p < 0.0001, ηp2 = 0.24, 1-β = 0.99, receding: F (6, 114) = 3.45, p = 0.004, ηp2 = 0.15, 1-β = 0.93). Post hoc tests (Shaffer's modified sequentially rejective Bonferroni procedure) of the interaction revealed that the mean RTs for the approaching sound at T5 (483 ms) were significantly faster than at T1 (525 ms) and T2 (521 ms) compared to bimodal conditions (T1–T5). In contrast, there were no significant differences between bimodal conditions for the receding sound. These results indicate that the effect of PPS in the receding sound was never or weaker than that in the approaching sound, which is consistent with the results of previous studies42,52.

The analysis also revealed that the RTs for the approaching sound on Tbefore (537 ms) were significantly slower than on Tafter (491 ms), and RTs for the receding sound at Tbefore (543 ms) were significantly slower than those for T2 (495 ms) and Tafter (500 ms).

Exploratory analysis on the approaching sound PPS

To investigate the PPS effect of the approaching sound in four directions, we conducted exploratory analyses. First, two-way repeated measures ANOVA was conducted on the mean RTs in four body-relative directions (front, rear, left, and right) and five temporal delays (bimodal condition: T1, T2, T3, T4, and T5), for only the approaching sound condition. The ANOVA revealed a significant main effect of temporal delays (F (4, 76) = 6.79, p = 0.0001, ηp2 = 0.26, 1-β = 0.99). The other main and interaction effects were not significant (body-relative directions, F (3, 57) = 1.38, p = 0.26, ηp2 = 0.07, 1-β = 0.36; body-relative directions × temporal delays, F (12, 228) = 0.85, p = 0.60, ηp2 = 0.04, 1-β = 0.49). Second, one-way repeated measures ANOVA was conducted on the mean RTs with five temporal delays (bimodal condition: T1, T2, T3, T4, and T5) separately for each of the four directions (front, rear, left, and right), for only the approaching sound condition. The ANOVA revealed a significant main effect of temporal delays in front (F (4, 76) = 5.12, p = 0.001, ηp2 = 0.21, 1-β = 0.95) and left space (F (4, 76) = 6.54, p = 0.0001, ηp2 = 0.26, 1-β = 0.99), while the main effects of temporal delays were not significant in the rear (F (4, 76) = 1.12, p = 0.35, ηp2 = 0.06, 1-β = 0.36) or right (F (4, 76) = 1.78, p = 0.14, ηp2 = 0.09, 1-β = 0.54) directions. These results indicate that the PPS might be affected by the direction, and clearer in the front and left directions than in the rear and right directions. However, we did not find a significant interaction of the direction and the time delay with two-way repeated measures ANOVA, as mentioned above.

To investigate the PPS in each direction in detail, two further analyses were conducted. First, the sigmoidal function was fitted to RTs against temporal delays for the average data across observers. The function is described by the following equation:

$$y\left(x\right)=\frac{{y}_{min}+{y}_{max}\cdot {e}^{\left(x-{x}_{c}\right)/b}}{1+{e}^{\left(x-{x}_{c}\right)/b}}$$

where xc represents the value of the abscissa at the central point of the function and b represents the slope of the function at the central point29,42. The slope of the sigmoidal function is large when the absolute value of b is small. Table 1 shows the slopes of the sigmoid function for each condition. The absolute b values in the front and left conditions were smaller than those in the rear and right conditions. Namely, the slopes of the sigmoidal function in the front and left conditions were larger than those in the rear and right conditions. Second, the sigmoidal function was fitted for each observer, and we calculated the coefficient of determination (R2) for the sigmoidal function, based on the analysis of Serino et al. (2018)37. Figure 4 shows the number of observers with R2 higher than 0.50. We found that the number of observers showed that the clear PPS (higher R2) was less in the rear direction than in the other three directions. Taken together, the results of the present study suggest that the PPS of the front and left directions might be stronger while the PPS of the rear might be weaker, although the analysis was exploratory.

Table 1 The data of slopes of the sigmoidal function (b) in each direction.
Figure 4
figure 4

The number of observers (N) of all 20 participants (N/20) and its percentage (%) with R2 (coefficient of determination for the sigmoidal function) higher than 0.5 for each body-relative direction for the approaching sound condition. The results of Table 1 and these results, taken together, imply that the PPS in the front and left directions might be stronger while the PPS of the rear might be weaker.

Discussion

Tactile detection was facilitated by task-irrelevant approaching sounds in the near body space rather than by receding sounds in all four directions (front, rear, left, and right). We did not find any significant differences in the directions of the PPS representation (front, rear, left, and right). These results suggest that humans integrate multisensory information in near-circular peri-trunk PPS around the body, and that integration occurs with approaching sounds.

Physiological and behavioral studies on humans and non-human primates have shown that approaching stimuli (for example, visual and auditory stimuli) in near space increase sensitivity to different sensory modalities (for example, tactile stimuli)29,30,43,54,55. The cortical network that processes approaching visual stimuli in the PPS to predict the consequences of these stimuli has been identified56,57. These findings are supported by an ecological perspective; the approaching stimulus contributes to detecting a danger or a predator approaching humans or animals as an information alert and predicting its timing55,56,57. Our findings are also consistent with these studies. Tactile detection was facilitated by approaching sounds in the near body space, but the effects of PPS in the receding sound were weaker than those in the approaching sound. This suggests that a receding event, even though happening in the near space around humans, would not facilitate the detection of the event in different sensory modalities. This is because the event is receding, and hence is not considered to involve humans in the near future.

One might argue that the sound provided temporal alerting information even though the sound was designed as a task-irrelevant stimulus. Particularly, the approaching stimulus can be an alert of an event approaching and contribute to predicting its timing, as discussed in the previous paragraph. However, we instructed the participants to neglect the sound and respond only to the tactile stimulus so that the sound was defined as a task-irrelevant stimulus. Moreover, the tactile stimulus was not presented in 30% of the trials and was presented before the sound in the Tbefore condition. For the sound to be used as a temporal timing indicator, the RTs of the Tbefore condition must have been longer than the bimodal conditions (T1–T5). We did not find significant differences between bimodal and unimodal conditions, except between Tbefore and T2 for the receding sound. Thus, it is unlikely that the sound contributed to the prediction of the timing of the tactile stimulus, particularly in the approaching sound condition.

We placed the vibrator on the chest (upper front part of the body) in all directions (front, rear, left, and right). Thus, one might expect the facilitation of tactile detection to occur only in the front condition; however, we found facilitation in all directions. It is suggested that the PPS representation is nearly circular around the trunk of the body. A previous study indicated that the peri-trunk PPS was distributed in a relatively large space without a difference between the front and rear of the trunk52. Our results support this hypothesis.

By using both approaching and receding stimuli, one may argue that tactile stimulus expectancy could be used to interpret the results of the study. Indeed, some previous studies have indicated that expectancy occurred under the experimental method we used (called expectancy effect58). This could explain why Tafter was faster than Tbefore. If the expectancy effect modulates the tactile detection in bimodal conditions, it conflicts with the effect of the PPS representation with receding sounds. In our results, the effect of the PPS with receding sounds was weaker than that with approaching sounds. Thus, our results would be caused not only by the PPS representation but also the expectancy effect. However, the false alarm rate in the catch trials (the ratio of participants’ responses without tactile stimulus) was very low in this study. Therefore, the expectancy effect was almost suppressed in the results of our study. Nevertheless, the advantage of approaching sounds could be explained by the ecological validity of the approaching sound. The looming or approaching stimuli are more likely to be relevant to, or ecologically important for humans and non-human primates than the descending or receding stimuli, and an attentional bias toward approaching stimuli is stronger than the receding stimuli (e.g.,9,14,59,60,61,62). This is an open question that needs further investigation.

Specific cortical processes for encoding near and far spaces have been investigated using humans and non-human primates, and compared between humans and non-human primates or between species57,63,64. Guipponi et al. (2013)64 have shown that the VIP area of macaques processes moving objects around and towards the face regardless of the sensory modality and argued that there is a strong homology between the VIP organizations of macaques and humans. Although there is a difference in the body part studied between their study and our study (face vs. trunk), we showed that humans also responded sensitively in the near space to the approaching stimulus. However, it is unclear whether the cortical network for humans is the same as that for monkeys, as this study did not take a neurological approach. In fact, it has been shown that there may be species differences between monkeys and humans63. This is one of the research topics that we should pay attention to in the future.

Finally, this study has some limitations. We focused on the relatively near space (10–110 cm) in four directions at chest height (sternum level) to represent the peripersonal space. We thus measured only the peri-trunk PPS. However, various body parts (hands, arms, and head; see review paper in detail65) also modulate the boundary of the PPS. Thus, our results cannot be applied to the PPS of other body parts, and this should be therefore investigated in a future study. A recent study has questioned the existence of audio-tactile interactions in the peripersonal space66. Thus, the conditions of emerging effects of peripersonal space are limited by various factors and stimulus parameters; therefore, we must be careful to compare different studies, and systematic pre-registered studies are required in the future. Another limitation was that a blocked design was used in the current study. The body-relative direction of the sound was constant at either the front, rear, left, or right in each block. It should be investigated with a trial-by-trial design in future studies because some cognitive phenomena do not occur in a blocked design. For example, attentional cueing effects only occur when stimulus location varies on a trial-by-trial basis67. In the future, it would be useful to investigate the PPS representation under the condition that participants cannot predict where the sound located. The tactile stimulus was presented to the front of the chest in all conditions to control sensitivity of touch. However, one may argue that the tactile stimulus should be presented at the trunk in the same direction as the auditory stimulus (e.g., vibration to the right side of the trunk when the sound moves to the right). All directional PPS can be investigated in this manner if we can equalize the strength of tactile stimuli in participants’ sensitivity at various surfaces of the trunk. We have investigated PPS representations in four directions (front, rear, left, right), but not in the up and down directions. PPS representations in three-dimensional space should be investigated in future studies because audio information is available in all directions.

Methods

Participants

Twenty observers (all male) aged 19–26 (mean 22.3, SD 1.9) years with a healthy auditory and tactile perception participated in the experiment. All volunteers provided written informed consent before the experiment. This study was approved by the Ethical Committee on Human-Subject Studies of Toyohashi University of Technology, and all methods were carried out in accordance with relevant guidelines and regulations. The sample size was based on previous studies in which a similar measurement of PPS was used42. This sample size corresponds to an effect size (f) of 0.12 (ηp2 = 0.015), an alpha of 0.05, and power of 0.95 using G*Power 3.168,69.

Stimuli

We adopted the audio-tactile task to measure the PPS representation developed by Canzoneri et al. (2012)42; participants responded as quickly as possible when approaching or receding sounds resulted in a tactile stimulus on their chest. We used Unity 5.6.1f1 in a computer to control the experimental sequence.

Audio stimuli

Audio stimuli were created by a pink noise (44.1 kHz) that moved toward the observer (approaching sound) and a sound that moved away from the observer (receding sound) for 3,000 ms. We used two loudspeakers (JBL, Control 1 Pro): one was placed close to the participant’s body at a distance of 10 cm, while the other was placed at a distance of 110 cm (Fig. 5a). The loudspeakers were placed at chest height (sternum level). The two loudspeakers were used to present the moving sound. The sound pressure level increased and decreased exponentially in the range of 55–70 dBA for the approaching sound and decreased for the receding sound, respectively. The pink noise moved in a linear uniform motion at 33.3 cm/s between 10 and 110 cm for 3000 ms.

Figure 5
figure 5

Experimental design. (a) Layout of the loudspeakers and observers. (b) Direction to the loudspeakers.

Tactile stimuli

In 70% of the trials, the tactile stimulus (a linear vibration actuator Nidec LD14-002) was controlled by the Arduino UNO and presented on the observer’s chest for 24 ms. To eliminate the effect of sensitivity differences for the tactile stimulus (chest, back, and shoulder), the actuator was always placed on the participant’s chest with surgical tape.

There were seven different temporal delays (Tbefore, T1, T2, T3, T4, T5, and Tafter). The T1–T5 tactile stimuli were set at 300, 800, 1500, 2200, and 2700 ms from the sound onset. The Tbefore and Tafter tactile stimuli were set 700 ms before the sound onset and 700 ms after the sound offset, respectively. We confirmed that the observers could perceive the vibration before the experiment.

Conditions

To measure the PPS representations separately in four directions, observers sat on a stool facing a different direction (front, rear, left, or right) to the loudspeakers in each block (Fig. 5b). Thus, the experiment consisted of four blocks. One block was composed of three different trials: bimodal, unimodal, and catch trials. Half (50%) of all the trials were bimodal trials, in which the tactile stimulus was presented with an audio stimulus (2 audio motions (approaching/ receding) × 5 temporal delays (T1-T5) × 10 repetitions = 100 trials); 20% of all trials were unimodal trials, in which the tactile stimulus was presented without audio stimulus (2 audio motions × 2 temporal delays (Tbefore/Tafter) × 10 repetitions = 40 trials); 30% of all trials were catch trials (to avoid easy prediction of timing of given tactile stimulus, see Discussion in detail), in which the tactile stimulus was not presented (60 trials). A block was composed of 200 trials (100 bimodal trials + 40 unimodal trials + 60 catch trials). Thus, observers performed 800 trials (200 trials/block × 4 different body-relative direction) in total.

Procedure

Participants sat on a stool and blindfolded during the experiment. They were instructed to detect the tactile stimulus on the chest, irrespective of the auditory stimulus, and respond as quickly as possible. They were also instructed not to respond without tactile stimulus (catch trials).

There were breaks after every 50 trials and between blocks. It took approximately 33 min to pass through each block. It took approximately 2.5 h to complete all four blocks. The order of the blocks was counterbalanced among participants, and the order of the trials in each block was randomized.

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Làdavas, E. & Serino, A. Action-dependent plasticity in peripersonal space representations. Cogn. Neuropsychol. 25, 1099–1113. https://doi.org/10.1080/02643290802359113 (2008).

    Article  PubMed  Google Scholar 

  2. Rizzolatti, G., Fadiga, L., Fogassi, L. & Gallese, V. The space around us. Science 277, 190–191. https://doi.org/10.1126/science.277.5323.190 (1997).

    CAS  Article  PubMed  Google Scholar 

  3. Cavada, C. & Goldman-Rakic, P. S. Posterior parietal cortex in rhesus monkey: II. Evidence for segregated corticocortical networks linking sensory and limbic areas with the frontal lobe. J. Comp. Neurol. 287, 422–445. https://doi.org/10.1002/cne.902870403 (1989).

    CAS  Article  PubMed  Google Scholar 

  4. Duhamel, J. R., Colby, C. L. & Goldberg, M. E. Ventral intraparietal area of the macaque: Congruent visual and somatic response properties. J. Neurophysiol. 79, 126–136. https://doi.org/10.1152/jn.1998.79.1.126 (1998).

    CAS  Article  PubMed  Google Scholar 

  5. Gentilucci, M. et al. Functional organization of inferior area 6 in the macaque monkey—I. Somatotopy and the control of proximal movements. Exp. Brain Res. 71, 475–490. https://doi.org/10.1007/BF00248741 (1988).

    CAS  Article  PubMed  Google Scholar 

  6. Gentilucci, M., Scandolara, C., Pigarev, I. N. & Rizzolatti, G. Visual responses in the postarcuate cortex (area 6) of the monkey that are independent of eye position. Exp. Brain Res. 50, 464–468. https://doi.org/10.1007/BF00239214 (1983).

    CAS  Article  PubMed  Google Scholar 

  7. Graziano, M. S. & Gross, C. G. A bimodal map of space: somatosensory receptive fields in the macaque putamen with corresponding visual receptive fields. Exp. Brain Res. 97, 96–109. https://doi.org/10.1152/jn.1998.79.1.126 (1993).

    CAS  Article  PubMed  Google Scholar 

  8. Graziano, M. S. & Gross, C. G. The representation of extrapersonal space: A possible role for bimodal, visual-tactile neurons. In The Cognitive Neurosciences 1021–1034 (ed. M. S. Gazzaniga) (The MIT Press, 1995).

  9. Graziano, M. S., Hu, X. T. & Gross, C. G. Visuospatial properties of ventral premotor cortex. J. Neurosci. 77, 2268–2292. https://doi.org/10.1152/jn.1997.77.5.2268 (1997).

    CAS  Article  Google Scholar 

  10. Rizzolatti, G., Scandolara, C., Matelli, M. & Gentilucci, M. Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses. . Behav. Brain Res. 2, 147–163. https://doi.org/10.1016/0166-4328(81)90053-X (1981).

    CAS  Article  PubMed  Google Scholar 

  11. Graziano, M. S., Reiss, L. A. & Gross, C. G. A neuronal representation of the location of nearby sounds. Nature 397, 428–430. https://doi.org/10.1038/17115 (1999).

    ADS  CAS  Article  PubMed  Google Scholar 

  12. Schlack, A., Sterbing-D’Angelo, S. J., Hartung, K., Hoffmann, K. P. & Bremmer, F. Multisensory space representations in the macaque ventral intraparietal area. J. Neurosci. 25, 4616–4625. https://doi.org/10.1523/JNEUROSCI.0455-05.2005 (2005).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  13. Graziano, M. S. & Cooke, D. F. Parieto-frontal interactions, personal space, and defensive behavior. Neuropsychologia 44, 845–859. https://doi.org/10.1016/j.neuropsychologia.2005.09.011 (2006).

    Article  PubMed  Google Scholar 

  14. Fogassi, L. et al. Coding of peripersonal space in inferior premotor cortex (area F4). J. Neurosci. 76, 141–157. https://doi.org/10.1152/jn.1996.76.1.141 (1996).

    CAS  Article  Google Scholar 

  15. Iriki, A., Tanaka, M. & Iwamura, Y. Coding of modified body schema during tool use by macaque postcentral neurones. NeuroReport 7, 2325–2330. https://doi.org/10.1097/00001756-199610020-00010 (1996).

    CAS  Article  Google Scholar 

  16. Holmes, N. & Spence, C. The body schema and multisensory representation(s) of peripersonal space. Cogn. Process. 5, 94–105. https://doi.org/10.1007/s10339-004-0013-3 (2004).

    Article  PubMed  PubMed Central  Google Scholar 

  17. Ackroyd, K., Riddoch, M. J., Humphreys, G. W., Nightingale, S. & Townsend, S. Widening the sphere of influence: Using a tool to extend extrapersonal visual space in a patient with severe neglect. Neurocase 8, 1–12. https://doi.org/10.1093/neucas/8.1.1 (2002).

    Article  PubMed  Google Scholar 

  18. Berti, A. & Frassinetti, F. When far becomes near: Remapping of space by tool use. J. Cogn. Neurosci. 12, 415–420. https://doi.org/10.1162/089892900562237 (2000).

    CAS  Article  PubMed  Google Scholar 

  19. Galli, G., Noel, J. P., Canzoneri, E., Blanke, O. & Serino, A. The wheelchair as a full-body tool extending the peripersonal space. Front. Psychol. 6, 639. https://doi.org/10.3389/fpsyg.2015.00639 (2015).

    Article  PubMed  PubMed Central  Google Scholar 

  20. Longo, M. R. & Lourenco, S. F. On the nature of near space: Effects of tool use and the transition to far space. Neuropsychologia 44, 977–981. https://doi.org/10.1016/j.neuropsychologia.2005.09.003 (2006).

    Article  PubMed  Google Scholar 

  21. Lourenco, S. F. & Longo, M. R. The plasticity of near space: Evidence for contraction. Cognition 112, 451–456. https://doi.org/10.1016/j.cognition.2009.05.011 (2009).

    Article  PubMed  PubMed Central  Google Scholar 

  22. Bufacchi, R. J. & Iannetti, G. D. Gravitational cues modulate the shape of defensive peripersonal space. Curr. Biol. 26, 1133–1134. https://doi.org/10.1016/j.cub.2016.09.025 (2016).

    CAS  Article  Google Scholar 

  23. Pfeiffer, C., Noel, J. P., Serino, A. & Blanke, O. Vestibular modulation of peripersonal space boundaries. Eur. J. Neurosci. 47, 800–811. https://doi.org/10.1111/ejn.13872 (2018).

    Article  PubMed  Google Scholar 

  24. Noel, J. P. et al. Full body action remapping of peripersonal space: The case of walking. Neuropsychologia 70, 375–384. https://doi.org/10.1016/j.neuropsychologia.2014.08.030 (2015).

    Article  Google Scholar 

  25. Amemiya, T., Ikei, Y. & Kitazaki, M. Remapping peripersonal space by using foot-sole vibrations without any body movement. Psychol. Sci. 30, 1522–1532. https://doi.org/10.1177/0956797619869337 (2019).

    Article  PubMed  Google Scholar 

  26. Brozzoli, C., Pavani, F., Urquizar, C., Cardinali, L. & Farne, A. Grasping actions remap peripersonal space. NeuroReport 20, 913–917. https://doi.org/10.1097/WNR.0b013e32832c0b9b (2009).

    Article  PubMed  Google Scholar 

  27. de Haan, A. M., Smit, M., Van der Stigchel, S. & Dijkerman, H. C. Approaching threat modulates visuotactile interactions in peripersonal space. Exp. Brain Res. 234, 1875–1884. https://doi.org/10.1007/s00221-016-4571-2 (2016).

    Article  PubMed  PubMed Central  Google Scholar 

  28. Taffou, M. & Viaud-Delmon, I. Cynophobic fear adaptively extends peri-personal space. Front. Psychiatry 5, 122. https://doi.org/10.3389/fpsyt.2014.00122 (2014).

    Article  PubMed  PubMed Central  Google Scholar 

  29. Teneggi, C., Canzoneri, E., di Pellegrino, G. & Serino, A. Social modulation of peripersonal space boundaries. Curr. Biol. 23, 406–411. https://doi.org/10.1016/j.cub.2013.01.043 (2013).

    CAS  Article  PubMed  Google Scholar 

  30. Maister, L., Cardini, F., Zamariola, G., Serino, A. & Tsakiris, M. Your place or mine: Shared sensory experiences elicit a remapping of peripersonal space. Neuropsychologia 70, 455–461. https://doi.org/10.1016/j.neuropsychologia.2014.10.027 (2015).

    Article  Google Scholar 

  31. Hobeika, L., Taffou, M. & Viaud-Delmon, I. Social coding of the multisensory space around us. R. Soc. Open Sci. 6, 181878. https://doi.org/10.1098/rsos.181878 (2019).

    ADS  Article  PubMed  PubMed Central  Google Scholar 

  32. Serino, A., Bassolino, M., Farne, A. & Ladavas, E. Extended multisensory space in blind cane users. Psychol. Sci. 18, 642–648. https://doi.org/10.1111/j.1467-9280.2007.01952.x (2007).

    Article  PubMed  Google Scholar 

  33. Holmes, N. P., Calvert, G. A. & Spence, C. Tool use changes multisensory interactions in seconds: Evidence from the crossmodal congruency task. Exp. Brain Res. 183, 465–476. https://doi.org/10.1007/s00221-007-1060-7 (2007).

    Article  PubMed  PubMed Central  Google Scholar 

  34. Noel, J. P. et al. Rapid recalibration of peri-personal space; Psychophysical, electrophysiological, and neural network modeling evidence. Cereb. Cortex. 30, 5088–5106. https://doi.org/10.1093/cercor/bhaa103 (2020).

    Article  PubMed  PubMed Central  Google Scholar 

  35. Iachini, T. et al. Peripersonal and interpersonal space in virtual and real environments: Effects of gender and age. J. Environ. Psychol. 45, 154–164. https://doi.org/10.1016/j.jenvp.2016.01.004 (2016).

    Article  Google Scholar 

  36. Noel, J. P., Pfeiffer, C., Blanke, O. & Serino, A. Peripersonal space as the space of the bodily self. Cognition 144, 49–57. https://doi.org/10.1016/j.cognition.2015.07.012 (2015).

    Article  PubMed  PubMed Central  Google Scholar 

  37. Serino, A. et al. Peripersonal space: An index of multisensory body–environment interactions in real, virtual, and mixed realities. Front. ICT 4, 31. https://doi.org/10.3389/fict.2017.00031 (2018).

    Article  Google Scholar 

  38. Ho, C., Spence, C. & Gray, R. Looming auditory and vibrotactile collision warnings for safe driving. In Proceedings of the 7th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, 551–557. https://doi.org/10.17077/drivingassessment.1540 (2013).

  39. Lee, J. & Spence, C. Audiovisual crossmodal cuing effects in front and rear space. Front. Psychol. Cogn. Sci. 6, 1086. https://doi.org/10.3389/fpsyg.2015.01086 (2015).

    Article  Google Scholar 

  40. Meng, F., Ho, C., Gray, R. & Spence, C. Dynamic vibrotactile signals for forward collision avoidance: Toward the torso vs toward the head. Ergonomics 58, 411–425. https://doi.org/10.1177/0018720814542651 (2015).

    Article  PubMed  Google Scholar 

  41. Spence, C., Lee, J. & van der Stoep, N. Responding to sounds from unseen locations: Crossmodal attentional orienting in response to sounds presented from the rear. Eur. J. Neurosci. 51, 1137–1150. https://doi.org/10.1111/ejn.13733 (2017).

    Article  PubMed  Google Scholar 

  42. Canzoneri, E., Magosso, E. & Serino, A. Dynamic sounds capture the boundaries of peripersonal space representation in humans. PLoS ONE 7, e44306. https://doi.org/10.1371/journal.pone.0044306 (2012).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  43. Ho, C. & Spence, C. Using peripersonal warning signals to orient a driver’s gaze. Hum. Factors 51(539–556), 2009. https://doi.org/10.1177/0018720809341735 (2009).

    Article  Google Scholar 

  44. Occelli, V., Hartcher-O’Brien, J., Spence, C. & Zampini, M. Assessing the audiotactile Colavita effect in near and rear space. Exp. Brain. Res. 203, 517–532. https://doi.org/10.1007/s00221-010-2255-x (2010).

    Article  PubMed  Google Scholar 

  45. Van der Stoep, N., Nijboer, T. C. W., Van der Stigchel, S. & Spence, C. Multisensory interactions in the depth plane in front and rear space: A review. Neuropsychologia 70, 335–349. https://doi.org/10.1016/j.neuropsychologia.2014.12.007 (2015).

    Article  PubMed  Google Scholar 

  46. Zampini, M., Torresan, D., Spence, C. & Murray, M. M. Audiotactile multisensory interactions in front and rear space. Neuropsychologia 45, 1869–1877. https://doi.org/10.1016/j.neuropsychologia.2006.12.004 (2007).

    Article  PubMed  Google Scholar 

  47. Farnè, A. & Làdavas, E. Auditory peripersonal space in humans. J. Cogn. Neurosci. 14, 1030–1043. https://doi.org/10.1162/089892902320474481 (2002).

    Article  PubMed  Google Scholar 

  48. Kitagawa, N., Zampini, M. & Spence, C. Audiotactile interactions in near and far space. Exp. Brain Res. 166, 528–537. https://doi.org/10.1007/s00221-005-2393-8 (2005).

    Article  PubMed  Google Scholar 

  49. Hunley, S. B. & Lourenco, S. F. What is peripersonal space? An examination of unresolved empirical issues and emerging findings. Wiley Interdiscip. Rev. Cogn. Sci. 9, e1472. https://doi.org/10.1002/wcs.1472 (2018).

    Article  PubMed  Google Scholar 

  50. Gillmeister, H. & Forster, B. Hands behind your back: Effects of arm posture on tactile attention in the space behind the body. Exp. Brain Res. 216, 489–497. https://doi.org/10.1007/s00221-011-2953-z (2012).

    Article  PubMed  Google Scholar 

  51. Kóbor, I., Füredi, L., Kovács, G., Spence, C. & Vidnyánszky, Z. Back-to-front: Improved tactile discrimination performance in the space you cannot see. Neurosci. Lett. 400, 163–167. https://doi.org/10.1016/j.neulet.2006.02.037 (2006).

    CAS  Article  PubMed  Google Scholar 

  52. Serino, A. et al. Body part-centered and full body-centered peripersonal space representations. Sci. Rep. 5, 18603. https://doi.org/10.1038/srep18603 (2015).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  53. Hobeika, L., Viaud-Delmon, I. & Taffou, M. Anisotropy of lateral peripersonal space is linked to handedness. Exp. Brain Res. 236, 609–618. https://doi.org/10.1007/s00221-017-5158-2 (2018).

    Article  PubMed  Google Scholar 

  54. Cléry, J., Guipponi, O., Odouard, S., Wardak, C. & Hamed, S. B. Impact prediction by looming visual stimuli enhances tactile detection. J. Neurosci. 35, 4179–4189. https://doi.org/10.1523/JNEUROSCI.3031-14.2015 (2015).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  55. Kandula, M., Hofman, D. & Dijkerman, H. C. Visuo-tactile interactions are dependent on the predictive value of the visual stimulus. Neuropsychologia 70, 358–366. https://doi.org/10.1016/j.neuropsychologia.2014.12.008 (2015).

    Article  PubMed  Google Scholar 

  56. Cléry, J. et al. The prediction of impact of a looming stimulus onto the body is subserved by multisensory integration mechanisms. J. Neurosci. 37, 10656–10670. https://doi.org/10.1523/JNEUROSCI.0610-17.2017 (2017).

    Article  PubMed  PubMed Central  Google Scholar 

  57. Cléry, J. C. et al. Looming and receding visual networks in awake marmosets investigated with fMRI. Neuroimage 215, 116815. https://doi.org/10.1016/j.neuroimage.2020.116815 (2020).

    Article  PubMed  Google Scholar 

  58. Kandula, M., Van der Stoep, N., Hofman, D. & Dijkerman, H. C. On the contribution of overt tactile expectations to visuo-tactile interactions within the peripersonal space. Exp. Brain Res. 235, 2511–2522. https://doi.org/10.1007/s00221-017-4965-9 (2017).

    Article  PubMed  PubMed Central  Google Scholar 

  59. Hall, D. A. & Moore, D. R. Auditory neuroscience: The salience of looming sounds. Curr. Biol. 13, 91–93. https://doi.org/10.1016/S0960-9822(03)00034-4 (2003).

    Article  Google Scholar 

  60. Kawahara, J., Yanase, K. & Kitazaki, M. Attentional capture by the onset and offset of motion signals outside the spatial focus of attention. J. Vis. 12, 1–13. https://doi.org/10.1167/12.12.10 (2012).

    Article  Google Scholar 

  61. Schiff, W. Perception of impending collision: A study of visually directed avoidant behavior. Psychol. Monogr: Gen. Appl. 79, 1–26. https://doi.org/10.1037/h0093887 (1965).

    Article  Google Scholar 

  62. Tajadura-Jiménez, A., Väljamäe, A., Asutay, E. & Västfjäll, D. Embodied auditory perception: The emotional impact of approaching and receding sound sources. Emotion 10, 216–229. https://doi.org/10.1037/a0018422 (2010).

    Article  PubMed  Google Scholar 

  63. Cléry, J., Guipponi, O., Odouard, S., Wardak, C. & Hamed, S. B. Cortical networks for encoding near and far space in the non-human primate. Neuroimage 176, 164–178. https://doi.org/10.1016/j.neuroimage.2018.04.036 (2018).

    Article  PubMed  Google Scholar 

  64. Guipponi, O. et al. Multimodal convergence within the intraparietal sulcus of the macaque monkey. J. Neurosci. 33, 4128–4139. https://doi.org/10.1523/JNEUROSCI.1421-12.2013 (2013).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  65. di Pellegrino, G. & Làdavas, E. Peripersonal space in the brain. Neuropsychologia 66, 126–133. https://doi.org/10.1016/j.neuropsychologia.2014.11.011 (2015).

    Article  Google Scholar 

  66. Holmes, N. P., Martin, D., Mitchell, W., Noorani, Z. & Thorne, A. Do sounds near the hand facilitate tactile reaction times? Four experiments and a meta-analysis provide mixed support and suggest a small effect size. Exp. Brain. Res. 238, 995–1009. https://doi.org/10.1007/s00221-020-05771-5 (2020).

    Article  PubMed  PubMed Central  Google Scholar 

  67. Posner, M. I., Snyder, C. R. & Davidson, B. J. Attention and the detection of signals. J. Exp. Psychol. Gen. 109, 160–174. https://doi.org/10.1037/0096-3445.109.2.160 (1980).

    CAS  Article  Google Scholar 

  68. Faul, F., Erdfelder, E., Lang, A. G. & Buchner, A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175–191. https://doi.org/10.3758/BF03193146 (2007).

    Article  Google Scholar 

  69. Faul, F., Erdfelder, E., Buchner, A. & Lang, A. G. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods. 1, 1149–1160. https://doi.org/10.3758/BRM.41.4.1149 (2009).

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported in part by the JST ERATO Grant Number JPMJER1701 (Inami JIZAI Body Project) and JSPS KAKENHI JP20H04489. We would like to thank Editage (www.editage.jp) for English language editing.

Author information

Authors and Affiliations

Authors

Contributions

Y.M., M.K., M.S., and M.I. conceived and designed the experiments. Y.M. collected and analyzed the data. Y.M. and M.K. contributed to the preparation of the manuscript. All authors have reviewed the manuscript.

Corresponding author

Correspondence to Yusuke Matsuda.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Matsuda, Y., Sugimoto, M., Inami, M. et al. Peripersonal space in the front, rear, left and right directions for audio-tactile multisensory integration. Sci Rep 11, 11303 (2021). https://doi.org/10.1038/s41598-021-90784-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1038/s41598-021-90784-5

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing