Introduction

In addition to loss of function, limb amputations pose a significant threat to a person’s body image. The body image represents the perceptual, conceptual, and emotional aspects of our bodies in our mind1. Limb loss immediately affects the perceptual and conceptual representation; the stored structural description of the body substantially mismatches the received visual and somatosensory feedback. Moreover, the exclusion from social rituals like handshaking, and prejudicial attitudes towards disabilities, can damage the emotional aspects of the body image and lead to a negative relation towards a missing limb. A distorted body image has also been correlated with “decreased life satisfaction, quality of life, activity levels, and overall psychological adjustment”2. One possibility to restore a distorted body image, and its related social and psychological consequences after limb amputation, might be the use of a prosthetic limb as substitute for the lost limb.

The use of highly sophisticated prosthetic limbs, offering natural aesthetics and increased functionality to reenable participation in social life, may improve the conceptual and emotional elements of the body image. One of the most promising advances to address the third element of the distorted body image—the perceptual aspects—is the restoration of sensory feedback. Different deployed strategies to this end include sensory substitution3,4, targeted sensory reinnervation5, and direct nerve stimulation6,7,8. A prosthesis offering intuitive and natural sensory feedback could achieve the shift from being perceived as just a technical device, to replacing the missing afferent sensory information and thus restore the user’s body image.

Experimental paradigms to evaluate differences between sensory feedback strategies are needed to evaluate the efficacy of such strategies. However, directly measuring the body image—an abstracted model of how the body is presented in the mind—has proven to be difficult. Nevertheless, one route to assess a change in the body image is by studying the sense of ownership (hereinafter referred as ownership)9.

Ownership is an aspect of self-awareness related to experiencing parts of our body belonging to ourselves. Ownership over a body part can be experienced regardless of whether said body part is at rest or in motion, and whether or not movement is under one's owns volition (as opposed to agency). One of the most prominent theories of how ownership emerges is a neurocognitive model based on a top-down account10. In the example of a prosthesis, the model first compares the visual congruency of the prosthesis to a concept of a biological limb (or a prosthesis11) stored in the body image. In a second step, the postural features of the prosthesis are compared to the current body posture. Multisensory integration of available afferent information is the last step within the model. If all three comparators match, ownership over the prosthesis arises. This neurocognitive model was later extended with ideas of predictive coding12, which stipulates that if there are inconsistencies between the received sensory feedback and the predictions based on body image, for example, the representation of the body in the brain is updated to minimize said inconsistencies.

Whereas functional advantages of restoring sensory perception should be evaluated in experimental conditions as close to the real-life use of the prosthesis as possible, disentangling confounding factors could be advantageous when studying properties specifically related to sensory feedback. A non-agentic experiment excludes confounding variables such as algorithms for decoding motor volition, the fixation of the prosthesis to the residual limb, and the proficiency in using a prosthetic device. These variables would otherwise play a considerable role in how a prosthesis is perceived and thereby influence prosthetic ownership. An established method to examine ownership in a non-agentic setting is the rubber hand illusion (RHI)13, where two brushes are used to stimulate both a rubber- and a participant’s own hand with brush strokes. The biological hand is shielded from view during the experiment, so that the rubber hand visually appears to replace the biological hand. If the visuo-tactile stimuli were perceived synchronously (this happens when the two brushes stroke synchronously) most participants reported ownership over the rubber hand. Asynchronous stimulation, however, does not lead to ownership reports of the rubber hand.

An increasing number of studies have shown that the ownership sensation can be evoked in amputees using an adapted version of the RHI experiment. Stimulation using a brush14 and vibrators15 on the residual limb, as well as mechanical and vibratory feedback on reinnervated tissue16, has been reported to allow for subjects with amputations to experience ownership of a rubber hand. Studies on using brain stimulation17, light beams18, and temperature19 demonstrated that the same ownership effects can be achieved by artificially evoked tactile feedback. Recently, two case studies with a total of three subjects with a transradial limb amputation reported increased ownership due to direct nerve stimulation during an adapted RHI experiment20,21. Independent replication of these findings is still necessary to establish the prevalence of such phenomenon, particularly considering the low number of subjects studied. In addition, whether similar findings can be observed in higher amputation levels remains an open question.

In this study, we explored the viability of the RHI paradigm as a tool to measure prosthetic ownership in subjects with transhumeral amputation. We recruited four participants who had been implanted with extra-neural electrodes on their severed nerves as part of a novel neuromusculoskeletal prosthetic system8,22. Stimulation of their afferent nerves produced discernable and localized tactile sensations on their phantom hand occupying the space of their prosthetic one8,22,23,24,25. However, elicited sensations via nerve stimulation are not experienced as nuanced or natural as the stroking of a brush24, which is the tactile stimulation normally used to induce the RHI. The perceptual experience elicited by direct nerve stimulation was reported by our participants as a gentle touch or tap on the phantom hand. We attempted to induce the RHI by providing direct nerve stimulation, while the prosthesis was tapped in the perceived location by a robotic tapping device. Contrary to the participants’ reports of strong ownership of their prosthesis in their daily life26, we found that the adapted RHI experiment did not result in induced ownership. We then investigated if tapping as opposed to stroking the rubber hand in 30 able-bodied subjects resulted in induced ownership. Our results indicated that the RHI could be induced comparably well with either stimulus. However, 33% of the subjects did not experienced the RHI with either tactile stimulation modality. The possibility remained that our prosthetic participants belong to the non-respondent group, independently of their amputation. We then confirmed this was the case since the RHI could not be induced in their intact hand. Our investigations suggest that the RHI is not a universally reliable paradigm to study prosthetic ownership, and thus more inclusive experimental paradigms are needed to evaluate and improve sensory feedback strategies.

Methods

Experiment 1: RHI in subjects with amputation

Subjects

Four participants with transhumeral amputation who received an implanted neuromusculoskeletal interface8,22 were recruited for this experiment. The individual participant is referred to by their internal patient IDs, e.g. AR007, hereafter (see Table 1). All participants use an artificial limb controller (ALC)27 integrated into a commercial prosthetic arm for control and sensory feedback in daily life. Neurostimulation built into the ALC allows for current-controlled stimulation pulses (see Tables 2 and 3) to be sent to the implanted cuff electrode to elicit somatosensory feedback. Informed consent in accordance with the Declaration of Helsinki as well as informed consent to publish identifying information was obtained before conducting the experiments from each subject. The study was approved by the Regional Ethical Review Board in Gothenburg (#769–12) and carried out in accordance with the declaration of Helsinki.

Table 1 Demographic overview of the participants with amputation.
Table 2 Standard stimulation parameters.
Table 3 Derived stimulation parameters.

Experimental design

Participants received neural stimulation together with visual feedback synchronously, and asynchronously as a control condition (see Fig. 1a). Elicited sensations using direct neural stimulation differ greatly from the sensation of a brushstroke as in the original RHI experiment13. We elicited perceptive fields on the phantom hand reported as small, confined, and relatively rounded23 (see Fig. 1b), whereas a brush stroke generally stimulates a larger, less defined area. Therefore, we designed a 3D printed tapping device to match the participant's visual experience to the perceptive area, quality, and duration of the sensation elicited via neural stimulation (see Fig. 1c).

Figure 1
figure 1

Experimental setup for participants with limb loss at the transhumeral level. (a) The prosthesis including the stimulation unit was connected directly to the implanted neuromusculoskeletal interface to provide neural sensory stimulation. A 3D printed tapper touched the participants’ prosthesis on the locations where the participants reported the origin of the perceived neural stimulation. (b) Reported perception locations in the phantom hand now occupied by the prosthetic hand (c) 3D printed tapper, actuated by a servomotor (grey).

Participants filled out an adapted version of the RHI questionnaire (see Table 4) after each experimental condition. The questionnaires included a Swedish translation of the questions below the original formulation. A week after the experiment, we asked the participants their agreement on questions regarding ownership at that moment (Q1, Q3, and Q4, Table 4). As an additional control condition, we conducted the conventional RHI experiment13 using a brush for both visuo- and tactile stimulation on the contralateral hand 2–3 weeks after the first RHI experiment using neurostimulation.

Table 4 The standard RHI questionnaire adapted to fit an experiment with tapping stimulation on a rubber hand.

Experiment procedure

The participant was asked to sit at the table and rest both the prosthetic as well as the contralateral arm on the table.

The neurostimulation pulse train was adjusted to stimulate for 1 s (30 pulses at a pulse frequency of 30 Hz) at 20% over the perception threshold (constant amplitude between 80 and 500 μA depending on the participant and a pulse width of 200 μs, determined similarly to Ackerley et al.23). The tapper was programmed to touch the prosthesis for an equal amount of time (1 s). To spatially match the elicited tactile sensation to be visually congruent to the tapper, the participants indicated the perception area resulting from the neurostimulation pulses. The tapper was then positioned to touch on the indicated area. We also calibrated the time delay between the tap and neurostimulation trigger for each participant to ensure perceived simultaneity of the feedback. The perceived simultaneity was calibrated by sending stimulation pulses ± [0, 40, 80, 100, 200, 400, 500, 600, 800, 1000] ms compared to the tap trigger command, and asking the participant to judge if the sensation was perceived before, at the time, or after seeing the tapper touching the prosthesis and thereby determining the temporal binding window28.

Both tactile and visual stimuli were provided once every 2 s, lasting 1 s each. During the one second without stimulation, the tapper moved up and down. In the asynchronous case, the neurostimulation was delayed by 500 ms. A complete stimulation sequence lasted 180 s. A systematic documentation of the stimulation parameters29 can be found in Tables 2 and 3.

The original RHI experiment on the contralateral hand was conducted for 180 s. Both conditions, synchronous and asynchronous, were tested in a random order. The following assignment was obtained for the visuo-neural condition: synchronous (AR007 and AR006) and asynchronous (AL001 and AL004) stimulation first, respectively. For the brush condition, synchronous stimulation first (AR007 and AL004) and asynchronous stimulation first (AR006 and AL001) was obtained. Noise-canceling headphones were used to mute the servo noise during the neurostimulation experiments.

Experiment 2: RHI in able-bodied participants

Participants and experiment design

Thirty able-bodied participants were recruited on a convenience sample basis (18 male/12 female, mean age 25.0 and range 21–31). The experiment was designed to validate the use of a tapper instead of a brush within the RHI paradigm (see Fig. 2a). Additionally, we investigate the influence of the stimulation area on the sense of ownership.

Figure 2
figure 2

Experimental setup for able-bodied participants. (a) Two tappers were positioned to touch the same spots on the participant's biological hand and the rubber hand. The same setup was used for the original RHI experiment, where the tap stimulation was replaced by “stroking with a brush” stimulation. (b) Two different tapping stimulation areas were investigated: a small area of 1 cm2 (light blue area) and a larger area of 8 cm2 (dark blue area). For comparison: the area of a brushstroke (purple area). (c) The tip of the tapper was interchangeable to allow for the two different stimulation areas.

Experiment procedure

The participant was asked to sit at the table with a rubber hand and a visual barrier already in place. They positioned their right hand next to the visual barrier in the same position as the rubber hand on the other side of the barrier. Thereafter, a blanket was used to cover both the rubber hand and the real hand from the participant’s shoulder onwards.

Two different stimulation areas were considered: a small area of 1 cm2 corresponding to the size of an amputee’s perceptive projected area due to neurostimulation, and a larger area of 8 cm2 representing the dorsal area of the proximal phalanx of the index finger, equivalent to the stimulation area of a brushstroke (see Fig. 2b). The stimulation area was changed by attaching a different tip to the 3D printed tapping device (see Fig. 2c).

The same stimulation timing as in the experiments with the participant with amputation was used: the participant received visuo-tactile stimuli once every 2 s, lasting 1 s each, for a total of 180 s. In the asynchronous condition, one tapper was delayed by 500 ms. For the asynchronous tap condition, only the small area was used to reduce the time investment for the participants.

The brush conditions were conducted with the same timing. All conditions were tested in a random order. The participants filled in the questionnaire after every condition.

Data analysis

An ownership score30 for each participant was defined from the ownership statements. The ownership score was defined as:

$$OwnershipScore = mean(Q1, Q2, Q3, Q4)$$

where Q1, Q2, Q3, and Q4 are the responses to the respective questions of the questionnaire.

Due to the ordinal nature of the data obtained from the Likert scale answers of the questionnaire, computing the average of multiple questions is only mathematically justifiable if the correlation of the questions average is an accurate estimate of the average correlation of all questions. Therefore, adequate reliability and internal consistency of the four questions were determined by calculating the Cronbach’s alpha31 before calculating the ownership score of the able-bodied participants.

The statistical analyses comparing the ownership scores between the synchronous and asynchronous conditions for both the group of subjects with amputation as well as for the group of able-bodied subjects was conducted using the Wilcoxon Signed Rank Test, as implemented in the “signrank” function of MATLAB’s Statistics toolbox (The Mathworks, Inc., Natick, MA, USA). The same analysis was employed to compare the ownership score to the mean of the control questions of the RHI questionnaire in the synchronous condition. The Bonferroni method was used to correct for the three conditions (tap on small area, tap on big area, and brush) and the significance values are reported as \({p}^{*}=p*n\), where \(n=3\).

As an indication of whether an individual person perceives ownership, a criterion similar to the one used by Trojan et al.32 was employed: Only participants yielding an ownership score higher than 4 in the synchronous condition and at least one point less in the asynchronous condition were assumed to be susceptible to RHI. This criterion is similar to using a cut-off only based on the synchronous conditions18,33, with the benefit of taking suggestibility of answering questionnaires into account.

Individual differences in susceptibility to the RHI and perception of ownership had been reported34, especially for subjects with amputation35. Given our heterogeneous group of participants with amputation, we also investigated the individual differences between each participant with amputation and the portion of the able-bodied control group fulfilling the ownership criterion. Similar to Bruno et al.36, the individual differences were evaluated with means of the Crawford’s test37 using the “ttest2” function of MATLAB’s Statistics toolbox.

The equivalence of the tapping condition compared to the brushing condition was evaluated using the Bayesian version of the Wilcoxon Signed Rank Test as implemented in JASP38. The standard prior was chosen, described by a zero centered Cauchy distribution with a width parameter of 0.707.

Results

The four participants with amputation reported low ownership towards their prosthetic hand during all neurostimulation conditions (see Fig. 3), and only one assigned slightly higher questionnaire scores during the original RHI experiment in the biological limb. However, none of the participants fulfilled the ownership criterion and no significant differences were observed between the synchronous and asynchronous condition (visuo-neural: p = 0.375, W = 8.5; brush: p = 0.25, W = 6) as well as the ownership and control questions (visuo-neural: p = 0.125, W = 10; brush: p = 0.5, W = 3). These results indicate that none of the four participants is susceptible to the RHI.

Figure 3
figure 3

Questionnaire answers by four participants with transhumeral amputation after both the synchronous and asynchronous administration of visuo-tactile neural stimulation involving their prosthesis, and visuo-tactile feedback involving a rubber hand and their intact contralateral hand. Questions 1–4 inquired ownership over the prosthesis, whereas questions 5–8 were control questions. The dotted line indicates the mid-point of the Likert scale.

In the experiment with able-bodied participants, both tapping conditions (see Fig. 4a) show a statistically significant difference in the ownership score when comparing the respective asynchronous condition to the synchronous one (\({p}^{*}\) = 1.47e−5, W = 403.5 and \({p}^{*}\) = 1.65e−5 and W = 378 for the tap on small area, and tap on big area, respectively). The ownership score is also significantly different compared to the control questions (\({p}^{*}\) = 3.2e−5, W = 372 and \({p}^{*}\) = 1.56e−4 and W = 380.5 for the tap on small area, and tap on big area, respectively). Similarly, the ownership score in the brushing condition (see Fig. 4b) is significantly higher in the synchronous condition compared to the asynchronous condition (\({p}^{*}\) = 8.44e−6 and W = 434) and significantly higher than the control questions (\({p}^{*}\) = 6.09e−5 and W = 390). These results imply that tapping is a viable stimulation method to induce the RHI.

Figure 4
figure 4

Ownership scores of the 30 able-bodied participants from (a) the two tap conditions and (b) from the brush condition. Synchronous tapping on a small area was equivalent compared to the brushing condition \((B{F}_{10}=0.195)\). Tapping on a bigger area is only anecdotally equivalent to brushing \((B{F}_{10}=0.345)\) and resulted more likely in smaller ownership scores (\(B{F}_{-0}=0.10)\). At the bottom of each box, the Cronbach alpha is reported.

Out of the 30 able-bodied participants, 10 (33%), 15 (50%), and 13 (43%) did not report ownership towards the rubber hand during the tap on small area, tap on big area, and brush condition.

Comparing the individual ownership scores of the participants with amputation in the synchronous visuo-neural stimulation condition, to the group of able-bodied participants reporting ownership in the tapping condition with the same stimulation area, it was found that all four participants with amputation scored significantly lower (AR007 \(p\) = 3.8e−4, AR006 \(p\) = 2.1e−3, AL001 \(p\) = 1.2e−3, and AL004 \(p\) = 3.7e−3). Doing the same comparison on the brush conditions revealed significantly lower ownership scores for three of the participants with amputation (AR007 \(p\) = 8.0e−4, AR006 \(p\) = 4.7e−4, and AL001 \(p\) = 4.7e−4). For AL004, the ownership score of 4 in the brushing condition is lower than the average score of 5.8 in the able-bodied control group, but not significantly lower (\(p\) = 0.085). Considering the results of the ownership criterion, which takes the high ownership score of AL004 during the asynchronous control condition into account, this analysis of individual differences further supports the above results that none of the four participants is susceptible to the RHI.

The questionnaire answered at home showed that all four participants with amputation experienced higher ownership over their prosthetic hand during their daily life compared to during the RHI paradigm (see Fig. 5).

Figure 5
figure 5

Ownership towards the prosthesis during daily life. All four participants with amputation reported their prosthetic hand as being part of their body. Q1: I feel as if the prosthetic hand is my hand, Q3: When I look at my prosthetic hand, it seems as I look directly at my own hand, rather than a prosthetic hand, Q4: The prosthetic hand is part of my body.

Discussion

As originally conceived, our study aimed to provide further evidence on the RHI experiment as a common paradigm to elicit ownership over a prosthetic limb. Similar to other researchers in the neuroprosthetics community, we regarded the RHI as a preferred test to evaluate the effect of sensory feedback. We expected that our participants with amputation would report ownership of their prosthesis, particularly considering recent reports of three subjects with transradial amputations for whom ownership via the RHI was induced after synchronous visuo-tactile neural stimulation20,21. However contrary to our expectations, none of our subjects reported ownership of their prosthetic hand during any of the experimental conditions in the RHI.

To ensure that our experimental design was not the reason for the unexpected lack of ownership, we verified the non-visuo-neural part of our setup with able-bodied participants. Our results showed that tapping is a viable stimulation method to induce ownership of a rubber hand in able-bodied subjects. This finding is consistent with contemporary work by Shehata et al.39, where tapping was used to induced ownership of a passive prosthesis worn by able-bodied participants. Furthermore, we showed that a small stimulation area was sufficient for a successful RHI. Indeed, such small area of perceived tactile stimulation was like that elicited area perceived by our participants via direct nerve stimulation.

Whereas the area and duration of visuo-tactile stimulation were matched, the quality of tapping on intact skin versus eliciting a tactile sensation via neural stimulation was not entirely equal. In an intact hand, there are different mechanoreceptors that activate differentially during touch creating a rich sensory experience that cannot be reproduced by contemporary neural electrodes, regardless of their invasiveness24. This difference in expected quality could have been the cause for failing to induce ownership, although other groups have reported it possible using a single stimulation contact and producing similarly large perceptive fields20,21, as we have done here.

Difficulties to induce the RHI has been reported on subjects with high manual dexterity, such as professional pianist40. This indicates that the more neural resources are dedicated to our hands, the harder is for our brain to be “fooled” by the RHI. In subjects with unilateral amputations, as our participants, control and sensory perception in the remaining hand would be potentially more developed as this is the only hand available to the subjects. This more extensive use of their able hand could potentially explain why our participants were not susceptible to the RHI in their able hand. However, by the same logic, it should be easier for them to experience the RHI in the missing hand as this is considerably less utilized. Either way, sensorimotor acuity mediating the RHI points to another potential complication on its application to subjects with amputations.

Over thirty percent of our able-bodied subjects reported no ownership towards the rubber hand in the synchronous tapping and brushing conditions. This agrees with the literature on the reported susceptibility to the RHI (22%41, 22%42, 26%43). Whereas subject compliance could be a reason for previously reported RHI using nerve neurostimulation20,21, the most likely explanation of the discrepancy with our work could be that our four subjects are among the non-negligible minority insusceptible to the RHI. Given that none of our participants with amputation reported ownership during the original RHI experiment in their contralateral intact hand, it is unlikely that the RHI would work with other stimulation means in their missing hand. These findings emphasize an impeding limitation of the RHI experiment as general paradigm to test sensory feedback strategies: the RHI paradigm can only be used with a subset of the population. Misleading conclusions on the effects of sensory feedback strategies could be drawn if one does not control for the susceptibility to the RHI in the first place.

Quantifying ownership is another hurdle in the RHI and in the study of ownership itself. We used the preferred method for quantifying ownership in the RHI (a questionnaire) to compare the experience to daily life. Yet this is far from ideal, as only three questions were relevant for such a scenario, and although the reporting scores were higher in comparison with the RHI, only one was reported consistently above the neutral value (Q4: “The prosthetic hand is part of my body”). Questions answerable by a numeric rating scale miss in the nuances of such a complex experience as ownership, and psychological factors might be at play on the perception of a rubber hand versus a prosthesis. Moreover, recent findings indicate that the RHI might be due to a suggestion effect44 and that the RHI questionnaire does not measure ownership but instead measures the ability to generate an experience to meet expectancies arising from suggestion45.

Three out of our four participants participated in an in-depth, qualitative investigation into the social and psychological consequences of living with neuromusculoskeletal prosthesis26. Said investigation found that using a highly integrated prosthesis with reliable control and sensory feedback results in a strong sense of ownership (or identification with the prosthesis as part of one’s own body)26. The failure to induce the RHI in subjects who otherwise report ownership of their prosthesis in their daily lives is a contradiction with farther-reaching implications. It has been assumed that demonstrating ownership in a laboratory setting justifies claims of ownership once these devices leave the experimental controlled environment. Our findings indicate that this is not a prerequisite, and how well induced ownership via RHI-like experiments in the laboratory translates to real-life usage of artificial limbs has yet to be investigated. In addition, closer examination of the sense of ownership indicates that it is dynamic, fleeting, and intensely dependent on the context of the particularly human–machine relationship in question26.

The discrepancy between the degree of ownership reported by our participants during daily life compared to after the RHI paradigm could be related to the deliberate non-agentic setting of the RHI experiment. The participants use their prosthesis all day and everyday22, and therefore routinely perform activities of daily living where they execute willed motor tasks with their prosthesis. The sense of agency that arises when the planned motor action is executed as intended has been found to strengthen the sense of ownership, when both the sense of agency and ownership co-occur46. The implanted neuromusculoskeletal interface used by our participants is based on osseointegration. Thus, another factor could be the additional sensory feedback received over osseoperception while moving the prosthesis47. Osseoperception conveys additional sensory information and can thereby complement the input received from isolated direct nerve stimulation48,49. Alternatively, the decrease ownership during the experiments could be attributed to the frequent don/doffing of the prosthesis in a laboratory setting. Taking of the prosthesis leads to an adjustment of the body image as the stored structural description of their body abruptly changes where, for example, the locational synchrony of the phantom limb is disrupted26.

Despite questionnaires being the most common assessment tool for ownership, the comparison of RHI paradigm and the daily life situation was limited in our study as no other tools were employed to assess ownership. Therefore, we cannot exclude the possibility, however unlikely, that the RHI illusion indeed induced ownerships but we could not capture its effect. Additional measures for future studies could include neural activity50, muscle activation51,52, or interoceptive sensitivity53. As well as more exhaustive questionnaires covering a wider range of common experiences as prosthetic user26,54,55 and normalization of phantom limb length20,54,56. On the other hand, proprioceptive drift and event-related changes in skin conductance have been found to be potentially misleading with regards to ownership35,57,58,59.

All the above considered, the RHI paradigm could still be a valuable tool to investigate sensory feedback strategies, as long as participants are susceptible to the illusion to beginning with, and its limitations are considered when assessing experimental outcomes. To strive for a more generable suite of experiments which does not exclude a subgroup of participants, we suggest including alternative paradigms that feature daily life situations (preferably in the long term), tasks investigating body-related sensorimotor integration60, and functional tests61. However, functional tests might include other aspects inducive to ownership, and therefore special care must be taken to not conflate concepts of agency with ownership46,62. Furthermore, the temporal nature of a sense of ownership must be considered as an important factor in examining the extent to which one can be said to embody their prosthesis26,63.