Introduction

People continuously receive large amounts of sensory inputs from the surrounding environment. Our brain automatically and efficiently integrates these inputs to be perceptually organized. In addition to additive/facilitatory processes, suppressive/inhibitory processes should exist in order to constantly receive new incoming information and update internal representations. In fact, the percept of an input (e.g., talking voices of neighbors) can be easily suppressed by another input (e.g., airplane takeoff sounds). This perceptual suppression effect has been investigated within single modalities (e.g., vision1,2,3). A neurophysiological study4 reported that masking stimuli, whose onsets were temporally preceded or succeeded by that of a target, suppressed neural responses related to the target onset or offset signal, respectively. This indicates that the perceptual suppression effect occurs due to direct interactions between neural responses to different inputs in the brain.

The brain receives and integrates information across sensory modalities in order to establish coherent and robust percepts5. For example, perceived intensity of a visual stimulus can be enhanced by a concurrent auditory stimulus6 at neural level interactions7. Studies on crossmodal interactions have mainly demonstrated such additive/facilitatory effects8,9 and assume that each bit of sensory information is independently sent from primary sensory areas to some higher sensory association areas to be integrated10. A recent study11, however, suggests that crossmodal inputs can induce activations in the cortex, which has been considered a sensory specific area, indicating that direct interactions could occur between primary sensory cortices. Moreover, it has been reported that there exist multimodal neurons (e.g., visuo-tactile neurons) that have very close or overlapping neural receptive fields for stimuli in different sensory modalities12. It is therefore very likely that the perceptual suppression effect can also occur across sensory modalities.

Here, we demonstrate that tactile input can suppress the percept of visual stimuli. In these experiments, tactile stimulation (vibration) was applied to the observer's index finger on the palm side of their hand, which was placed forward and covered by a black cloth. We presented Gabor patches as visual target stimuli on a display in front of the observers (Fig. 1A). A simple detection task (e.g., reporting whether a target is presented or not) may involve a response/decisional bias (e.g., tactile stimulation induce frequent visual present or absent responses/judgments) instead of a perceptual effect. Thus, we introduced visual orientation discrimination as an indirect perceptual task; observers judged whether stripes of the visual stimuli were perceived as tilting left or right. We found that tactile stimulation degraded visual orientation discrimination performance. Moreover, this effect frequently occurred when tactile and visual stimuli were presented in a spatially and temporally consistent manner. These results reveal that tactile stimulation can induce the perceptual suppression effect on visual perception.

Figure 1
figure 1

Suppression effect of tactile stimulation on the visual orientation discrimination task (Exp. 1).

(A) Schematic illustrations of tactile and visual stimuli. A vibrator was set on the participant's left index finger of hand, which was covered by a black cloth. After presentation of a fixation point (0.6 × 0.6 deg) and a gray ring (2 deg in diameter, 0.05 deg in width) for 1200–2000 ms (randomly assigned in each trial), a visual target (0.5 × 0.5 deg) tilting either left or right was presented at the center of the ring for 20 ms. The target's contrast was either 0.12, 0.15, 0.18, 0.21, 0.24, or 0.27. The ring color was also changed from gray to black as the cue for the target onset. Tactile stimulation was concurrently applied for 200 ms. White noise bursts were also delivered through headphones to mask sounds emitted by the vibrator. After presentation of the target, participants were asked to judge the target's orientation. (B) Psychometric functions. Proportions of correct responses for visual discrimination were plotted against the target contrasts. The point of 75% responses of the functions (thresholds) and slopes were estimated. (C) Threshold and slopes. Threshold was increased when the tactile stimulation was applied (Touched condition) relative to when the sound (Sound condition) or no stimulus was presented (Without-Touched and Without-Sound conditions). These tendencies were not observed for the slopes. Error bars denote the standard error of the mean (N = 8). An asterisk indicates the condition was significantly different from the others (p < .05). Illustrations produced by and used with permission from Shoko Yabuki.

Results

Suppression effect of tactile stimulation on visual discrimination

In Exp. 1, we presented Gabor patches (0.5 × 0.5 deg, 5.88 cycle/deg, σ = 1.30 deg, 180 deg of phase angle) as target stimuli against a gray background (30.41 cd/m2) for 20 ms. We asked 8 participants to judge whether the orientation of the target was perceived as tilting left (−45 deg) or right (+45 deg) (Fig. 1A). The target's contrast (Weber contrast) was either 0.12, 0.15, 0.18, 0.21, 0.24, or 0.27. During the presentation of the target, vibration (460 Hz sinusoidal burst) was applied to the participant's left index finger for 200 ms as the tactile stimulus (Touched condition). Sounds emitted by the vibration were masked by white noise bursts delivered through headphones (Fig. 1A). Trials without the tactile stimulus were also included as a baseline (Without-Touched condition). We plotted proportions of correct responses against the target contrasts (Fig. 1B). This revealed that the proportions of the Touched condition were lower than that of the Without-Touched condition. We also tested whether sounds, a sensory input other than tactile stimulation, could also be effective on visual discrimination. White noise bursts (200 ms), instead of vibration, were delivered thorough speakers (covered by a black cloth) placed around the participant's index finger (Sound condition). The perceived intensity of the sound was adjusted by the participants as subjectively consistent with that of the tactile stimulus (67.63 (average) ± 6.20 (standard deviation) dBA). Trials without the auditory stimulus were also introduced as a baseline (Without-Sound condition). The proportions of correct responses in Sound and Without-Sound conditions were almost identical (Fig. 1B). We estimated the 75% point of the proportions as threshold by linear regression analysis in each condition for each participant (Fig. 1C). A one-way repeated measures of analysis of variance (ANOVA) revealed a main effect of the conditions [F(3, 21) = 5.17, p < .01]. A post hoc test (Tukey's HSD) revealed that the threshold of the Touched condition was larger than the other conditions (p < .05). These tendencies were not observed for the slopes of the functions, which is considered an index of sensitivity [F(3, 21) = 0.38, p = .77]. These results thus indicate that a tactile stimulus can suppress the percept of visual stimuli. Absence of the auditory effect also indicates that this suppression effect on visual perception was primarily observed for tactile stimulation, suggesting that the effect could not be simply explained by spatial attentional capture from the visual stimuli to the other sensory inputs13.

Spatial aspects of the tactile suppression effect

Exp. 2 investigated spatial aspects of the tactile suppression effect on visual perception. We stimulated the index finger, forearm, or chest on the left side of the body for 9 participants (Index finger, Forearm and Chest conditions) (Fig. 2A). These body parts were assumed to have similar tactile sensitivities14. The Without-Touched condition was also included as a baseline. The visual targets with 0.21 of contrast level were presented on either the left or right visual field, so that they were congruent or incongruent with the tactile stimulus in space, respectively. Target orientation discrimination performance was again degraded by tactile stimulation to the index finger when the visual and tactile stimuli were at the ipsilateral, congruent position (Fig. 2B). Regarding the Index finger condition, a two-way repeated measures ANOVA with the tactile (Touched/Without-Touched) and spatial (Congruent/Incongruent) conditions revealed a significant interaction effect between these factors [F(1, 8) = 6.53, p < .05]. A simple main effect of tactile condition was significant in the Congruent condition [F(1, 16) = 13.22, p < .005], but not in the Incongruent condition [F(1, 16) = 0.03, p = .87]. These tendencies were not observed for the Forearm and Chest conditions; the corresponding interaction effects were not significant in both conditions [Fs(1, 8) = 1.28, 1.46, ps = .29, .26, respectively]. These results indicate that the tactile suppression effect was observed specifically when the tactile stimulus was applied to the index finger and when the visual and tactile stimuli were congruent in space.

Figure 2
figure 2

Effects of body parts and spatial congruency (Exp. 2).

(A) Schematic illustrations of visual and tactile conditions. Tactile stimulation was applied to the index finger, forearm, or chest on the left side of participants' bodies. The visual target (0.21 of contrast level) was presented on either the left or the right visual field, so that it was congruent or incongruent with the tactile stimulus in space, respectively. (B) Results. Proportions of correct responses for visual discrimination were degraded only when the tactile stimulus was applied to the index finger and when the visual and tactile stimuli were at the congruent position in space. Error bars denote the standard error of the mean (N = 8). An asterisk indicates the condition was significantly different from the others (p < .05). Illustrations produced by and used with permission from Shoko Yabuki.

Exp. 3 further investigated spatial congruency aspects of the tactile suppression effect on visual perception. The tactile stimulus was applied to the left or right index finger of each 8 participant and the visual target was presented in the left or right visual field for each half of the participants, respectively. We asked the participants to uncross or cross their hands. In the Hands-Uncrossed condition, the left visual target and the left hand tactile stimulus were congruent both in space and body coordinates. In the Hands-Crossed condition, however, the left visual target was spatially congruent with the right hand tactile stimulus. In contrast, the left visual target was consistent with the left hand tactile stimulus in body coordinates (Fig. 3A). The Without-Touched condition was also included as a baseline. We found that the tactile stimulus degraded discrimination performance for visual target orientation, when the tactile and visual stimuli were presented at the ipsilateral, congruent position in space, regardless of whether hands were crossed or uncrossed. A three-way repeated measures ANOVA with hand (Hands-Uncrossed/Crossed), tactile (Touched/Without-Touched) and spatial (Congruent/Incongruent) conditions found a significant interaction effect between the latter two factors [F(1, 7) = 11.12, p < .05]. A significant simple main effect of tactile condition in the Congruent condition [F (1, 14) = 6.07, p < .05] revealed that the proportion correct in the Touched condition was lower than that of the Without-Touched condition, while the effect in the Incongruent condition [F (1, 14) = 4.76, p < .05] showed the opposite tendency. Therefore, the tactile suppression effect was observed especially when the visual and tactile stimuli were presented in a spatially congruent manner.

Figure 3
figure 3

Effects of spatial congruency with or without hands-crossed (Exp. 3).

(A) Schematic illustrations of visual and tactile conditions. While the visual target was presented on either the left or the right visual fields, the tactile stimulus was applied to either the left or the right index finger. Participants' hands were uncrossed or crossed. In the Hands-Uncrossed condition, the left visual target and the left hand tactile stimulus were congruent both in space and body coordinates. In the Hands-Crossed condition, whereas the left visual target was spatially congruent with the right hand tactile stimulus, the left visual target was consistent with the left hand tactile stimulus in body coordinates. (B) Results. Proportions of correct responses for visual discrimination were degraded only when the tactile and visual stimuli were congruent in spatial coordinates. Error bars denote the standard error of the mean (N = 8). Asterisks indicate the conditions with a significant difference (p < .05). Illustrations produced by and used with permission from Shoko Yabuki.

Temporal aspects of the tactile suppression effect

Exp. 4 investigated temporal aspects of the tactile suppression effect on visual perception. Since the tactile suppression effect could occur when the visual and tactile stimuli were temporally overlapped, we manipulated the inter-stimulus interval (ISI) between these stimuli from −250 ms (tactile stimulus first) to +250 ms (visual stimulus first) in 50-ms steps for 10 participants (Fig. 4A). We also included the Without-Touched condition as a baseline. We estimated the amount of tactile effect by subtracting the proportions of correct responses in the Without-Touched condition from those in each ISI condition for each participant (Fig. 4B). Larger values indicate a greater tactile effect. A one-way repeated measures ANOVA revealed a significant main effect of ISI [F(8, 72) = 2.16, p < .05]. We estimated the peak values of the ISI functions by fitting a quadratic function to each participant's data using a least squares method. The average peak is 53.85 ms and the 95% confidence interval is from −15.49 ms to 123.19 ms. These results indicate that the tactile suppression effect occurs when visual and tactile stimuli are presented within a certain temporal range.

Figure 4
figure 4

Effects of temporal distance between visual and tactile stimuli (Exp. 4).

(A) Schematic illustrations of the inter-stimulus interval (ISI) between the visual and tactile stimuli. ISIs were assigned from −250 ms (tactile stimulus first) to +250 ms (visual stimulus first) in 50-ms steps. (B) Results. After calculating the amount of tactile effect in each ISI based on proportions of correct responses for visual discrimination, we estimated peak values of ISI functions in each participant's data using a least squares method. The average peak is 53.85 ms and the 95% confidence interval ranges from −15.49 ms to 123.19 ms (gray shaded area). A black curved line indicates a fitted quadratic function to the averaged data (R2 = .74). Illustrations produced by and used with permission from Shoko Yabuki.

Discussion

The present study demonstrates that tactile stimulation applied to the index finger of an observer's hand degrades visual orientation discrimination performance. This tactile suppression effect on visual perception was not observed when the tactile stimulation was applied to the forearm or chest. We also showed that the tactile suppression effect occurred when the tactile and visual stimuli were presented at ipsilateral, congruent positions in space, regardless of whether hands were crossed or uncrossed. Furthermore, the tactile suppression effect primarily occurred when the tactile and visual stimuli were presented within a certain temporal range. These results reveal that a tactile stimulus to the hand can induce the suppression effect on visual perception when these stimuli are spatially and temporally consistent.

A study reported that tactile stimulation increased the detection threshold for sounds15. In this study, tactile stimulation was transiently presented during a sequence of sounds varying in intensity. Thus, attentional capture from a sound to tactile stimulus would be considered a key factor for this tactile effect16. Similar crossmodal attentional effects have been reported as attentional blink17 or change blindness18. However, these crossmodal attentional effects could not fully explain our current findings. The degradation of visual discrimination performance was not observed when the sounds were presented around the participants' index fingers, although both tactile and auditory stimuli could equally capture the participants' attention to the stimulus locations13. We also found that the tactile suppression effect on visual perception primarily occurred when the visual and tactile stimuli were presented within a temporal window that peaked around 50 ms of ISI (i.e., visual target first). This characteristic is incompatible with the crossmodal attentional effect because attentional cueing stimuli were reported to be effective when they temporally preceded target stimuli19,20. Rather, the tactile enhancement effect, instead of the interference effect, was observed when the tactile stimulus temporally preceded the visual stimulus (−200 ms and 150 ms of ISI in Exp. 4) as well as when they were presented in a spatially incongruent manner (the Incongruent condition in Exp. 3). One might also assume the involvement of response/decisional biases. However, the spatial and temporal congruency aspects of the tactile suppression effect on visual perception, as well as the adoption of the indirect perceptual task (visual orientation discrimination), could exclude the interpretations based on these biases. We could thus consider that the tactile suppression effect could occur at a perceptual processing stage.

Crossmodal researches have demonstrated interactions between visual and tactile information21, specifically as additive/facilitatory effects from vision to tactile sensation. For instance, the sight of body parts, such as the hand or forearm, could alter or improve tactile sensitivity22,23 or enhance visuo-tactile interaction24. Neurophysiological studies have also reported that macaque premotor cortical areas responded not only to tactile stimulation but also to visual hand images25. Similarly, human brain-imaging studies have found that activations in the somatosensory cortex, such as the parietal and premotor cortical regions, were modulated by not only tactile information but also by visual information26. Further, the sight of hands could modulate neural activation to tactile inputs in the somatosensory cortical regions27,28. The results of the current study could add two new findings regarding visuo-tactile interactions: the suppressive/inhibitory effect can occur from tactile sensation to vision.

Neurophysiological evidence has suggested that perceptual suppression effect in a single modality (vision) could occur due to direct interaction/suppression of neural responses to different stimuli4. Studies on crossmodal interaction have also suggested that there exist direct interactions among primary sensory cortices, including vision and tactile sensation11,29. It has also been reported that visuo-tactile bimodal neurons in the ventral intraparietal (VIP) area in macaque monkeys have firmly congruent receptive fields for each type of stimuli30,31. Based on these findings, the tactile suppression effect on visual perception could also occur by direct interaction of neural responses to visual and tactile inputs.

We found that the tactile suppression effect on visual perception primarily occurred when the tactile stimulus was applied to the index finger of hand, which was covered by a black cloth. It was reported that visuo-tactile bimodal neurons in somatosensory cortices, such as the VIP area, have visual receptive fields surrounding areas of the hand32. Moreover, this type of receptive field could be also mapped onto a displayed visual hand image when the visual image and tactile/proprioceptive sensations of a covered hand are associated based on their spatiotemporal consistency33. These findings would suggest that tactile stimulation and related neural responses could be associated with the visual target on the display in our experimental situation. It would also be noteworthy that the peak of the temporal window for the tactile suppression effect on visual perception was estimated to shift toward tactile stimulus delayed timing (around 50 ms of ISI). These characteristics are compatible with visual metacontrast masking1,34; a target visual stimulus is masked by a following surrounding masker, which is assumed to trigger excitatory feedback and lateral inhibition from the masker to the target35 (Fig. 5A). We demonstrated that the visual perceptual suppression effect, comparable with the tactile suppression effect, could be induced by a visual masker with 0.55 deg of width and 0.37 of contrast (Weber contrast) at 30 ms and 80 ms of ISI relative to the target (Fig. 5B). This result would suggest that tactile stimulation could be represented and could function as this visual masker in the tactile suppression effect on visual perception. The underlying mechanisms of the tactile suppression effect on visual perception, including whether and how primary visual and somatosensory cortices interact with each other through visuo-tactile bimodal neurons and/or direct feed-forward and feed-back neuronal connections, should be firmly investigated in near future with neurophysiological and brain imaging techniques.

Figure 5
figure 5

Visual metacontrast masking effect.

(A) In order to investigate what kind of visual stimuli could induce the suppression effect on visual perception comparable with the tactile suppression effect, we presented a visual masker (0.55 deg of width) instead of the tactile stimulus at a surrounding position of the visual target. The contrast of the visual masker was either 0.17, 0.27, or 0.37 (Weber contrast) and the ISI between visual target and masker was 30 ms or 80 ms. The Without-Mask condition was also included as a baseline. We introduced 240 main session trials (Mask Conditions (2) × Mask contrasts (3) × ISIs (2) × Target's orientations (2) × Repetitions (10)), followed by 72 training session trials (3 Repetitions). Except for these differences, the stimulus, apparatus and procedure were identical to those used in Exps. 2–4. (B) Results. The one-way repeated measures ANOVA found a significant main effect of the conditions [F(6, 48) = 3.14, p < .05]. The post hoc test revealed that the proportions of correct responses for visual discrimination in the conditions with 0.37 of contrast and with 30 ms and 80 ms of ISI were significantly lower than in the Without-Mask condition (p < .05). Error bars denote the standard error of the mean (N = 9). An asterisk indicates the conditions with a significant difference (p < .05).

Methods

Participants and apparatus

Each of the participants (8, 9, 8 and 10 participants in Exp. 1, 2, 3 and 4, respectively) had normal or corrected-to-normal vision and normal hearing. The participants were naïve to the purpose of the experiment. Informed consent was obtained from each participant before conducting the experiments. All procedures were approved by the local ethics committee of Rikkyo University. Visual stimuli were presented on a linearized CRT display (EIZO, FlexScan T566, 17 inch) with a resolution of 1024 × 768 pixels and a refresh rate of 100 Hz. The viewing distance was 57.3 cm. A black cloth covered the participant's hand and forearm. Tactile stimuli were presented through an audio interface (Roland, EDIROL FA-66) and a vibrator (Eishindenki, Attachable Speaker M-PZT-02). In order to mask the sounds emitted by the vibrator, white noise bursts (56.1 dBA) were generated digitally (sampling frequency 44.1 kHz) and delivered through headphones (Sennheiser HDA200). In Exp. 1, auditory stimuli (white noise bursts) were also delivered through the audio interface and speakers (Dell, AX210). A customized PC (Dell Precision T5500 workstation) and MATLAB (MathWorks, Inc.) with the Psychophysics Toolbox36,37 were used to control the experiment. A numeric keypad and a foot switch (FS3-P, Route-R) was used for recording responses in Exps.1–3 and Exp. 4, respectively. We confirmed that the onset of the visual and tactile or auditory stimuli was synchronized using a digital oscilloscope (OWON, PDS5022TFT). The observers were instructed to place their heads on a chin rest. All experiments were conducted in a dark room.

Stimuli

For visual stimuli, a fixation point consisting of bull's eye and cross hair (0.6 × 0.6 deg; 0.52 cd/m2)38 and a gray ring (2 deg in diameter, 0.05 deg in width; 15.04 cd/m2) was presented on a gray background (30.41 cd/m2). The ring was presented at the left (Exps. 1, 4) or at either the left or right (Exps. 2, 3) position relative to the fixation point in 3.5 deg of horizontal distance. We also presented a Gabor patch (0.5 × 0.5 deg, 5.88 cycle/deg, σ = 1.30 deg, 180 deg of phase angle) as a target for 20 ms. The stripes of the target stimulus tilted either left (−45 deg) or right (+45 deg). The target's contrast (Weber contrast) was either 0.12, 0.15, 0.18, 0.21, 0.24, or 0.27 in Exp. 1 and was fixed at 0.21 in the other experiments. The ring color was changed from gray to black (0.52 cd/m2) during target presentation. As a tactile stimulus, a vibration (460-Hz sinusoidal burst) was applied for 200 ms with 1 ms of cosine ramp at the onset and offset. The vibrator was attached to the participant's index finger on the palm side of their hand in Exps. 1 and 4, to the left index finger/left forearm/left side of the chest in Exp. 2 and to the left/right index fingers in Exp. 3. In Exp. 1, auditory stimuli (white noise bursts) were also delivered through two speakers placed around the participant's index finger for 200 ms with 1 ms of cosine ramp at the onset and offset. The perceived intensity of the auditory stimuli was adjusted by the participants as subjectively consistent with that of the tactile stimulus (67.63 (average) ± 6.20 (standard deviation) dBA).

Procedure

In Exp. 1, after presentation of the fixation point and the gray ring for 1200–2000 ms (randomly assigned in each trial), the visual target was presented. The ring color also changed from gray to black as the cue of target onset. Concurrently, the tactile (Touched condition) or the auditory (Sound condition) stimulus was presented. The situation without the tactile (Without-Touched condition) or the auditory (Without-Sound condition) stimulus was also included. The tactile and auditory trials were introduced as a blocked design. After the target presentation, the gray ring reappeared and the participants were asked to judge whether the target was perceived as tilting left or right. This experiment consisted of training and main sessions. The training session consisted of 72 trials without presentation of the tactile or auditory stimulus: Target's contrasts (6) × Target's orientations (2) × Repetitions (6). The main session consisted of 216 trials in each block-designed condition (432 trials total): Tactile or Auditory conditions (2) × Target's contrasts (6) × Target's orientations (2) × Repetitions (9). The order of these conditions was randomly assigned in each trial and counterbalanced among the participants. The order of the block-designed conditions (tactile/auditory conditions) was also counterbalanced among the participants.

In Exp. 2, we presented the tactile stimulus at either index finger, forearm, or chest in left side of the participants' body as a blocked design (Index finger, Forearm and Chest conditions). The Without-Touched condition was also included. The visual targets were presented at either left or right side relative to the fixation. Thus, the target and the tactile stimuli were either congruent (Congruent condition) or incongruent (Incongruent condition) in space. After 24 trials of the training session (Target's positions (2) × Target's orientations (2) × Repetitions (6)), 80 trials of the main session were introduced in each block-designed condition (240 trials in total): Tactile Conditions (2) × Target's positions (2) × Target's orientations (2) × Repetitions (10). The order of these conditions were randomly assigned in each trial and counterbalanced among the participants. The order of the block-designed conditions (Index finger/Forearm/Chest conditions) was also counterbalanced among the participants.

In Exp. 3, we asked the participants to uncross or cross their hands as a blocked design. While the tactile stimulus was applied to the left or right index finger of each participant, the visual targets were presented on either the left or right side relative to the fixation point for each half of the participants, respectively. Thus, the target and the tactile stimuli were either congruent (Congruent condition) or incongruent (Incongruent condition) in space both in the Hands-Crossed and Hands-Uncrossed conditions. The Without-Touched condition was also included. After 24 trials of the training session (Target's positions (2) × Target's orientations (2) × Repetitions (6)), 80 trials of the main session were introduced in each block-designed condition (160 trials total): Tactile Conditions (2) × Target's positions (2) × Target's orientations (2) × Repetitions (10). The order of these conditions was randomly assigned in each trial and counterbalanced among the participants. The order of the block-designed conditions (Hands-Uncrossed/Crossed conditions) was also counterbalanced among the participants.

In Exp. 4, we manipulated the inter-stimulus interval (ISI) between the visual targets and tactile stimuli from −250 ms (tactile stimulus first) to +250 ms (visual target first) in 50-ms steps. The tactile stimulus was applied to the left index finger of the participants. We also included the Without-Touched condition. The visual targets were presented on the left side relative to the fixation point. The black ring was presented from the tactile or visual target onset to the tactile or visual target offset. After 72 trials of the training session (visual onset timing relative to the black ring onset (9) × Target's orientations (2) × Repetitions (4)), 360 trials of the main session were introduced: ISIs (9) × Tactile Conditions (2) × Target's orientations (2) × Repetitions (10). The order of these conditions was randomized in each trial and counterbalanced among the participants.