Abstract
This study assessed the pupil responses in the sensory integration of various directional optic flows during the perception of gravitational vertical. A total of 30 healthy participants were enrolled with normal responses to conventional subjective visual vertical (SVV) which was determined by measuring the difference (error angles) between the luminous line adjusted by the participants and the true vertical. SVV was performed under various types of rotational (5°/s, 10°/s, and 50°/s) and straight (5°/s and 10°/s) optic flows presented via a head-mounted display. Error angles (°) of the SVV and changes in pupil diameters (mm) were measured to evaluate the changes in the visually assessed subjective verticality and related cognitive demands. Significantly larger error angles were measured under rotational optic flows than under straight flows (p < 0.001). The error angles also significantly increased as the velocity of the rotational optic flow increased. The pupil diameter increased after starting the test, demonstrating the largest diameter during the final fine-tuning around the vertical. Significantly larger pupil changes were identified under rotational flows than in straight flows. Pupil changes were significantly correlated with error angles and the visual analog scale representing subjective difficulties during each test. These results suggest increased pupil changes for integrating more challenging visual sensory inputs in the process of gravity perception.
Similar content being viewed by others
Introduction
Accurate estimation of the direction of gravity is essential for spatial orientation and postural stability. Inputs from various sensory systems, including the otolith organs, visual information, and proprioception, are centrally integrated to generate an internal estimate of the direction of gravity1,2,3. In addition to the information from the otolith organs, accurate visual information plays an important role in calculating the internal verticality. In other words, confusing or limited visual information could induce a failed perception of the accurate direction of the gravitational vertical, which can be observed in several cases of air crashes from limited visual reference during starless night flight through a thick cloud or flying over featureless terrain4,5,6.
Experimentally, the presence of additional visual cues can influence the accuracy of subjectively perceived verticality7. In particular, the rotating optokinetic stimulus could shift the subjectively perceived vertical direction7,8,9,10,11. Ocular torsion induced by the rotating optokinetic flow has been suggested as an underlying physiologic mechanism that biases the perception of verticality, especially when the subjective verticality was assessed in a visually controlled way, such as the subjective visual vertical (SVV)12,13,14,15. However, the underlying mechanisms of this optokinetic stimulation-induced bias of SVV are not fully understood.
As such, the determination of subjective verticality could require a considerable amount of cognitive resources as the process has to evaluate and integrate multiple sensory information. In other words, the process could be easily affected by conflicting or confusing sensory information, especially for those with limited cognitive reserve. Previous studies have reported the role of higher cortical functions as well as brainstem reflexes in the internal estimation of the direction of gravity, possibly confirming the potential role of cognitive functions10,16. Reportedly, age-associated increasing dependence on visual cues might suggest an increased probability of failed central integration of multiple sensory information17. The pupil response has been used to measure the required cognitive load or attention in a variety of task types18,19,20,21. In general, pupil dilation can be promptly observed following the onset of relevant stimuli with an increase in the cognitive demands of a task18,19,20,21. Among the clinical tests for vestibular functions, pupil response can be preferentially applied to the SVV because it is performed in a dark visual field with minimal eye movement, making it easy to reliably measure the pupil size.
In this study, we aimed to evaluate the cognitive demands required to integrate confusing optokinetic stimuli during the subjective perception of verticality by assessing pupil changes. The association between the accuracy of verticality perception and cognitive demands was also analyzed.
Methods
Participants
A total of 30 healthy participants (male:female = 8:22, an average age of 38.5 y with a range of 24–62 y) without any history of neuro-otologic or vestibular disorders were enrolled in the study. All the participants reported near-normal visual acuity of the naked eye (better than 20/25 of the Snellen chart in the better eye without anisometropia). Those with visual, psychological, systemic disease, and medications that could affect the equilibrium or pupil responses were excluded, and those weighing more than 90 kg were also excluded owing to restrictions in equipment usage. The participants underwent conventional SVV tests (JI SVV, Jeil Inc., Republic of Korea) prior to participating in the experiments for ruling out potential dysfunction related to the perception of the gravitational vertical. All the participants had normal SVV findings, defined as error angles less than 2°. The measurements were performed at the Korea University Ansan Hospital between March 5, 2020 and June 4, 2020. The institutional ethics committee approval was obtained from the Korea University Ansan Hospital (2020AS0057). All methods were performed in accordance with the relevant guidelines and regulations. Informed consent was obtained from all the participants.
Stimuli and equipment
Directional optic flows were generated by moving multiple tiny dot patterns in the programmed directions and velocities. They were presented through a head-mounted display (HMD) (Vive Pro Eye, HTC, Taiwan). The visual stimuli were constructed by creating a large virtual spherical space with a radius of 10 m from the participant’s point of view. The background moving objects (0.125 m of virtual radius) were created on the surface of the sphere with a density of 0.55 objects/m2. The field of view was a small area of the virtual sphere with a visual angle of 10° on latitude and longitude centered on the equator of the sphere.
To measure the perceived gravitational vertical, an adjustable rotating test rod was placed in the center of the screen and controlled in the CW and CCW directions at a speed of 5°/s (continuously) or with 0.1°/s (per click) by a controller (Vive Pro Eye, HTC, Taiwan). The participant was instructed to align the test rod in the direction of the subjectively perceived direction of gravitational vertical from the initially tilted offset at 30°or 330°. The error angle to the actual gravitational vertical was calculated with a resolution of 10–6° in the roll plane for each test.
The pupil diameter was measured for each test using an eye tracker (incorporated within Vive Pro Eye, HTC, Taiwan). A dark visual field was obtained by tightly fitting the HMD to the face in a dark experimental room with the lights turned off. The luminance of the test screen was measured for each experiment by calculating the L* value of the CIE-Lab color space and luminance (Y) value of YIQ color space22. These color components were transformed from the originally extracted sRGB component of each test screen. The L* of CIE-Lab, which ranges from 0 (dark) to 100 (light), reflects the lightness felt by humans, independent of the medium and the Y component of the YIQ color space represents the luminance in a computer image23,24.
Procedures and measured data
The participants sported an HMD with a controller in their preferred hand, which was established on a force plate (i2a systems, Republic of Korea). Two inertial measurement units (IMUs) were placed in the center of gravity (CoG) and ankle (GSPI, Republic of Korea).
Three practice rounds were conducted for each experiment before the actual measurement to familiarize the participants with the program and equipment. Thirty seconds of a self-playing test screen with the same velocity of the optic flow was presented prior to each trial to revert the pupil diameter to baseline. After four seconds following the commencement of the recording, the participants were asked to align the test rod with the subjectively perceived visual vertical. A one-minute break was provided between each experiment to reduce cybersickness and eyestrain caused by repeated measurements.
The measurements were carried out in the following sequence of optic flows with respect to the starting offset of 330 degrees, and then another set of measurements with starting offset of 30 degrees were followed: (1) a static screen displayed with multiple motionless dot patterns (Fig. 1A). (2) straight flow in the horizontal direction (5°/s, 10°/s, Fig. 1B), (3) straight flow in the gravitational vertical direction (5°/s, 10°/s, Fig. 1C), (4) clockwise (CW, Fig. 1D) rotational flows, and (5) counter-clockwise (CCW, Fig. 1E) rotational flows in the roll plane (5°/s, 10°/s, and 50°/s). Detailed illustrations are presented in Fig. 1.
Changes in pupil diameter were determined by calculating the difference between the diameter of maximal dilatation and baseline. A 10-Hz low-pass filter was applied to the raw data of pupil size, and linear interpolation was applied for missing data from brisk changes in pupil size. The diameter of maximal dilatation was defined by the average pupil diameter across 0.3 s of maximal dilatation, which satisfies less than 0.05 mm changes over 80% of the time interval. The baseline diameter was also defined as the average pupil diameter within a standard deviation across 4 s following the start of each measurement.
Postural sway was also measured to assess the resultant postural imbalance, especially induced by challenging stimulation that exceeds individual cognitive reserve. Three-dimensional postural sway at the CoG was obtained using the attached IMU. The maximal and average sway angles (°) were calculated from the reference point and compared between each experiment. The sway angle was automatically calculated by integrating the measured angular acceleration using the programmed algorithms. Two-dimensional postural sway of the center of pressure (CoP) was also obtained using a force plate in the X- (back-forth) and Y- (right-left) axes. The maximal and average sways (mm) were calculated from the reference point and compared between each experiment.
To quantify subjective dizziness and task-related discomfort induced by virtual reality-based visual stimulation, the dizziness handicap inventory (DHI)25,26, simulator sickness questionnaire (SSQ)27, and motion sickness susceptibility questionnaire (MSSQ)28 were obtained prior to the experiments and after completing the entire experiment. To briefly check the subjective dizziness caused by each experimental unit, a 10-point visual analog scale (VAS)29 was obtained immediately after completing each experiment.
Comparison and statistical analysis
The error angle was a primary variable reflecting the accuracy of the participants’ perceived gravitational vertical. The error angles were compared between various experimental conditions, including different types of optic flow (static screen, straight, and rotational optic flow), different velocities of optic flow (5°/s, 10°/s, and 50°/s), and the relative direction of the test rod alignment to the background optic flow. Pupil diameter was the primary variable assessing task-related cognitive workload in each experiment. The pupil diameter was also compared between the above-mentioned experimental conditions, including different types of optic flow, different velocities of optic flow, and the relative direction of optic flow. Standardized changes in the pupil diameter, calculated by dividing the changes by baseline pupil diameter, were also evaluated. The correlation was also evaluated between error angle and pupil diameter, and pupil diameter and the results of questionnaires assessing subjective dizziness and discomfort. Postural sway was compared between various experimental conditions based on the sway angle (°) for IMU data and sway distance (mm) for force plate data.
All data are expressed as mean ± standard deviation. A paired sample t-test and one-way analysis of variance (ANOVA) with Tukey’s post-hoc test were comprehensively applied to compare the average. Error angles and pupil diameter under the same velocity of straight optic flows (horizontal, and vertical) were compared, and these were also evaluated under different velocities (5°/s, 10°/s, and 50°/s) of the same optic flow. Pearson’s correlation analysis was implemented to predict the association between the variables. Statistical analyses were performed using the SPSS software (ver. 15, SPSS Inc. Chicago, IL, USA).
Results
Subjective gravitational vertical under directional optic flow
All the patients underwent conventional SVV test, and all the patients recorded error angles of a normal range (< 2°) with an average of 0.49 ± 0.35°, ranging from 0.02 to 1.38°. In the subjective visual horizontal (SVH), the average error angle was 0.39 ± 0.20°, ranging from 0.03° to 0.80°.
Although the error angles were below 2° in all the measurements, significantly larger error angles were measured under a static visual field with numerous small dots in the background (SVV, 1.32 ± 1.27°) compared to the values measured with conventional SVV (0.49 ± 0.35°).
Compared to the mean error angles in the static background screen, those of rotational optic flows were significantly increased (p < 0.001 for all comparisons, Table 1A). The mean error angles of straight optic flows were increased; however, they did not differ from those of the static screen and were below 2°. The error angles of each test condition were also compared with those of the straight optic flow with the slowest velocity (5°/s), and the error angles of the rotational optic flows were confirmed to be significantly higher (p < 0.001 for all comparisons, Table 1B). The error angles also significantly increased as the angular velocity increased for rotatory optic flows (Fig. 2 and Table 1C). For straight optic flows, the error angles were not significantly different for the different directions of optic flow (horizontal and vertical flow) and for the different velocities of the optic flow (Supplementary Table 1A and 1B). The error angles of SVV were larger when the direction of the test rod adjustment was aligned in the opposite direction (tilt offset of 30° under CW rotatory stimuli and tilt offset of 330° under CCW rotational stimuli) for 10°/s rotational optic flows than in the same direction (tilt offset of 30° under CCW rotational stimuli and tilt offset of 330° under CW rotatory stimuli) (p = 0.492, t = 0.691, df = 62 for 5°/s and p = 0.008, t = 2.703, df = 62 for 10°/s). The details are shown in Supplementary Table 1B.
Pupil responses
In general, the pupil diameter increased following the start of the experiment and an additional increase in the pupil diameter was observed during the final fine alignment of the test rod to the gravitational vertical direction (Fig. 3).
Significantly larger increases in the pupil size were confirmed for rotational optic flows compared to the pupil changes of the static screen, whereas the changes were not significant for straight flows (Fig. 4A, B, Table 2A, and Supplementary Table 2A). The pupil changes in each test condition were also compared with those of the straight optic flow with the slowest velocity (5°/s), and the pupil changes of the rotational optic flows were confirmed to be significantly higher (p < 0.001* for 5°/s and 10°/s, p = 0.004* for 50°/s, Table 2B). However, the pupil changes were not significantly different according to the velocity of the straight and rotational optic flows (Table 2B, C), although the changes in the 50°/s velocity were the highest. Interestingly, for rotational flows, the pupil changes were larger when the test rod was aligned in the opposite direction (tilt offset of 30° under CW rotatory stimuli and tilt offset of 330° under CCW rotational stimuli) for the 5°/s rotational optic flows than in the same direction (tilt offset of 30° under CCW rotatory stimuli and tilt offset of 330° under CW rotational stimuli) (p = 0.045*, t = 2.049, df = 59 for 5°/s, p = 0.092, t = 1.528, df = 59 for 10°/s, Supplementary table 2B). The illuminance of the test screen showed a minimal difference between each individual measurement, without any statistical significance (p = 0.293 for Y component of the YIQ color space and p = 0.367 for L* of CIE-Lab). Detailed values are shown in Supplementary Table 3.
A significant correlation was found between the change in the pupil size and error angle of each test (r = 0.198, p = 0.004, Fig. 4C). A significant correlation was also found between the changes in pupil size and the VAS (r = 0.153, p = 0.005, Fig. 4D).
Postural sways and subjective dizziness
The average sway was 5.16 ± 12.21 mm on the X- (back–forth) and 11.04 ± 19.31 mm on the Y- (right-left) axis in static visual stimulation. The postural sway was the largest in the condition of 50°/s rotational flows on the X-axis (9.83 ± 27.40) and in the 10°/s rotational flows on the Y-axis (16.25 ± 41.51); however, there was no significant statistical difference among the conditions with different optic flows. The average three-dimensional postural sway was 1.52 ± 3.48°, 1.38 ± 3.16°, and 0.06 ± 0.50° on the roll, pitch, and yaw planes, respectively. These did not differ across the test conditions, suggesting that the current test procedures had little impact on the postural stability (Supplementary Figure 1).
Surveys for subjective dizziness (DHI) and virtual reality-related dizziness (MSSQ, SSQ) were conducted, and all the scores were nearly the same before and after the measurement. The DHI was 1.37 ± 3.96 initially and changed to 1.43 ± 2.96 following the measurement (p = 0.532). After the measurement, the MSSQ score changed from 20.43 ± 11.19 to 19.70 ± 11.89 (p = 0.596) and the SSQ score changed from 6.17 ± 4.85 to 5.66 ± 5.31 (p = 0.845). Minimal changes in these scores suggest negligible dizziness from the virtual reality-based entire measurement procedures.
Discussion
Verticality
Our data confirmed significantly larger pupil dilatations along with significantly larger error angles when performing SVV under rotational optic flows in a roll plane than those under straight optic flows. Normal postural control, including the perception of verticality, requires proper integration of vestibular, visual, and somatosensory information. The relative weightings on each sensory cue vary according to the integrity of sensory information and the sensory processing ability based on personal experience and cognitive function29,30,31,32. Generally, limited or moving visual surrounds could deliver confusing visual information. In response, individuals reassess the changed nature of sensory cues, and adaptive reweighting is followed to determine reliable sensory cues.
SVV is a commonly practiced clinical test to measure the accuracy of subjectively estimated verticality by calculating the error angles to the gravitational vertical by adjusting a visualized test rod in the roll plane. When SVV is performed in a dark visual environment, the vestibular and somatosensory systems dominate SVV performance7. However, such condition is rarely experienced in the real world, and visual information cueing the direction of gravitational vertical plays an important role in the estimation of subjective verticality1,3. Thus, the authors attempted to evaluate the potential effect of various moving visual information in the determination of subjective verticality. The cognitive workload required in the central processing of these multiple sensory inputs was also evaluated by measuring the pupil response. Therefore, simplified moving visual stimulations were generated by altering the direction and velocity of the numerous tiny dot patterns in the black background. A dark visual field was constructed to enhance the amplitude of the pupil response. The luminance of the each test screen was also strictly controlled to minimize any potential influence of luminance on pupil response. The luminance was measured by a calculating algorithm using Y component of the YIQ color space and the lightness value (L*) of CIE-Lab. The difference in luminance was minimal, without significant differences among individual test screens.
Early pioneering research on this topic employed similar test paradigms. A tilted frame (rod and frame test)33 or rotating disks (rod and disk test)9,34,35 were developed to provide distorted visual information. Higher error angles were commonly found under a rotating visual surround for both normal participants and participants with vestibular dysfunction. The error angles were also larger for individuals experiencing persistent dizziness following vestibular neuritis36. Increased error angles were also observed in patients with a higher chance of visual vertigo, along with vestibular impairment36.
Several hypotheses have been suggested for the underlying mechanisms of the increased error angles under rotational optokinetic flows. Previously, it has been observed that a rotating optokinetic stimulus shifts the perceived vertical orientation of a visual line with a shift in the internal representation of the gravity vector9,13. Several subsequent studies have observed a roll-angle dependency of the optokinetic-induced bias, which is consistent with earlier observations35,37. According to the gravito-inertial force resolution hypothesis, integration of the visual rotation signal could induce the estimates of gravity to develop a bias outside the actual otolith signal (gravito-inertial acceleration, GIA)14. From the perspective of a static, upright observer, CW visual rotation can be used to infer left ear-down head tilt, causing a rotation of the internal gravitational vector to the CW direction away from the actual otolith signal (GIA)7,14; the counterclockwise rotation could induce the opposite. Consistent with this prediction in the rotation of the visual scene, compensatory nystagmus is induced as though the body is being translated to the side14. In addition, certain studies have recently evaluated how visual stimuli affect the perceived verticals by varying the angle of the whole body roll tilt. Ward et al. observed an increase in the optokinetic stimuli-induced bias of the SVV with the increasing roll-tilt angle of the head and suggested that visual input was weighted more when the vestibular input became less reliable11.
Interestingly, the straight optic flows did not significantly increase the error angles in our data. The test rod placed in the center of the test screen could act as a visual target superimposed on the moving visual background, which suppressed the horizontal optokinetic ocular response38,39,40. However, the test rod could not effectively suppress the background rotational optic flows probably because it was placed in the center of the concentric circular optic flow. In our data, it seems that this type of visual target could not effectively suppress the induced torsional optokinetic ocular responses. However, still more data on the suppression of the torsional optokinetic ocular response induced by rotational visual stimuli are warranted, since the torsional pursuit system has not been clearly demonstrated41.
Pupil changes and cognition
The pupil responds to arousal and mental activity because pupil dilation is correlated with the activity of the noradrenergic locus coeruleus (LC)42, a small nucleus in the brainstem that plays a pivotal role in physiological arousal and the regulation of cognitive function43. The relationship between the pupillary system and LC-norepinephrine activity has been established through numerous anatomical and physiological studies in humans and animals44. Pupil responses have been used extensively to measure the required cognitive load or attention in a variety of tasks18,19,20,21,44,45,46,47. In general, pupil dilation can be promptly observed following the onset of relevant stimuli with an increase in the cognitive demands of the task18,19,20,21.
The pupil diameter is involuntarily altered by cognitive and autonomic activity44. The major pupil responses are induced by luminance changes, which were strictly controlled as shown in the result48. Other miscellaneous factors include wakefullness, visual focusing, or anxiety level, which were also largely controlled by the experimental protocols and programs. Therefore, the measured pupil changes could mostly reflect the changes in cognitive activity. Another evidence from our data could be that the pupil responses were different according to the different levels of the task, especially by the velocity of the rotational optic flows. The rotational optic flows of higher velocity, which became more difficult tasks for the participants resulting in higher error angles, and VAS induced larger pupil dilation. Other influencing factors for pupil changes were not altered by this condition.
Error angles and pupil responses
The error angles of SVV under various visual stimuli are calculated with a fairly complex computational process by integrating multisensory inputs, and multiple brain regions are involved in these neural representations including the cerebellum, brainstem, and several cortical areas such as the putative human ventral intraparietal area49,50,51. We found that the pupil changes were significantly larger under rotational visual stimuli along with increased error angles. When analyzed based on the entire data, the error angle and pupil response were significantly correlated. Error angles in the SVV test, which could reflect the difficulty of verticality recognition, increased with pupil dilation. Considering that there is little change in other factors that can affect the size of the pupil, including luminance, other than the difficulty of the task, these results could suggest an increased demand of cognitive resources to integrate more complex or confusing visual inputs in calculating internal verticality. The larger error angles recorded in the process with larger pupil changes could suggest an increased chance of failed integration when the process demanded higher cognitive resources. The significant correlation between the pupil changes and the VAS reflecting the subjective difficulty of the task also supports the assumption (Fig. 4D).
It is more natural that the pupil changes would be small in static conditions with motionless background objects compared to the conditions in which the background object constituted visual flows. However, the pupil changes under the straight optic flow with a 5°/s velocity were even smaller than those under the preceding static screen, although the difference was not significant (Table 2A). It could indicate that the participants had not yet become sufficiently familiar with the task, despite several rounds of exercise. In other words, the pupil changes under the static screen would reflect the increased cognitive demand from the interpretation of an abruptly encountered unfamiliar task. Hence, the pupil changes under straight 5°/s were also used for the comparison with the pupil changes in the following tasks (Table 2B). Likewise, the error angles were also compared with the error angles under straight 5°/s (Table 1B).
Participants were asked to align the test rod from both the initial tilt offset of 30° (CCW adjustment of the test rod) and 330° (CW adjustment of the test rod) to the direction of the perceived vertical. For rotational flows, the error angles and pupil changes were larger when the test rod was aligned in the opposite direction (tilt offset of 30° under CW rotatory stimuli and tilt offset of 330° under CCW rotatory stimuli) of the optic flows than in the same direction (tilt offset of 30° under CCW rotatory stimuli and tilt offset of 330° under CW rotatory stimuli) (Supplementary Table 1B and 2B). The optokinetic flow in the direction opposite to that of the SVV might serve as a more confusing stimulus and induced an illusionary requirement for a larger adjustment angle with a chance of greater noise accumulation.
Postural sways
The postural sway was slightly larger under higher velocity rotational flows; however, there was no significant statistical difference for the types of optic flows. Previous studies have revealed that visual stimuli could affect postural stability by providing an excitatory input on the postural muscles52,53,54. The foveal and random optic flows induced larger postural sway with higher variability than peripheral flows and the provoked sways were greater in patients with an impaired retinal function54,55. Our condition evaluated a static postural sway in an upright position on a stable-support surface. The tasks modulated visual cues interfering with the otolith organ function leaving vestibular and proprioceptive inputs intact. Therefore, the induced postural reflex might not cause significant sways in the CoG measured in this study. The postural sway of our data could not be comparable to that of the above-mentioned studies since the presented visual stimuli were different in nature. In our study, the centrally placed test bar could induce visual fixation suppressing the optokinetic effect of the visual stimuli.
Limitations
Healthy adult volunteers without any neuro-otologic and visual disorders were enrolled in this study. The participants’ age ranged from 24 to 63 years including two in their 60 s and majority in their 20–40 s (83.3%, 25/30). There was a positive correlation between age and the error angle (p = 0.001, r = 0.186); however, no significant difference was found among groups when comparing the mean error angle by the age group (20 s, 30 s, 40 s, 50 s, and 60 s) probably owing to the small number of participants in their 50 s and 60 s. Pupil change did not show any correlation with age. The heterogeneity of age could be a limitation of this study, and meticulous care is warranted in the interpretation of the data; however, the resultant deviation could be limited considering the small number of the elderly participants. There was no significant difference in the error angle between male and female under most of the conditions, with the exception of a 10°/s rotational optic flow (male, 5.39 ± 2.94; female, 8.26 ± 5.46; p = 0.011*). Pupil changes also did not differ by gender under all kinds of optic flow.
The straight optic flow could act as a visual cue aiding in the prediction of the direction of gravitational vertical considering that it is directed linearly forming a fixed angle with the gravitational vector, which could be preferentially applied for the vertical and horizontal optic flows. However, additional physiologic mechanisms are still suggested considering that the error angles were also very small even in the oblique flow (data not shown), which necessitates a more complex internal calculation to estimate the vertical direction.
Pupil response has been interpreted in conjunction with the cognitive activity in a variety of neuro-cognitive research. For its application in measuring the cognitive activity in the visuo-vestibular interactions, we strictly controlled the potential factors affecting the pupil changes, including luminance, wakefulness, consuming drugs, and attention. However, still, caution needs to be exercised in interpreting the clinical meanings of pupil changes in relation with the cognitive functions.
The randomized preset angle of the SVV could have contributed in the reduction of a potential studying effect from repeated measurement. However, it was not applied to the actual measurement considering the resultant variance on the concentration and cognition and to reduce the total test sessions in order to allow the participants to maintain a consistent cognitive function. Randomization needs to be considered in future studies.
This study confirmed that rotational optic flows increase the error angles of the SVV, compared to those under straight optic flows. Larger pupil changes were also confirmed under rotational optic flows potentially suggesting increased cognitive demand. Based on these findings, we could assume that the process of calculating the internal estimates of verticality requires a considerable amount of cognitive resources, especially when confusing visual inputs are presented.
References
Cullen, K. E. & Taube, J. S. Our sense of direction: Progress, controversies and challenges. Nat. Neurosci. 20, 1465–1473 (2017).
De Vrijer, M., Medendorp, W. P. & Van Gisbergen, J. A. Shared computational mechanism for tilt compensation accounts for biased verticality percepts in motion and pattern vision. J. Neurophysiol. 99, 915–930 (2008).
MacNeilage, P. R., Banks, M. S., Berger, D. R. & Bülthoff, H. H. A Bayesian model of the disambiguation of gravitoinertial force by visual cues. Exp. Brain Res. 179, 263–290 (2007).
Gibb, R. W. Visual spatial disorientation: Revisiting the black hole illusion. Aviat. Space Environ. Med. 78, 801–808 (2007).
Meeks, R. K., Anderson, J. & Bell, P. M. Physiology of spatial orienttion. in StatPearls (StatPearls Publishing, Treasure Island (FL), 2021).
Sanchez-Tena, M. A., Alvarez-Peregrina, C., Valbuena-Iglesias, M. C. & Palomera, P. R. Optical illusions and spatial disorientation in aviation pilots. J. Med. Syst. 42, 79 (2018).
Dakin, C. J. & Rosenberg, A. Gravity estimation and verticality perception. Handb. Clin. Neurol. 159, 43–59 (2018).
Witkin, H. A. & Asch, S. E. Studies in space orientation; further experiments on perception of the upright with displaced visual fields. J. Exp. Psychol. 38, 762–782 (1948).
Dichgans, J., Held, R., Young, L. R. & Brandt, T. Moving visual scenes influence the apparent direction of gravity. Science 178, 1217–1219 (1972).
Dockheer, K. M., Bockisch, C. J. & Tarnutzer, A. A. Effects of optokinetic stimulation on verticality perception are much larger for vision-based paradigms than for vision-independent paradigms. Front. Neurol. 9, 323 (2018).
Ward, B. K., Bockisch, C. J., Caramia, N., Bertolini, G. & Tarnutzer, A. A. Gravity dependence of the effect of optokinetic stimulation on the subjective visual vertical. J. Neurophysiol. 117, 1948–1958 (2017).
Brandt, T. & Dieterich, M. Pathological eye-head coordination in roll: Tonic ocular tilt reaction in mesencephalic and medullary lesions. Brain 110, 649–666 (1987).
Held, R., Dichigans, J. & Bauer, J. Characteristics of moving visual scenes influencing spatial orientation. Vision Res. 15, 357–365 (1975).
Zupan, L. H. & Merfeld, D. M. Neural processing of gravito-inertial cues in humans. IV. Influence of visual rotational cues during roll optokinetic stimuli. J. Neurophysiol. 89, 390–400 (2003).
Ibbotson, M. R., Price, N. S., Das, V. E., Hietanen, M. A. & Mustari, M. J. Torsional eye movements during psychophysical testing with rotating patterns. Exp. Brain Res. 160, 264–267 (2005).
Tarnutzer, A. A., Bockisch, C. J. & Straumann, D. Head roll dependent variability of subjective visual vertical and ocular counterroll. Exp Brain Res 195, 621–626 (2009).
Kobayashi, H. et al. Dynamic and static subjective visual vertical with aging. Auris Nasus Larynx 29, 325–328 (2002).
Kahneman, D. & Beatty, J. Pupil diameter and load on memory. Science 154, 1583–1585 (1966).
Beatty, J. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol. Bull. 91, 276–292 (1982).
Wierda, S. M., van Rijn, H., Taatgen, N. A. & Martens, S. Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. Proc. Natl. Acad. Sci. U. S. A. 109, 8456–8460 (2012).
McCloy, D. R., Larson, E. D., Lau, B. & Lee, A. K. Temporal alignment of pupillary response with stimulus events via deconvolution. J. Acoust. Soc. Am. 139, E157–E162 (2016).
Schwarz, M. W., Cowan, W. & Beatty, J. C. An Experimental Comparison of RGB, YIQ, LAB, HSV, and Opponent Color Models. ACM Trans. Graph. 6, 123–158 (1987).
Hill, B., Roger, T. & Vorhagen, F. W. Comparative analysis of the quantization of color spaces on the basis of the CIELAB color-difference formula. ACM Trans. Graph. 16, 109–154 (1997).
Tominaga, S., Schettini, R. & Tr´emeau, A. (eds) CCIW 2013, LNCS 7786, 53–67 (Springer-Verlag Berlin Heidelberg, 2013).
Jacobson, G. P. & Newman, C. W. The development of the Dizziness Handicap Inventory. Arch. Otolaryngol. Head Neck Surg. 116, 424–427 (1990).
Han, G. C. et al. The study of standardization for a Korean adaptation of self-report measures of dizziness. J. Korean Balance Soc. 3, 307–325 (2004).
Frank, L. H., Kennedy, R. S., Kellogg, R. S. & McCauley, M.E. Simulator sickness: A reaction to a transformed perceptual world. Scope of the Problem (NAVTRAEQUIPCEN TN-65), Naval Training Equipment Center, Orlando, FL (1983)
Golding, J. F. Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness. Brain Res. Bull. 47, 507–516 (1998).
Brandt, T. Otolithic vertigo. Adv. Otorhinolaryngol. 58, 34–47 (2001).
Zago, M., Carrozzo, M., Moscatelli, A. & Lacquaniti, F. Time, observation, movement. Cogn. Crit. 4, 61–86 (2011).
Abdul Razzak, R., Bagust, J. & Docherty, S. Young and older adults differ in integration of sensory cues for vertical perception. J. Aging Res. 2020, 8284504. https://doi.org/10.1155/2020/8284504 (2020).
Vingerhoets, R. A., De Vrijer, M., Van Gisbergen, J. A. & Medendorp, W. P. Fusion of visual and vestibular tilt cues in the perception of visual vertical. J. Neurophysiol. 101, 1321–1333 (2009).
Witkin, H. A. & Asch, S. E. Studies in space orientation; perception of the upright in the absence of a visual field. J. Exp. Psychol. 38, 603–614 (1948).
Guerraz, M. et al. Visual vertigo: Symptom assessment, spatial orientation and postural control. Brain 124, 1646–1656 (2001).
Bronstein, A. M., Yardley, L., Moore, A. P. & Cleeves, L. Visually and posturally mediated tilt illusion in Parkinson’s disease and in labyrinthine defective subjects. Neurology 47, 651–656 (1996).
Cousins, S. et al. Visual dependency and dizziness after vestibular neuritis. PLoS ONE 9, e105426 (2014).
Dichgans, J., Diener, H. C. & Brandt, T. Optokinetic-graviceptive interaction in different head positions. Acta Otolaryngol. 78, 391–398 (1974).
Barnes, G. R. & Crombie, J. W. The interaction of conflicting retinal motion stimuli in oculomotor control. Exp. Brain Res. 59, 548–558 (1985).
Wyatt, H. J. & Pola, J. A mechanism for suppression of optokinesis. Vis. Res. 24, 1931–1945 (1984).
Howard, I. P., Giaschi, D. & Murasugi, C. M. Suppression of OKN and VOR by afterimages and imaginary objects. Exp. Brain Res. 75, 139–145 (1989).
Suzuki, Y., Shinmei, Y., Nara, H. & Ifukube, T. Effects of a fixation target on torsional optokinetic nystagmus. Invest. Ophthalmol. Vis. Sci. 41, 2954–2959 (2000).
Rajkowski, J., Kubiak, P. & Aston-Jones, G. Correlations between locuscoeruleus (LC) neural activity, pupil diameter and behavior in monkey supporta role of LC in attention. Society for Neuroscience Abstract. Presented at theSociety for Neuroscience Conference. 974 (1993).
Sara, S. J. The locus coeruleus and noradrenergic modulation of cognition. Nat. Rev. Neurosci. 10, 211–223 (2009).
Eckstein, M. K., Guerra-Carrillo, B., Miller-Singley, A. T. & Bunge, S. A. Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development?. Dev. Cogn. Neurosci. 25, 69–91 (2017).
Laeng, B., Ørbo, M., Holmlund, T. & Miozzo, M. Pupillary stroop effects. Cogn. Process 12, 13–21 (2010).
Book, G., Stevens, M.C., Pearlson, G. & Kiehl, K.A. Fusion of fMRI and the pupilresponse during an auditory oddball task. Presented at the Conference of the Cognitive Neuroscience Society (2008).
Siegle, G. J., Steinhauer, S. R. & Thase, M. E. Pupillary assessment and computational modeling of the Stroop task in depression. Int. J. Psychophysiol. 52, 63–76 (2004).
Hu, X., Hisakata, R. & Kaneko, H. Pupillary dilation elicited by attending to two disks with different luminance. J. Vis. 21(1), 11. https://doi.org/10.1167/jov.21.1.11 (2021).
Kano, M., Kano, M. S. & Maekawa, K. Optokinetic response of simple spikes of Purkinje cells in the cerebellar flocculus and nodulus of the pigmented rabbit. Exp. Brain Res. 87, 484–496 (1991).
Waespe, W. & Henn, V. Neuronal activity in the vestibular nuclei of the alert monkey during vestibular and optokinetic stimulation. Exp. Brain Res. 27, 523–538 (1977).
Sunkara, A., DeAngelis, G. C. & Angelaki, D. E. Joint representation of translational and rotational components of optic flow in parietal cortex. Proc. Natl. Acad. Sci. U. S. A. 113, 5077–5082 (2016).
Piras, A., Raffi, M., Perazzolo, M. & Squatrito, S. Influence of heading perception in the control of posture. J. Electromyogr. Kinesiol. 39, 89–94 (2018).
Persiani, M., Piras, A., Squatrito, S. & Raffi, M. Laterality of stance during optic flow stimulation in male and female young adults. Biomed. Res. Int. 2015, 1–9 (2015).
Raffi, M., Piras, A., Persiani, M. & Squatrito, S. Importance of optic flow for postural stability of male and female young adults. Eur. J. Appl. Physiol. 114, 71–83 (2014).
Piras, A., Perazzolo, M., Scalinci, S. Z. & Raffi, M. The effect of diabetic retinopathy on standing posture during optic flow stimulation. Gait Posture S0966–6362(20), 30600–30607 (2021).
Acknowledgements
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (Grant No. 2017R1D1A1B03036131 to Y.C. Rah) and a Korea University Funds (to Y.C. Rah). The funding bodies had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author information
Authors and Affiliations
Contributions
R.Y.C. designed the research study; C.S.I., H.J.H., and R.Y.C. performed the research; P.J.H. and R.Y.C. analyzed the data; P.J.H. and R.Y.C. wrote the paper; C.S.I. and C.J. served as scientific advisors. All the authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Park, J.H., Cho, S.I., Choi, J. et al. Pupil responses associated with the perception of gravitational vertical under directional optic flows. Sci Rep 11, 21303 (2021). https://doi.org/10.1038/s41598-021-00346-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-021-00346-y
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.