Multifocal pupillographic objective perimetry (mfPOP) has recently been shown to be able to measure cortical function. Here we assessed 44 regions of the central 60 degrees of the visual fields of each eye concurrently in 7 minutes/test. We examined how foveally- and peripherally-directed attention changed response sensitivity and delay across the 44 visual field locations/eye. Four experiments were completed comparing white, yellow and blue stimulus arrays. Experiments 1 to 4 tested 16, 23, 9 and 6 subjects, 49/54 being unique. Experiment 1, Experiments 2 and 3, and Experiment 4 used three variants of the mfPOP method that provided increasingly improved signal quality. Experiments 1 to 3 examined centrally directed attention, and Experiment 4 compared effects of attention directed to different peripheral targets. Attention reduced the sensitivity of the peripheral locations in Experiment 1, but only for the white stimuli not yellow. Experiment 2 confirmed that result. Experiment 3 showed that blue stimuli behaved like white. Peripheral attention showed increased sensitivity around the attentional targets. The results are discussed in terms of the cortical inputs to the pupillary system. The results agree with those from multifocal and other fMRI and VEP studies. mfPOP may be a useful adjunct to those methods.
The study of visual attention has grown prodigiously over the past 25 years. Although there is some evidence of increased sensitivity to attended items, behavioural studies have generally indicated that there is suppression of sensitivity peripheral to the focus of attention1,2,3,4. In seeming agreement early fMRI studies of attention reported reduced BOLD signals for unattended parts of the visual field5,6,7,8,9. Recent studies indicate that these changes are not due to blood stealing10, and that they are correlated with independent measures of reduced brain responsivity11,12,13,14,15.
The suppressive effects are best seen when several peripherally placed distractors are presented together. A genre of experimental methods where this occurs as a matter of course are the multifocal methods, where responses are obtained to many independent stimuli that are concurrently presented across the visual field. For such stimuli, there is scope for attended and unattended stimuli amongst the concurrently presented ensemble, as can occur in nature. Attention has been reported to enhance multifocal VEP (mfVEP) responses at the attended location, and also to produce a mixture of milder enhancement and suppression at adjacent unattended locations16. Those patterns of sensitivity change are similar to those reported for fMRI methods that use multifocal-like methods17,18. One of us has extended multifocal methods to fMRI assessing retinotopic brain mapping19,20. That multifocal fMRI method has been applied to visual attention showing focal enhancement and peripheral suppression21. Here we describe a convenient and lower-cost multifocal method with which to explore attentional effects across the visual field: multifocal pupillographic objective perimetry (mfPOP).
Early versions of mfPOP have produced good diagnostic performance for glaucoma22,23,24, macular degeneration25,26, and early-stage diabetic retinopathy27,28. More recently the method has shown clinically useful results in multiple sclerosis29. The pupillary system is known to receive input from at least 7 extra-striate visual cortical areas30. Two of our recent studies confirm cortical input to mfPOP responses24,31. Furthermore, by using combined mfPOP and mfVEPs, we have recently verified extra-striate cortical drive of the irises in 42 subjects for stimuli like those used here33. A recent fMRI study reported that extra-striate cortical areas beyond V4 have been shown to have wider zones of peripheral suppression extending to 10 to 20 degrees away from the focus of attention18, well within the parts of the visual field tested by the mfPOP stimuli used here.
Here we mainly examine whether a foveally-directed attentional task suppresses mfPOP responses to ensembles of 44 multifocal stimuli per eye, presented at locations spanning 1 to 30 degrees eccentricity. This study arose as part of an investigation of mfPOP responses to stimulus ensembles of yellow or white stimuli presented at a range of luminance levels33. In our initial experiments on 16 subjects, the results for centrally directed attention were counter-intuitive: responses to peripherally presented white stimuli were suppressed, but this was not seen for the yellow stimuli. We therefore repeated the experiment with 23 different subjects, different experimenters, and mfPOP stimuli that had improved signal to noise ratios. Since white stimuli differ from yellow in containing blue we also examined blue vs. yellow stimuli in a further 9 subjects. Finally we compared the effects of attention directed to peripheral targets using the newest mfPOP stimulus methods26 on 6 subjects. We present the results of the four studies here and discuss them in terms of inputs to the pupillary system.
Experiment 1 examined 16 volunteer participants (8 females; mean age 23.8 ± 7.1 SD years). Experiment 2 included 23 subjects (12 females, 39 ± 13.6 years). Experiment 3 examined 9 subjects (6 females, 40.4 ± 7.8 SD years). Experiment 4 tested 6 subjects (3 females, 39.8 ± 9.62 years). Subjects had normal or corrected visual acuity of 6/9 or better. Their visual fields were tested with the Humphrey FDT-C20 visual field test (Carl Zeiss Meditec, Dublin, CA), and none showed visual deficits. The study conformed to the Declaration of Helsinki and subjects gave written informed consent under the Australian National University’s Human Experimentation Ethics protocols 04/238 and 10/061. Subjects were requested to refrain from caffeine or alcohol at for least one hour before each session.
Multifocal visual stimuli were presented using a prototype of the FDA-cleared nuCoria Field Analyzer (nCFA) (nuCoria, Acton, Australia), which records pupillary responses to dichoptic stimuli presented to both eyes (Fig. 1A). Refractive errors were corrected to the nearest 1.5 D. The nCFA stimuli are blurred so that they contain no spatial frequencies above 2 cpd, and thus refractive errors of <2 D do not significantly reduce the contrast of the stimuli. During the central attentional tasks, a button was provided for the subject to press (see Stimuli and Procedure below).
The stimulus ensemble for each eye contained 44 test regions extending from 2 to 30 degrees eccentricity. The stimuli are arranged in 5 concentric rings (Fig. 1B). In Experiment 1 all the stimuli had the same luminance, 288 cd/m2, as was used in the original mfPOP methods27. The stimuli of Experiments 2 to 4 had slightly different luminances across the regions. These differences were introduced to balance out differences in visual field sensitivity23. The maximum luminance of any test stimulus was 150 cd/m2. Aside from yielding more similarly sized responses at each tested region this luminance balancing also improves the median signal to noise ratios obtained by about 15% in the least responsive regions of the visual field23. The stimuli of Experiment 4 used the clustered volleys method which improve signal to noise ratios by 40% relative to the presentation methods of Experiments 2 and 326. Thus the experiments of this paper illustrate the evolution of the mfPOP method to date.
There were three colour-variants of the test stimuli: white, yellow and blue. The cone activations and CIE coordinates of the stimuli are given elsewhere24,31. All stimuli were presented against a background of 10 cd/m2. The temporal presentation of each of the stimulus regions was modulated by independent pseudo-random sequences. The transient onset stimuli were presented for a duration of 33 ms. In Experiment 1 the mean presentation interval was 1 s/region, generating 44 stimuli/s/eye; in Experiments 2 to 4 the mean interval was 4 s/region or 11 stimuli/s/eye. Those slower presentation rates have been shown to further improve signal to noise ratios23. In Experiment 1 each test was divided into eight segments of 30 seconds duration (4 minutes in total), whereas in Experiments 2 to 4 there were nine segments of 40 seconds (6 minutes). Rest periods of 7 seconds were given between segments. In the central Attention condition the centrally located fixation object changed transiently from a cross to a dot at random intervals during the course of each test sequence. This dot contained the same number of pixels as the cross. The fixation object remained a cross for the duration of the No-Attention condition. The fixation stimuli were red, were 1.6 deg square, and were presented within the central 2 deg of the stimulus ensembles. It is worth noting that in the No-Attention condition that the slow delivery of the transient onset stimuli meant that attention could not be distributed across a great number of stimuli at any one time. Experiment 4 employed a red 1.1 deg diameter circular attentional target displayed at either plus or minus10 deg eccentricity along the vertical midline. The mfPOP stimuli do not cross the horizontal of vertical meridians (Fig. 1)24, so the attentional targets did not overlap with any multifocal stimulus element. Subjects fixated centrally but attended to whichever target was presented.
In Experiment 1, the study was divided into two testing sessions, half the subjects first seeing the white stimuli in session 1, and half the yellow stimuli. Subjects were shown the other colour of stimuli in session 2. Subjects were randomized to doing or not doing the attentional task in one of the sessions. The task involved pressing the response button when they saw the fixation target change from the cross to the dot. In Experiments 2 and 3, all subjects were tested with four test protocols in a single session. For Experiment 2 these protocols presented: yellow stimuli with attention, yellow stimuli without attention, white stimuli with attention, and white stimuli without attention. In Experiment 3 transient blue stimuli were substituted for the white stimuli of Experiment 2. The order of these protocols was randomized across the subjects. Subjects were naïve as to the objectives of the two experiments. The experimenters were YH in Experiment 1, YR in Experiment 2,3, and CC and ER in Experiment 4.
Blinks or fixation losses during a test sequence were automatically labeled as invalid data22,27. If more than 15% of the data was lost from a particular test segment, it was repeated. Subjects were asked to blink several times prior to each test segment in order to minimize the blinking during the test. The multifocal analysis methods used in this experiment have been given in detail22,27. The regressive analysis method produced a standard error for each contraction amplitude and time to peak. These allow a t-statistic to be computed for each regional response amplitude and delay. The multifocal analysis is a form of multiple regression, so the standard errors are quite similar for each test region. The resulting t-statistics provided a measure of the signal reliability for each region, separate t-statistics being available for each region from each pupil.
The per region pupil constriction amplitudes in micrometers were transformed using a generalized log-transformation to stabilize the variance, and sensitivity at each visual field region was expressed in 10log10 decibels. To examine average regional effects, linear models were fitted that contained factors for region, and region by attention (Matlab ver 2016b). We also fitted effects for sex and consensual pupil response (response of a pupil to stimuli presented to the opposite eye). To examine the effect of eccentricity and deal with issues of multiple comparisons/subject, we fitted linear mixed-effects models. For Experiments 1 to 3 these were based on the mean response for each of the five rings of the stimuli (Fig. 1B), for each eye and pupil (R Foundation for Statistical Computing, version 3.2.0). These models contained effects for ring, ring by attention, sex and consensual pupil response. For Experiment 4 five analysis zones that pooled data for the left, inferior, right, superior and central field were substituted for rings. The central zone averaged results for the central 12 visual field regions, while the four peripheral zones averaged data from 8 visual field regions each.
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
Figure 2 illustrates the average effects of the attentional task upon each visual field region. The four figures are derived from linear models (Methods). The upper two panels (Fig. 2A,C) give the mean sensitivity at each of the 44 visual field locations for the No-Attention condition. Thus, the luminance of each coloured region indicates the mean sensitivity computed across eyes, pupils, and subjects (N = 64 data sets). Prior to fitting the models, the responses for right eyes were reversed right to left, and so the data are all presented as for the left eye, with the temporal visual field on the left. Figure 2B,C are the region by attention effects, averaged across eyes, pupils, and subjects (Δ Attention). The regions with a ‘*’ indicate regions in the Attention condition that deviated from those of the No-Attention condition at the p < 0.05 level, the background pale orange indicating zero difference, darker red hues indicating suppression. The results seem to suggest that, on average, centrally directed attention caused peripheral suppression of the responses to the white stimuli (Fig. 2B). In the case of yellow stimuli 12 regions showed average enhancement of responses across the subjects, and three regions showed suppression (Fig. 2D).
Following the initial result we created stimuli that were spatially similar but, due to their slower presentation rate and somewhat different luminances across the field, provided better signal to noise ratios23. We used these new stimuli to check the result of Experiment 1. In Experiment 2, all 23 subjects performed experiments with and without attention, for both white and yellow stimuli. Figure 3 illustrates the outcomes. The mean sensitivities obtained with and without attention are given in the top two rows (Fig. 3A,B,D,E) (N = 92 averaged fields/figure). The region by attention effects are given in Fig. 3C,F (Δ Attention). The results are broadly similar to Fig. 2, with 11 white stimulus regions producing suppression, 10 of them peripheral, while the yellow stimuli produced a mix of suppression and enhancement.
Figures 2 and 3 indicate some variability in the results. This variability might be due to sources such as: subject-wise issues, the particular attentional tasks, or noise. Figure 4 presents a measure of reliability of the mfPOP responses for the four conditions of Experiment 2 expressed as the mean (±SD) t-statistic for each of five rings of the stimuli (Methods). The t-statistics are calculated as the regional result divided by its SE. As mentioned in the Methods the multifocal analysis is essentially a multiple regression and so the SE for a given subject are fairly constant, hence variations in the t-statistic are mainly driven by changes in sensitivity or delay. For response amplitude, these t-statistics test the null hypothesis that there was no response. For the peripheral rings (Fig. 1B) the mean t-statistics were around 4 for all four test conditions indicating that the pupil signals were reliable.
Experiment 3 was similar to Experiment 2 except that blue transient stimuli were substituted for the white stimuli. Given that the yellow stimuli were trending towards enhancements with attention, then based on the idea that White = Yellow + Blue, one might expect the suppressive effects of attention might be somewhat larger for blue than for white. The analysis that follows indicates this is correct.
We decided to address the issues of the average effect of attention as a function of visual field eccentricity. The average regional effects of attention as presented in Figs 2B,D and 3C,F are reported as in automated perimetry tests using the univariate t-statics at each location (produced by the multiple regression models), which might be considered problematic. We therefore used linear mixed-effects models that computed the mean suppression or enhancements for each of the five rings of stimuli. These models contained 20 measures per subject (5 rings × 2 eyes × 2 pupils), and the mixed-effects models accounted for these multiple measures/subject. The equivalent linear models were also computed for comparison (using the lmer and lm functions of the lme4 library of R). As in the linear models used to produce Figs 2 and 3 we included effects for sex, and consensual response. Correcting for multiple comparisons reduced the t-statistics by about 10%, suggesting that the ring-wise effects were substantially independent.
Figure 5 summarises the results for the interaction: ring by attention, for the white, yellow and blue stimuli. The smaller standard errors of the data of Experiment 3 compared to the data for Experiment 1 are indicative of the better signal to noise ratios obtained for the newer stimuli (given similar N). In the case of Experiment 1 none of the attentional effects were significant for the mixed-effects models (Fig. 5A). The rings showing significance for the simpler linear models are marked with a ‘+’. For Experiment 2 the rings of the white stimuli with mean eccentricities of 12 and 24 degrees eccentricity showed significant suppression in the linear mixed-effects models (marked *). The results of Experiments 2 and 3 where similar, with blue stimuli behaving much like the white stimuli. The cyan dotted line of Fig. 5B is the simple sum of the results for yellow in Experiment 2 and those for blue in Experiment 3, on the simple assumption that White = Yellow + Blue, and that the results for experiment 2 provide the best evidence of average behavior for yellow (N = 23).
The results of adjustment for sex and consensual response from these mixed-effects models was very similar across the Experiments, and consistent with previous results. On average, consensual responses were about 94% of direct pupil responses, and females’ responses were about 1.1 times larger on average across the tests, regions etc. We checked for significant regional differences in attentional effects for direct and consensual responses but found none.
Figure 6 presents the same analysis as Fig. 5, but where the data are the delays in the time to peak contraction. Surprisingly the results are the reverse of those for pupil amplitude: attention appears to decrease the time to peak (hence the negative differences), but more so for yellow stimuli than for blue or white. For Experiment 2, for which we have the most data, the overall time to peak contraction was 456 ± 59.0 ms (mean ± SD) so the effects are <5% of the total delay. The mean regional t-statistic for delay was 16.8, implying a SE of about 3% of the total delay. Thus, the delays are accurately measured. The significant differences occur both centrally and peripherally, suggesting that perhaps the effects upon delay are more diffusely distributed across the visual field than effects upon sensitivity.
To extend these results we investigated the effects of attention directed to peripheral attentional targets placed at ±10 deg eccentricity along the vertical meridian (Methods). Thus, subjects fixated the central cross while attending to the superiorly- or inferiorly-placed target. This was repeated for white and yellow versions of the stimuli in six subjects. Experiments 1 to 3 all compared an Attention and No-Attention cases. The No-Attention case could be thought of as a distributed attention case, although the transient onset stimuli meant that only a few stimuli were presented at any one time (unlike conventional multifocal stimuli where modulating stimulus are continuously presented at all field locations). Nevertheless, it was useful to compare conditions for similarly directed attention. To quantify the effect we computed the difference between the results for superiorly and inferiorly directed attention. These data used the newer Clustered Volleys mfPOP method and the signal quality of these data was higher than the previous experiments providing a median (±SD) t-statistic for response amplitude of 5.53 ± 2.17 for yellow, and 5.58 ± 2.18 for white (cf. Fig. 4).
Figure 7A shows the mean difference in sensitivity at each point in the field (computed across eyes, pupils and subjects) for the white stimuli. Thus, positive numbers indicate greater sensitivity where attention was directed to the superior field and negative values indicate greater sensitivity where attention was directed to the inferior field. There are clear effects superiorly and more diffuse effects inferiorly. Figure 7B indicates the 5 zones used to pool (average) results for the mixed effects models, meaning these models parallel the 5-ring models of the previous experiments. Figure 7C shows the results from the models for white and yellow stimuli. Only the white stimuli provided significant results for the superior (S) and inferior (I) zones, 0.61 ± 0.19 dB and −0.42 ± 0.19 dB (mean ± SE) respectively. Figure 7D shows means of the pairs of regions straddling the vertical meridian of the field (±SE). The position of the attentional targets are indicted by black circular dots. It appears that the attentional effects are fairly diffuse and appear to extend to more peripheral locations. Examining the regions of the left and right zones of Fig. 7A indicates some suppression away from the point of attention. Analysis of response delays showed no significant differences.
The main finding of this study was that attention to the central visual field tended to produce suppression of sensitivity away from that focus. This is similar to the findings of fMRI studies that have employed multiple, concurrently presented stimuli across the visual field17,18,21. A point of difference was that stimuli containing blue (white stimuli) seemed to show stronger effects than yellow stimuli. To our knowledge, no such colour differences have been explored using fMRI. Conversely, attention to yellow stimuli accelerated pupil responses, while those to blue or white stimuli had little to no effect on delay. We are unsure as to why these delay effects occur but their presence strengthens the case that something different is occurring for stimuli that do, or do not contain blue. When the effects of peripheral attention were examined (Fig. 7) the observation was mainly of increased responses in the vicinity of the attended target, which was similar to the largest fMRI study of the effect of peripheral attentional targets21. Again effects were larger for white stimuli than yellow.
Although the responses reported here were well measured (Fig. 4) there appeared to be some variation across the field of the effects of attention (Figs 3C,F, 5 and 6). Of course, we do not yet know the details of how the effects of attention actually vary across the field, or across subjects. This is especially the case for the natural situation where all parts of the whole field are stimulated in parallel, all at the same time. What we do know mainly comes from three fMRI studies that used multifocal stimulus arrays that covered a similar portion of the fields as used here. One fitted attentional effects as difference of Gaussians (DOG) for the data of 4 subjects. In that study the point of attention followed a circular path at a fixed eccentricity during testing. Thus, the measured “fields” were the average for the circular set of attentional foci. That method allowed the broader effects of suppression by attention to be identified in higher cortical areas, some of which supply the pupils30. A second study showed high variability across its five subjects17. The third examined the effects of attention at 4 eccentric foci in 19 subjects, and found that attentional suppression was variable and strongest in the two superior quadrants of the visual field, while enhancement was greatest in the inferior field.21. As here the effects were quite diffuse and extended quite far peripherally. Mind you the BOLD changes observed were on the order of 0.5% rather than the 15% observed here (e.g. 0.6 dB, Fig. 7). None of these studies used dichoptic stimuli, nor did they investigate colour as used here. Overall new experiments and better methods are needed to understand the details of the distribution of attentional effects across the field. Our new Clustered Volleys stimuli include macular versions, which may prove interesting given the recent demonstration effects of directed attention within the fovea.34 Also they could allow more direct comparison with the fMRI studies of Simola et al.21 that sampled the central 20 degrees, with peripheral attentional targets presented at 4 degrees.
Colour dependent attentional effects are not totally without precedent. Work by Morrone et al.35 indicates that greater attentional effects occur when the chromatic properties of centrally attended targets match those of the peripheral stimuli. Here the red content of the peripheral stimuli and attentional tasks was similar except for the blue stimuli of Experiment 3.
Attentional effects are thought to be mediated by higher cortical areas exerting top-down influences36,37,38, which in humans not only extend to occipital cortical areas39, but also to modulation of the lateral geniculate nucleus (LGN)40, and the superior colliculus41,42,43. Thus, our results need to be discussed in terms of the blue sensing system and thalamo-cortical connectivity to the pupillary system of its visual inputs.
The pretectal olivary nuclei (PON) drive the pupils and receive about half their input directly from retinal ganglion cells (RGCs), and the remainder from brain areas including the striate and extra-striate cortex30. Perhaps the best-known cortical input to the pupils is the luminance-based accommodative triad, which converges the eyes, accommodates the lenses and constricts the pupils when objects draw near44. This cortically derived, stereopsis-driven, system also appears to make the pupils sensitive to equiluminant temporal modulation of very high spatial frequency luminance gratings45. Pupil responses to red-green equiluminant stimuli, can be reversibly modulated from macaque extrastriate cortex46, or blocked by related cortical lesions in humans47. Those patients display red-green achromatopsia, thus the cortically mediated visual sensation and the pupil responses are concordant. As we have confirmed with 44-region multifocal stimuli31, these cortically driven pupil responses to red-green equiluminant stimuli are delayed compared to responses to luminance stimuli48. Pupil responses to 13 Hz modulation of blue-yellow contrast are similarly delayed49.
The blue content of white stimuli has been reported to be a major source of between-subject variability in multifocal ERGs50 due to the different blue-blocking capacity of brunescent lenses in older persons. The subjects in the present study were too young for this to be a major factor. At the level of the retinal ganglion cells (RGCs) the blue system is quite heterodox compared to other RGC types. In primates, the luminance and red/green RGCs come in anatomically similar pairs of parasol and midget RGCs, with the inputs to their receptive field centres exchanged to provide ON or OFF luminance centres, and red-ON or green-ON centres. The anatomically similar members of each pair of RGC types differ principally in which strata of the inner plexiform layer (IPL) their dendrites reside51. By contrast, the blue-ON and blue-OFF signals we experience are gathered by anatomically very different sub-populations of RGCs. The small-bistratified RGCS carry the cone-driven Blue-ON/Yellow-OFF signal, while the cone-driven blue-OFF/Yellow-ON signal is transmitted by the giant-monostratified RGCs52. These cells are much larger than the bistratified RGCs and have sub-populations defined by their stratification in the IPL and whether their axons project to the LGN or the PON.
All the giant-monostratified RGCs contain melanopsin, making them intrinsically photo-receptive to blue light52, and so they are sometimes referred to as ipRGCs. The melanopsin has no light adaptation mechanism, which gives the ipRGCs a Blue-ON response that tracks absolute luminance in bright conditions53. The melanopsin response is very sluggish and is the main determinant of the steady state pupil diameter in bright light53,54,55. The cone derived Blue-OFF and melanopsin derived Blue-ON responses are thus temporally duplexed. Thus, post-synaptic cells could largely select which blue signal they are attending to (ON or OFF) by either integrating with a time constant of about 1 second, or by differentiating the input to monitor frequencies above 1 Hz.
The key factor for the present study is that both types of blue sensitive RGCs appear to contribute to visual perception via their projections to the LGN. As summarised above these signals then return to the pupillary system via the extra-striate cortical input to the PON30. That multifocal stimuli such as those used here influence the pupils via this route has been recently demonstrated by several of our studies. We have compared yellow and red-green stimuli in healthy subjects31 and in glaucoma patients23. As shown by other studies the cortically derived pupil responses to red-green stimuli were delayed compared to luminance stimuli. Both stimulus types picked up visual field losses in glaucoma suggesting the pupillary responses to these transiently presented stimuli are concordant with visual perception. By contrast, when extremely slow, long duration, blue stimuli that drove melanopsin were used the ability to detect glaucomatous visual field loss was poor compared to our standard transiently presented yellow stimuli24. That may be because of the very large dendritic trees of the ipRGCs or the branching of ipRGC axons within the retina56. Overall, it seems we can at least partially choose cortical versus retinal sources by altering the temporal properties of the stimuli. This idea is supported by our demonstration that a visual field marker for early-stage macular degeneration and diabetic eye disease is seen both for yellow mfPOP and mfVEP testing on the same 47 patients when the mfVEP electrodes are positioned to pick up extrastriate cortical activity32. In summary, several sources of evidence indicate that mfPOP responses to transiently presented stimuli are substantially driven by the extrastriate cortex, as PON connectivity would suggest30.
Reports of the ability of the pupils to track aspects of attention and cognition have been growing, but so far not with a detailed spatial mapping of the attentional affects as shown here. For example, pupil constrictions to dim photographs of the sun have been reported57,58. Similarly, constriction and dilation effects have been shown with respect to modulations of attention and the apparent brightness of stimuli59,60. Attention, but not day-dreaming, modulates pupil dilation mediated by the slow sympathetic nervous system61. Here we have concentrated on the higher-bandwidth pupil constriction system driven by the parasympathetic system. That being said we have demonstrated that mfPOP can quantify the temporal evolution of the sympathetic-driven re-dilation phase out to several seconds24. Those parts of the pupillary response have been shown to quantify very interesting aspects of attentional modulation60,61. Thus, these effects could also be assessed in a multifocal setting, and differences between contraction and dilation effects quantified in one test.
The multifocal methods used here open up the possibility of examining retinotopic mechanisms of attention as has begun to be explored with fMRI17,18,21, but with a cheaper and more user-friendly apparatus. One could also combine pupillometry and fMRI, or pupillometry, fMRI, and Near Infrared Spectroscopy. As we have recently demonstrated mfVEPs measured using EEG electrodes that largely sample extra-striate visual cortex verify some aspects of mfPOP responses33, and there would be no reason not to do both simultaneously to better identify the sources of pupil responses to attention. Certainly, the set-up for mfPOP is shorter than for EEG, and the system is potentially very portable. The dichoptic set-up also allows for a variety of between-eye stimulus manipulations. An aspect we have not addressed is that by stimulating both eyes concurrently and recording both pupils both direct and consensual responses are recorded. This allows for differential examination of afferent versus efferent effects of attention. Some of our results indicate that efferent effects were large but confirmation will await the use of newer more reliable stimuli26.
Perhaps the rate of delivery of multifocal stimuli needs to be considered more. Differences between Experiment 1 and the other three were observed, and the stimulus delivery rate in Experiment 1 was 4 times higher. Aside from the stimuli being different, an idea suggested by a reviewer is that with the more rapid stimuli attention would possibly be more divided between them, when there was no central task.
A problem with the first three experiments was the possibility that the participants either guessed the purpose of the experiment, or invented some attentional task of their own during the experiments, when they were not directed to attend to the central changes. It was therefore useful to compare results obtained for different foci of continuously directed attention as in Experiment 4 (Fig. 7). Nevertheless, it was reasonable to attempt the Attention vs. No-Attention case in the first instance and that is what the closest fMRI studies have used21. Experiment 4 examined differences between different direct attention conditions and revealed that attention in the inferior field may be more variable.
Bahcall, D. O. & Kowler, E. Attentional interference at small spatial separations. Vision Res 39, 71–86, doi:S0042-6989(98)00090-X (1999).
Cepeda, N. J., Cave, K. R., Bichot, N. P. & Kim, M. S. Spatial selection via feature-driven inhibition of distractor locations. Percept Psychophys 60, 727–746, https://doi.org/10.3758/BF03206059 (1998).
Mounts, J. R. Attentional capture by abrupt onsets and feature singletons produces inhibitory surrounds. Percept Psychophys 62, 1485–1493, https://doi.org/10.3758/BF03212148 (2000).
Mounts, J. R. Evidence for suppressive mechanisms in attentional selection: feature singletons produce inhibitory surrounds. Percept Psychophys 62, 969–983, https://doi.org/10.3758/BF03212082 (2000).
Brefczynski, J. & DeYoe, E. A physiological correlate of the ‘spotlight’ of visual attention. Nat Neurosci 2, 370–374, https://doi.org/10.1038/7280 (1999).
Kastner, S., Pinsk, M., De Weerd, P., Desimone, R. & Ungerleider, L. Increase activity in human visual cortex during directed attention in the absence of visual stimulation. Neuron 22, 751–761, https://doi.org/10.1016/S0896-6273(00)80734-5 (1999).
Muller, N. G. & Kleinschmidt, A. The attentional ‘spotlight’s’ penumbra: center-surround modulation in striate cortex. Neuroreport 15, 977–980, doi:00001756-200404290-00009 (2004).
Slotnick, S. D., Schwarzbach, J. & Yantis, S. Attentional inhibition of visual processing in human striate and extrastriate cortex. Neuroimage 19, 1602–1611, doi:S1053811903001873 (2003).
Smith, A., Singh, K. & Greenlee, M. Attention suppression of activity in the human visual cortex. Neuroreport 11, 271–277 (2000).
Heinemann, L., Kleinschmidt, A. & Muller, N. Exploring BOLD changes during spation attention in non-stimulated visual cortex. PLoS ONE 4, 1–8, https://doi.org/10.1371/journal.pone.0005560 (2009).
Hopf, J. M. et al. Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision. Proc Natl Acad Sci USA 103, 1053–1058, https://doi.org/10.1073/pnas.0507746103 (2006).
Kastrup, A. et al. Behavioral correlates of negative BOLD signal changes in the primary somatosensory cortex. Neuroimage 41, 1364–1371, https://doi.org/10.1016/j.neuroimage.2008.03.049 (2008).
Mevorach, C., Hodsoll, J., Allen, H., Shalev, L. & Humphreys, G. Ignoring the elephant in the room: a neural circuit to downregulate salience. J Neurosci 30, 6072–6079, https://doi.org/10.1523/JNEUROSCI.0241-10.2010 (2010).
Herrmann, K., Montaser-Kouhsari, L., Carrasco, M. & Heeger, D. J. When size matters: attention affects performance by contrast or response gain. Nat Neurosci 13, 1554–1559, https://doi.org/10.1038/nn.2669 (2010).
Herrmann, K., Heeger, D. J. & Carrasco, M. Feature-based attention enhances performance by increasing response gain. Vision Res 74, 10–20, https://doi.org/10.1016/j.visres.2012.04.016 (2012).
Seiple, W., Clemens, C., Greenstein, V., Holopigian, K. & Zhang, X. The spatial distribution of selective attention assessed using the multifocal visual evoked potential. Vision Research 42, 1513–1521, https://doi.org/10.1016/S0042-6989(02)00079-2 (2002).
Brefczynski-Lewis, J., Datta, R., Lewis, J. & DeYoe, E. The topography of visuospatial attention as revealed by a novel visual field mapping technique. J Cog Neurosci 21, 1447–1460, https://doi.org/10.1162/jocn.2009.21005 (2009).
Puckett, A. M. & DeYoe, E. A. The attentional field revealed by single-voxel modeling of fMRI time courses. J Neurosci 35, 5030–5042, https://doi.org/10.1523/JNEUROSCI.3754-14.2015 (2015).
Vanni, S., Henriksson, L., Viikari, M. & James, A. C. Retinotopic distribution of chromatic responses in human primary visual cortex. Eur J Neurosci 24, 1821–1831, https://doi.org/10.1111/j.1460-9568.2006.05070.x (2006).
Vanni, S., Henriksson, L. & James, A. C. Multifocal fMRI mapping of visual cortical areas. Neuroimage 27, 95–105, https://doi.org/10.1016/j.neuroimage.2005.01.046 (2005).
Simola, J., Stenbacka, L. & Vanni, S. Topography of attention in the primary visual cortex. Eur J Neurosci 29, 188–196, https://doi.org/10.1111/j.1460-9568.2008.06558.x (2009).
Carle, C. F., James, A. C., Kolic, M., Loh, Y. & Maddess, T. High resolution multifocal pupillographic objective perimetry in glaucoma. Invest Ophth Vis Sci 52, 604–610, https://doi.org/10.1167/iovs.10-5737 (2011).
Carle, C. F., James, A. C., Kolic, M., Essex, R. W. & Maddess, T. Luminance and color variant pupillographic perimetry in glaucoma. Clin Exp Ophthal 42, 815–824, https://doi.org/10.1111/ceo.12346 (2014).
Carle, C. F., James, A. C., Kolic, M., Essex, R. W. & Maddess, T. Blue multifocal pupillographic objective perimetry in glaucoma. Invest Ophth Vis Sci 56, 6394–6403, https://doi.org/10.1167/iovs.14-16029 (2015).
Sabeti, F., Maddess, T., Essex, R. W. & James, A. C. Multifocal pupillography identifies ranibizumab induced changes in retinal function for exudative age-related macular degeneration. Invest Ophthalmol Vis Sci 53, 253–260, https://doi.org/10.1167/iovs.11-8004 (2012).
Sabeti, F. et al. Multifocal pupillography in early age-related macular degeneration. Opt Vis Sci 91, 904–915, https://doi.org/10.1097/OPX.0000000000000319 (2014).
Bell, A., James, A., Kolic, M., Essex, R. & Maddess, T. Dichoptic multifocal pupillography reveals afferent visual field defects in early type 2 diabetes. Invest Ophthalmol Vis Sci 51, 602–608, https://doi.org/10.1167/iovs.09-3659 (2010).
Sabeti, F. et al. Multifocal pupillography identifies changes in visual sensitivity according to severity of diabetic retinopathy in type 2 diabetes. Invest Ophthalmol Vis Sci 56, 4504–4513, https://doi.org/10.1167/iovs.15-16712 (2015).
Ali, E. N., Maddess, T., James, A. C., Voicu, C. & Lueck, C. J. Pupillary response to sparse multifocal stimuli in multiple sclerosis patients. Multiple Sclerosis J 20, 854–861, https://doi.org/10.1177/1352458513512708 (2014).
Gamlin, P. D. The pretectum: connections and oculomotor-related roles. Prog Brain Res 151, 379–405, https://doi.org/10.1016/S0079-6123(05)51012-4 (2006).
Carle, C. F., James, A. C. & Maddess, T. The pupillary response to color and luminance variant multifocal stimuli. Invest Ophthalmol Vis Sci 54, 467–475, https://doi.org/10.1167/iovs.12-10829 (2013).
Sabeti, F. et al. Comparing multifocal pupillographic objective perimetry (mfPOP) and multifocal visual evoked potentials (mfVEP) in retinal diseases. Sci Reports 7, 45847, https://doi.org/10.1038/srep45847 (2017).
Maddess, T. et al. Multifocal pupillographic perimetry with white and colored stimuli. J. Glaucoma 20, 336–343, https://doi.org/10.1097/IJG.0b013e3181efb097 (2010).
Poletti, M., Rucci, M. & Carrasco, M. Selective attention within the foveola. Nat Neurosci, https://doi.org/10.1038/nn.4622 (2017).
Morrone, M. C., Denti, V. & Spinelli, D. Color and luminance contrasts attract independent attention. Curr Biol 12, 1134–1137, https://doi.org/10.1016/S0960-9822(02)00921-1 (2002).
Corbetta, M. & Shulman, G. Control of goal directed and stimulus-driven attention in the brain. Nature Rev Neurosci 3, 201–205, https://doi.org/10.1038/nrn755 (2002).
Kastner, S. & Pinsk, M. Visual attention as a multilevel selection process. Cog Aff Behav Neurosci 4, 483–500, https://doi.org/10.3758/CABN.4.4.483 (2004).
Maunsell, J. Neuronal representations of cognitive state: reward or attention? Trends Cog Sci 8, 261–265, https://doi.org/10.1016/j.tics.2004.04.003 (2004).
Saygin, A. & Sereno, M. Retinotopy and attention in human occipital, temporal, parietal and frontal cortex. Cerebral Cortex 18, https://doi.org/10.1093/cercor/bhm242 (2008).
O’Connor, D., Fukui, M., Pinsk, M. & Kastner, S. Attention modulates responses in the human lateral geniculate nucleus. Nat Neurosci 5, 1203–1209, https://doi.org/10.1038/nn957 (2002).
Anderson, E. & Rees, G. The neural correlates of spatial orienting in the human colliculus. J Neurophysiol, https://doi.org/10.1152/jn.00286.2011 (2011).
Katyal, S., Zughni, S., Greene, C. & Ress, D. Topography of covert visual attention in human superior colliculus. J Neurophysiol 104, 3074–3083, https://doi.org/10.1152/jn.00283.2010 (2010).
Schneider, K. & Kastner, S. Effects of sustained spatial attention in the human lateral geniculate nucleus and superior colliculus. J Neurosci 29, 1784–1795, https://doi.org/10.1523/JNEUROSCI.4452-08.2009 (2009).
Stark, L., Kenyon, R. V., Krishnan, V. V. & Ciuffreda, K. J. Disparity vergence: a proposed name for a dominant component of binocular vergence eye movements. Am J Optom Physiol Opt 57, 606–609, https://doi.org/10.1097/00006324-198009000-00011 (1980).
Slooter, J. & van Norren, D. Visual acuity measured with pupil responses to checkerboard stimuli. Invest Ophthalmol Vis Sci 19, 105–108, https://doi.org/10.1167/iovs.12-10829 (1980).
Heywood, C. A., Nicholas, J. J., LeMare, C. & Cowey, A. The effect of lesions to cortical areas V4 or AIT on pupillary responses to chromatic and achromatic stimuli in monkeys. Exp Brain Res 122, 475–480, https://doi.org/10.1007/s002210050536 (1998).
Keenleyside, M. S., Barbur, J. L. & Pinney, H. D. Stimulus-specific pupillary responses in normal and hemianopic subjects. Perception 17, 347 (1988).
Barbur, J. L., Harlow, A. J. & Sahraie, A. Pupillary responses to stimulus structure, colour and movement. Opthal Physiol Optics 12, 137–141 (1992).
Drew, P., Sayres, R., Watanabe, K. & Shimojo, S. Pupillary response to chromatic flicker. Exp Brain Res 136, 256–262, https://doi.org/10.1007/s002210000605 (2001).
Fortune, B. & Johnson, C. A. Decline of photopic multifocal electroretinogram responses with age is due primarily to preretinal optical factors. J Opti Soc Am A 19, 173–184, https://doi.org/10.1364/JOSAA.19.000173 (2002).
Dacey, D. M., Peterson, B. B., Robinson, F. R. & Gamlin, P. D. Fireworks in the primate retina: in vitro photodynamics reveals diverse LGN-projecting ganglion cell types. Neuron 37, 15–27, https://doi.org/10.1016/S0896-6273(02)01143-1 (2003).
Dacey, D. et al. Melanopsin-expressing ganglion cells in primae retina signal colour and irradiance and project to the LGN. Nature 433, https://doi.org/10.1038/nature03387 (2005).
Keenan, W. T. et al. A visual circuit uses complementary mechanisms to support transient and sustained pupil constriction. Elife 5, https://doi.org/10.7554/eLife.15392 (2016).
Gamlin, P. et al. Human and macaque pupil responses drivenby melanopsin- containign retinal ganglion cells. Vision Res 47, 946–954, https://doi.org/10.1016/j.visres.2006.12.015 (2007).
Barrionuevo, P. A. & Cao, D. Luminance and chromatic signals interact differently with melanopsin activation to control the pupil light response. J Vis 16, 29, https://doi.org/10.1167/16.11.29 (2016).
Joo, H. R., Peterson, B. B., Dacey, D. M., Hattar, S. & Chen, S. K. Recurrent axon collaterals of intrinsically photosensitive retinal ganglion cells. Vis Neurosci 30, 175–182, https://doi.org/10.1017/S0952523813000199 (2013).
Binda, P., Pereverzeva, M. & Murray, S. O. Pupil constrictions to photographs of the sun. J Vis 13, https://doi.org/10.1167/13.6.8 (2013).
Naber, M. & Nakayama, K. Pupil responses to high-level image content. J Vis 13, https://doi.org/10.1167/13.6.7 (2013).
Naber, M., Alvarez, G. A. & Nakayama, K. Tracking the allocation of attention using human pupillary oscillations. Front Psychol 4, 919, https://doi.org/10.3389/fpsyg.2013.00919 (2013).
Mathot, S., van der Linden, L., Grainger, J. & Vitu, F. The pupillary light response reveals the focus of covert visual attention. PLoS One 8, e78168, https://doi.org/10.1371/journal.pone.0078168 (2013).
Kang, O. E., Huffer, K. E. & Wheatley, T. P. Pupil dilation dynamics track attention to high-level information. PLoS One 9, e102463, https://doi.org/10.1371/journal.pone.0102463 (2014).
This research was supported by Australian Research Council through the ARC Centre of Excellence in Vision Science (CE0561903). Drs Rosli and Carle are equal first authors.
Yanti Rosli – None. Corinne Carle – Patent to NuCoria Pty Ltd., Acton, ACT. Australia. Yiling Ho - None. Andrew James - Research support and Patent to nuCoria NuCoria Pty Ltd., Acton, ACT. Australia. Maria Kolic – None. Emilie Rohan - None. Ted Maddess - Research support and Patent to NuCoria Pty Ltd., Acton, ACT. Australia.
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Rosli, Y., Carle, C.F., Ho, Y. et al. Retinotopic effects of visual attention revealed by dichoptic multifocal pupillography. Sci Rep 8, 2991 (2018). https://doi.org/10.1038/s41598-018-21196-1
This article is cited by
Neurological Sciences (2023)
Multifocal pupillographic objective perimetry for assessment of early diabetic retinopathy and generalised diabetes-related tissue injury in persons with type 1 diabetes
BMC Ophthalmology (2022)
BMC Neurology (2021)
Graefe's Archive for Clinical and Experimental Ophthalmology (2020)
Disinhibition of intrinsic photosensitive retinal ganglion cells in patients with X-linked congenital stationary night blindness
Graefe's Archive for Clinical and Experimental Ophthalmology (2019)