Introduction

Age-related macular degeneration (AMD) is the leading cause of irreversible blindness in the developed world, and causes considerable morbidity despite recent advances in treatment.1 Patients with AMD now may be treated using a variety of preventive methods,2 and anti-vascular endothelial growth factor (VEGF) therapy for choroidal neovascularization has converted wet AMD from a disease often resulting in vision of 20/200 or worse to one where patients may enjoy vision of 20/40.3 However, despite the visual outcome may be better than it was before the anti-VEGF therapy, patients with treated wet AMD often complain about difficulties performing tasks of daily living.

The Snellen chart test is the most commonly used chart to evaluate vision in clinical setting. More recently, the ETDRS chart has become the gold-standard test for best-corrected visual acuity (BCVA) in clinical trials evaluating eyes with macular disease.4 However, these are non-timed tests and thus may not reflect real-life situations such as driving, where the patient has only a limited amount of time to recognize objects and read signs and make important visual-based decisions. This is important in patients with AMD because many of the vision tasks that they complain about involve visual difficulties in time-dependent experiences including reading, driving, and recognizing faces in fluid social situations.5 In addition, well-known issues of scoring the Snellen chart test and the ETDRS test are also present: means of calculating BCVA scores may vary between examiners, as patients are often able to read only some letters but from multiple lines.6, 7 Moreover, these chart tests use high-contrast black letters against an unchanging white background of one luminance in the moderate photopic environment of the examination office. For these reasons, other investigators have suggested that these chart tests are not a useful determination of vision in other contrast or luminance environments, and those measurements are poorly correlated with daily living activities8, 9 that require the patient to assess visual stimuli in multiple lighting, contrast, or glare conditions against a varied background color or luminance.7 Also, many common daily activities require an individual to react to a visual stimulus with limited time or information.7, 10

Testing of multiple aspects of patients’ visual function (such as contrast sensitivity, luminance adaption, color perception, and reading speed) currently must be performed with separate tests and scoring methods. Recently, the Central Vision Analyzer (CVA; Visoptics, LLC, Mechanicsburg, PA, USA) has been introduced and approved by the Food and Drug Administration as a new interactive computer program to perform a comprehensive analysis of the central visual acuity under conditions that simulate environments of real-world activities that are often reported as visually stressful, such as those encountered under mesopic, lighting, or glare photopic conditions.11, 12, 13 It also simulates the fixation times that are required for those activities. Unlike the ETDRS chart test, the CVA presents tumbled Landolt C and thresholds for the smallest C for which the patient responds the correct position under the luminance, contrast and presentation times of the activity, watching and examining reaction times, and thus avoiding letter confusion with the consistent use of one symbol.10

The purpose of the present study was to evaluate how visual function varies in patients with AMD compared with normal subjects tested with this novel computerized test of time-dependent contrast sensitivity under conditions that simulate real-world environments.

Materials and methods

Subjects

We recruited 35 normal eyes and 37 eyes with an ophthalmoscopic diagnosis of wet or dry AMD, confirmed with retinal imaging, from 53 consecutive patients. Eyes with dry AMD had drusen, pigment changes, and/or drusenoid pigment epithelial detachment; all patients with wet AMD were under treatment with an anti-VEGF agent. Eyes with a concomitant ocular abnormality (eg, corneal opacity, cataract, or glaucoma) were not tested. Prior to CVA testing, all participants underwent refraction and BCVA assessment using a standard ETDRS chart. A full optical correction was given to each patient, if necessary. Written informed consent for non-invasive diagnostic procedure was obtained from each subject before examination. The study was approved by the Institutional Review Board at Shiley Eye Center at the University of California, San Diego (UCSD) and was conducted in adherence to the tenets of the Declaration of Helsinki. All applicable institutional and governmental regulations concerning the ethical use of human volunteers were followed during this research.

Visual function testing

Automated visual acuity testing was performed using the CVA. Participants were placed in a dark room of luminance <5 Cd/m2, sitting at a distance of 5 m from the testing 20-inch LED monitor, as calculated by the combined distance from the participant to the mirror and from the mirror to the testing monitor.12 First, an instruction video with a practice test was given: participants were shown a fixation cross on the monitor and asked to indicate the orientation of the tumbled Landolt C by pressing the corresponding arrow button ‘right,’ ‘left,’ ‘up’, or ‘down’ on a keypad on their lap. If they pressed the correct button, the response would be counted as correct. Any other button pressing, including no pressing within the maximum time period (up to 4 s), would be counted as incorrect. After the instruction video, patients performed the CVA testing twice using a Landolt C presentation of 900 ms. Our initial experience suggested that the 900-ms stimulus duration is well tolerated and fast enough to simulate a real-world, time-dependent situation, while patients expressed concern when tested with shorter presentations. Participants were allowed 15 min of rest in a dimly lit room between the two sessions.

As previously described by our group,13 the CVA thresholds acuity under three mesopic and three photopic (backlight glare) environments in sequential manner, automatically changing contrast and luminance levels. Contrasts and luminance levels of the six modules are presented in Table 1. Specifically, they were 99% Michelson contrast (MC) module with white letters against a 3 Cd/m2 background (‘M1’ module), followed by lower-contrast mesopic module of 64% MC against a 3 Cd/m2 background (‘M2’ module, simulating an environment similar to a dimly lit restaurant), and then an even lower-contrast module of 43% MC against a 3 Cd/m2 background (‘M3’ module, simulating visual activities encountered while driving at dusk). Immediately following the mesopic conditions, backlight-glare conditions were then tested in the following order: 10% MC module with black letters against a 200 Cd/m2 background (‘G2’ module, simulating playing golf or tennis outside with the sun over head), followed by an even lower-contrast module of 8% MC against a 200 Cd/m2 background (‘G3’ module that simulates playing golf or tennis outside under the sun 15° off-axis), and finally ending with the ‘G1’ module, a full-contrast module of black letters presented at 99% MC against a 200 Cd/m2 background. During the test, the CVA software automatically adjusts the size of the C depending upon the responses in a reversing staircase with progressively diminishing steps (6 : 4 : 2 : 1 of logMAR 0.05 steps) until a threshold is reached, determined by two correct responses at the lowest logMAR 0.05 presentation with two incorrect responses at one logMAR 0.05 step smaller. At the end of the test, results were automatically presented to the examiner in a report as six separate visual acuity threshold scores, one for each of the simulated lighting and contrast conditions.

Table 1 Central Vision Analyzer modules’ characteristics

Validation of the CVA

The validation study of the CVA is currently under review and therefore is not part of the present study. Validation data presented at the Association for Research in Vision and Ophthalmology meetings (Gutstein W et al IOVS 2006, 47, ARVO E-Abstract 92; Sinclair SH et al IOVS 2009, 50, ARVO E-Abstract 3977; Gutstein W et al IOVS 2009, 50, ARVO E-Abstract 3212; and Gutstein W et al IOVS 2012, 53, ARVO E-Abstract 3056), in brief, demonstrated 0.50 to 0.96 correlation with ETDRS charts presenting the same contrast and luminance with Bland and Altman statistics that demonstrate similar reproducibility and comparative visual acuities as acuity measurements with charts. One may question the ability of the CVA to measure sun glare environments on an LCD or LED monitor in a darkened room. The CVA reduces the contrast of the visualized targets against the background according to the research of Vos14 that predicted the resultant decrease in contrast for a 30-year-old individual visualizing the targets with the sun off-axis. This is defined by the off-axis distance of glare source and the ratio of the luminance of that source compared with the average luminance of the discriminated targets, not the absolute luminance (whether the source is the sun in daylight glare environments or headlight glare in mesopic environments).

For each activity, vision tasks were identified (eg, facial recognition and menu reading, among others for the activity restaurant dining) with their respective discriminated targets and backgrounds that were measured from electronic RAW images taken of each activity. Each element and the respective background represent point sources in the International Commission on Illumination (CIE) color space defined by their L × a × b × values (where ‘L’ represents luminance, ‘a’ represents the color hue, and ‘b’ represents the saturation of the color from white light occupying the center of the space). The color contrast between the two points is then represented as ΔE/L, the calculated Euclidean distance between the two points in the CIE color space.15, 16 To define the black and white contrast of the Landolt C presented against the pedestal and background, the ΔE/L contrasts were converted to the equivalent MCs for the averages of the most important vision tasks defined by participants of the activity (in each case not <10 persons), and then examined to define those that required the finest resolution among the higher ranked.

Because the system does not utilize anti-aliasing, careful consideration if given of the monitor to subject’s face viewing distances such that, given the pixel step sizes, the gap openings of the smallest Landolt C must represent no greater than a 10% variance from the correct size. The test monitor chart background luminance and contrast of the presented figures were controlled by calibration measurements that were repeated at required monthly intervals using the Pantone Huey colorimeter (Pantone LLC, Carlstadt, NJ, USA). In addition, the colorimeter is set facing toward the mirror in order to measure and control the luminance of the wall (and hence room luminance viewed) by the patient during the testing.

Statistical analysis

Statistical analyses were performed using SAS statistical software version 9.2 (SAS Inc., Cary, NC, USA). Main outcome measures in this study were the threshold logMAR BCVA scores for each CVA module. The repeatability of the BCVA scores was evaluated by the standard deviation (SD) of repeated measurements (test–retest) described by Bland and Altman.17 Generalized estimating equations, adjusted for age, were used to test for the overall significance of BCVA measurements across categories. Bonferroni-adjusted P-values were used for multiple pairwise comparisons. Pearson’s correlation analysis was completed using subject-averaged logMAR BCVA measurements. A P-value <0.05 was considered to be statistically significant.

Results

The mean age of the 53 subjects (72 eyes) enrolled in the study was 39 years for normal patients (range 20–69 years, 35 eyes) and 79 years for AMD patients (range 46–83 years, 37 eyes; P<0.001). The median BCVA was 20/20 and 20/32 for normal and pathological groups, respectively. The average duration for the CVA testing was 2.1 min per eye in normal eyes (range 1.5–3.0 min), and 3.5 min per eye in eyes with AMD (range 2.0–4.0 min).

Both in normal subjects and in AMD patients, visual function significantly reduced with decreasing contrast and luminance in all mesopic and glare environments (Table 2). M1 scores (high-contrast environment) were significantly better than M2 and M3 (low-contrast environments; both P<0.001). Similarly, G1 scores (high-contrast environment) were significantly better than G2 and G3 (low-contrast environments; both P<0.01). In AMD eyes, the visual function dropped to a greater extent than seen in normal eyes with decreasing contrast and luminance in mesopic environments (P=0.002 between M1 and M2, and P=0.003 between M1 and M3; Table 2 and Figure 1). In addition, the drop between M1 and M3 was significantly greater in eyes with wet AMD compared to eyes with dry AMD (P=0.003); no different visual drops were found in glare environments between wet and dry AMD eyes. The greater drop of visual function for AMD patients compared to normal subjects was not found in glare environments (P=0.957 between G1 and G2, and P=0.791 between G1 and G3; Table 2 and Figure 1).

Table 2 Comparison between visual acuity results for each module by disease group
Figure 1
figure 1

Clustered column graph showing comparisons between visual acuity drops for normal eyes and eyes with age-related macular degeneration (AMD) while changing lighting/contrast conditions using the Central Vision Analyzer. The visual function dropped more in AMD eyes than normal eyes while decreasing contrast and Landolt C luminance in mesopic environments (P=0.002 between M1 and M2, and P=0.003 between M1 and M3). This greater drop for AMD patients compared to normal patients was not found in glare environments (P=0.957 between G1 and G2, and P=0.791 between G1 and G3). The drop in visual function between ETDRS and G1 was significantly greater in AMD eyes compared to normal eyes (P=0.004).

We also compared results of the logMAR BCVA of the G1 module (the closest one to lighting of the ETDRS chart—high-contrast black type over a bright white background) to the logMAR ETDRS BCVA (Table 2). In AMD eyes, we found that BCVA score was significantly different between ETDRS and G1 (P<0.001); more specifically, the ETDRS score was better than the G1 score. On the contrary, ETDRS and G1 scores for BCVA did not differ for normal patients (P=0.100). The drop in visual function between ETDRS and G1 was significantly greater in AMD eyes compared to normal eyes (P=0.004; Table 2 and Figure 1).

Table 3 summarizes results of the test–retest coefficients of repeatability (equal to 1.96 × standard error sigma) for each of the CVA modules. The SDs of test–retest ranged from 0.100 to 0.129 logMAR in normal eyes, from 0.118 to 0.139 logMAR in eyes with AMD, and from 0.100 to 0.132 in the entire sample. Independent t-test demonstrated no significant difference in repeatability scores between normal and AMD eyes. Bland–Altman plots for visual function measurements in each CVA environment are shown in Figure 2, both for normal eyes and AMD eyes. Scrutiny of Bland–Altman charts did not demonstrate any untoward relationship between agreement and magnitude of any measures, with random scatter above and below zero and no significant bias.

Table 3 Results of repeatability of visual acuity scores using Central Vision Analyzer (logMAR units)
Figure 2
figure 2

Bland–Altman plots for visual function measures for normal eyes (a–f) and for eyes with age-related macular degeneration (g–l) in the six modules of the Central Vision Analyzer. (a,g) ‘M1’ module (full-contrast module of white letters presented at 99% contrast against a 3 Cd/m2 background). (b,h): ‘M2’ module (lower-contrast module of 64% contrast against a 3 Cd/m2 background, simulating an environment similar to a dimly lit restaurant). (c,i) ‘M3’ module and (lower-contrast module of 43% contrast against a 3 Cd/m2 background, simulating an environment similar to driving at dusk). (d,j) ‘G1’ module (full-contrast module of black letters presented at 99% contrast against a 200 Cd/m2 background). (e,k) ‘G2’ module (lower contract module of 10% contrast against a 200 Cd/m2 background, simulating playing golf or tennis outside with the sun over head). (f,l) ‘G3’ module (lower-contrast module of 8% contrast against a 200 Cd/m2 background, simulating an environment similar to playing golf or tennis outside under the sun 15° off-axis).

Discussion

In the present study, we used the CVA to evaluate visual function in different mesopic- and backlight-glare environments in eyes with AMD compared to normal eyes, using time-dependent settings to simulate real-life conditions. BCVA scores reduced significantly with decreasing contrast and luminance conditions in both normal and AMD eyes. However, the visual function in AMD eyes was more affected than in normal eyes by the decreasing contrast in mesopic conditions; that is, the magnitude of vision drop was larger for AMD eyes than for normal eyes. In addition, we found that ETDRS scores and G1 scores for BCVA were equal only for normal eyes, while the ETDRS charts measured a better acuity compared to the G1 module (timed test) for AMD eyes. This means that, under timed conditions, AMD eyes (and not normals) have significantly lower acuity than expected. As discussed further below, CVA testing was generally a repeatable method, with repeatability within 0.10 and 0.14 logMAR for both normal and AMD eyes.

In an era of important technological treatment advances in AMD and other ophthalmic disorders, it is important to understand the real-world effects on vision of such interventions. For example, a patient with treated wet AMD may achieve a BCVA of 20/40 but the quality of that vision may not be good in everyday situations where speed-related vision tasks at varying contrast or background illumination are common. The Snellen chart test and the ETDRS chart test are the current standard methods for testing BCVA in clinical and research settings,4 and Pelli–Robson charts are one of the most common methods for testing contrast sensitivity. However, these tests allow the patient to take an indefinite amount of time to recognize the target; this is not reproducing real-world experiences, which are time-dependent. The Pelli–Robson contrast chart requires different test cards than the ETDRS, has a different illumination, and tests only contrast at large spatial frequencies. On the contrary, the CVA tests contrast at both high and low spatial frequencies (ie, high and low visual acuity). Moreover, the Snellen testing is less accurate than ETDRS in patients with AMD probably because of its lower contrast and brightness, resulting in lower acuity measurements than ETDRS.18 With the use of the timed CVA testing we demonstrated that lighting and contrast variations significantly reduce the visual performance for both normal and AMD subjects. However, contrast reduction affects AMD patients more adversely than normal subjects; in addition, eyes with wet AMD experience more trouble in low-contrast environments than dry AMD eyes. This is consistent with results of previous studies that reported delayed light adaptation and reduced contrast sensitivity in patients with AMD.19, 20 We did not find differences in drops of visual function between normal and AMD eyes in backlight-glare environments. The presence of a smaller pupil size in elderly population may account for the lack of effect of backlight glare, and therefore explain this finding.

The luminance and contrast of the CVA’s G1 module is most similar to that of the ETDRS chart test (eg, high-contrast black type over a bright white background). We demonstrated that in eyes with AMD, testing BCVA with conventional non-timed ETDRS charts lead to better visual scores compared to the timed G1 testing; this finding is likely due to the time-dependent nature of the automated CVA testing. It is known that patients with macular pathology have a slower reading speed than normal patients21 and thus may fail to recognize letters if projected only for a short period of time. However, we emphasize that in real-life situations one does not have all the time he wants to read something, such as reading a road sign while driving, or reading a sign on a moving object. Therefore, we believe that a time-dependent test for BCVA, such as the CVA, may reproduce real-life situations better than a static ETDRS chart.

We also tested the repeatability of the CVA testing. The test–retest coefficients of repeatability of the CVA were found to be within 0.10 and 0.14 logMAR for both normal and AMD eyes, without significant differences between the two groups. At first glance, the coefficients of repeatability of the CVA appear to be slightly larger than those that are reported for reading logMAR charts. For 0.1 logMAR chart reading, previous studies reported repeatability mean sigmas of 0.04 to 0.05 logMAR (95% confidence limits: 0.086 to 0.100 logMAR) among young subjects, and up to 0.08 logMAR (95% confidence limits: 0.130 logMAR) among older individuals for letter-by-letter scoring. Our repeatability scores using the CVA are slightly lower than that reported with ETDRS likely because our subjects were patients with clinical problems, while most ETDRS studies often tested young motivated optometry students without refractive errors.22, 23 Second, the ETDRS chart test and the CVA test are designed with different size steps; on an ETDRS-style chart each letter accounts for 0.02 logMAR in size, while the CVA uses 0.05 logMAR size steps. Random fluctuations in repeatability will lead to poorer repeatability of the CVA because of its coarser scale.22, 23 Third, letter-by-letter scoring (as measured using the ETDRS chart) is dependent upon the termination criteria of the examiner and whether the examined individual is forced to proceed through the entire chart to the end with encouraged guessing,6 as opposed to proceeding downward to a line in which none of the letters are guessed correctly.24 If the examiner knows the prior test result, this will influence his/her termination criteria. Therefore, in a clinical setting testing of real patients, in which the examiner cannot control or influence the automated CVA test, and in which guessing is allowed but not forced, the resultant mean test–retest coefficient of repeatability is elevated to levels of 0.10 to 0.14 logMAR with 95% confidence limits of 0.19 to 0.24 logMAR.

In conclusion, the automated CVA showed the problems that AMD patients have in a six-domain real-life vision simulation scenario and helped explaining the complaints that such individuals have under timed conditions. We suggest that testing vision using timed tests across different lighting/contrast situations will help ophthalmologists in better understanding the quality of vision in AMD patients compared to the standard ETDRS charts test.