Introduction

Over the past decade, technologies measuring the peripapillary retinal nerve fibre layer (RNFL) thickness have gained wide popularity in ophthalmology. Optical coherence tomography (OCT), first described in 1991 by Huang et al,1 has a major role in this context and has been applied in the diagnosis of several diseases of the optic nerve, such as glaucoma, optic neuritis, papilledema, hereditary optic neuropathies, and multiple sclerosis.2, 3, 4, 5, 6 Until recently most clinical investigations were carried out by using time-domain OCT (TD-OCT), which has been available since the mid 90s on the OCT 1 and since 2002 on the Stratus OCT (both from Carl Zeiss Meditec, Dublin, CA, USA). TD-OCT uses a scanning interferometer and an 820-nm infrared light source that is split into two separate beams: one beam scans a tissue being analysed, and the other one functions as a reference beam that is reflected by a moving reference mirror. By comparing the two light beams, TD-OCT measures the optical backscattering of light to generate a cross-sectional image of the tested tissue. These instruments have been shown to provide measurements of the RNFL thickness with good repeatability and reproducibility, which are mandatory requisites for accurately assessing a disease and its progression.7, 8, 9 Moreover, their measurements have been shown to correlate positively with ex vivo histological measurements of the retina.10, 11

Spectral-domain OCT (SD-OCT) has now replaced TD-OCT and a large number of instruments by different manufacturers are commercially available. This technology provides increased axial resolution and scanning speed as it records the interferometric information using a spectrometric method instead of adjusting the position of a reference mirror. Hence, it does not need to measure reflectivity changes between retinal layers in each A-scan one at a time. Instead, the spectrometer detects the relative amplitudes of many optical frequencies simultaneously within the backscattered light. Many points are thus sampled at the same time, with all of the retinal layer depths of each A-scan calculated using Fourier transformation.12 Resolution in Fourier transformation is up to five times higher and imaging speed is up to 50 times faster than in conventional TD-OCT.13 Showing the accuracy of RNFL thickness measurements is an important first step towards validating latest-generation SD-OCTs for the diagnosis of glaucoma and glaucoma progression, as well as any other disease of the optic nerve.

Recently, several authors showed that the Cirrus HD-OCT has very good intra-observer repeatability in both healthy and glaucomatous eyes.14, 15, 16 Similar results were obtained by Gonzáles-García et al17 with another instrument (RTVue; Optovue Inc., Fremont, CA, USA).

Optic nerve and RNFL analyses by TD-OCT are usually carried out after dilating the pupil. Earlier studies using OCT1 and OCT 2 always followed this procedure, due to difficulties in visualizing the optic disc without pupil dilation.18, 19, 20, 21, 22 Recently, mydriasis was also induced using Stratus OCT.20, 23, 24, 25 Some controversy, in fact, still exists regarding the effect of pupil dilation on RNFL thickness measurements by Stratus OCT: whereas some articles reported that the difference is little or even not statistically significant,26, 27 other studies found that measurements before and after dilation are not interchangeable.28, 29 Being able to acquire OCT scans without mydriasis would allow the operator to save time in a busy practice, would eliminate the risk of angle closure in predisposed eyes, and would not cause annoying visual disturbances in patients undergoing the examination. Moreover, it should be considered that during the follow-up it may occur that the same eye is examined sometimes with and without mydriasis. Hence, the aim of this study was to assess whether pupil dilation affects RNFL thickness measurements by Cirrus HD-OCT and their repeatability.

Materials and methods

Between February and March 2009, 35 eyes of 35 subjects were enrolled in a private practice for this prospective observational case series. The study population consisted of consecutive patients with minor refractive disorders. All individuals underwent a complete ophthalmological examination, including visual acuity measurement, intraocular pressure measurement, slit-lamp biomicroscopy, and indirect ophthalmoscopy, to determine eligibility. Inclusion criteria were: best corrected visual acuity above 20/25, refractive error between −3 and +3 dioptres of sphere or between −2 and +2 dioptres of cylinder, normal intraocular pressure <21 mm Hg, normal appearance of the optic disc, no significant ocular disease found by routine ophthalmological examination, no history of glaucoma in the family, and/or systemic diseases with possible ocular involvement, such as diabetes mellitus.

Before pupil dilation, three individual 200 × 200 cube optic disc scans were obtained with Cirrus OCT (software version 3.0) as previously described by Knight et al.12 Once the subject was seated and properly aligned, the iris was brought into view. The scanning laser ophthalmoscopic image was focused by adjusting for refractive error. As the optic nerve head was centred on the live scanning laser ophthalmoscopic image using the internal fixation cross, centring (Z-offset) and enhancement (polarization) were optimized. A 6 × 6 mm square of data was acquired. If the subject had an involuntary saccade during the scan, this was discarded and retaken (Figure 1). Ultimately, the signal strength had to be 6 or higher. Each optic disc scan captured a 6 × 6 × 2 mm ‘cube’ of data consisting of 200 A-scans from 200 linear B-scans (40 000 points) in 1.5 s (27 000 A-scans per second).

Figure 1
figure 1

Typical example of eye movement artefact with vessel misalignment. Scans like this were excluded.

Because the data collected by Cirrus are a ‘cube,’ rather than a single circle as in TD-OCT, a comparable circle (radius 1.73 mm) must be extracted from the data. In the Glaucoma Analysis, Cirrus HD-OCT algorithms find the optic disc, even if it is not well centred in the scan image, and automatically place a calculation circle of 3.46 mm diameter evenly around it. Layer-seeking algorithms find the RNFL inner (anterior) boundary and RNFL outer (posterior) boundary for the entire cube, except the optic disc. The system extracts from the data cube 256 A-scan samples along the path of the calculation circle. The resulting temporal, superior, nasal, inferior, temporal profile map is equivalent to the Stratus peripapillary RNFL scan.

The same procedure was carried out after pupil dilation induced by 1% tropicamide.

All participants gave their informed consent. The study was conducted according to the Declaration of Helsinki Principles and was approved by the internal review board of the Department of Neurological Sciences at the University of Bologna.

Statistics

For the purposes of this study, the term repeatability was used according to the definition of the British Standards Institute, which considers it as a part of accuracy.30 Accuracy, as formally defined by BS ISO 5725-1, includes trueness and precision. Trueness is the inverse of bias and is obtained by comparing the measurement result with the accepted reference (conventional true) value. Precision is the inverse of statistical uncertainty, and is normally expressed in terms of standard deviation (SD). The factors involved include (1) the operator, (2) the equipment used, (3) the equipment calibration, (4) the environment, and (5) the elapsed time between measurements. Precision has two conditions: repeatability and reproducibility. Under repeatability conditions, factors such as 1–5 are considered to be constant and do not contribute to the variability of the measurement result. Under reproducibility conditions, the factors can vary. Repeatability and reproducibility are the two extremes of precision.

We assessed repeatability by the following methods:

  • Repeated-measures analysis of variance (ANOVA): this was automatically calculated using InStat software 3.0 (GraphPad, San Diego, CA, USA, 2003) for each of the RNFL parameters (average, four quadrants and 12 sectors) both before and after pupil dilation.

  • Coefficient of variation (COV): this was calculated as the within-subject SD of the three repeated measurements divided by the within-subject mean, and was expressed as a percentage.8, 31

  • Intra-session test–retest variability in RNFL thickness: this was measured in micrometres and was calculated as twice the SD of the three repeated measurements for each measure of RNFL thickness.8

Differences between mean measurements before and after pupil dilation were assessed by a paired t-test. We postulated that a mean difference of 3.5 μm in the average RNFL thickness measurement could have been regarded as clinically significant, as this value corresponds to the intra-session test–retest variability reported by Budenz et al7 for Stratus OCT (data for Cirrus HD-OCT have not yet been published). Using PS version 3.0.12 (http://biostat.mc.vanderbilt.edu/twiki/bin/view/Main/PowerSampleSize, checked on 4 February 2010), we estimated a sample size of 29 eyes to detect such a difference with an SD of ±4.4 μm (corresponding to the SD of the difference between Stratus OCT average RNFL thickness measurements before and after mydriasis),26 and a power of 95% at a significant level of 5%. A smaller sample would have been required to detect differences higher than 3.5 μm.

In all cases, differences were considered statistically significant when P-value was <0.05.

Results

Two patients were excluded, as the pupil diameter was too small to allow visualization of the optic nerve before pharmacological dilation. Another subject was excluded because of motion artefacts. Hence the statistical analysis was carried out on a final sample of 32 eyes (10 men and 22 women, mean age 59±19 years) out of 35.

Repeated-measures ANOVA did not show statistically significant differences among the three series of measurements either before or after mydriasis, in any of the quadrants and sectors, including the 360° average measurement (P>0.05 in all the cases). For each measurement, the mean of the three values did not show statistical differences before and after dilation, the only exception being the nasal sector at 9 o’clock, where the mean value was higher after mydriasis (Table 1).

Table 1 Mean values of three measurements of the RNFL thickness before and after pupil dilation

On the basis of the results shown in Table 1, therefore, pupil dilation did not significantly affect RNFL thickness measurements by Cirrus HD-OCT. Nor did it affect the mean signal strength (7.77±1.09 before and 8.00±1.18 after pupil dilation, P>0.05).

As far as repeatability is concerned, excellent results were obtained for the COV and test–retest variability (Table 2).

Table 2 COV and test–retest variability of intra-session RNFL thickness measurements with Cirrus HD-OCT compared to intra-session values obtained by Budenz et al7 with TD-OCT and a standard 3.4 mm scan

Discussion

The present investigation shows that pupil dilation does not affect the RNFL thickness measurements provided by Cirrus HD-OCT: signal strength, mean values, and repeatability did not change before and mydriasis. Moreover, only in a small minority of subjects (2 out of 35, 5.7%) could the scan not be acquired because of an insufficient pupil diameter. These findings reveal noteworthy differences compared with the Stratus OCT. In a study involving 38 glaucoma patients with a mean age similar to that in our own sample, Smith et al.28 reported that in almost a quarter of cases (23.7%) it was not possible to acquire high-quality OCT images without pupil dilation and that dilated scans were more reproducible and gave different RNFL thickness mean values. A significant effect of pupil dilation was found also by Paunescu et al.29 In a previous study on a group of patients undergoing cataract surgery, our group reported that pupil dilation slightly affected RNFL thickness measurements by Stratus OCT, as RNFL thickness values were statistically higher in the 360° average measurement and in the nasal quadrant and some differences were found in the other quadrants as well, although statistical difference was not reached.26 Just one study found that pupil dilation did not induce any statistical difference in RNFL thickness measurements, but the sample of this investigation was probably too small (10 eyes) to detect such a difference.27 Overall, therefore, we can conclude that SD-OCT is less influenced than TD-OCT by pupil size and this represents a further step forward for this technology.

Our study results also confirm the excellent repeatability of Cirrus HD-OCT RNFL thickness measurements and suggest that the measurements provided by Cirrus HD-OCT and RTVue have similar repeatability.14, 15, 16, 17 This is a mandatory requirement of any instrument designed not only to diagnose, but also to enable a follow-up assessment of possible changes in any measurement. If there is excellent repeatability, with little variance in measurements, then identifying small changes in those measurements over time will be meaningful, as long as one accounts for age-related changes. Conversely, in the case of poor repeatability, relatively large pathological changes will be needed before true progression of the disease may be diagnosed.8

Compared to the intra-session repeatability of TD-OCT as reported in previous studies, the repeatability achieved using Cirrus HD-OCT proved to be higher. As shown in Table 2, Cirrus HD-OCT had lower COVs and test–retest variability compared with Stratus OCT, based on the data reported by Budenz et al.7 The most likely explanation for the better performance of Cirrus HD-OCT is related to the position of the circular scan: Cirrus HD-OCT does not depend on the operator correctly placing the scan because it includes an automated graph-based algorithm (AutoCenter) that identifies centre and border of the optic disc in peripapillary images. In contrast, the Stratus OCT requires the operator to choose the location of the circle, and previous studies have already shown that this procedure may affect RNFL thickness measurements.32, 33

Interestingly, we also confirmed that RNFL thickness measurements are slightly less repeatable in the nasal quadrant. This finding has already been reported with both TD-OCT and SD-OCT,14 and, as previously suggested, may be related to the fact that the angle of incidence of the illuminating beam is such that the RNFL is dimmer nasally, so that the edges of the RNFL are less reliably identified.8

This study did not address two important issues: repeatability in glaucomatous eyes and both inter-observer and inter-visit reproducibility. Although the former evaluation has been recently carried out (with excellent results),14 the latter will be the subject of further investigations.

In conclusion, our study data confirm that Cirrus HD-OCT measurements of the RNFL thickness show excellent repeatability, on condition that no artefacts are produced during the scan acquisition, and are not influenced by pupil size.