Introduction

Quality assurance programs have been instituted in many hospitals to improve outcomes. In the United States, governmental initiatives to encourage outcomes reporting were first introduced in 2008 as the Physician Quality Reporting Initiative (PQRI), now known as Physician Quality Reporting System (PQRS). The primary purpose of these quality assurance programs was to identify the potential for improving outcomes, which requires identification of and reporting measures that are meant to reflect quality of care. It is important to adopt indicators that unify and simplify often complex medical interventions to create a common base for comparing the performance and the outcome of different providers.1

The most commonly used indicators in adult cataract surgery are best corrected visual acuity (BCVA) and refractive accuracy as reported in multiple benchmark studies.1, 2, 3, 4, 5, 6, 7 However, there are no publications focused on benchmark indicators in pediatric cataract surgery, probably because pediatric patient populations usually include ‘complicated’ cases, with unique surgical and management challenges, including inability to obtain accurate biometry or cooperate for reliable visual acuity (VA) testing. Young children have smaller eyes with shorter globe axial length (AL), and potentially anterior segment anatomic abnormalities that can affect effective biometry measures, intraocular lens (IOL) calculations, and effective IOL position and thus post-operative refraction. Moreover, young children are often intentionally left with variable degrees of hyperopic refractive error depending on the age at surgery, to allow for ocular growth after surgery and in anticipation of myopic shift. All of these differences make it difficult to assess and compare the outcomes of pediatric cataract surgery to adult outcomes.

The aim of our study was to establish valid benchmark indicators in the pediatric population, when uncomplicated surgery with primary IOL implantation is planned.

Materials and methods

The data included in this study were collected as part of the hospital quality assurance program, hence informed consent was not required from the patients. Approval from the institutional review board was obtained for this chart review.

This was a retrospective chart review of all patients older than 2 years of age undergoing cataract surgery with primary IOL implantation over an 11-year period (November 2005–February 2016). The patients with ocular comorbidities known to potentially result in poor vision or inability to obtain accurate biometry (corneal opacity, glaucoma, uveitis, trauma, manifest nystagmus, retinal disease, or subluxated lenses) were excluded from the study. The data collected included pre- and post-operative VA measures, biometry data, and refractive outcomes. The pre- and post-operative VA was measured with M&S system (M&S Technologies Inc., Niles, IL, USA). Post-operative retinoscopy and manifest refraction was performed within 90 days of surgery. Post-operative refraction and glasses prescription management was performed by the surgeon.

The method of pre-operative biometry depended on the age and cooperation of the child, as well as the density of the cataract. Optical biometry (Zeiss IOLMaster, Zeiss Humphrey Systems, Dublin, CA, USA) was attempted in most patients who were older and cooperative. Keratometry and ultrasound biometry measures were otherwise taken by the surgeon. Keratometry was measured with a hand-held keratometer (Nidek Inc., Fremont, CA, USA), either in the office or under anesthesia. Contact ultrasound biometry (Sonomed E-Z scan AB 5500, Sonomed Inc., Lake Success, NY, USA) was performed in cooperative patients in the office, and for younger or uncooperative patients, under anesthesia. Immersion ultrasound was performed for most patients who had biometry performed under anesthesia. Ultrasound biometry was often repeated under anesthesia to confirm accuracy of measurements obtained in the office in younger, less cooperative children. The IOL calculation formula, IOL type, and refractive target were chosen by the surgeon depending on the age at surgery. SRK/T formula was used for IOL calculation in most eyes and single piece acrylic IOL was used in all these eyes. The surgical technique also varied somewhat depending on the operating surgeon; there were eight different surgeons that performed the surgeries in this study. All children from 2 to 5 years of age received posterior capsulotomy and anterior vitrectomy, and children older than 5 years did not receive posterior capsulotomy or anterior vitrectomy. The second eye of patients with bilateral cataracts was operated depending on the density and progress of cataract in that eye.

To assess cataract surgery performance, we studied the following two separate outcome measures:

Best corrected visual acuity

To evaluate VA in a consistent manner, we included only patients aged 2 years or older at the time of surgery, who were treated with bilateral cataract surgery, who were followed for at least 3 months after surgery, and who had a final VA measured with Snellen letters. In this manner, we eliminated the possibility of dense amblyopia from congenital cataract with late presentation, or those with dense amblyopia due to unilaterality. BCVA is the preferred visual outcome measure, as young children are often left intentionally with varying degrees of hyperopic refraction, due to expected ocular growth and myopic shift over time, and decreased uncorrected VA would not represent a poor outcome.

Prediction error

Prediction error (PE) and absolute PE was calculated in the following manner:

PE=predicted refraction−actual refraction

Absolute PE=|predicted refraction−actual refraction|

Predicted refraction was calculated for the IOL power that was implanted in the eye using AL, K, and the manufacturer’s A-constant. The actual refraction was converted into spherical equivalent by using the formula:

Spherical equivalent=Sphere+Cylinder/2.

The PE outcome was determined in patients irrespective of the age at surgery and laterality, thus it also included patients with unilateral cataracts and patients who were still too young for Snellen VA measurements.

We also sought to study differences in PE and refractive outcome based on short AL and age. Unpaired t-test was used to compare the mean PE and mean absolute PE between the two groups of patients depending on AL (AL≤22 mm vs AL>22 mm). One-way analysis of variance test was used to compare the PE in groups of patients depending on the age at surgery. P-value <0.05 was considered significant. We tabulated the number of patients who achieved a post-operative refraction within 0.5, 1.0, and 2.0 diopters (D) of the targeted refraction.

Results

One hundred and twenty-four eyes of 62 patients with bilateral cataract surgery met the inclusion criteria and were analyzed for VA outcomes. Mean age at surgery in this group was 8.3±4.6 years (median age: 6.8 years). Mean follow-up duration was 3.7±2.7 years. All but one patient had IOL implantation within the capsular bag. The IOL power was reduced by 1.0 D in the patient with sulcus implantation.

BCVA at the last visit was 20/40 or better in 96% eyes (Table 1) at their last follow-up visit (median follow-up; 3.0 years). When the eyes were classified depending on the age at surgery, there was no difference in median VA between different age groups as shown in Table 2. Five patients had amblyopia, of these three patients were in the age range of 2–6 years and one patient was in the age range of 6–10 years, and one patient was >10 years at the time of cataract surgery. Two eyes had vision worse than 20/100 at the last visit. Both these patients were 3.7 and 4.5 years at the time of surgery and had severe deprivation amblyopia (BCVA: 20/100 and 20/200) that did not respond to amblyopia treatment. The VA had improved in all other patients compared with the pre-operative measure.

Table 1 Best corrected visual acuity (BCVA) outcomes in patients older than 2 years with bilateral cataract surgery
Table 2 Median visual acuity in eyes operated for bilateral cataract surgery classified depending on age at surgery

PE calculations could be performed for 235 eyes of 179 patients (56 bilateral, 123 unilateral). The mean age at surgery in this group was 6.3±4.8 years (median, 4.7 years; range, 0.1–18 years). The mean AL was 22.3±1.8 mm (range, 17.7–27.8 mm). The mean PE was 0.3±1.1 D (median, 0.375 D) and the mean absolute PE was 0.9±0.7 D (median, 0.7 D). The PE was within 0.5 D in 43% eyes, 1.0 D of target in 66% eyes, and 2.0 D of target in 95% eyes.

Table 3 shows the mean PE and mean absolute PE when the eyes were analyzed after classifying depending on the AL (eyes with AL≤22 mm vs AL>22 mm). The mean absolute PE in the group of eyes with shorter AL was higher compared to eyes with long AL and the difference was significant statistically.

Table 3 Prediction error (PE) by axial length (AL)

Table 4 compares the mean PE in four different age groups: age ≤1 year (n=19), age >1–3 years (n=55), age >3–6 years (n=70), and age >6–18 years (n=95). The mean absolute PE was not statistically significant between different age groups.

Table 4 Prediction error (PE) by age

Discussion

Quality management based on outcome indicators is increasingly finding its way into Ophthalmology practices, especially for adult cataract and refractive surgery.1, 2, 3, 4, 5, 6, 7 To evaluate performance, a reference for good quality or best practice is needed, the so-called benchmark. It is increasingly important to establish benchmarks in the face of initiatives by the government, hospitals, and insurance companies to improve quality of care and effectiveness.1

Pediatric patients often represent ‘complicated’ cases as the surgery can be technically challenging compared with the adult cataract surgery owing to highly elastic lens capsule, low scleral rigidity, small compliant eyes, and the need for primary management of posterior capsule and anterior vitreous due to higher incidence of visual axis opacification. In addition, despite the best technical outcomes, functional vision outcomes can be less reliable not only due to variable cooperation for vision testing, but VA measures can be compromised by co-existing conditions such as amblyopia, latent nystagmus, strabismus, or intentionally planned residual refractive error, which must be managed concurrently in a young child. We measured final BCVA in our cohort to allow for recovery of vision for patients in the amblyogenic age group. Unilateral cataract patients were excluded, as amblyopia in these cases is often too dense to overcome even with good compliance to therapy, and final BCVA is not a reflection on cataract surgery quality of care. Pediatric patients are also often excluded from adult PE studies due to inconsistencies with biometry technique, and because of inherent difficulties of obtaining accurate biometry in small compliant eyes. Optical biometry is often not possible either due to lack of cooperation or density of the cataract. Post-operative refractions can be challenging. There is no IOL calculation formula specifically designed for pediatric eyes, but surgeons generally use a preferred formula based on AL. Eyes with globe AL<22 mm are prone to greater PE, and while uncommon in adult populations, are typical in children. Use of optimized constants is often not possible due to lack of consistent data from a large number of eyes having similar anatomic characteristics and ALs operated by a single surgeon. Furthermore, due to the continued growth of the eye and changing refractive status, a smaller window is needed to obtain the post-operative refraction and assess PE, and the final refractive status and vision may not be known for many years. PE was greater in our population compared with that reported in adult studies,1, 4, 6 likely due to measurement error in these small compliant eyes or lack of customized constants for IOL formula calculations.

The children with bilateral cataract surgery in our study achieved excellent VA outcomes, which is comparable to outcomes reported for surgery in adult eyes. Hahn et al1 conducted a prospective multicenter cohort study with seven participating centers, and analyzed visual outcomes in 1553 adult patients. They reported VA of 20/40 or better in 98.5% patients 3 months after surgery. Jaycock et al5 used the cataract national data set comprising 55 567 adult cataract operations using multicenter data from an electronic patient record system to establish benchmark standards of care in the National Health Service (NHS) and beyond. Post-operative VA of 20/40 or better was achieved in 91% of eyes; 94.7% in eyes with no co-pathologies, and 79.9% in eyes with one or more co-pathologies. Ledoux et al8 analyzed VA outcome in patients with pediatric cataract extraction with IOL implantation older than 4 years at the time of surgery and found that 80.8% (59/73 patients) with bilateral cataract surgery had visual outcome of 20/40 and better. Crouch et al9 performed a prospective analysis of pediatric pseudophakia in children between 12 months and 18 years, and reported that 95% of patients with bilateral cataract surgery had VA of 20/30 or better (n=20 eyes of 10 patients), though the sample size in this study was small.

PE reflects the accuracy of a surgeon to obtain the expected post-operative refractive target, and is a good benchmark indicator of refractive outcomes in the immediate post-operative period. Another way to report refractive outcomes is by calculating the number of eyes within an acceptable range from the expected refractive target. In the Hahn et al1 multicenter study, surgeons achieved a spherical equivalent within 1.0 D of the targeted refraction in 95.5% eyes, and within 0.5 D in 77.4% of the cases, measured 1 month after surgery. Simon et al4 reported a target refraction within 1 D in 94% of eyes (n=1275) analyzed at an academic teaching institution’s comprehensive ophthalmology service, measured 90 days after the surgery. Gale et al6 established benchmark standards for refractive outcome after adult cataract surgery in the NHS by analyzing three cycles of prospective data where the electronic medical record automatically recommended the IOL calculation formula using customized A constant. The post-operative subjective refraction was within 1 D of the predicted value in 80% eyes in cycle 1, 83% in cycle 2, and 87% in cycle 3. This report supports the idea that measurement of refractive outcomes can allow changes in practice and result in improvement in this quality of care measure.

The mean absolute PE was somewhat greater in our general pediatric population than reported in many adult populations, at 0.9±0.7 D, and we note that typical absolute PE is reported to be between 0.7 D and 1.5 D in pediatric populations.10, 11, 12, 13 We previously reported a subset of these patients where the mean absolute PE was 0.97±0.91 in children ≤2 years (N=22) and 0.85±0.69 in children >2 years (N=113), which was not statistically different though the sample size of children <2 years was very small. In the same population, the mean absolute PE was 1.08±0.77 in children with AL≤22 mm (N=69), which was statistically different than mean absolute PE of 0.75±0.64 in children with AL>22 mm (N=66).12 The Infant Aphakia Treatment Study reported mean absolute PE of 1.8±1.3 D for infantile eyes with primary IOL surgery.14 In the IATS, refractions were within 0.5 D in 12% eyes, within 1 D in 45% of eyes, and within 2 D in 59% of eyes, with an inverse relationship between PE and AL.

The limitations of our study are that it is retrospective, and it includes pediatric patients with a wide range of ages at surgery. On the other hand, this population is fairly representative of the typical pediatric cataract population in a tertiary referral center, noting our inclusion and exclusion criteria for the outcomes studied. A strength of the study is the large number of eyes, operated on by multiple surgeons with varying degrees of experience, though all surgeons performed current surgical techniques using modern foldable IOLs. With regard to visual outcomes, because children were selected by surgical technique (primary IOL implantation), bilateral cataract status, and ability to cooperate for Snellen VA testing, we may have induced a bias for better BCVA outcomes. In addition, we did not include children with co-existing ocular anatomic abnormalities or systemic diagnoses that might interfere with ability to obtain accurate VA testing, so VA scores may not be as good, or as easily measured, for such children. With regard to benchmarks for post-operative refraction, we find that more variability should be expected with very-short eyes and in very-young children.

For quality outcome measures, we suggest that children >2 years at the time of bilateral cataract surgery with primary IOL implantation should achieve excellent visual outcomes in 96% of eyes, which is comparable to benchmarks in adult eyes. The limiting factor in pediatric eyes is amblyopia. The PE in pediatric eyes is somewhat greater than benchmark reported in adult population studies, so that overall only 66% are within 1 D of the target refraction.