Eight consultant ophthalmologist ROP screeners in Scotland graded RetCam (Natus Medical, Pleasanton, CA, USA) images of 25 eyes of 25 infants regarding the presence and severity of plus disease, and stated their management decision (‘treatment’ or ‘no treatment’). Clinical information on gestational age at birth, birth weight, and post-gestational age at the time of imaging was provided. Graders viewed the revised standard ICROP photograph for plus disease prior to commencing the task . Thirteen of the 25 eyes were treated for ROP.
Inter-observer agreement (Fleiss-Kappa, where 0.21–0.40 is considered ‘fair’) was 0.34 (95% CI = 0.28–0.39) for the presence of plus and 0.40 (95% CI = 0.33–0.48) for management decision, slightly greater than that reported by Fleck et al. for UK ophthalmologists (0.2 and 0.33, respectively) .
Our data supports the poorer degree of inter-observer agreement found for UK ophthalmologists compared with those of the ANZ group, who had lower treatment rates, although comparable visual outcomes, in the BOOST II trials . The ANZ grading group self-certified using a training website. Given that a possible tendency towards over-treating ROP could result in unnecessary morbidity, the development of a similar online tool to improve standardisation and management decisions would be of potential benefit to UK ophthalmologists.
Chiang MF, Jiang L, Gelman R, Du YE, Flynn JT. Interexpert agreement of plus disease diagnosis in retinopathy of prematurity. Arch Ophthalmol. 2007;125:875–80.
Fleck BW, Williams C, Juszczak E, Cocker K, Stenson BJ, Darlow BA, Dai S, Gole GA, Quinn GE, Wallace DK, Ells A, Carden S, Butler L, Clark D, Elder J, Wilson C, Biswas S, Shafiq A, King A, Brocklehurst P, Fielder AR, for the BOOST II Retinal Image Digital Analysis (RIDA) Group. An international comparison of retinopathy of prematurity grading performance within the Benefits of Oxygen Saturation Targeting II trials. Eye. 2018;32:74–80.
International Committee for the Classification of Retinopathy of Prematurity. The international classification of retinopathy of prematurity revisited. Arch Ophthalmol. 2005;123:991–9.
Australia B-I, United Kingdom Collaborative Group, Tarnow-Mordi W, Stenson B, Kirby A, Juszczak E, et al. Outcomes of two trials of oxygen-saturation targets in preterm infants. N Engl J Med. 2016;374:749–60.
Conflict of interest
The authors declare that they have no conflict of interest.
About this article
Cite this article
Burgess, F.R., Davies, R., Mulvihill, A.O. et al. Comment on: ‘An international comparison of retinopathy of prematurity grading performance within the Benefits of Oxygen Saturation Targeting II trials’. Eye 32, 1291–1292 (2018) doi:10.1038/s41433-018-0083-6