Abstract
Objective
To evaluate the diagnostic accuracy of ultrawide pseudocolor retinal photography (pseudocolor UWF) compared to wide field fundus fluorescein angiography (WFFFA) in the detection of retinal neovascularization (NV) and NV of the disc (NVD) in patients with diabetic retinopathy (DR).
Design
Diagnostic accuracy observational study evaluating pseudocolor UWF as the index test. The reference standard was WFFFA.
Setting
Single retinal centre in India.
Participants
People with severe non-proliferative DR (sNPDR), early proliferative DR (ePDR) or high-risk proliferative DR (HR PDR).
Main outcome measures
Sensitivity and specificity of pseudocolor UWF in the detection of NV.
Results
A total of 176 eyes of 94 subjects with sNPDR, ePDR or HR PDR underwent pseudocolor UWF and WFFFA. The sensitivity and specificity of pseudocolor UWF in detecting NVE were 92.5% (95% CI 86.2–96.5) and 81% (95% CI 64.8–92.0), respectively, with moderate interobserver agreement of 0.722 (p value 0.001). The positive predictive value and negative predictive value were 83.0 (71.4–90.5) and 91.5 (84.9–95.3), respectively.
Conclusion
Compared to WFFFA as the gold standard, pseudocolor UWF has high sensitivity and specificity in detection of NV in all retinal quadrants and NVD. Therefore, pseudocolor UWF may be used as a non-invasive tool for screening and managing DR.
Similar content being viewed by others
Introduction
The severity of diabetic retinopathy (DR) is determined by mydriatic fundus examination or photography. The severity of DR is broadly classified into non-proliferative DR (NPDR) and proliferative DR (PDR) based on the lesion characteristics on standard ETDRS seven-field fundus photography [1]. As seven-field photography is challenging for both patients and technicians, most DR screening programmes tend to rely on DR severity grades based on 1–3-field fundus photography [2].
Neovascularization (NV) elsewhere of the retina (NVE) and/or NV of the optic disc (NVD) are the hallmark clinical signs of PDR. They develop as a consequence of underlying retinal ischaemia. However, these NVs are quite subtle at times making their identification challenging especially in cases of severe non-proliferative DR (sNPDR) or early proliferative DR (ePDR). Early detection and treatment of these NVs are recommended as they can cause sight-threatening complications such as vitreous haemorrhage (VH) and tractional retinal detachment. Clinicians often tend to intervene even rather than observing the eyes with early PDR in a real-world setting as evidenced by the disease characteristics of patients included in the recent PDR trials such as Diabetic Retinopathy Clinical Research Network (DRCR.Net) Protocol S [3] and CLARITY [4] trials, although the Diabetic Retinopathy Study (DRS) had shown that panretinal photocoagulation (PRP) can be reserved for high-risk PDR (HR PDR). Hence, most patients undergo confirmatory fundus fluorescein angiography (FFA) to identify NV and coexisting capillary non-perfusion (CNP) areas. Although an established procedure, FFA has disadvantages. It is invasive, requires pupillary dilatation, nurses for intravenous injection of fluorescein dye, trained photographers to capture the images and images should be sequentially captured for up to 10 min. Rarely, patients need to be monitored for allergic reactions.
Pseudocolor ultrawide field retinal imaging (pseudocolor UWF) is captured on Optos (Optos Ltd, Dunfermline, Scotland) through an undilated pupil within a few minutes by non-technical staff. It has revolutionised retinal imaging with the ability to see 200° of retinal surface amounting to three times the area of retina visualised on conventional seven-field retinal photography [5]. Over the last decade, the availability of non-mydriatic ultrawide field (UWF) retinal colour photography has increased our knowledge on DR. It is as good as clinical screening [6] and more effective than seven-field photography in DR screening [7]. Eyes with predominantly peripheral lesions such as microaneurysms, hard exudates, intraretinal microvascular abnormalities (IRMA), venous beading and NVE detected outside the standard seven-field fundus photography showed four times more progression (25%) to PDR in comparison to eyes without predominantly peripheral lesions (6%) before adjusting for the baseline DR severity, glycosylated haemoglobin (HbA1c) levels, duration and type of diabetes. However, correlation with each lesion separately was not evaluated in particular [8]. In addition, as more area of the retina is visible on pseudocolor UWF, it enables visualisation of more numbers and areas of NV.
We hypothesised that pseudocolor UWF retinal imaging is as accurate as standard FFA to robustly detect PDR in people with diabetes. The aim of our study was to assess the diagnostic accuracy of pseudocolor UWF compared to standard FFA to detect NVE and NVD in people with diabetes.
Materials and methods
This is a diagnostic accuracy study based on retrospective case notes review. The study was approved by the Institutional ethics committee. Informed consent was obtained from all the study participants. The study followed the tenets of Declaration of Helsinki. The sample size calculation was not done since it was done as a pilot study.
Identification of participants
Consecutive eligible patients were identified from the retinal imaging database. Eligibility criteria included participants with sNPDR or early PDR or HR PDR who had been imaged on both pseudocolour UWF and had FFA in the same clinic visit from January 2019 to January 2020. All the subjects underwent a complete ophthalmological examination including best corrected visual acuity in logMAR, intraocular pressure examination with Goldmann applanation tonometry, slit-lamp biomicroscopy and fundus examination using 78D as well as indirect ophthalmoscopy. Other baseline data included age, gender, duration of diabetes, fasting blood sugar (FBS), post-prandial blood sugar (PPBS) and HbA1c. Eyes with ungradable images due to media opacities or already ablated with PRP were excluded.
Index test was defined as pseudocolor UWF imaging for mydriatic fundus photography on Optos Daytona plus (Optos Ltd, Dunfermline, Scotland) without any eye steering.
Reference test was wide field FFA (WFFFA) on Spectralis, Heidelberg (Heidelberg Engineering, Germany), obtained after administration of 3 mL 20% fluorescein sodium dye intravenously and then capturing early and late frames up to 8 min.
The images from pseudocolor and WFFFA were divided into superotemporal, superonasal, inferotemporal and inferonasal quadrants with fovea as the centre according to the recommendations from the International Widefield Imaging Study Group [9].
Both the investigations were performed on the same day and hence the images were captured after mydriasis using tropicamide 0.8% and phenylephrine hydrochloride 5% eye drops. Two independent masked investigators (SI and SH) evaluated the pseudocolor UWF images and WFFFA images, respectively, and any discrepancies were settled by principal investigator (AG). The images from both the modalities were recruited by SH who among the investigators alone had access to the patient identification number (PIN) and the electronic medical record (EMR) system which carries the clinical diagnosis made by the consultant physicians who have seen the patient in the clinic. No patients who were initially seen by SI or SH in the clinic were included in the study. The pseudocolor UWF images and the WFFFA images were assessed by SI and SH, respectively, and were masked to each other as well as the clinical diagnosis due to their inaccessibility to the EMR system. The pseudocolor UWF and the Heidelberg databases need the PIN alone to access the patient image. This obviated the need for accessing the patient details in any step of grading, thus making it entirely based on their interpretation of the images alone.
Definition of positive test
In the pseudocolor UWF images, NVs were identified as active NVs appearing as reticular red coloured lesions arising from the retinal vessels assuming a sea-fan pattern or as fibrovascular proliferation NVs in the form of pale yellow tissue with lesser vascular component. Similar lesions when present over the optic disc or within 1 disc diameter were considered to be positive test for NVD. The images were resized and contrast adjusted accordingly to identify the NVE and NVD.
The NVs in WFFFA were defined as the arborising network-like areas which appear in early frames of FFA with increase in fuzziness and leakage towards the late phase.
The number of NVs in each quadrant was recorded separately for the two modalities by the masked investigators. The sample image of pseudocolor UWF imaging and WFFFA of a same eye is shown in Fig. 1.
After assessing the number of NVE/NVD in each quadrant, the eyes were classified into sNPDR, ePDR or HR PDR based on the following classification system for each imaging modality. In grading the pseudocolor UWF images, sNPDR was defined as presence of retinal haemorrhages in all four quadrants, venous beading in at least two quadrants or presence of IRMA in at least one quadrant, ePDR as presence of NVE without VH/preretinal haemorrhage and HR PDR as NVD > 1/3–1/4 DD or NVD if <1/3–1/4 DD with VH/preretinal haemorrhage or NVE with VH/preretinal haemorrhage. While grading WFFFA, sNPDR was defined as presence of microaneurysms alone with CNP areas in all quadrants, but no NVE/NVD, ePDR as any NVE without blocked fluorescence of VH/preretinal haemorrhage and HR PDR as NVE or NVD with blocked fluorescence due to preretinal haemorrhage or VH.
Statistical analysis
The data were entered in Microsoft Excel spreadsheet. The primary outcome of sensitivity and specificity with 95% confidence intervals were calculated for pseudocolor UWF in detecting NVE and NVD using the WFFA as a reference standard considering each pseudocolor UWF image as whole and also separately for each quadrant. p value of <0.05 was considered statistically significant for the data. Other outcomes included positive and negative predictive values (PPV and NPV) and positive and negative likelihood ratios (LR+ and LR−) and the area under the receiver operating characteristics (ROC) curve, with 95% confidence intervals. The interobserver agreement using Kappa statistics was also calculated. The kappa value between 0.6 and 0.79 was considered moderate agreement, 0.8 and 0.9 suggested strong agreement and more than 9 was perfect agreement.
The statistical analyses were carried out in SPSS 26.0 Version (IBM SPSS Statistics for Windows, Version 26.0. Armonk, NY: IBM Corp).
Results
A total of 176 eyes of 94 patients with sNPDR and PDR were recruited for the study. The study population comprised of 62 males and 32 females. The mean duration of diabetes was 15.27 months. The mean FBS, PPBS and HbA1c were 143.56 mg/dL, 225.82 mg/dL and 10.25%, respectively. The distribution of various severity grades of DR in the study population is shown in Table 1.
Of these, 10 eyes were excluded from NV assessment in WFFFA and 12 eyes from the pseudocolour UWF due to media haze from VH, nuclear or cortical cataract. Seven eyes were indeterminate due to confluence of NVE and NVD.
The sensitivity and specificity of pseudocolor UWF in detecting NV in comparison to gold standard WFFFA were 92.5% (95% CI 86.2–96.5) and 81% (95% CI 64.8–92.0), respectively. Table 2 shows the PPV and NPV, AUC of pseudocolour UWF considering the image as a whole and per quadrant. AUC for NV in pseudocolor UWF was 0.868 as demonstrated in Fig. 2. When we evaluated the sensitivity and specificity of NVD detection, pseudocolor UWF imaging was more specific than sensitive with very high positive likelihood ratio.
The kappa statistics demonstrating the interobserver agreement in pseudocolor UWF and WFFFA in NVE and NVD detection was found to be 0.722 (p value: 0.001) and 0.727 (p value: 0.001), respectively, and both were statistically significant.
In the subgroup analysis of eyes with sNPDR and early PDR, there was increased sensitivity in the early PDR in comparison to the sNPDR eyes when analysed separately, although the sensitivity and specificity increased when they were analysed together as evidenced by the results given in Table 3.
Discussion
Pseudocolor UWF imaging utilises red (633 nm) and green (532 nm) lasers in scanning laser ophthalmoscope via an ellipsoid mirror to produce UWF pseudocolor image of retinal surface. The utility of pseudocolour UWF in detecting peripheral retinal diseases such as retinal tears, retinal detachment [10], adult onset Coats’ disease [11], proliferative retinopathy in sickle cell disease [12] as well as posterior lesions like neovascular age related macular degeneration are well established [13]. It has also been utilised in deep learning to detect NV in sickle cell retinopathy with sensitivity of 97.4% (95% CI, 86.5–99.9%) and specificity of 97.0% (95% CI, 93.5–98.9%) in comparison to clinical examination [14]. Similar attempt in the setting of DR has been successfully done using different fundus cameras such as Centervue DRS, Optovue ICam, Canon CR1/DGi/CR2, and Topcon TRC NW6 non-mydriatic camera but in a restricted field of only up to 45° [15]. Furthermore, all of these studies were done in comparison to clinical grading and not to the gold standard modality of FFA to detect early NV.
Pseudocolor UWF imaging is as good as the standard ETDRS seven-field photography in comparison to clinical assessment in DR and diabetic macular oedema grading with an agreement of 95.8% and 90.8%, respectively [7]. However, the utility of pseudocolor UWF imaging in detecting DR changes in comparison to the gold standard FFA in detecting NV that warrant active intervention has not yet been evaluated. In our study, we have found pseudocolor UWF imaging to have good sensitivity and reasonable specificity in NV detection with good interobserver agreement which proves its utility as a good screening tool in finding the eyes that need treatment or referral to higher centre. NV lesions develop as a result of retinal hypoxia evidenced as CNP areas, both of which are identified by FFA. Presence of CNP areas in the absence of NV are managed conservatively until NVs are seen clinically. Active intervention in the form of PRP is mandatory, once the NV has been identified. Patients are often lost to follow-up and waiting for HR PDR to ensue is not recommended in real life [16] unlike what was proven in DRS [17]. So, the presence of NV can be a surrogate marker to detect the eyes that need treatment.
Although there is a generalised increased sensitivity, a drop in sensitivity is noted in the inferior quadrants, probably due to the eyelash artefacts in pseudocolor UWF imaging as stated in another study [10]. However, our study shows numerous strengths for pseudocolor UWF. It has the advantages of decreasing patient exposure to light and imaging, decreasing the waiting time and it can be obtained even in non-mydriatic eyes, although imaging in our cohort was done in mydriatic setting because we performed both the procedures on the same day. Pseudocolor UWF imaging also has the advantage of shorter image capture time and repeatability in comparison to gold standard FFA. Our study has proven that NV can be detected using pseudocolor UWF imaging with excellent sensitivity and specificity even in comparison to the gold standard test.
Conclusion
The purpose of any DR screening programme is primarily to identify eyes with vision threatening DR. Pseudocolor UWF imaging is an effective tool in detecting NV which is a surrogate marker of retinal ischaemia and has excellent sensitivity and reasonable specificity when compared to WFFFA. The increased sensitivity in the subset of eyes diagnosed as sNPDR or ePDR adds to its clinical relevance.
Summary
What was known before
-
Fundus fluorescein angiography is mandatory for the diagnosis of treatable retinopathy.
What this study adds
-
Pseudocolour UWF imaging using Optos will aid in identifying eyes that need treatment.
References
Early Treatment Diabetic Retinopathy Study Research Group. Grading diabetic retinopathy from stereoscopic color fundus photographs—an extension of the modified airlie house classification. ETDRS report number 10. Ophthalmology. 2020;127:S99–119.
Vujosevic S, Benetti E, Massignan F, Pilotto E, Varano M, Cavarzeran F, et al. Screening for diabetic retinopathy: 1 and 3 nonmydriatic 45-degree digital fundus photographs vs 7 standard early treatment diabetic retinopathy study fields. Am J Ophthalmol. 2009;148:111–8. https://pubmed.ncbi.nlm.nih.gov/19406376/.
Gross JG, Glassman AR. A novel treatment for proliferative diabetic retinopathy: anti-vascular endothelial growth factor therapy. JAMA Ophthalmol. 2016;134:13–4. https://pubmed.ncbi.nlm.nih.gov/26583372/.
Sivaprasad S, Prevost AT, Vasconcelos JC, Riddell A, Murphy C, Kelly J et al. Clinical efficacy of intravitreal aflibercept versus panretinal photocoagulation for best corrected visual acuity in patients with proliferative diabetic retinopathy at 52 weeks (CLARITY): a multicentre, single-blinded, randomised, controlled, phase 2b, non-inferiority trial. Lancet. 2017;389:2193–203. https://pubmed.ncbi.nlm.nih.gov/28494920/.
Witmer MT, Parlitsis G, Patel S, Kiss S. Comparison of ultra-widefield fluorescein angiography with the Heidelberg Spectralis(®) noncontact ultra-widefield module versus the Optos(®) Optomap(®). Clinical Ophthalmology (Auckland, N.Z.). 2013;7:389–94.
Neubauer AS, Kernt M, Haritoglou C, Priglinger SG, Kampik A, Ulbig MW. Nonmydriatic screening for diabetic retinopathy by ultra-widefield scanning laser ophthalmoscopy (Optomap). Graefe’s Arch Clin Exp Ophthalmol. 2008;246:229–35.
Kernt M, Hadi I, Pinter F, Seidensticker F, Hirneiss C, Haritoglou C, et al. Assessment of diabetic retinopathy using nonmydriatic ultra-widefield scanning laser ophthalmoscopy (Optomap) compared with ETDRS 7-field stereo photography. Diabetes Care. 2012;35:2459–63.
Silva PS, Cavallerano JD, Haddad NMN, Kwak H, Dyer KH, Omar AF, et al. Peripheral lesions identified on ultrawide field imaging predict increased risk of diabetic retinopathy progression over 4 years. Ophthalmology. 2015;122:949–56. https://doi.org/10.1016/j.ophtha.2015.01.008.
Choudhry N, Duker JS, Freund KB, Kiss S, Querques G, Rosen R, et al. Classification and guidelines for widefield imaging: recommendations from the International Widefield Imaging Study Group. Ophthalmol Retin. 2019;3:843–9. https://pubmed.ncbi.nlm.nih.gov/31302104/.
Mackenzie PJ, Russell M, Ma PE, Isbister CM, Maberley DAL. Sensitivity and specificity of the Optos Optomap for detecting peripheral retinal lesions. Retina. 2007;27:1119–24. https://journals.lww.com/00006982-200710000-00022.
Kumar V, Chandra P, Kumar A. Ultra-wide field imaging in the diagnosis and management of adult-onset Coats’ disease. Clin Exp Optom. 2017;100:79–82.
Linz MO, Scott AW. Wide-field imaging of sickle retinopathy. Int J Retina Vitr. 2019;5:27. pmc/articles/PMC6907105/.
Maruyama-Inoue M, Kitajima Y, Mohamed S, Inoue T, Sato S, Ito A, et al. Sensitivity and specificity of high-resolution wide field fundus imaging for detecting neovascular age-related macular degeneration. PLoS ONE. 2020;15. https://pubmed.ncbi.nlm.nih.gov/32822418/.
Cai S, Parker F, Urias MG, Goldberg MF, Hager GD, Scott AW. Deep learning detection of sea fan neovascularization from ultra-widefield color fundus photographs of patients with sickle cell hemoglobinopathy. JAMA Ophthalmol. 2021;139. https://pubmed.ncbi.nlm.nih.gov/33377944/.
Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316:2402–10. https://pubmed.ncbi.nlm.nih.gov/27898976/.
Obeid A, Gao X, Ali FS, Talcott KE, Aderman CM, Hyman L, et al. Loss to follow-up in patients with proliferative diabetic retinopathy after panretinal photocoagulation or intravitreal anti-VEGF injections. Ophthalmology. 2018;125:1386–92. http://www.aaojournal.org/article/S0161642017335698/fulltext.
Four risk factors for severe visual loss in diabetic retinopathy: the third report from the Diabetic Retinopathy Study. Arch Ophthalmol. 1979;97:654–5. https://jamanetwork.com/journals/jamaophthalmology/fullarticle/632929.
Acknowledgements
The authors acknowledge Optos plc, Dunfermline, Scotland, for providing the Optos Daytona plus for research purpose.
Author information
Authors and Affiliations
Contributions
SH was responsible for recruiting the patients for the study. SI graded the pseudocolor UWF images and SH graded the WFFFA images apart from extracting and analysing the data and result interpretation. SS and AG overviewed writing the report.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Haridas, S., Indurkhya, S., Kumar, S. et al. Sensitivity and specificity of pseudocolor ultrawide field imaging in comparison to wide field fundus fluorescein angiography in detecting retinal neovascularization in diabetic retinopathy. Eye 36, 1940–1944 (2022). https://doi.org/10.1038/s41433-021-01772-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41433-021-01772-y
This article is cited by
-
Scanning laser ophthalmoscopy retroillumination: applications and illusions
International Journal of Retina and Vitreous (2022)