Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Assessment of image quality on color fundus retinal images using the automatic retinal image analysis

Abstract

Image quality assessment is essential for retinopathy detection on color fundus retinal image. However, most studies focused on the classification of good and poor quality without considering the different types of poor quality. This study developed an automatic retinal image analysis (ARIA) method, incorporating transfer net ResNet50 deep network with the automatic features generation approach to automatically assess image quality, and distinguish eye-abnormality-associated-poor-quality from artefact-associated-poor-quality on color fundus retinal images. A total of 2434 retinal images, including 1439 good quality and 995 poor quality (483 eye-abnormality-associated-poor-quality and 512 artefact-associated-poor-quality), were used for training, testing, and 10-ford cross-validation. We also analyzed the external validation with the clinical diagnosis of eye abnormality as the reference standard to evaluate the performance of the method. The sensitivity, specificity, and accuracy for testing good quality against poor quality were 98.0%, 99.1%, and 98.6%, and for differentiating between eye-abnormality-associated-poor-quality and artefact-associated-poor-quality were 92.2%, 93.8%, and 93.0%, respectively. In external validation, our method achieved an area under the ROC curve of 0.997 for the overall quality classification and 0.915 for the classification of two types of poor quality. The proposed approach, ARIA, showed good performance in testing, 10-fold cross validation and external validation. This study provides a novel angle for image quality screening based on the different poor quality types and corresponding dealing methods. It suggested that the ARIA can be used as a screening tool in the preliminary stage of retinopathy grading by telemedicine or artificial intelligence analysis.

Introduction

Image quality, in real-world settings, is a significant aspect for diagnosis because the proportion of poor-quality images has been reported to reach up to 19.7% in non-mydriatic retinal photography1. Poor images are the main reason for decreasing the accuracy of retinopathy detection2. It has been investigated for decades to improve the automatic mage quality assessment, such as clarity assessment techniques including spatial techniques3,4,5,6,7,8,9,10,11 and wavelet transform (WT) techniques12,13,14,15,16. However, despite low computational complexity, traditional methods requiring human intervention only can identify some characteristics of image quality and have poor generalization to other datasets. Recently, some research focused on using the deep learning (DL) approach to assess image quality on color fundus retinal images. As the most popular deep learning architecture, a deep convolutional neural network (CNN) can automatically identify and extract hidden or latent features inherent in the input images with no need to define hand-crafted features17, and shows superior performance than traditional machine learning methods. The main studies about CNN method are summarized in the following paragraphs and Table 1.

Table 1 Review of studies using CNN method to assess retinal image quality.

In 2016, Mahapatra et al.18 combined unsupervised information from saliency maps and supervised information from CNN with 5 convolution layers to assess image quality. A dataset from the diabetic retinopathy (DR) screening initiative with 9653 ungradable retinal images and 11,347 gradable images was used and graded by human graders. In 2017, Yu et al.19 used a dataset including the training set with 3000 images and the test set with 2200 images from the Kaggle database labelled by the professionals. They extract CNN-based features as well as the unsupervised saliency map-based features and fuse them. In 2017, Saha et al.20 trained a deep learning framework using 3428 images (3179 accept, 249 reject, and 147 ambiguous), and the rest 3425 images (3302 accept and 123 reject) were used for evaluation. All the images were labelled by three retinal image analysis experts including one ophthalmologist from the EyePACS. They defined about 2% of the images of observation discrepancy between graders as ‘ambiguous’ category and found that they confuse the network and decrease overall performance when used for training. However, these three studies did not validate the algorithm on other datasets.

In 2018, Zago et al.21 used a pre-trained deep neural network (Inception-v3) and selected two public databases, namely, DRIMDB(216 retinal images divided into 125 good, 69 poor, and outlier classes) and ELSA-Brasil (842 retinal images divided into 817 good and 25 poor). The intra-database cross-validation and inter-database cross-validation (train from a database and test from another database) were used to evaluate the algorithm’s performance.

In 2019, Chalakkala et al.22 proposed a deep learning-based approach and tested on seven public databases. They used images from one database (DR1) as the training set and the images from all the other databases as the validation set. The training set consisted of 1500 images (800 medically suitable retinal images (MSRI) high-quality and 700 low-quality), and the validation set consisted of 7007 images (5009 MSRI high-quality and 1998 low quality). The classification of image quality was separately labelled by different graders in each database.

In 2020, Shen et al.23 proposed a novel multi-task deep learning framework, which can evaluate the overall image quality with quality factor analysis in terms of artefact, clarity, and field definition. It has three modules: (1) multi-task multi-factor image quality assessment; (2) landmarks (optic disc and fovea) detection; (3) semi-tied adversarial discriminative domain adaptation. Dataset in this study including 18,653 retinal images (10,000 for training and 8653 for testing) from Shanghai Diabetic Retinopathy Screening Program (SDRSP) labelled by three ophthalmologists. The training dataset and testing dataset were from different districts in Shanghai.

In 2021, Yuen et al.24 developed two DL-based algorithms (EfficientNet-B0 and MobileNet-V2) using 21,348 retinal photographs (14,422 in the primary dataset and 6926 in the external dataset). In addition, one ophthalmologist and two medical students labelled images targeting image quality, a field of view, and the laterality of the eye. For image quality, they achieved AUC of 0.975, 0.999, and 0.987 in the internal dataset and external 1 and 2 datasets, respectively.

In these studies, images were divided into predefined categories, usually binary classification according to whether retinal images can be used for assessment. However, among images with poor quality, except for technical failures (e.g., small pupil and wrong position of patients), some eye diseases in the late stage (e.g., mature cataract) are also noticeable causes of poor image quality25.

Some other studies using the automatic method in detecting retinopathy also considered the influence of image quality. Most of them manually excluded images with poor quality2,26,27,28,29,30 or created a classification model to select images with good quality31. However, an eye disease that can make images ungradable is usually very severe in clinic, such as central retinal vein occlusion (CRVO), or in the late stage, such as mature cataract and proliferative diabetic retinopathy (PDR). Grouping them as poor quality images will result in misdiagnosis for retinopathy and prompting treatment. Therefore, those images need to be detected in the image quality assessment stage and then suggest patients with those images be referred to ophthalmologists. Only a few studies focused on this issue. Among them, two studies put all the ungradable images into the referral category32,33. Another study suggested adding the visual acuity assessment into retinal analysis in DR screening, and those with reduced vision should be given a referral34. Therefore, if automatic image quality assessment includes differentiation between eye-abnormality-associated-poor-quality and artefact-associated-poor-quality, it would neither overlook the eye diseases with the need of a referral, nor lead to the waste of medical resources for additional examinations and invalid referral.

On the other hand, in terms of technique, images with eye-abnormality-associated-poor-quality should also be detected. There are two options to make images with poor quality gradable:

  1. 1.

    A recapture of images23,35.

  2. 2.

    Using artificial methods to improve image quality36.

However, neither of them is effective for quality improvement of eye-abnormality-associate-poor-quality. For the first option, recapturing images can only fix the technical problem of photography rather than changing the ocular structure. Thus, the repeated image acquisition for eye abnormality-associate-poor-quality leads to a waste of time, manpower, and medical resource. For the second option, even though researchers have successfully investigated and developed artificial methods to eliminate artefacts, they found that images with eye-abnormality-associated-poor-quality (e.g., asteroid hyalosis) could not be improved by those methods and remained ungradable36.

To the best of our knowledge, no study focuses on the automatic image analysis method in identifying eye abnormalities that contribute to the poor quality of the retinal image. In previous work, we developed an automatic retinal imaging analysis (ARIA) approach to assess the risks of stroke and cardiovascular disease (CVD) and identify lesion patterns in retinopathy37,38,39,40. It showed great performance in detecting patterns and extracting the data mainly through fractal analysis, high order spectra analysis and statistical texture analysis. This study aims to train and validate ARIA to automatically assess image quality and distinguish eye-abnormality-associated-poor-quality from artefact-associated-poor-quality on color fundus retinal images.

Method

Primary dataset

Kaggle database, a publicly available database, was used for training and testing. The images in the dataset come from different types of cameras under various illumination. This data set contains 35,126 training images and 53,576 testing images, and many uninterpretable images with poor quality under different circumstances. Although most of the images were derived from the Kaggle database, we added a subgroup of 118 images with CRVO collected from Zhongshan hospital of Fudan University using TOPCON TRC-50DC Retinal Camera into the primary dataset because the Kaggle database lacks images with CRVO. This common retinal disease can make images ungradable. Two thousand four hundred and thirty four color fundus retinal images composed the primary dataset (Table 2). Among them, 1439 images were labelled as good quality, and 995 images were labelled as poor quality. Among images of poor quality, 483 were labelled as eye-abnormality-associated-poor-quality, and 512 as artefact-associated-poor-quality. Eye abnormalities included 220 cataracts, 118 CRVO, 83 asteroid hyalosis, and 62 vitreous opaque (Fig. 1).

Table 2 Summary of images in the primary dataset used for training, testing, and 10-fold cross validation.
Figure 1
figure 1

Examples of (a) good quality, (b) artefact-associated-poor-quality, and eye-abnormality-associated-poor-quality including (c) cataract, (d) central retinal vein occlusion (CRVO), (e) asteroid hyalosis, and (f) vitreous opaque.

Image quality classification and labelling

Our study's definition of image quality was evaluated according to two clinical established aspects: visibility and clarity. Images were labelled as poor quality if artefacts or eye abnormalities cover more than 1/4 of images or level III vascular arches or larger vascular arches are invisible (Table 3) based on the recommendation of the threshold of image quality23. Among images with poor quality, they were categorized into eye-abnormality-associated-poor-quality and artefact-associated-poor-quality. Three ophthalmologists rated all the images in the training and external validation datasets; all of them have more than 5 years of experience. If there was a discordance result between ophthalmologists, another ophthalmologist with experience over ten years would make a final decision.

Table 3 Definition of image quality classification.

External validation dataset

We used images from the Zhongshan Hospital of Fudan University for ARIA external validation. This study and data collection were approved by the Research Ethics Committee of Zhongshan Hospital and were performed according to the tenets of the Declaration of Helsinki. Images were captured by TOPCON TRC-NW100 Non-mydriatic Retinal Camera and TOPCON TRC-50DC Retinal Camera. It is worth mentioning that there was no overlap of selected images from the same eyes between the two cameras. Three hundred and fifty six color fundus retinal images composed the validation dataset (198 good quality, and 158 poor quality), and show on Table 4. Among images with poor quality, 104 were labelled as eye-abnormality-associated-poor-quality, and 54 as artefact-associated-poor-quality. Eye abnormality included 56 cataracts, 32 CRVO, and 16 vitreous opaque. The definition of image quality classification was the same as the training and testing dataset. The labels of specific eye abnormalities were the clinical diagnosis confirmed by ophthalmologists.

Table 4 Summary of images in the external validation dataset taken by TOPCON TRC-NW100 non-mydriatic retinal camera and TOPCON TRC-50DC retinal camera from the hospital.

Training, testing, and external validation

In the primary dataset, the model(s) building with 70% of images was for training and 30% for testing. The study included deep learning models for (1) classification of all good quality and all poor quality images, (2) classification of all good quality and eye-abnormality-associated-poor-quality, (3) classification of all good quality and artefact-associated-poor-quality and (4) classification of eye abnormality-associated poor quality and artefact-associated-poor-quality.

We used the automatic retinal image analysis(ARIA) method developed using Matlab, which has been reported (US Patent 8787638 B2)41. It incorporates deep learning techniques to classify image quality and shows on Fig. 2. Firstly, we applied transfer net ResNet-50 deep network with retinal images (RGB) as input, and features generated at the layer of ''fc1000_softmax'' as output based on pixels associated with image quality42. We also used the ARIA automatic features generation approach to extract the texture/fractal/spectrum-related features written in Matlab41. Then we applied the Glmnet approach to select the most important subset of features based on the penalized maximum likelihood43. These refined features are highly associated with image quality and were used to generate models by random forest (RF) in Matlab. The rest, 30% of the primary dataset, was used to test the performance of models. After internal portion testing and the model built, we also applied a tenfold cross-validation with support vector machine (SVM) approach for the model assessment in order to avoid over-classification. Finally, we confirmed the ability of models to classify image quality in the external validation dataset and analyzed the false positive cases and false-negative cases.

Figure 2
figure 2

Flowchart of the presented method in image quality classification. ResNet50 Residual network that is 50 layers deep, Glmnet Generalized linear model via penalized maximum likelihood, RF Random forest, SVM Support vector machine.

Statistical analysis

The performance of prediction models in training and testing dataset by calculating sensitivity, specificity, and accuracy from the testing dataset and 10-fold crossing validation. In external validation, the area under the curve (AUC) of receiver operator characteristic (ROC) curve of analysis, sensitivity, specificity, accuracy, and the proportion of the false-positive cases and false-negative cases of external validation were calculated. All analyses were performed using the software of SPSS 20 and Matlab 2020a.

Result

The performance of ARIA in differentiating different categories of image quality was summarized on Table 5 and Fig. 3. Using a simple random sampling method, 1007 images with good quality and 696 images with poor quality (including 338 images with eye-abnormality-associated-poor-quality and 358 images with artefact-associated-poor-quality) were assigned to the training dataset. The remaining 432 images with good quality and 299 images with poor quality (including 145 images with eye-abnormality-associated-poor-quality and 154 images with artefact-associated-poor-quality) were held out for testing. The sensitivity, specificity and accuracy of the ARIA for testing good quality against poor quality were 98.0%, 99.1%, and 98.6%, and ones in tenfold cross-validation were 99.0%, 98.3%, and 98.6%, respectively. The sensitivity, specificity and accuracy of the ARIA for testing good quality VS eye-abnormality-associated-poor-quality were 98.6%, 99.8%, and 99.5%, and ones in tenfold cross-validation were 99.0%, 99.7%, and 99.5%, respectively. The sensitivity, specificity and accuracy of the ARIA for testing good quality against artefact-associated-poor-quality were 98.7%, 99.8%, and 99.5%, and ones in tenfold cross-validation were 99.8%, 99.6%, and 99.6%, respectively. Last but not least, the sensitivity, specificity and accuracy of the ARIA for testing eye-abnormality-associated-poor-quality against artefact-associated-poor-quality were 92.2%, 93.8%, and 93.0%, and ones in tenfold cross-validation were 92.2%, 93.8%, and 93.0%, respectively.

Table 5 The performance of ARIA in testing dataset.
Figure 3
figure 3

Confusion matrix of testing (1) and 10-fold cross validation (2). (a(1), a(2)) Good quality VS Poor quality; (b(1), b(2)) Good quality VS Eye-abnormality-associated-poor-quality; (c(1), c(2)) Good quality VS Artefact-associated-poor-quality; (d(1), d(2)) Eye-abnormality-associated-poor-quality VS Artefact-associated-poor-quality.

In the external validation, ARIA also showed comparable and robust results in distinguishing between good quality and poor quality (Fig. 4a), achieving a sensitivity of 100%, the specificity of 99.4%, the accuracy of 99.7%, and the area under the ROC curve of 0.997. The performance of ARIA was also evaluated in distinguishing between artefact-associated-poor-quality and eye-abnormality-associated-poor-quality (Fig. 4b). The sensitivity, specificity, accuracy, and area under the ROC curve were 87.5%, 92.6%, 98.2%, and 0.915, respectively. Furthermore, details of misclassification of artefact-associated-poor-quality and eye-abnormality-associated-poor-quality were shown on Table 6 and Fig. 5. Eye abnormalities of false-negative cases included CRVO (n = 7) and vitreous opaque (n = 6), which showed that these images with these eye abnormalities were misclassified as images with artefacts.

Figure 4
figure 4

(a) The performance of ARIA to differentiate good quality from poor quality in the external validation dataset; (b) The performance of ARIA to differentiate artefact-associated-poor-quality from eye-abnormality-associated-poor-quality in the external validation dataset.

Table 6 The misclassification of ARIA in differentiating artefact-associated-poor-quality from eye-abnormality-associated-poor-quality.
Figure 5
figure 5

Violin plot for the probability of ARIA output in differentiating artefact-associated-poor-quality from eye-abnormality-associated-poor-quality in the external validation dataset (predicted value of probability: 0: Artefact-associated-poor-quality; 1: Eye-abnormality-associated-poor-quality).

Discussion

In this study, we trained and validated an automatic method, ARIA, to automatically assess image quality. In evaluating color retinal images from a multiethnic public dataset and an external dataset from the hospital, the ARIA had excellent performance in classifying good quality and poor quality compared to the performance of other automatic methods (Table 1). Additionally, the differentiation of two types of poor quality is more challenging than the classification of good and poor quality and did not investigate before. Our results also show that the ARIA can differentiate eye-abnormality-associated-poor-quality from artefact-associated-poor-quality. Therefore, this approach has the potential to be used as a screening tool for automatic retinal image quality assessment in the preliminary stage of retinopathy detection. Furthermore, poor quality images with eye abnormality can be filtered out and referred to an ophthalmologist. In contrast, images with artefact-associated-poor-quality require image improvement by the second photography or image processing.

Our study included some of the most common eye abnormalities that may cause poor image quality. Media opacity has been reported to play a critical role in causing poor image quality44,45,46,47,48, and some studies focusing on automatic retinopathy grading excluded them before the training procedure30,49. A cataract is lens opacity, a type of the most common opacity. According to the definition of four grades of cataract50, cataract in the advanced stage was labelled as eye-abnormality-associated-poor-quality and successfully detected in our study. Suppose we screened out images as poor quality during the image assessment procedure. In that case, patients will lose the opportunity for prompt cataract surgery. They may lead to hyper mature senile cataract (HMSC) or even adverse complications such as lens-induced uveitis phagocytic glaucoma and rarely spontaneous dislocation of the nucleus51,52,53.

Besides cataracts, vitreous opaque, such as haemorrhage and proliferative membrane, and retinal vein occlusion (RVO) are also the common eye abnormalities that can make images ungradable and should be promptly referred to doctors in case of the complication of retinal detachment, retinal tears, neovascular event, and retinal capillary nonperfusion54,55, which may lead to permanent vision loss or blindness. In addition, in external validation, we found that CRVO and opaque vitreous consist of the entire false-positive cases. It indicates that they are more likely to be misclassified as artefact-associated-poor-quality compared to cataracts, probably due to the relatively small amount of training images and various patterns of lesions on images. This investigation will be helpful for a better understanding of ARIA grading. In the future, to optimize the model, more images with CRVO and vitreous opaque can be included in the training dataset.

Asteroid hyalosis is an eye abnormality; that vitreous body contains small yellow-white, spherical particles known as asteroid bodies (ABs)56. Although it barely impacts on the patient’s vision, it can significantly influence the clinical examination of ophthalmologists on the fundus. Severe asteroid hyalinosis can even render fundus examination impossible56,57. Moreover, the estimated global prevalence of asteroid hyalinosis continues increasing, and old people make up a substantial and increasing fraction57. Hence, although most of those patients do not need a referral, the images should also be screened out in the quality screening stage due to the increasing prevalence and impairment of fundus assessment. It is worth mentioning that cataract, asteroid hyalinosis, and RVO are the conditions becoming increasingly prevalent with age58,59. Therefore, in age-related retinopathy screening programs, such as age-related macula disease (AMD), a larger proportion of eye disease is associated with poor quality, which influences the retinopathy assessment. In the above, we should pay more attention to the eye abnormalities associated with poor image quality in those programs.

Conclusion

Our ARIA approach showed good performance in identifying eye-abnormality-associated-poor-quality and artefact-associated-poor-quality and distinguishing between good and poor quality. Thus, images with eye abnormality-associated-poor-quality can be filtered out and be referred to an ophthalmologist. On the other hand, images with artefact-associated-poor-quality denote a requirement for quality improvement by the second photography or image processing. Further research can enlarge the variety of eye diseases that can lead to poor image quality in the ARIA method and evaluate the applicability and utility of the real-world clinical practice.

References

  1. Scanlon, P. H. et al. The effectiveness of screening for diabetic retinopathy by digital imaging photography and technician ophthalmoscopy. Diabet. Med. 20(6), 467–474 (2003).

    CAS  PubMed  Article  Google Scholar 

  2. Kanagasingam, Y. et al. Evaluation of artificial intelligence-based grading of diabetic retinopathy in primary care. JAMA Netw. Open 1(5), e182665 (2018).

    PubMed  PubMed Central  Article  Google Scholar 

  3. Lee, S. C. Automatic retinal image quality assessment and enhancement. Medical imaging (International Society for Optics and Photonics, 1999).

    Google Scholar 

  4. Lalonde, M. & Boucher, M. Automatic visual quality assessment in optical fundus images. Proc. Vis. Interface 1, 259–264 (2001).

    Google Scholar 

  5. Usher, D. B., Himaga, M. & Dumskyj, M. J. Automated assessment of digital fundus image quality using detected vessel area. Proc. Med. Image Understand. Anal. 1, 81–84 (2003).

    Google Scholar 

  6. Paulus, J. et al. Automated quality assessment of retinal fundus photos. Int. J. Comput. Assist. Radiol. Surg. 5, 557–564 (2010).

    PubMed  Article  Google Scholar 

  7. Dias, J., Manta Oliveira, C. & da Silva Cruz, L. Retinal Image Quality Assessment Using Generic Image Quality Indicators (Information Fusion, 2012).

    Google Scholar 

  8. Sevik, U. et al. Identification of suitable fundus images using automated quality assessment methods. J. Biomed. Opt. 19, 46006 (2014).

    Article  Google Scholar 

  9. Nugroho, H. A. et al. Contrast Measurement for No-reference Retinal Image Quality Assessment 1–4 (Springer, 2014).

    Google Scholar 

  10. Veiga, D. et al. Quality evaluation of digital fundus images through combined measures. J. Med. Imaging 1, 014001 (2014).

    Article  Google Scholar 

  11. Welikala, R. et al. Automated retinal image quality assessment on the UK biobank dataset for epidemiological studies. Comput. Biol. Med. 71, 67–76 (2016).

    CAS  PubMed  Article  Google Scholar 

  12. Dumic, E., Grgic, S. & Grgic, M. New image-quality measure based on wavelets. J. Electron. Imaging 19(1), 011018–011018 (2010).

    ADS  Article  Google Scholar 

  13. Chen, M.-J. & Bovik, A. C. No-reference image blur assessment using multiscale gradient. J. Image Video Proc. 2011(1), 1–11 (2011).

    Article  Google Scholar 

  14. Bartling, H., Wanger, P. & Martin, L. Automated quality evaluation of digital fundus photographs. Acta Ophthalmol. 87(6), 643–647 (2009).

    PubMed  Article  Google Scholar 

  15. Nirmala, S. R., Dandapat, S. & Bora, P. K. Wavelet weighted distortion measure for retinal images. SIViP 7(5), 1005–1014 (2012).

    Article  Google Scholar 

  16. Abdel-Hamid, L., et al. No-reference wavelet based retinal image quality assessment. in Proceeding of the 5th Eccomas Thematic Conference on Computational Vision and Medical Image Processing (VipIMAGE), 123–130 (2015).

  17. Schmidhuber, J. Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015).

    PubMed  Article  Google Scholar 

  18. Mahapatra, D. et al. Retinal Image Quality Classification Using Saliency Maps and CNNs 172–179 (Springer, 2016).

    Google Scholar 

  19. FengLi, Y. et al. Image quality classification for DR screening using deep learning. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2017, 664–667 (2017).

    Google Scholar 

  20. Saha, S. K. et al. Deep Learning for Automated Quality Assessment of Color Fundus Images in Diabetic Retinopathy Screening (Springer, 2017).

    Google Scholar 

  21. Zago, G. T. et al. Retinal image quality assessment using deep learning. Comput. Biol. Med. 103, 64–70 (2018).

    PubMed  Article  Google Scholar 

  22. Chalakkal, R. J., Abdulla, W. H. & Thulaseedharan, S. S. Quality and content analysis of fundus images using deep learning. Comput. Biol. Med. 108, 317–331 (2019).

    PubMed  Article  Google Scholar 

  23. Shen, Y. et al. Domain-invariant interpretable fundus image quality assessment. Med. Image Anal. 61, 101654 (2020).

    PubMed  Article  Google Scholar 

  24. Yuen, V. et al. Deep-learning-based pre-diagnosis assessment module for retinal photographs: A multicenter study. Transl. Vis. Sci. Technol. 10(11), 16 (2021).

    PubMed  PubMed Central  Article  Google Scholar 

  25. Agrawal, A. & Mckibbin, M. A. Technical failure in photographic screening for diabetic retinopathy. Diabet. Med. 20(9), 777–777 (2010).

    Article  Google Scholar 

  26. Stevenson, C. H., Hong, S. C. & Ogbuehi, K. C. Development of an artificial intelligence system to classify pathology and clinical features on retinal fundus images. Clin. Exp. Ophthalmol. 47(4), 484–489 (2019).

    PubMed  Article  Google Scholar 

  27. Li, F. et al. Automatic detection of diabetic retinopathy in retinal fundus photographs based on deep learning algorithm. Transl. Vis. Sci. Technol. 8(6), 4 (2019).

    PubMed  PubMed Central  Article  Google Scholar 

  28. Hacisoftaoglu, R. E., Karakaya, M. & Sallam, A. B. Deep learning frameworks for diabetic retinopathy detection with smartphone-based retinal imaging systems. Pattern Recogn. Lett. 135, 409–417 (2020).

    ADS  Article  Google Scholar 

  29. Treder, M., Lauermann, J. L. & Eter, N. Deep learning-based detection and classification of geographic atrophy using a deep convolutional neural network classifier. Graefe’s Arch. Clin. Exp. Ophthalmol. 256(11), 2053–2060 (2018).

    CAS  Article  Google Scholar 

  30. Mota, S.H.-D. et al. Classification of fundus autofluorescence abnormal patterns in diabetic macular edema. Gac. Med. Mex. 155(5), 458–462 (2019).

    PubMed  Google Scholar 

  31. Liu, H. et al. Development and validation of a deep learning system to detect glaucomatous optic neuropathy using fundus photographs. JAMA Ophthalmol. 137(12), 1353–1360 (2019).

    PubMed  PubMed Central  Article  Google Scholar 

  32. Ting, D. S. W. et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318(22), 2211–2223 (2017).

    PubMed  PubMed Central  Article  Google Scholar 

  33. Rodríguez Villa, S. et al. Five-year experience of tele-ophthalmology for diabetic retinopathy screening in a rural population. Arch. Soc. Esp. Oftalmol. 91(9), 426–430 (2016).

    PubMed  Article  Google Scholar 

  34. Li, Z. et al. An automated grading system for detection of vision-threatening referable diabetic retinopathy on the basis of color fundus photographs. Diabetes Care 41(12), 2509–2516 (2018).

    ADS  PubMed  Article  Google Scholar 

  35. Calderon-Auza, G. et al. A teleophthalmology support system based on the visibility of retinal elements using the CNNs. Sensors 20, 10 (2020).

    Article  Google Scholar 

  36. Yoo, T. K., Choi, J. Y. & Kim, H. K. CycleGAN-based deep learning technique for artifact reduction in fundus photography. Graefe’s Arch. Clin. Exp. Ophthalmol. 258(8), 1631–1637 (2020).

    Article  Google Scholar 

  37. Lee, J., Zee, B. & Li, Q. Segmentation and texture analysis with multimodel inference for the automatic detection of exudates in early diabetic retinopathy. J. Biomed. Sci. Eng. 6, 298–307 (2013).

    Article  Google Scholar 

  38. Lee, J., Zee, B. C. Y. & Li, Q. Detection of neovascularization based on fractal and texture analysis with interaction effects in diabetic retinopathy. PLoS ONE 8(12), e75699 (2013).

    ADS  PubMed  PubMed Central  Article  CAS  Google Scholar 

  39. Zhuo, Y. et al. Prediction factors of recurrent stroke among Chinese adults using retinal vasculature characteristics. J. Stroke Cerebrovasc. Dis. 26(4), 679–685 (2017).

    MathSciNet  PubMed  Article  Google Scholar 

  40. Guo, V. Y. et al. Retinal information is independently associated with cardiovascular disease in patients with type 2 diabetes. Sci. Rep. 6, 19053 (2016).

    ADS  CAS  PubMed  PubMed Central  Article  Google Scholar 

  41. Zee, C.Y., Lee, J.W. & Li, Q. Method and Device for Retinal Image Analysis. US8787638 B2 (2014). https://patents.google.com/patent/US20120257164A1/en.

  42. Kaiming, H. et al. Deep Residual Learning for Image Recognition 770–778 (Springer, 2016).

    Google Scholar 

  43. Hastie, T. The Elements of Statistical Learning: Data Mining, Inference, and Prediction 2nd edn. (Springer, 2009).

    MATH  Book  Google Scholar 

  44. Toy, B. C. et al. Smartphone-based dilated fundus photography and near visual acuity testing as inexpensive screening tools to detect referral warranted diabetic eye disease. Retina 36(5), 1000–1008 (2016).

    PubMed  Article  Google Scholar 

  45. Lin, T.-C. et al. Image quality and diagnostic accuracy of a handheld nonmydriatic fundus camera: Feasibility of a telemedical approach in screening retinal diseases. J. Chin. Med. Assoc. JCMA 83(10), 962–966 (2020).

    PubMed  Article  Google Scholar 

  46. Szabó, D. et al. Telemedical diabetic retinopathy screening in Hungary: A pilot programme. J. Telemed. Telecare 21(3), 167–173 (2015).

    ADS  PubMed  Article  Google Scholar 

  47. Scanlon, P. H. et al. The influence of age, duration of diabetes, cataract, and pupil size on image quality in digital photographic retinal screening. Diabetes Care 28(10), 2448–2453 (2005).

    PubMed  Article  Google Scholar 

  48. Scanlon, P. H. et al. Comparison of two reference standards in validating two field mydriatic digital photography as a method of screening for diabetic retinopathy. Br. J. Ophthalmol. 87(10), 1258–1263 (2003).

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  49. Keel, S. et al. Feasibility and patient acceptability of a novel artificial intelligence-based screening model for diabetic retinopathy at endocrinology outpatient services: A pilot study. Sci. Rep. 8(1), 4330 (2018).

    ADS  PubMed  PubMed Central  Article  CAS  Google Scholar 

  50. Yang, M. et al. Classification of retinal image for automatic cataract detection. in IEEE International Conference on E-health Networking (2013).

  51. Goel, N. & Nagar, M. Spontaneous rupture of the lens capsule in hypermature cataract: Presentations and outcomes. Br. J. Ophthalmol. 100(8), 1081–1086 (2016).

    PubMed  Article  Google Scholar 

  52. Kwitko, M. L. Glaucoma due to hypermature cataract: The use of urea in diagnosis. Can. Med. Assoc. J. 89, 569–571 (1963).

    CAS  PubMed  PubMed Central  Google Scholar 

  53. Azhany, Y. et al. Sequelae of neglected senile cataract. Malays. Fam. Physician 8(1), 33–37 (2013).

    CAS  PubMed  PubMed Central  Google Scholar 

  54. Chan, C. K. et al. SCORE Study report #11: Incidences of neovascular events in eyes with retinal vein occlusion. Ophthalmology 118(7), 1364–1372 (2011).

    PubMed  Google Scholar 

  55. Sarrafizadeh, R. et al. Incidence of retinal detachment and visual outcome in eyes presenting with posterior vitreous separation and dense fundus-obscuring vitreous hemorrhage. Ophthalmology 108(12), 2273–2278 (2001).

    CAS  PubMed  Article  Google Scholar 

  56. Khoshnevis, M., Rosen, S. & Sebag, J. Asteroid hyalosis: A comprehensive review. Surv. Ophthalmol. 64(4), 452–462 (2019).

    PubMed  Article  Google Scholar 

  57. Møller-Lorentzen, T. B. et al. Global prevalence of asteroid hyalosis and projection of its future burden: A systematic review and meta-analysis. Acta Ophthalmol. 98(8), 755–762 (2020).

    PubMed  Article  Google Scholar 

  58. Mitchell, P., Wang, M. Y. & Wang, J. J. Asteroid hyalosis in an older population: The blue mountains eye study. Ophthal. Epidemiol. 10(5), 331–335 (2003).

    Article  Google Scholar 

  59. Fawzi, A. A. et al. Asteroid hyalosis in an autopsy population: The University of California at Los Angeles (UCLA) experience. Arch. Ophthalmol. 123(4), 486–490 (2005).

    PubMed  Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Contributions

C.S. designed the study, collected data, assessed the images, wrote the main manuscript, and prepared all the tables and figures. J.L. trained and validated the automatic analysis method. G.W., X.D., and F.Y. assessed the images. B.Z. proposed the idea and revised the manuscript. All authors reviewed the manuscript.

Corresponding author

Correspondence to Benny Zee.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Shi, C., Lee, J., Wang, G. et al. Assessment of image quality on color fundus retinal images using the automatic retinal image analysis. Sci Rep 12, 10455 (2022). https://doi.org/10.1038/s41598-022-13919-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1038/s41598-022-13919-2

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing