Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

# Semantic Segmentation of the Choroid in Swept Source Optical Coherence Tomography Images for Volumetrics

## Abstract

The choroid is a complex vascular tissue that is covered with the retinal pigment epithelium. Ultra high speed swept source optical coherence tomography (SS-OCT) provides us with high-resolution cube scan images of the choroid. Robust segmentation techniques are required to reconstruct choroidal volume using SS-OCT images. For automated segmentation, the delineation of the choroidal-scleral (C-S) boundary is key to accurate segmentation. Low contrast of the boundary, scleral canals formed by the vessel and the nerve, and the posterior stromal layer, may cause segmentation errors. Semantic segmentation is one of the applications of deep learning used to classify the parts of images related to the meanings of the subjects. We applied semantic segmentation to choroidal segmentation and measured the volume of the choroid. The measurement results were validated through comparison with those of other segmentation methods. As a result, semantic segmentation was able to segment the C-S boundary and choroidal volume adequately.

## Introduction

The choroid is the tissue with high blood flow per unit volume in the body, and the choriocapillaris that is located in the innermost layer of the choroid nourishes both the photoreceptor and the retinal pigment epithelium1,2. The emergence of OCT technology has been one of the most significant advances in ophthalmology in the past 20 years3,4,5. In the era of OCT, the choroidal thickness has become a useful parameter in the diagnosis of diseases associated with the choroid, such as Vogt-Koyanagi-Harada disease6, choroidal tumors7, age-related macular degeneration (AMD)8,9, and central serous chorioretinopathy (CSC)10. In the pachychoroid spectrum, which includes CSC and part of AMD, it has been suggested that localized choroidal thickening may be involved in local serous retinal detachment or choroidal neovascularization11,12. In order to detect such regional structural changes of the choroid, a choroidal thickness map and three-dimensional (3D) analysis may be useful13. Manual choroidal segmentation in each slice is indeed very useful14,15, but that of the volume scan for the choroidal thickness map is time-consuming work, and may not be practical in a clinic. The problem with automatic segmentation of the choroid is that the C-S boundaries are difficult to detect because they are ill-defined on the OCT images. Several methods, Graph-cut segmentation16,17 or segmentation based on the gradient of pixels18, have been proposed previously. At present, automated segmentation may not have the same accuracy as manual segmentation.

Recently, an artificial neural network represented a significant breakthrough, and deep learning architectures have been applied to various fields, such as computer vision, bioinformatics, and medical image analysis19. Semantic segmentation, based on the convolutional neural network, is a novel image analysis technique20,21, describes the process of associating each pixel of an image with a class label, and is used in the fields of autonomous driving and medical imaging analysis. This method is potentially useful for choroidal segmentation in 3D choroidal analysis. To our knowledge, there has only been one report describing the segmentation of the choroid using a convolutional neural network, in which the spectral domain OCT image was used22. The wide range of depth penetration in SS-OCT has the advantage of visualizing the choroid. In the current study, we investigated semantic segmentation of the choroid in SS-OCT images of the choroidal thickness map or the volume analysis. We also examined the similarities and reproducibility of the automated semantic segmentation using a deep convolutional neural network (DCNN), and other methods of choroidal segmentation.

## Subjects and Methods

### Informed consent

This prospective, noncomparative case-series was approved by the Institutional Ethics Committee of Fukushima Medical University, and was conducted in accordance with the tenets of the Declaration of Helsinki of 1975, as revised in 2000. Informed consent was obtained from all individuals participating in this study.

Subjects: 43 eyes from 34 healthy individuals were analyzed. 8 males and 26 females, mean age: 28 (range: 22–44) y.o., mean axial length: 24.84 (range: 22.79–26.20) mm. SS-OCT images from 6 eyes of 3 individuals were used as baseline data. 290 randomly selected images in the cube scans of 37 eyes from 31 individuals were used to analyze similarities. The twenty-five eyes were scanned two times in a row. The two volume images in each eye were used to examine reproducibility between these two images.

### Image acquisition

SS-OCT (Plex Elite 9000-TM, Carl Zeiss Meditec, Inc., Dublin, California, USA) 6 × 6-mm (a 500 × 500 sampling in one volume scan) OCT images of the healthy eyes were acquired using OCT angiography mode between November 1, 2018 and March 24, 2019, after application of mydriatics (5 mg/ml tropicamide and 5 mg/ml phenylephrine sodium chloride, Santen Pharmaceutical Co. Ltd., Osaka, Japan). Two ophthalmic imaging experts took SS-OCT images. The SS-OCT instrument has a central wavelength of 1,060 nm, a bandwidth of 100 nm, A-scan depth of 3.0 mm in tissue, full-width (at half-maximal axial resolution) of about 5 µm in tissue, and lateral resolution at the retinal surface of about 20 µm. The FastTrac motion-correction software built into the SS-OCT was used during image acquisition. We used the structural OCT data only for the analysis.

### Semantic segmentation

Three thousand B-scan images from six cube scans of six eyes were used as the ground truth data for training. The labeling of the choroidal boundary on the SS-OCT images was carried out by one retina specialist (Y.S.) manually (Fig. 1). The C-S boundary was defined along the extended low contrast line between the choroid and the sclera, not the outer boundary of the large choroidal vessel. The area of the choroid was defined as the area between the line beneath the retinal pigment epithelium and the C-S boundary on a B-scan image. We approached choroidal segmentation using the SegNet, which was developed by members of the Computer Vision and Robotics Group at the University of Cambridge, UK, based on the VGG19 network, primarily designed for large-scale natural image classification and transfer learning. This network consisted of 16 convolutional layers, with pooling as the encoder and three upsampling transposed convolutional layers as the decoder23. This decoder was trained to convert the features from the encoder to class labels, accompanying skip layers being used to process higher resolution features from the lower layers.

In the VGG19 network, the final layer uses a softmax function to produce a probability output. The area ratio of the choroidal area to the outside of the choroidal area on the images was about 1:9 in an SS-OCT image in the present study, so we balanced the classes using class weighting. For adapting this network to various SS-OCT images, we augmented the training images with translation and rotation. Stochastic gradient descent with momentum was used for training this network, with a momentum of 0.9, a learning rate of 0.001, and mini-batch size to use for a prediction of 1. We found that this network converged within 100 epochs.

### C-S boundary segmentation

A cubic smoothing spline was applied to determine the C-S boundary. The cubic smoothing spline f minimizes

$$p\mathop{\sum }\limits_{j=1}^{n}{|{y}_{j}-f({x}_{j})|}^{2}+(1-p)\int {|{D}^{2}f(t)|}^{2}dt$$

where n represents the number of entries of x, and the integral is over the smallest interval containing the whole entries of x. In addition, xj and yj refer to the jth entries of x and y, respectively, and D2f represents the second order derivative of the function f. In the present study, the smoothing parameter p was 0.01. The number was selected for smoothing the edges of the C-S boundary correctly and keeping its details.

Graph cut segmentation was performed as described previously by Chiu, S. et al.24.

### Validation of similarities

The Sørensen–Dice coefficient (DSC) among the segmentations performed with the SegNet and other methods (the graph cut and manual segmentation) was calculated to evaluate similarities in 290 SS-OCT B scan images randomly selected from 37 eyes of 31 individuals. Three retina specialists (A.O., A.K., T.S.) segmented the choroid independently using the same method as that used for ground truth labeling; they enclosed the area of the choroid in a polygonal shape using a personal computer. The following equation was used to calculate the DSC.

$$DSC=\frac{2|A\cap B|}{|A|+|B|}$$

A and B are the choroidal region segmented by either method respectively.

### Validation of feasibility and reproducibility

To evaluate the feasibility and reproducibility of the SegNet model, we measured the intraclass correlation coefficient (ICC) between the repeatedly measured choroidal volumes of twenty-five eyes. The volumetric data were calculated from the SS-OCT cube images. We registerd the center of the fovea in the two images taken in row using ImageJ (version 1.52n)25 along the x-, y-, and z-axes. We cropped the original 3D choroidal volume at sizes of 250 × 500 × 500 pixels (Height × Width x Depth) to 170 × 450 × 400 pixels to remove the outside of the overlapping area.

### Visualization of choroidal thickness

The choroidal thickness was plotted as a heat map to visualize the regional choroidal thickening8,26, and was converted using the following normalization method:

$$Y=(M-m)\frac{X-{x}_{min}}{{x}_{max}-{x}_{min}}$$

X: the original choroidal thickness measured after segmentation.

Y: the choroidal thickness for 64 color heat map.

xmax: maximum value of the original choroidal thickness in the total scan area.

xmin: minimum value of the original choroidal thickness in the total scan area.

M: maximum number of steps in the color map.

m: minimum number of steps in the color map.

Here, we made 64 steps color map. So, M = 64, m = 0.

The algorithm we used was implemented in MATLAB R2018a.

## Results

### Similarities in B-scan images

We compared the results of the semantic segmentation (SegNet) to manual segmentaion and that made by graph cut method (Fig. 2). The SegNet model showed a similar segmentation to the manual segmentation, whereas the graph cut method partially failed to delineate the C-S boundary. Table 1 shows the areas measured using each method. We analyzed the DSC between the segmentation by three manual graders (A, B, and C) individually, the SegNet model, and the graph cut method (Table 2). The median of intergrader similarity between the three manual segmentations was 0.9184–0.9358. All of the DSC medians between the SegNet and manual segmentation by each grader were above 0.9000, meaning that the automated segmentation of the choroid using SegNet was not inferior to manual segmentation. The DSC median between the graph cut method and manual segmentation was low in each manual segmentation compared to that using SegNet.

### Reproducibility

We were able to measure fifty choroidal volumes of all twenty-five pairs of cube scans using SegNet. The ICC between the choroidal volumes in the repeatedly measured two images was 0.985 (95% confidence interval, 0.967 to 0.993) (Fig. 3). The mean choroidal volume in the posterior pole (5.4 × 4.8 mm) was 7.4671 ± 0.8168 (standard deviation) mm3 in twenty-five healthy eyes. We analyzed the DSC of the twenty-five pairs of choroidal volumes calculated using SegNet. The DSC median was 0.9090 (standard deviation, 0.0554; range 0.7650–0.9647).

### 2D thickness map

Figure 4 shows 2D choroidal thickness maps before (a) and after normalization (b). The regional changes are enhanced in the normalized thickness map.

## Discussion

The median DSC among the SegNet and manual segmentation by each grader were 0.9494 (grader A), 0.9447 (grader B), and 0.9275 (grader C). The DSC medians among the manual segmentations were 0.9184 to 0.9358, and the SegNet results were almost equivalent to those of the manual segmentation (Table 2). The high ICC value (0.985) in the choroidal volumetrics suggested good reproducibility of SS-OCT measurement and 3D segmentation.

SS-OCT, which has a high penetration laser light source and provides depth-enhanced images, is suitable for imaging of the choroid. 3D image analysis and choroidal 2D maps using SS-OCT images are potentially useful to explore the unknown pathogenesis of the choroid. To accomplish this purpose, the choroidal segmentation has several problems that cannot be easily overcome; low contrast of the C-S boundary, a deficit of the inner surface of the sclera, namely scleral canals for vessels or nerves, and the presence of a posterior stromal layer and lamina fusca27.

Enhancement of the C-S boundary in the preprocessing of OCT images has been reported to improve the success rate of boundary detection17,18,28. Even if the C-S boundary is completely delineated, the sclera has a pathway through which blood vessels and nerves pass28. The pathway in the sclera should be corrected to make the outer surface of the choroid. Interpolation in the processing of the outer surface of the choroid17 can correct the deletion of the boundary. Since statistical image segmentation (maximally stable extremal regions) can be robust against scleral defects caused by the scleral canal, shadowing, and other elements of the choroid in the OCT images, software using these techniques has made it possible to successfully delineate the C-S boundary. However, in previous studies, the C-S boundary was delineated along the outer border of the choroidal vessels, detected using automated segmentation17,29,30,31. Recently, the choroidal posterior stromal layer has led to misinterpretations of C-S boundaries that have been delineated automatically32. In the current study, we trained the SegNet model to identify the outer edge of the posterior stromal layer, not the C-S boundary at the posterior limit of the choroidal vessel. Therefore, the SegNet achieved choroidal segmentation with high similarity to manual segmentation under the same rule, which was superior to the graph cut segmentation.

An additional advantage of the SegNet model is that it was able to successfully delineate the boundary (Fig. 2) without denoising or edge enhancement, although the previous segmentation model required edge enhancement or inclination adjustment17,31.

Limitations. The present study has several limitations. First, in this series, we did not examine eyes with retinal and choroidal diseases, such as diabetic maculopathy or AMD, so we do not know whether our method can segment the choroids of such eyes effectively. If not, additional training using images of eyes with diseases can improve the segmentation results in such eyes, since the DCNN model is versatile. Second, the parameters to make 3D spline can influence the volume of the choroid, especially in eyes with an irregular C-S boundary, such as in CSC10,33 or polypoidal choroidal vasculopathy34. Third, histopathological correlation to SS-OCT images was not validated; we were unable to identify whether C-S boundaries segmented by SegNet or human grader in SS-OCT images matched histopathologically segmented borders. The definition of the C-S boundary on the SS-OCT should be made based on histopathological studies in the future.

### Conclusions

Semantic segmentation of SS-OCT images using DCNN is comparable to manual segmentation with high reproducibility.

## References

1. 1.

Flower, R. W. Physiology of the developing ocular vasculature. Birth Defects Orig. Artic. Ser. 24, 129–146 (1988).

2. 2.

Stefansson, E. Oxygen and diabetic eye disease. Graefes Arch. Clin. Exp. Ophthalmol. 228, 120–123 (1990).

3. 3.

Fercher, A. F., Hitzenberger, C. K., Drexler, W., Kamp, G. & Sattmann, H. In vivo optical coherence tomography. Am. J. Ophthalmol. 116, 113–114 (1993).

4. 4.

Huang, D. et al. Optical coherence tomography. Science 254, 1178–1181 (1991).

5. 5.

Swanson, E. A. et al. In vivo retinal imaging by optical coherence tomography. Opt. Lett. 18, 1864–1866 (1993).

6. 6.

Maruko, I. et al. Subfoveal choroidal thickness after treatment of Vogt-Koyanagi-Harada disease. Retina 31, 510–517, https://doi.org/10.1097/IAE.0b013e3181eef053 (2011).

7. 7.

Sayanagi, K., Pelayes, D. E., Kaiser, P. K. & Singh, A. D. 3D Spectral domain optical coherence tomography findings in choroidal tumors. Eur. J. ophthalmology 21, 271–275, https://doi.org/10.5301/EJO.2010.5848 (2011).

8. 8.

Zheng, F. et al. Choroidal Thickness and Choroidal Vessel Density in Nonexudative Age-Related Macular Degeneration Using Swept-Source Optical Coherence Tomography Imaging. Invest. Ophthalmol. Vis. Sci. 57, 6256–6264, https://doi.org/10.1167/iovs.16-20161 (2016).

9. 9.

Dansingani, K. K., Balaratnasingam, C., Naysan, J. & Freund, K. B. En Face Imaging of Pachychoroid Spectrum Disorders with Swept-Source Optical Coherence Tomography. Retina 36, 499–516, https://doi.org/10.1097/iae.0000000000000742 (2016).

10. 10.

Maruko, I. et al. Subfoveal choroidal thickness after treatment of central serous chorioretinopathy. Ophthalmology. 117, 1792–1799, https://doi.org/10.1016/j.ophtha.2010.01.023 (2010).

11. 11.

Haas P., Esmaeelpour M., Ansari-Shahrezaei S., Drexler W. & Binder S. Choroidal thickness in patients with reticular pseudodrusen using 3D 1060-nm OCT maps. Invest Ophthalmol. Vis. Sci. 55, https://doi.org/10.1167/iovs.13-13338 (2014).

12. 12.

Novais E. A. et al. Choroidal Neovascularization Analyzed on Ultrahigh-Speed Swept-Source Optical Coherence Tomography Angiography Compared to Spectral-Domain Optical Coherence Tomography Angiography. Am. J. Ophthalmol. 164, https://doi.org/10.1016/j.ajo.2016.01.011 (2016).

13. 13.

Bonini Filho, M. A. et al. Association of Choroidal Neovascularization and Central Serous Chorioretinopathy With Optical Coherence Tomography Angiography. JAMA Ophthalmol. 133, https://doi.org/10.1001/jamaophthalmol.2015.1320 (2015).

14. 14.

Manjunath, V., Taha, M., Fujimoto, J. G. & Duker, J. S. Choroidal thickness in normal eyes measured using Cirrus HD optical coherence tomography. Am. J. Ophthalmol. 150, https://doi.org/10.1016/j.ajo.2010.04.018 (2010).

15. 15.

Ruiz-Medrano, J. et al Macular choroidal thickness profile in a healthy population measured by swept-source optical coherence tomography. Invest Ophthalmol. Vis. Sci. 55, https://doi.org/10.1167/iovs.14-13868 (2014).

16. 16.

Zhang, L. et al. Validity of Automated Choroidal Segmentation in SS-OCT and SD-OCT. Invest. Ophthalmol. Vis. Sci. 56, 3202–3211, https://doi.org/10.1167/iovs.14-15669 (2015).

17. 17.

Mazzaferri, J., Beaton, L., Hounye, G., Sayah, D. N. & Costantino, S. Open-source algorithm for automatic choroid segmentation of OCT volume reconstructions. Sci. rep. 7, 42112, https://doi.org/10.1038/srep42112 (2017).

18. 18.

Duan, L., Hong, Y. J. & Yasuno, Y. Automated segmentation and characterization of choroidal vessels in high-penetration optical coherence tomography. Opt. Express 21, 15787–15808, https://doi.org/10.1364/oe.21.015787 (2013).

19. 19.

Pastur-Romay, L. A., Cedron, F., Pazos, A. & Porto-Pazos, A. B. Deep Artificial Neural Networks and Neuromorphic Chips for Big Data Analysis: Pharmaceutical and Bioinformatics Applications. Int. J. Mol. Sci. 17, https://doi.org/10.3390/ijms17081313 (2016).

20. 20.

Roy, A. G. et al. ReLayNet: retinal layer and fluid segmentation of macular optical coherence tomography using fully convolutional networks. Biomed. Opt. express 8, 3627–3642, https://doi.org/10.1364/boe.8.003627 (2017).

21. 21.

Shelhamer, E., Long, J. & Darrell, T. Fully Convolutional Networks for Semantic Segmentation. IEEE Trans. pattern Anal. Mach. Intell. 39, 640–651, https://doi.org/10.1109/tpami.2016.2572683 (2017).

22. 22.

Chen, M., Wang, J., Oguz, I., VanderBeek, B. L. & Gee, J. C. Automated segmentation of the choroid in EDI-OCT images with retinal pathology using convolution neural networks. Fetal, infant. ophthalmic Med. image analysis: Int. Workshop, FIFI 2017, 4th Int. Workshop, OMIA 2017, held conjunction MICCAI 2017, Que. City, QC, Canada, September 14 10554, 177–184 (2017).

23. 23.

Kei Otsuka. Medical Image Segmentation Using SegNet, https://www.mathworks.com/matlabcentral/fileexchange/66448-medical-image-segmentation-using-segnet, MATLAB Central File Exchange. Retrieved July 9 (2019).

24. 24.

Chiu, S. J. et al. Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation. Opt. Express. 18, 19413–19428, https://doi.org/10.1364/oe.18.019413 (2010).

25. 25.

Rueden, C. T. et al. ImageJ2: ImageJ for the next generation of scientific image data. BMC bioinformatics. 18, 529, https://doi.org/10.1186/s12859-017-1934-z (2017).

26. 26.

Hirata, M. et al. Macular choroidal thickness and volume in normal subjects measured by swept-source optical coherence tomography. Invest. Ophthalmol. Vis. Sci. 52, 4971–4978 (2011).

27. 27.

Chandrasekera, E., Wong, E. N., Sampson, D. M., Alonso-Caneiro, D. & Chen, F. K. Posterior Choroidal Stroma Reduces Accuracy of Automated Segmentation of Outer Choroidal Boundary in Swept Source Optical Coherence Tomography. Invest. Ophthalmol. Vis. Sci. 59, 4404–4412, https://doi.org/10.1167/iovs.18-24665 (2018).

28. 28.

Beaton, L. et al. Non-invasive measurement of choroidal volume change and ocular rigidity through automated segmentation of high-speed OCT imaging. Biomed. Opt. express 6, 1694–1706, https://doi.org/10.1364/boe.6.001694 (2015).

29. 29.

Kajic, V. et al. Automated three-dimensional choroidal vessel segmentation of 3D 1060 nm OCT retinal data. Biomed. Opt. express. 4, 134–150, https://doi.org/10.1364/boe.4.000134 (2013).

30. 30.

Kajic, V. et al. Automated choroidal segmentation of 1060 nm OCT in healthy and pathologic eyes using a statistical model. Biomed. Opt. express 3, 86–103, https://doi.org/10.1364/boe.3.000086 (2012).

31. 31.

Zhang, L. et al. Automated segmentation of the choroid from clinical SD-OCT. Invest. Ophthalmol. Vis. Sci. 53, 7510–7519, https://doi.org/10.1167/iovs.12-10311 (2012).

32. 32.

Hogan, M. J. Histology of the human eye. 202–392 (Saunders, 1971).

33. 33.

Maruko, I., Iida, T., Sugano, Y., Ojima, A. & Sekiryu, T. Subfoveal choroidal thickness in fellow eyes of patients with central serous chorioretinopathy. Retina 31, 1603–1608, https://doi.org/10.1097/IAE.0b013e31820f4b39 (2011).

34. 34.

Gharbiya, M. et al. Choroidal Thickness Changes After Intravitreal Antivascular Endothelial Growth Factor Therapy for Age-Related Macular Degeneration: Ranibizumab Versus Aflibercept. J. Ocul. Pharmacol. Ther. 31, 357–362, https://doi.org/10.1089/jop.2014.0160 (2015).

## Author information

Authors

### Contributions

Tsuji S. processed the image and calculated the data calculation and made the tables and the figures and wrote the manuscript. Sekiryu T. presented the concept of the research and supervised this study. Sugano Y., Ojima A. and Kasai A. collected the data. Okamoto M. gave advice about image processing. Eifuku S. supervised image processing. All authors reviewed the manuscript.

### Corresponding author

Correspondence to Tetsuju Sekiryu.

## Ethics declarations

### Competing interests

The authors declare no competing interests.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

Tsuji, S., Sekiryu, T., Sugano, Y. et al. Semantic Segmentation of the Choroid in Swept Source Optical Coherence Tomography Images for Volumetrics. Sci Rep 10, 1088 (2020). https://doi.org/10.1038/s41598-020-57788-z

• Accepted:

• Published:

• DOI: https://doi.org/10.1038/s41598-020-57788-z