Why do we need adaptive optics?

The visualisation of individual cells had been historically only achievable using histological techniques. Therefore, in vivo cellular imaging of the retina is of great interest to the scientific community. Direct assessment of individual cells in the living retina has the potential to revolutionise our understanding of retinal structure and function in health and disease. The waveguiding property of cone photoreceptors as well as their relatively large diameter in the periphery make them the easiest target for cellular imaging. Towards the end of the last century, in vivo imaging of the cone photoreceptors in normal peripheral retina was achieved using flood illumination (FI) fundus camera [1] and scanning laser ophthalmoscopy (SLO) [2] technologies. In addition, optical coherence tomography (OCT) provided unparalleled sub-cellular axial resolution for the retina [3]. However, the lateral resolution of these systems was limited by wavefront aberrations caused by the optics of the eye.

Optical aberrations are generally classified into chromatic and monochromatic aberrations. Chromatic aberration develops due to the variation in refractive index of eye components for different wavelengths, resulting in inconsistent magnification and positioning of different components of the light at the back of the eye. These aberrations can be overcome using a single wavelength light source. Monochromatic aberrations are wavelength-independent and are commonly divided into low order and high order aberrations. Low order aberrations constitute the greatest proportion and can be corrected using spherical and cylindrical lenses. Although higher order aberrations represent a relatively small proportion of the optical aberrations of the eye, they can significantly reduce lateral resolution and degrade retinal image quality. Adaptive optics (AO) technology was introduced to measure and correct high order aberrations to enhance the resolution and image quality of the existing imaging modalities.

Brief history of adaptive optics

The history of AO started in astronomy. Horace Babock originally proposed the use of AO to correct the dynamic wave-front error that atmospheric turbulence causes in ground-based telescopes [4]. Since then it has been possible to measure the total optical aberrations of the human eye using a Shack-Hartmann wavefront sensor (SHWS), an essential piece of innovation in the development of AO. Moreover, Dreher and his group then introduced a deformable mirror another an essential component of AO scanners [5] to correct the measured aberrations. AO is capable of correcting the total wave aberration of the eye. The first use of AO in ophthalmic practice was reported in 1997 [6]. Liang et al. was the first to combine a SHWS with a deformable mirror to correct aberrations and obtain high-quality images of the retina.

The first clinical use of AO was in 2000 to assess cone-rod dystrophy [7]. Since then multiple studies have been carried out in assessing cones, rods, retinal vessels and other retinal structures such as drusen, microaneurysms, haemorrhage, etc. AO can complement other forms of retinal imaging such as spectral-domain OCT, fundus autofluorescence (FAF), fundus fluorescein angiography (FFA), indocyanine green angiography (ICG) etc in helping understand retinal disease.

Principles of Adaptive Optics

In addition to ocular aberrations, high-resolution imaging of the retina also faces the challenge of limited reflectance of the retina, in particular the retinal pigment epithelium (RPE), photoreceptor inner segments and retinal ganglion cells (RGC) [8]. The principles of adaptive optics were invented by astrophysicists to help improve the quality of images of distant stars obtained by telescopes. The issue, when analyzing distant objects with a telescope, was the lack of clarity of these objects due to the blur-inducing optical aberrations caused by turbulence within the earth’s atmosphere. The principles used in telescopes have since been translated into ophthalmic practice to view the retina at a cellular level. The human eye is not an optically perfect system and irregularities within the cornea, lens and vitreous makes viewing the retina difficult. These distortions limit image quality and AO uses four components that work together to remove these distortions—wavefront sensor, wavefront correction, control system and artificial guide star (Fig. 1). The eyes best optical performance occurs with a pupil ~3 mm in diameter. However, for retinal examination, the pupils will need to be dilated to about 8 mm when significantly more aberrations occur. The development of AO allows the possibility of projecting aberration-free images on the retina with large pupil diameters.

Fig. 1
figure 1

Image showing how the different components of an adaptive optic system come together to overcome the optical aberrations of the eye.

Resolution

AO has the ability to resolve cones and rods in the retina [9] as well as the finest retinal vasculature. AO can resolve to 2μm but there is substantial difference in resolving rods over cones which is most likely down to the smaller sizes of rods. The resolution of an imaging system is determined by the following formula:

r = 0.61λ/NA

(r is the resolution, λ the imaging wavelength, and NA is the numerical aperture).

In theory the expected limit of achievable lateral resolution is about 2μm, this limit is not reached because the eye is not diffraction-limited even for monochromatic light.

Wavefront sensor and wavefront correction

The principle behind AO imaging is to identify the optical aberrations of the eye and to then correct for these imperfections (Fig. 1). AO systems require three different components: a wavefront sensing component, a wavefront correcting component and a controller. The aim of the controller is to link the first two components.

Wavefront sensing requires a beacon of light to act as a guide star i.e., a reference point from which the measurements can be made. A variety of different wave front sensors exist but the most commonly used is the SHWS. We can measure the optical aberrations of an eye using the SHWS [10] and it is this that has made AO imaging possible. Other types of wavefront sensors exist e.g., the pyramid sensor [11]. The SHWS is made of lenslets placed at the focal distance, the aim of which is for each lenslet to focus collimated light on to an area detector i.e., a charge coupled device or a complementary metal–oxide–semiconductor. A planar wave that is incident on the SHWS is used as the reference to produce spots on the camera. Any deviations from this reference wavefront will produce displacements of each spot that can be represented in the cartesian coordinate system of the camera.

The other essential part of the AO imaging devices is the wavefront correction. The most commonly used is the deformable mirror as this can be used to counter the aberrations measured by the SHWS. Other types of wavefront correction devices include a liquid spatial light modulator [12] or segmented mirrors [13, 14]. Some systems use two deformable mirrors to compensate for a larger variety of aberrations. The way in which a deformable mirror works is by changing the surface shape under experimental control to compensate for the eye’s optical aberration. The limited range of shapes of deformable mirrors initially limited the amount of aberrations that could be corrected [5], however, this is now much improved.

Types of adaptive optics

AO technology is basically a technique to overcome optical aberrations. Thus, in theory, it can be incorporated with almost any ophthalmic imaging modality to increase resolution to cellular/subcellular level. To date, AO has been combined with flood illumination ophthalmoscopy (AO-FIO), scanning laser ophthalmoscopy (AO-SLO), as well as optical coherence tomography (AO-OCT).

Adaptive optics flood illumination ophthalmoscopy

One of the earliest approaches to utilise AO in ophthalmology was through merging it with a fundus camera [6]. In an AO-FIO system, the whole region of interest is illuminated simultaneously, and the entire frame is captured concurrently from backscattered light. Therefore, images can be acquired in a relatively short time, minimising the effect of eye movement. However, this approach limits the axial resolution of images. In addition, defocused scattered light from the retina and choroid can still be included in the image resulting in reduced contrast as compared to SLO-based systems [15]. The rtx1 (Imagine Eyes, Orsay, France) is an example of a compact FIO-based commercially available AO system [16]. The system has been used for investigating parafoveal cone photoreceptors and retinal vasculature in normal subjects as well as several eye diseases (Figs. 25) [17,18,19].

Fig. 2: Adaptive optics flood illumination ophthalmoscope (AO-FIO, rtx1, Imagine Eyes) imaging of the cone photoreceptor mosaic in the right eye of a 36-year-old female healthy volunteer.
figure 2

Quantitative analyses were performed on the AODetect software (Imagine Eyes). a 0.5 × 0.5 mm image captured at a location 2 degrees temporal to the centre of the fovea. The area inside the yellow square was enlarged in bf to extract measurements. b The centre of cones was identified automatically (small red squares) and then validated/corrected by a human grader (green square). Voronoi analysis of the cone mosaic (c) was performed to calculate and construct colour-coded maps of cone density, spacing and regularity (df, respectively).

Fig. 3
figure 3

Lamina cribrosa from the right and left eyes of a 35-year-old healthy female. Images were taken using a commercial adaptive optics flood illumination camera (rtx1, Imagine Eyes).

Fig. 4: Imaging retinal vessels using adaptive optics flood illumination ophthalmoscopy.
figure 4

Images were taken from the right eye of a 36-year-old healthy female. a The structure of retinal arteriole and venules can be visualised. b Enlarged image of the arteriole, corresponding to the red square in a. c Gradient profile orthogonal to the blood vessel (corresponds to the white line in b). Edges of the vessel wall (blue and yellow lines) were automatically identified from the orthogonal gradient profile. Wall thickness, lumen diameter, total vessel diameter, cross-sectional area of vessel wall (WCSA), and wall-to-lumen ratio (WLR) were calculated for the vessel of interest. The white scale bars in a and b represent 100 μm.

Fig. 5: Adaptive optics scanning laser ophthalmoscope (AO-SLO) imaging of photoreceptors in a healthy subject and diabetic patients.
figure 5

a, c, e Cone reflection images. b, d, f Voronoi analysis of cone photoreceptors in (a, c, e), respectively. Upper row: densely packed cone photoreceptors in a healthy control subject. Middle and lower rows: reduced cone density and increased irregularity in the cone mosaic in patients with diabetic retinopathy. Reprinted with permission from Lammer et al. [152].

Adaptive optics scanning laser ophthalmoscopy

In contrast with FIO systems, SLO uses a focused single-spot light beam to raster scan the retina [20]. Backscattered light is refocused onto a confocal aperture to eliminate the effect of stray defocused light, therefore enhancing contrast and axial resolution [9]. Confocal detection allows for imaging the waveguiding photoreceptor outer segments (OS) and the highly-reflective nerve fibres, lamina cribrosa and blood vessels [21]. More recently, non-confocal light detection modes have been proposed to benefit from a multiply scattered light surrounding central focused signal [22]. “Offset aperture” imaging can enhance the visualisation structures that scatter light in one direction such as retinal ganglion cells [23]. “Dark-field” imaging involves blocking the confocal signal and detecting the whole surrounding annular signal, and has been used to visualise the RPE pattern [24]. In “split-detection” imaging mode, the annular signal can be divided into two detectors to reveal photoreceptor inner segments [25].

Adaptive optics optical coherence tomography

Spectral-domain OCT has the ability to provide cross-sectional images with unparalleled axial resolution. However, monochromatic aberrations of the eye limit its lateral resolution to about 15–20 μm [26]. In addition, the interferometric nature of OCT results in introducing granular speckle noise that can obscure detailed microscopic features. Incorporating the AO technology into OCT can significantly improve lateral resolution and reduce speckle size [27, 28]. Thus, facilitating high-resolution three-dimensional imaging of retinal cells/structures and even biological processes [29].

Adaptive optics-based metrics

Photoreceptors

Cone photoreceptors were one of the earliest cells to be visualised and quantified in the retina using AO. Cone photoreceptors are normally arranged in an imperfect hexagonal lattice pattern [30]. The identification of cones is most commonly performed using semi-automated approaches, in which the centre of cone photoreceptors is initially detected automatically, and then reviewed by an experienced human grader for manual corrections (Fig. 2) [31]. Although highly reliable, this approach can be intensively laborious and time consuming. Thus, new tools are actively being developed to improve the performance of automated detection of photoreceptors [32].

After the identification of cells, several metrics can be automatically measured (Fig. 2) [33]. Cone density and spacing are the most commonly utilised biomarkers [34]. Photoreceptor density is calculated by simply dividing the number of cones within a region by the area. For spacing parameters, distances between adjacent cells (neighbours) are used to perform Voronoi mapping of the cone mosaic (Fig. 2) [35]. Inter cell distance is defined as the mean distance between each cone photoreceptor and its neighbours. Nearest and farthest neighbour distances has been also described to define the minimum and maximum space between each cone and its neighbours in the submosaic [33]. Voronoi analysis can also provide information on the regularity of the cone mosaic [36]. Prevalence of cells with exactly six neighbouring cells can indicate the degree of hexagonality, hence regularity, in the cone mosaic (Fig. 2). The reliability of cone density and distancing measurement was found to be dependent on sampling window size and analysis methodology. Intrasession repeatability can be as good as 2.7% with a larger sampling window, image alignment and semi-automated cone identification methods [34].

More recently, photoreceptor size measurements were proposed to describe cell degenerative processes. Split-detection AO-SLO was used to visualise and measure the diameter of photoreceptor inner segments [37]. In addition, the high axial resolution provided by AO-OCT allowed for sensitive measurement of the outer segment length [38]. However, the significance and applicability of these size metrics still needs to be studied.

Cone photoreceptor reflectivity has been also measured and used as a metric [39]. Dysflective cones can be detected in AO-FIO, AO-SLO and AO-OCT images, representing non-waveguiding cones outer segments [33, 40]. Although cone reflectance was proposed to correlate with function, several studies concluded that the relationship between them is not straightforward [41]. This is discussed in detail in “How does adaptive optics relate to visual function?” section of this review.

Retinal pigment epithelium

Fluorescence and dark field AO-SLO techniques have been used for RPE imaging [24, 42]. Direct visualisation of RPE in normal retina using confocal AO-SLO has been challenging. However, RPE was successfully imaged in cases with photoreceptor loss or subretinal detachment [43]. Thus, the embedment of photoreceptor outer segments into RPE has been linked to the difficulty of RPE visualisation. The previously described photoreceptor cell density and spacing techniques were similarly utilised for RPE quantification [44]. Multimodal AO imaging allowed for simultaneous measurement of RPE and photoreceptor densities to calculate the RPE-to-photoreceptors ratio in healthy and diseased retina [45]. In addition, reflectance-based analysis of AO-OCT images of the photoreceptor-RPE complex has been described to characterise organelle motility and light scatter pattern [46]. Liu et al. performed repeated measurement of organelle motility at the same retinal location in 1 subject to assess variability [46]. A 3% difference was calculated between repeated measurements [46]. However, extensive reliability investigations still need to be performed on large cohorts to validate the potential of RPE-related metrics.

Retinal ganglion cells

The in-vivo visualisation of RGCs has been difficult due to their transparency and dense three-dimensional geometry. Multi-offset AO-SLO imaging was used to produce 2D images of a monolayer of RGCs at areas with limited overlying NFL [47]. Cell somas were segmented manually to measure the distribution of cell diameter and area [47]. Liu et al. used 3D AO-OCT volumes to investigate the tomography of the inner retina including GCL [23]. However, GCs and displaced amacrine cells could not be differentiated within the GCL. Soma diameter and stack thickness at different retinal locations were measured based on the en face reflectance projection of a 3-pixel thick slabs around cell centres. GCL soma reflectivity was also measured at the centre of the cells [23]. GC counts and densities were measured at different retinal eccentricities after subtracting amacrine cell number estimates from the literature. AO-OCT was also able to distinguish parasol and midget GC subtypes based on cell size, density and reflectivity [23]. The GC-to-cone ratio was also calculated across different locations. The reliability of these metrics still needs to be studied.

Lamina cribrosa

The lamina cribrosa has always been an area of interest for pathophysiological investigations in glaucoma. Confocal AO-SLO and AO-FIO imaging allowed for high resolution 2D visualisation of the lamina cribrosa (Fig. 3) and quantitative analysis of pore geometry [48]. Several groups utilised manual delineation of pore boundaries in AO-SLO images to calculate pore number, density and area [48]. The pore ovality index was also measured as the ratio between major and minor axes of the best-fitted ellipse. Nearest neighbour distance of each pore was also determined after the identification of pore centroid location [48]. Distance and area measurements can be corrected for individual’s axial length using Littmann’s method [49]. Ivers et al. acquired repeated measurements to assess intrasession and intersession variability in normal eyes [48]. Pore geometry metrics had an excellent repeatability of <1%. However, they reported larger intersession variability, ranging from 4% for distance measurements to around 8% for pore elongation and area parameters [48]. More recently, with the development of AO-OCT technology, three-dimensional parameters were introduced to characterize the microstructure of the lamina cribrosa [50]. Semiautomated methods were developed for pore and beam segmentation. Connective tissue volume fraction was defined as the percentage volume of voxels occupied by beams within the analysed lamina cribrosa [50]. Local thickness was measured at each voxel within a region of interest (pore or beam) as the diameter of the largest fitting sphere inside the region. Pore diameter and beam thickness were calculated by averaging the assigned local thickness values of the corresponding voxels [50]. A reliability study revealed high repeatability of 3D AO-OCT parameters in normal and glaucomatous eyes. Nadler et al. reported a variability of ≤4.7% in the measurement pore area and diameter, beam thickness and connective tissue volume fraction using their automated segmentation [50]. However, they reported poor repeatability in measuring lamina volume due to the unreliable identification of external lamina cribrosa boundary [50]. More studies are still needed to investigate intersession reproducibility of these parameters.

Retinal vasculature

Several AO systems and imaging modalities allowed for exquisite visualisation of blood vessel wall, lumen and blood cells, enabling the assessment of vascular morphology and perfusion [51]. Arteriolar wall thickness and lumen diameter can be measured reliably from AO images (Fig. 4) [52]. Meixner et al. reported intra-observer measurement variability of 6 and 2% for vessel wall thickness and total vessel diameter, respectively [18]. Wall-to-lumen ratio (WLR) is a commonly used metric to evaluate structural changes in retinal arterioles [18, 53]. Lumen diameter and total vessel diameter were found to exhibit a strong linear correlation across different vessel sizes in normal subjects [54]. Thus, WLR can be highly predictable for a given vessel size. Deviations from this relationship can be used as a disease biomarker [54]. The cross-sectional area of vascular wall (WCSA) can be also measured based on vessels and lumen diameters (Fig. 4) [18]. Retinal vessel branching has been also investigated in health and disease [55]. Arteries and veins were imaged at bifurcation sites across a wide range of vessel sizes. Bifurcation angle and the diameter of parent and daughter vessels can be measured from structural images and perfusion maps [55].

High-resolution images of retinal capillary networks can be also generated by acquiring overlapping AO images and using motion inside blood vessels as a contrast to construct parafoveal perfusion maps non-invasively, a similar concept to the OCT angiography technology [56]. Several metrics have been introduced to characterize retinal microvascular changes. Foveal avascular zone (FAZ) area has been segmented and measured using manual or semiautomated approaches [56, 57]. The effective diameter of the FAZ was also calculated as the diameter of the circle with equal area [58]. The boundary of the FAZ was used to calculate an acercularity index, defined as the ratio between perimeter of the FAZ and the circumference of the circle with equal area [58]. Capillaries can also be identified within a region of interest to measure the total length of extracted capillaries. Capillary density has been also calculated as a ratio between total capillary length and the total area of the region of interest. A tortuosity metric has also been described based on vessels curvature [58]. Curvature was calculated using a sliding least-squares polynomial fitting approach [53].

Retinal blood flow

Individual leukocytes can be directly visualised in confocal AO-SLO videos. Due to the relatively low absorption and scattering of leukocytes as compared to other blood components, they allow more light to reach photoreceptors and then reflect back [59]. Thus, they appear as hyperreflective particles moving inside darker vessels. Observing leukocyte movement within capillaries can be potentially used for in vivo investigation of leukocyte-endothelial interactions in humans [59]. Leukocyte velocity can be also calculated after measuring the distance travelled by the cell in successive 2D frames [60]. Axial length should always be taken into account when measuring retinal distances to overcome the effect of optical magnification [49]. However, Martin et al. observed significant variability in velocity measurements between repeated sessions [61]. Pulsatility of leukocytes can be determined by analysing the association between the measured velocity and cardiac cycle [62]. Each cardiac cycle was tracked simultaneously during retinal imaging, and then divided into five equal segments. Leukocyte velocity measurements were computed from video frames and a mean velocity was assigned to each cardiac cycle segment. The difference in mean velocity between highest and lowest segments (VmaxVmin) and the average of all measured leukocyte velocities (Vmean) were calculated. A pulsatility index (P) was then defined as P = (VmaxVmin)/Vmean [62]. Spatiotemporal plots of a selected vessel have also been generated from AO-SLO videos by plotting the intensity along the centre of the vessel of interest against frame number [63]. Objects within vessels can be then traced from the plots to extract hemodynamic information, including flow direction, speed, pulsatility, as well cell distribution and trafficking across different vessels [63].

Spatiotemporal plots (XT images) can be also constructed from repeated 1D line scans across the vessel of interest to trace the movement of blood cells [64]. Moving erythrocytes appear as diagonal bright lines within the imaged vessels. Velocity of RBC movement can be calculated from the slope of these diagonal streaks [65]. Palochak et al. confirmed the precision of this method by measuring blood flow in parent and daughter vessels at a bifurcation in a healthy control and two diabetic patients [66]. Further studies are still needed to assess the reliability of AO-derived blood flow measurements.

How does adaptive optics relate to visual function?

The ability of AO to resolve individual photoreceptors has enabled cell-targeted functional testing [67]. Spatiotemporal variation in photoreceptor reflectance is a prominent feature in AO images [8, 39]. Photopigment bleaching can change cone photoreceptor reflectivity. By employing selective bleaching and retinal densitometry techniques, it is possible to characterize the arrangement of the trichromatic cone mosaic at the cellular level [68]. In addition, several other factors have been linked to changes in cone reflectivity, including OS length and integrity, phototransduction, visual stimulation and direction of illumination [69, 70]. The relationship between photoreceptor reflectivity and function is not fully understood. Areas with decreased cone reflectance are reported to exhibit no functionality in several retinal diseases including age-related macular degeneration (AMD) [71] and achromatopsia [22]. In contrast, other investigators reported residual sensitivity in those areas in AMD [72] and macular telangiectasia [73]. In addition, in normal eyes, no correlation was observed between cone reflectivity and sensitivity [41]. Temporal changes in the reflectivity of rod photoreceptors has also been detected in healthy and diseased retinas [8].

The AO-OCT has been also used to characterize physiological changes in photoreceptors. Temporal changes in the reflectivity of cone OS tips as well as the decrease in OS length have been attributed to disc shedding and phagocytosis by RPE [74]. AO can also be used to present diffraction limited tiny visual stimuli to target the centre of a photoreceptor, inter-cell space or a small group of photoreceptors [75]. This can be achieved by modulating the imaging light or using a second channel to provide visual stimuli [76]. Grieve and Roorda used AO-SLO to study the single cone response to checker board pattern visual stimuli [69]. They reported a variable response in cones, with some cones showing increased reflectance while others might show a decrease in reflectivity. Similar AO-based techniques are being extensively used for detailed investigation of visual processing in the human retina [77].

Vascular autoregulatory processes have also been investigated by AO technology. AO-SLO and AO-FIO reveal a focal increase in retinal blood velocity and/or vessel diameter in response to local visual stimulation [78]. Thus demonstrating the neurovascular coupling previously described in neural tissue, including the retina [79]. Furthermore, AO perfusion maps can reveal autoregulatory microvascular dilation or constriction in response to hypercapnea and hyperoxia, respectively [80]. Similar responses have been previously described using other imaging modalities including OCT angiography [81].

Table 1 summarises quantitative metrics derived from AO images and their definition.

Table 1 A summary of adaptive optics-based metrics and their definitions.

Clinical applications of AO

Healthy eyes

It is essential to analyse healthy eyes using AO as the results can be used to help develop normative databases. This can then be used in clinical practice when assessing patients i.e., identifying deviations from normal. At present there needs to be an expansion in the volume of healthy eyes imaged with AO. Below we will discuss some of the relevant studies looking at healthy eyes using AO.

Firstly, AO-SLO has been used to measure the variation of cone packing density across the retina in healthy subjects of different ages [82]. This group tested ten younger subjects (age range, 22–35 years) and ten older subjects (age range, 50–65 years). They showed cone packing density was higher closer to the fovea and decreased with increasing retinal eccentricity. They found that older subjects had ~75% of the cone density at 0.6° from the fovea compared to the younger group. This study demonstrates that normal values may be different for different age groups.

In a separate but similar study the cone packing density was again measured using an AO-SLO [83]. Cone density was analysed as a function of retinal eccentricity, refractive error, axial length, age, gender, race/ethnicity and ocular dominance. Cone packing density was measured at three different retinal eccentricities 0.5, 1.0 and 1.5 mm from the foveal centre. Cone density decreased from 32,200 to 11,600 cells/mm2 with retinal eccentricity. It demonstrated cone packing density decreases as a function of retinal eccentricity and axial length. However, gender, ocular dominance and race/ethnicity were not important determinants of cone density. Again, the data for different factors e.g., race and gender need to be well established before AO can be applied to clinical use.

More recently a group in France used an AO retinal camera (RTX-1® Imagine Eyes) [19] to assess healthy eyes belonging to patients of various ages. They measured cone density together with cone spacing and cone mosaic packing in the nasal and temporal area 450 µm from the fovea. There results showed that perifoveal cone density significantly decreased with age whereas cone spacing increased with age. In this study age and axial length were shown to be related to a cone density decrease, while choroidal and retinal thicknesses did not affect cone metrics in healthy subjects. The recurring theme here is that age and axial length are important factors when evaluating cone density.

Finally, another group again use the AO flood-illumination retinal camera (rtx1) to measure cone density in the eyes of healthy individuals. This study included 33 patients and the median cone density was 19,269 cones/mm as measured 3 degrees from the fovea [84].

Data from patients with so-called normal eyes is essential to help build the data of expected AO parametric values. A uniform way of measuring photoreceptor density and spacing should be established in order for all researchers/clinicians to carry out the above assessments in a standardised way. Clinicians need to be taught how to interpret these images and be given information on what AO images/results mean for their patients.

Diabetic retinopathy (DR)

AO has been used to evaluate parafoveal cone density in patients with Type 1 diabetes mellitus [85]. Of the patients in the study, five had a diagnosis of no diabetic retinopathy and six had mild non-proliferative diabetic retinopathy. The results showed that cone density was 10% lower in the study than in the control group at each retinal eccentricity along the horizontal and vertical meridians. This study suggests AO can identify early retinal changes of diabetes not detectable by other forms of imaging or by clinical examination (Fig. 5).

Furthermore, AO has been used in diabetics to look at the FAZ, microaneurysms and drop out of capillaries at the edge of the FAZ [86]. AO-SLO videos of the parafoveal region from patients with type 2 diabetes and no retinopathy and from control subjects were assessed. An increased average tortuosity of arteriovenous channels in patients with type 2 diabetes were seen even though there were no signs of DR in these eyes. This again highlights the clinical application of AO in detecting early changes in eyes which appear to be not clinical affected by diabetes.

A study presented at the Association for Research in Vision and Ophthalmology meeting in 2012 showed the cone photoreceptor mosaic pattern can be disrupted in diabetic retinopathy in patients with type 1 diabetes using AO-SLO [87]. Interestingly, alterations in photoreceptor density and arrangement are most evident in the superotemporal quadrant in eyes with diabetic macular oedema [87].

In contrast, another study found that parafoveal cone photoreceptor density in type 1 diabetics was not reduced and was found to be similar to controls [88]. Given this difference in findings between the above studies further studies looking at cone densities are crucial.

There is no doubt that AO is now able to pick up finer changes in blood vessels in patients with diabetic retinopathy [89] helping us better understand the underlying pathology of diabetic retinopathy. A study of retinal capillary lumen calibre in patients with type 1 diabetes was analysed. It showed that average capillary lumen calibre was significantly narrower in eyes with non-proliferative diabetic retinopathy compared with control eyes. These vascular changes are an indication of early diabetes-induced damage. Clinically if these changes could predict which patients will progress, early intervention could be applied to reduce the progression.

AO-SLO is able to identify and visualise individual microaneurysms [90] and some of these microaneurysms have quite different appearances. AO-SLO offset pinhole motion contrast (utilises an off-centre pinhole with no need for an external contrast agent) can provide perfusion maps comparable to those obtained with AO-SLO FA, while AO-SLO OP reflectance images provide additional information such as vessel wall fine structure.

AO is useful in gaining a better mechanistic understanding of DR. It can image microaneurysms, blood vessels and cone cells. These are all targets that are damaged in DR.

Central serous chorioretinopathy (CSCR)

AO has been used to assess central serous chorioretinopathy. A case presentation revealed that AO optics demonstrated lower density, spacing and changes in the photoreceptor mosaic pattern in the left eye which had recovered from CSCR than in the right eye, suggesting that CSCR may cause damage to cones after clinical recovery [91]. A more comprehensive comparison with AO-SLO in 45 eyes with resolved CSCR and 20 normal eyes demonstrated abnormal cone mosaic patterns and reduced cone densities in eyes with resolved CSCR, and these abnormalities were associated with VA loss [92]. In a separate study, patients who had CSCR were followed up with AO-SLO for 12 months once the CSCR had resolved. The results revealed a gradual increase in macular cone densities over a 12-month period in patients with resolved CSCR [93]. These studies demonstrate another potential role for AO in patients with CSCR i.e., to monitor patients post resolution of CSCR.

Age-related macular degeneration

In the developed world AMD is a leading cause of blindness. One application of AO in AMD is in monitoring retinal changes such as drusen, pigmentation, pseudodrusen and atrophy as well as changes in RPE and photoreceptors with progression of the disease (Fig. 6). One study demonstrated that cone photoreceptors are preserved over drusen in a patient with early onset large colloidal drusen [94].

Fig. 6: Photoreceptor imaging in the left eye of a 71-year-old female patient with intermediate age-related macular degeneration.
figure 6

a A 30-degree en face infrared image with overlaid 4-degree adaptive optics flood illumination ophthalmoscope (AO-FIO) image (inside the red square). b The enlarged AO-FIO image of cone photoreceptor mosaic (4 degrees temporal to the centre of the fovea). The area surrounded by a yellow square was enlarged for the qualitative analysis of cones. c Semiautomated detection of photoreceptors. Red squares correspond to automatically identified cones. Green squares represent cones that were manually corrected/identified. df Voronoic colour-coded maps of cone density, spacing and regularity, respectively.

Fig. 7
figure 7

Adaptive optics scanning laser ophthalmoscope (AO-SLO) imaging of photoreceptors at 5° temporal to the fovea from a healthy control (a, b) and a stargardt disease patient (c, d). Confocal (a, c) and split-detector (b, d) images clearly illustrates loss of cone photoreceptors in the patient as compared to the control. Black arrows in (d) represent some remaining cones. Scale bar: 25 μm. Reprinted with permission from Razeen et al. [153].

Fig. 8
figure 8

Photoreceptor imaging in an age-matched normal subject (ad) and a retinitis pigmentosa patient (eh). a, e Central 10° AO image. Orange, yellow and blue squares correspond to the magnified images in (b, f), (c, g) and (d, h), respectively. Decreased cone density and increased spacing can be detected in the patient. Reprinted with permission from Lin et al. [154].

Geographic atrophy has been studied using AO. Studies have looked at the changes in cone density at atrophic sites and in areas adjacent to these sites [95]. They showed that a complex, dynamic process of redistribution of hyporeflective clumps throughout the posterior pole precedes and accompanies the emergence and progression of atrophy. Hence these clumps are probable biomarkers of RPE damage and atrophy. As demonstrated here AO can be invaluable in measuring progression and in identifying those who may progress.

Furthermore, AO-SLO identified several small drusen deposits that were not observed with standard clinical imaging techniques leading to the potential of AMD being diagnosed at even earlier stages [96].

A study of photoreceptor distribution showed retinal cells overlying both soft and hard drusen exhibit structural and molecular abnormalities. These abnormalities resemble the degenerative effects confined to areas directly overlying drusen. This suggests that photoreceptor cell function is compromised as a consequence of drusen formation [97]. This has been shown in other studies using AO [98]. It is unclear which tissue is affected first in AMD: choroid, RPE, or photoreceptors. AO studies can help identify the time and the sequence in which tissues are affected first by identifying microscopic changes.

Finally, AO has been used in trials of AMD patients who have undergone stem cell therapy. Recently a team transplanted an autologous induced pluripotent stem cell-derived RPE cell sheet following removal of choroidal neovascularization in a patient with exudative age-related macular degeneration and polypoidal choroidal vasculopathy [99]. On follow up with AO dark cell-like structures (suspected to be RPE cells) with a predominantly hexagonal arrangement were observed in an area located near the margin of the graft sheet.

Inherited retinal dystrophies (IRD)

Inherited retinal degenerations have been investigated using AO. Table 2 shows the different types of IRD and the valuable information that has been obtained through the use of AO.

Table 2 Examples of IRD assessed using AO.

Glaucoma

There have been several studies looking at the use of AO in glaucoma. One study involved assessing the morphology of human lamina cribrosa pores in healthy and primary open-angle glaucoma (POAG) eyes. It concluded that on average, lamina cribrosa pores are elongated in POAG eyes and also in the healthy eyes of POAG relatives [100]. Another study looked at eyes with primary open-angle glaucoma who had suffered parafoveal visual field loss at least 3 years previously [101]. As determined using AO-SLO, eyes with glaucoma did not differ significantly from normal eyes in terms of cone density even in areas with visual field and/or nerve fibre loss. Although not many studies have been conducted with AO on glaucoma patients one study revealed the potential of this form of imaging by revealing glaucomatous damage that is difficult, if not impossible, to see with current OCT technology [102].

Other diseases

Given this relatively new form of imaging modality only a few studies have been conducted on other ophthalmic diseases. Examples of other eye diseases that were assessed using AO are summarised in Table 3.

Table 3 Examples of eye diseases assessed using AO.

Uses of adaptive optics

One of the main advantages of AO is its ability to detect changes at a microscopic level before macroscopic damage occurs. This can allow diseases to be detected earlier and therefore allowing a clinician the opportunity to intervene at an earlier stage in the disease process.

Furthermore, AO is capable of providing information immediately to researchers as opposed to histological samples post-mortem. AO provides us with further information on how the visual system i.e., the retina is organised in humans in both health and disease.

Once there is an expansion in volume of number of healthy and diseased AO imaging, we will be able to better and more efficiently identify and monitor ophthalmic disease using AO. A uniform way of measuring photoreceptor density and spacing should be established in order for all researchers/clinicians to carry out the above assessments in a standardised way and monitor the patient’s disease using AO. Clinicians need to be taught how to interpret these images and given information on what AO images mean for their patient’s condition.

AO can be used to determine what structures remain at the edge of lesions [22] i.e., the composition of cells. This is particularly important when planning future therapies such as stem cell and gene therapies. AO permits observation of the natural history of retinal disease at a cellular level. This potentially could aid determining when a treatment could be instigated to maintain or improve vision to a patient.

Furthermore, phenotype determined by AO-SLO can be correlated with genotype to better understand inherited diseases such as Stargardt disease and retinitis pigmentosa. AO can be used to assess which cells/structures in the retina are affected in each disease/stage of disease helping us better target treatment. For example, one study demonstrated that cone photoreceptors are present in geographic atrophy without adjacent surviving RPE [103].

One future direction of AO is almost certainly in monitoring patients in clinical trials. AO can be used for participant selection, stratification and monitoring treatment safety and efficacy. AO has the advantage of being non-invasive and reproducible. It may identify early biomarkers of progression thus allowing shorter duration trials and novel clinical endpoints. This should accelerate drug development for retinal diseases. While AO use in clinical trials is still modest it has already been used to monitor progression of retinitis pigmentosa in patients treated with ciliary neurotrophic factor (CNTF) [104]. More recent studies include a phase 2 multicentre randomized clinical trial of CNTF for macular telangiectasia type 2 [105] and a phase 1, open-label, safety and feasibility study of the implantation of human embryonic stem cell derived retinal pigment epithelium in subjects with acute wet AMD [106].

AO is undoubtedly an exceptional research tool given the high-quality and detailed images it can provide of the human retina. It enables resolution at a cellular level, but, the important question is what is its potential role in day to day clinical practice? To date AO has not been used routinely in clinical practice principally due to its high cost and complexity.

Adaptive optics in animal models and ex vivo tissue

Animal models play an important role in studying normal and diseased eyes. Classically, animal eyes have been studied in vitro using histopathological techniques, hindering longitudinal assessment. Using AO for in vivo cellular imaging allows for non-invasive structural and functional investigations of the retina.

Non-human Old-World primates, especially the macaque monkey have been employed extensively as a model to understand structural and functional characteristics of the human retina. By using either endogenous or extrinsic fluorophores, single and multi-photon fluorescence AO-SLO systems were utilised to capture direct reflectance or fluorescence images of the microscopic structure of normal macaque retina, including RGC, photoreceptors, Müller cell processes, RPE, lamina cribrosa and microvasculature [42, 47, 107].

In vivo functional imaging has been accessible by using fluorescence AO in the primate eye. Morgan et al. used autofluorescence AO-SLO to characterise RPE damage and the reduction in retinal autofluorescence after light exposure to macaque retina [108]. Their experiments showed permanent retinal changes after using light conditions close to the maximum permissible exposure levels set by the American National Standards Institute (ANSI) [108]. In addition, Sincich et al. used AO-SLO to visualise and stimulate individual foveal cone photoreceptors to map the receptive field [109]. More recently, the retinoid cycle was investigated in vivo in the macaque by monitoring fluorescence changes in photoreceptors during light and dark adaptation conditions [110]. The calcium response in RGC was also recorded after light stimulation [111].

The northern tree shrew is a mammal closely related to primates and has been recently used as a model in vision research. Sajdak et al. used a Shack-Hartman wavefront sensor to characterise the relatively high aberrations of the optical system of the tree shew eye [112]. They adapted an AO-SLO instrument to image the cone photoreceptor mosaic using confocal and split-detection techniques. Sporadic rod photoreceptors were also visible on confocal and non-confocal images [112].

The mouse is the most commonly used animal model in biomedical research, including ophthalmic diseases. Garcíade la Cera et al. used a Hartmann–Shack waverfront sensor to characterise optical aberrations in the mouse eye [113]. AO retinal imaging in the mouse can be more difficult than in human and non-human primates due to the smaller pupil size and the much thicker retina relative to the focal length of the mouse eye. One year later, Biss et al. used an AO system for in vivo and ex vivo imaging of fluorescently labelled retinal capillaries and microglial cells [114]. Fluorescent confocal AO-SLO has been also developed for the mouse eye with an average measured in vivo transverse and axial resolution of 0.79μm and 10.8μm, respectively [115]. The system allowed for direct non-invasive visualisation of nerve fibre bundles, blood vessels and photoreceptors. Fluorescently labelled ganglion cells and dendrites were also visualised and morphologically classified using the same system [115]. A similar instrument was modified for the use in rats [116]. With an average measured transverse resolution of 1.84μm, images of microscopic structures in the rat retina were captured [116].

Yin et al. also utilised a similar fluorescent AO-SLO system to investigate the calcium response of individual ganglion cells after visual stimulation in mice expressing a genetically encoded calcium indicator (G-CaMP3) [117]. Over the years, AO has been combined with several other imaging modalities for in vivo imaging of mice retina including OCT [14], two photon imaging [118] and multimodal systems [119]. Due to the challenges faced with direct wavefront measurement in the eyes of small animals, an image-based AO approach has been recently proposed to measure and correct for aberrations without the need for wavefront sensor [120].

Recently, red blood cells and platelets were imaged within retinal capillaries using 2D confocal and split-detector AO-SLO imaging [121]. 1D line scans orthogonal to a capillary enabled the calculation of cell flow velocity and capillary pulsatility. In addition, pericytes surrounding retinal capillary endothelial cells in transgenic mice were visualised using fluorescent AO-SLO [122].

AO imaging has recently been employed to characterise structural and functional changes as well as response to treatment in a mouse model of retinal diseases. AO-SLO detected shortened cone outer segments in the blue cone monochromacy mouse model, which was significantly restored after opsin gene augmentation therapy [123]. Functional fluorescent AO imaging also showed extensive functional loss in photoreceptor-degenerated rd10 mice as compared to wild-type mice [124]. More recently, Miller et al. used multimodal imaging including AO-SLO to characterize short-term and long-term cellular interactions in the retina after focal photoreceptor damage [125].

Ex vivo imaging of biological specimens is also limited by wavefront aberrations from cellular/subcellular structures which can detriment image quality. AO has been combined with several microscopical approaches to enhance imaging quality and efficiency, thus reducing the needed illumination power. Two-photon excited fluorescence microscope uses two photons with a relatively long wavelength to excite intrinsic or extrinsic fluorophores to emit light which can then be detected to obtain 3D images. Debarre et al. incorporated an image-based sensor-less AO system to the microscope to provide depth-resolved aberration correction in biological samples [126]. Harmonic generation microscopy uses nonlinear optical properties to visualise tissue specimens. The variation in the generation of second or third harmonic radiation is used as a contrast to visualise cellular structure in three dimensions. AO was used to overcome the system- and specimen-induced aberrations, resulting in more efficient and higher resolution imaging [127]. Fluorescence fluctuation microscopy analyses the spatial and/or temporal fluctuation in fluorescence signal to reveal morphological and functional characteristics of a biological tissue. AO has been able to measure and correct for single cell-induced aberrations allowing for more precise measurements [128]. Optical coherence microscopy combines the principles of OCT and confocal microscopy to produce 3D volumetric imaging of a biological specimen. Computational AO was utilised for real-time correction of aberrations to achieve a lateral resolution of 0.6 µm [129].

Limitations of adaptive optics

There are limitations to using AO in a clinical setting including the cost of running an AO imaging service, the time needed to scan patients, the lack of normative databases, the very small size of area imaged, and the quality of images obtained.

Firstly, good quality images cannot be obtained readily in a significant number of patients due to optical media densities/abnormalities such as dry eyes, cataracts, vitreous debris and corneal scarring. In addition, large/uncontrolled eye movements such as nystagmus can also further depreciate the quality of the images obtained. The quality of the images also depends on how well the patient cooperates and it may be difficult to achieve good cooperation from elderly patients whom make up the majority of patients seen in ophthalmology clinics. If good quality scans cannot be obtained in a timely manner in a clinic setting it will mean this form of imaging may not be so readily introduced for clinical use.

Another limitation of AO is the number of degrees from the fovea which the photoreceptors have been imaged. Photoreceptors (rods and cones) have been imaged out to 30’ in the temporal and nasal retina [130]. This is particularly important in studying conditions affecting the peripheral retina such as retinitis pigmentosa. The field of view and the reach of the camera to the peripheral retina needs to be enhanced in order to be able to assess monitor and analyse more peripheral regions. The field of view is very narrow in AO meaning that re-imaging the same area will be necessary for comparative purposes e.g., cone receptor densities in two different areas of the retina done at different times will not be comparable. Given the small area imaged, pathology in other areas of the retina may be missed.

Given the high cost of AO devices eye units will need a sufficient clinical indication in order to purchase this expensive device. Several companies have developed AO prototypes including Boston Micromachines Corporation, Canon, Inc., Imagine Eyes and Physical Sciences, Inc. However, very few machines have regulatory approval.

As mentioned previously the images produced are complex and normative databases are lacking. For AO to be useful at the very least normative, data bases need to be produced and clinicians need to be trained in interpreting these.

Finally, AO provides us with structural information, and it is difficult to determine whether this correlates with function i.e., healthy appearing cones/rods may in fact not be functioning despites normal structural appearance or vice versa. Again, further research needs to be done before this can be established.

Future of adaptive optics

The use of AO technology for retinal imaging has been growing exponentially since its introduction to vision research by the end of last century. However, the previously mentioned limitations curbed its expansion into widespread clinical utilisation. Efforts are being made to overcome some of these challenges. The analysis of AO images is complex, laborious and time-consuming. Automated algorithms, including machine learning techniques, might offer a more robust alternative to manual grading [131]. Proper validation and reliability assessment of these automated algorithms are needed to characterise their performance. A wide range of AO metrics are being used by different research groups. Standardisation of the nomenclature and definition of AO metrics might be needed.

Continuous advancements in AO hardware and software will reduce the size and cost of AO imaging systems. Sensorless AO systems have been developed to use the image itself, rather than a wavefront sensor, to measure and correct the aberrations [132]. Computational AO is another technique that measures the amplitude and phase of the back scattered light to calculate and minimise the effect of wavefront aberrations [133]. These techniques can simplify the hardware needed for an AO system, and potentially cut the costs. Although the image quality might not be as good as a conventional full hardware system, reasonable trade-offs are often needed to achieve a manageable cost.

Other technical improvements are making the technology easier to use. These include increased imaging speeds and the use of eye-tracking systems to significantly eliminate the effect of motion artefacts [134]. Several approaches have also been recently introduced to maximise the corrected field of view of AO systems. Multi-pupil AO and conjugate AO with multiple guide stars approaches have been described for simultaneous aberration correction over a wider area [135, 136]. More recently, Camino et al. developed a hill-climbing algorithm for real-time estimation of the largest achievable field of view in an AO-OCT system [137]. Increased computational speeds and parallel processing capabilities will continue to enhance the efficiency and capacity of AO imaging.

Non-confocal AO imaging has also been an emerging area of interest over the last several years [138]. Further work is needed to better understand the images and to determine their association with retinal structure and function. AO-OCT and AO-OCT angiography are showing great potential for 3D visualisation of the neurosensory retina, as well as choroidal and retinal vascular networks [29, 139]. More recently, AO was combined with swept-source OCT to achieve deeper tissue penetration [133]. In addition, fluorescence imaging techniques have been described in humans and animals for enhanced visualisation of retinal cells and microvasculature [140]. Two-photon excitation fluorescence has also been widely used in animal models to capture high-contrast images of retinal structure [47]. However, more work is needed to optimise light exposure for human use.

In summary, AO offers the ability to image the retina at a cellular level in vivo. As its use widens it offers the opportunity to better understand the pathogenesis of retinal disease. Similar to the first ophthalmoscopes, there are technical challenges in using AO. However, as the technology develops and it becomes easier to use it should play an increasing role in clinical management and clinical trials leading to better outcomes for patients.