Oblique scanning laser microscopy for simultaneously volumetric structural and molecular imaging using only one raster scan

Abstract

Multi-modal three dimensional (3D) optical imaging combining both structural sensitivity and molecular specificity is highly desirable in biomedical research. In this paper, we present a method termed oblique scanning laser microscopy (OSLM) to combine optical coherence tomography (OCT), for simultaneously volumetric structural and molecular imaging with cellular resolution in all three dimensions. Conventional 3D laser scanning fluorescence microscopy requires repeated optical sectioning to create z-stacks in depth. Here, the use of an obliquely scanning laser eliminates the z-stacking process, then allows highly efficient 3D OCT and fluorescence imaging by using only one raster scan. The current setup provides ~3.6 × 4.2 × 6.5 μm resolution in fluorescence imaging, ~7 × 7 × 3.5 μm in OCT in three dimensions, and the current speed of imaging is up to 100 frames per second (fps) over a volume about 0.8 × 1 × 0.5 mm3. We demonstrate several mechanisms for molecular imaging, including intrinsically expressed GFP fluorescence, autofluorescence from Flavin proteins, and exogenous antibody-conjugated dyes. We also demonstrate potential applications in imaging human intestinal organoids (HIOs), colon mucosa, and retina.

Introduction

Volumetric optical imaging with cellular and sub-cellular resolution is essential for our fundamental understanding of biological systems. One critical aspect of optical imaging is the 3D localization of molecular composites in tissues or cells, typically by using specific antibodies with fluorescent reporters. However, this molecular specificity comes with a dilemma that the structural context and other unspecified molecules would not appear in the images, i.e. we can only see what we choose to see. This missing information can confuse and sometimes mislead our interpretation. For example, the detection of fluorescence not only depends on the absolute amount of targeted molecules, but also the local structural density which can limit the diffusion and binding of the antibodies. Therefore, there is an increasing need for multimodal imaging techniques that can provide both molecular specificity and the structural context. Despite a large body of literatures and long standing efforts on this subject, it is still challenging to provide a multimodal system that can achieve volumetric structural and molecular imaging simultaneously with equivalent high resolutions for both modalities.

Early work on multi-modal 3D optical imaging is based on confocal laser scanning microscopy (LSM), where a confocal pinhole is applied for the depth sectioning and a stack of transverse images are taken for 3D reconstruction1. In addition to the fluorescence mode for molecular specificity, LSM can simultaneously detect the backscattered light in the reflectance mode which is sensitive to structural heterogeneity2, 3. Since the development of LSM, a variety of different microscopic techniques have been adopted to improve the multimodal capabilities for either fluorescence or reflectance modes. For instance, multi-photon microscopy has been used for the fluorescence mode to extend the depth penetration in highly scattering medium and to allow label-free molecular contrast4,5,6. For the reflectance mode, the confocal gating has been replaced with coherence gating to improve the depth resolution4,5,6. A combination of coherence gating and structured illumination allows a 3D multimodal imaging under a wide field microscopy with only incoherent sources7. However, the common and major limitation of these imaging methods is that the depth sectioning primarily depends on the focusing power of the objective lens, which leads to practical limitations on depth penetration, unequal lateral and depth resolution, photo bleaching and imaging speed. For example, to obtain high depth resolution, an objective lens with high numerical aperture (NA) and a dense depth sampling are required, which inevitably limit the field of view (FOV) in each acquisition.

To address these limitations, light sheet fluorescence microscopy (also called selective plane illumination microscopy) has been developed to decouple the depth resolution from the objective lens and use a second orthogonally aligned objective lens to provide a “light of sheet” for depth sectioning8. This allowed a high throughput volumetric imaging system with sub-cellular resolution over 1 × 1 × 1 mm3 within several seconds9. It was later demonstrated that the light sheet microscopy can be implemented with a single objective lens, a method termed oblique plane microscopy (OPM)10, to achieve video rate 3D imaging at a microscopic volume11, 12. More recently, the full advantage of OPM has been demonstrated by swept confocally aligned planar-excitation microscope (SCAPE)13, which achieved high speed volumetric imaging on a macroscopic volume of mouse cortex in vivo at 10 Hz and freely moving Drosophila larvae at 20 Hz. However, there is not yet a multimodal system that can simultaneously provide structural imaging co-registered with light sheet fluorescence microscopy. Optical projection tomography (OPT) has been integrated to image the structural contrast14. The limitation is that OPT and light sheet microscopy were operated separately, and the transmission configuration of OPT significantly limits the in vivo applications.

On the other hand, optical coherence tomography (OCT) has emerged to be an important volumetric structural imaging modality capable of micron/sub-micron level resolution and up to several millimeter depth of penetration in vivo. Regardless of its lack of molecular specificity, OCT has exquisite sensitivity to structural changes even at sub-diffractional length scales (several tens of nanometers) without actually resolving the detail nanoarchitecture15, 16. In addition, OCT can provide comprehensive measurements of blood flow17, 18, blood oxygenation19, 20 and capillary-level angiography21, 22, altogether making it a powerful tool to characterize the microenvironment in living tissues. Since OCT also adapts the laser scanning scheme, it has been integrated with LSM in various forms, such as in a conventional microscopic LSM setting4,5,6,7, 23,24,25,26, in an endoscopic form with fluorescence contrast agent or autofluorescence27,28,29,30, and in the ophthalmic imaging systems31, 32. However, none of these approaches provides simultaneous 3D imaging of both OCT and fluorescence due to their different depth discrimination mechanisms. The depth sectioning in OCT relies on the coherence gating by interfering the scattered light with a reference light, in such a way that 3D imaging can be implemented by only one raster scan of the laser. This is in contrast with the repeated raster scans used in LSM for 3D imaging. Aside from LSM, fluorescence laminar optical tomography (FLOT) has been used for a multimodal imaging system with OCT33, 34. The caveat there is that FLOT is based on a diffusive contrast which limits the resolution to several hundreds of microns.

In this paper, we present a multimodal volumetric imaging system implementing a method that we called oblique scanning laser microscopy (OSLM). Combined with OCT, the system is capable of simultaneous structural and molecular imaging with cellular resolution with only one raster scan on the sample. The system adopted the oblique illumination scheme with a single objective lens as in OPM and SCAPE. By reducing the 2D light sheet illumination to a 1D laser scanning, OCT can be seamlessly and simultaneously incorporated and provide structural imaging with equivalent resolutions. The current setup provided ~3.6 × 4.2 × 6.5 μm resolution in OSLM, ~7 × 7 × 3.5 μm in OCT in three dimensions, and a volumetric FOV around ~0.8 × 1 × 0.5 mm3. In organizing this paper, we firstly introduced the system setup and methods for our experiments, then provided the characterization of OSLM, and several examples of potential applications including imaging intestinal organoids differentiated from genetically modified human induced pluripotent stem cells (iPSC), intrinsic fluorescence from colonic mucosa, and mouse retina with stained endothelium. In the end, we discussed the limitation of the current system and potential in vivo applications.

Methods and Materials

All animal procedures were approved by the Institutional Animal Care and Use Committee at Boston Medical Center and conformed to the guidelines on the Use of Animals from the National Institutes of Health (NIH).

System setup

The system schematic is shown in Fig. 1A. A supercontinuum laser (SL, SuperK, NKT photonics) was used to generate the broad band laser output. The visible portion (420–650 nm) was filtered out using a dichroic mirror, and polarized by a polarization beam splitter (PBS). A pair of prisms dispersed the spectrum onto a reflecting mirror (M1), such that a thin aluminum film can be inserted to block the fluorescence emission band. Figure 1B shows the illumination spectrum, where the 420–470 nm range excited the fluorescence and the range above 550 nm was used for OCT. The light is coupled into a 50/50 optical fibre coupler (OFC), and collimated by an f = 4.5 mm lens. Two galvanometer scanning mirrors (GM1, GM2) and two parabolic mirrors were mounted on a custom-made raster scanning unit to steer the laser. Then a telescope system (L5 + L6) relayed the beam to the back pupil of the objective (Olympus UPLAN NA 0.5). The optical axis of the telescope system (L5, L6) and that of the objective was offset to create oblique laser illumination. The objective and a double band dichroic mirror (ZT514/1064rpc, Chroma) were mounted on a custom-made dove tail slider to adjust the offset and the oblique angle. An offset of 4 mm resulted in a ~26° of angle with respect to the optical axis of the objective (Supplemental Fig. 1).

The fluorescence light was redirected by the dichroic mirror and further filtered by a band-pass filter. Three 4-f telescope systems (L7 + L8, L9 + L10, L11 + L12) were used to relay the light from the back pupil plane of OL2 to two de-scanning galvanometer mirrors (GM3, GM4) and finally, to the back pupil of the second objective lens (OL3). To reduce the spherical aberration and astigmatism, pairs of identical achromatic doublets were used for all the relay optics (L5-L12)35. The magnification from the sample plane in front of OL2 to the image plane after OL3 was ~2/3 and the angle of the image was magnified to ~40° with respect to the optical axis of OL3 Supplemental Fig. 2). The choice of this magnification is to have a proper angle of image after OL3, so that we can balance the light collection efficiency from OL3 to OL4 and a moderate focal length of L13 (f = 50 mm in current setup). The calculation of the angle of image with respect to the magnification is described in the supplemental materials. Finally, another imaging system (OL4 + L13) was aligned in an angle of around 50° to refocus the angled image on to a CCD camera (PCO Pixelfly-USB).

For OCT, the reference beam was collimated and reflected by a mirror (M2). A variable ND filter and several BK7 glass plates (DC) were installed in the reference arm to attenuate the light, and to compensate the dispersion in the sample arm. The returning light was sent to a custom-made spectrometer. The detailed part components are included in the supplementary materials.

The 3D model of OSLM at the sample space is shown in Fig. 1C, where the 1D scanning laser illuminates an oblique plane x’-z’ by the fast scanning, and the volumetric imaging is achieved by another slow scan in y’. The tilted image of x’-z’ at the conjugate space after OL3 were then refocused onto the CCD camera.

System synchronization

The synchronization sequence for our system is illustrated in Fig. 1D. The fast galvanometer scanning mirror in x’ direction was controlled by a saw tooth voltage with an 80% duty cycle. Five repeated scans were given at each slow axis in y’ direction. In each forward scanning direction in x’, 400 triggers were sent to the line scan camera for OCT acquisition. At each y’ location, a single trigger was given to the 2D CCD camera to start the exposure. The exposure time was maximized to just allow sufficient time for data transfer before the next frame. The galvo driving signals and the triggers were generated from an analogue output (AO) card (PCI-6731, National Instruments). For the de-scanning mirrors, we reversed and scaled the waveforms for the scanning mirrors and sent the voltage from two AO ports of the DAQ card (PCIe-6351, National Instruments). When using the CCD camera, only one of the de-scanning mirror was synchronized with the slow axis scanning mirror and the second de-scanning mirror was kept still. Unless otherwise specified, the OCT A-line rate was 50 kHz. The 2D CCD camera exposure time is 20 ms. The maximum frame rate is 100 fps for OCT, 20 fps for camera.

Numerical simulation for resolution characterization

The schematic of the simulation is shown in Fig. 2A. A 3D matrix in Fourier space was firstly created with initial value of zeros. The coordinate was defined by a wave vector

$${\boldsymbol{k}}=\frac{2\pi }{\lambda }\hat{k}=({k}_{x},{k}_{y},{k}_{z})\,,$$

where $$\hat{k}$$ is the directional vector with unit magnitude. The range of three orthogonal directions were −2π/λ < k x  < 2π/λ, −2π/λ < k y  < 2π/λ, and 0 < k z  < 2π/λ. The wavelength λ was set to be 500 nm for simplicity. Next, the spatial frequency range corresponding to the illumination was identified: (−2π/λ) × NAi < k x  < (2π/λ) × NAi, (−2π/λ) × NAi < k y  − k offset  < (2π/λ) × NAi, and k z 2 + k x 2 + k y 2 = (2π/λ)2, as the blue area on the dome in Fig. 2A. The NAi is the numerical aperture of the illumination which is set to be 0.04 according to the experimental setup. The laser incidence is offset in Fourier domain from k z axis by k offset for the oblique illumination, as shown in Fig. 2A.

For fluorescence emission, we first specified the frequency range of the objective lens (OL2) based on its NA where (−2π/λ) × NAobj < k x  < (2π/λ) × NAobj, (−2π/λ) × NAobj < k y  < (2π/λ) × NAobj and k z 2 + k x 2 + k y 2 = (2π/λ)2. In Fig. 2A, the frequency range is the area on the dome projected by the collection cone of OL2. Because of the angled alignment between OL3 and OL4, only partial frequency range at the back pupil of OL2 can be collected, illustrated in Fig. 2A as the overlapping dome area between two offset cones representing the collection ranges of OL2 and OL4. Thus, an additional constrain was applied to further limit the collection range in the back pupil of OL2: (−2π/λ) × NAobj < k y <m × (−2π/λ) × NAobj, where m is about 0.5 (Supplemental Fig. 3).

After the spatial frequency range was identified and given the value of ones, a 3D FFT was performed, and the corresponding point spread function (PSF) for illumination and the emission collection were obtained by taking the absolute values. The final system resolution for fluorescence imaging is the multiplication of the PSFs by illumination and collection. The values of NAobj, k offset were adjusted to for different numerical apertures as summarized in Table 1.

Preparation of GFP expressing human intestinal organoids (HIOs) derived from iPSC

Genetically modified iPSC expressing ubiquitous eGFP were used to differentiate human intestinal organoids (HIOs). Following the protocol described by Spence et al.36, we first incubated highly confluent iPSC with 100 ng/μL of Activin A (R&D; 338-AC-010) during three days to promote cell differentiation into definitive endoderm. Subsequently, we pushed the cells towards mid- and hindgut specification with 2 μM of the Glycogen synthase kinase 3 (GSK-3α/β) inhibitor, CHIR-99021 (Stemgent; 04–0004), and 500 ng/mL of human fibroblast growth factor 4 (hFGF4) (R&D; 235-F4-025) during five days. At this point, 3D structures emerged from the cell monolayer as floating spheroids expressing the intestinal marker CDX2. These spheroids were 3D cultured in Matrigel matrix (Corning; 354234) and incubated with 2 μM of HEPES buffer, 1% B27 supplement (Invitrogen; 12587-010), 500 ng/mL of Rspondin1 (R&D, 4645-RS-025), 100 ng/mL of Noggin (R&D; 6057-NG-025) and human epidermal growth factor (hEGF) (R&D; 236-EG-200) as pro-intestinal growth factors. After seven days, the organoids were split and re-plated again on plastic coverslips for imaging.

Retinal vascular staining

Mice were euthanized and the eyes were enucleated. The eye balls were fixed in 4% Paraformaldehyde (PFA) for 15 mins, then transferred to 2% PBS for 20 mins. The anterior chamber, ocular lens, and vitreous, were carefully removed; the retina was then carefully removed from the choroid and flat-mounted on a clean petri dish. Excessive PBS was removed by a piece of paper, and −20 °C methanol was drop by drop applied on top of the retina to facilitate the staining. Retinas were moved to 2 ml tubes in cold methanol for at least 20 mins. After methanol fixation, retinas were washed several times with PBS, incubated with 100 ul perm/block solution (PBS + 0.3% Triton + 0.2% BSA) + 5% of goat serum per retina for one hour on a gently shaking rocker. After incubation, the perm/block solution was removed and each retina was incubated with 100 μl Alexa-488 conjugated isolectin-B4 solution (1/100 dilution in perm/block solution) overnight in 4 °C on a gentle rocker in the dark. After the overnight staining, retinas were washed 4 × 30 mins in PBS + 0.3% Triton (PBSTX). Then the retinas were mounted on glass slides with mounting media for imaging.

Image processing and co-registration

For the OCT images, a horizontal surface would appear tilted in the slow scanning y’ direction due to the angled illumination. This tilt was first corrected by shifting the z’ dimension at each y’ location. For the fluorescence images, two steps were taken to adjust the distortion of the image before the co-registration with OCT. First, the cross sectional image in x’-z’ was warped to transfer the image shapes from trapezoid to rectangle, to co-register with OCT B-scan images. Then the z dimension was resampled at each y’ location to maintain a constant and linear scale of depth. The volumetric co-registration between OCT and fluoresce images was slightly adjusted for each experiment to account for the different sample positioning. For biological samples, the refractive index of 1.38 was assumed in OCT reconstruction. An example of the image processing is provided in Supplemental Fig. 4. We should note that all the 3D rendering throughout the manuscript automatically assigned x’, y’ and z’ as mutually orthogonal coordinates, while physically z’ is tiled due to the oblique illumination as illustrated in Fig. 1C.

Results

The concept of oblique illumination with a single objective lens is illustrated in Fig. 2A, showing the 3D reciprocal Fourier domain in k x , k y , k z at the back pupil plane of the objective lens (OL2). The dome represents all the spatial frequency at a particular k = 2π/λ in the backward direction. Conventional LSM aligns the optical axis of the laser beam (at neutral scanning position) along with that of the objective lens. Here in OSLM, the laser incidence is offset in Fourier domain from k z axis as in OPM and SCAPE (i.e. blue area in Fig. 2A), so that the laser is focused obliquely after the objective lens. In the detection of the fluorescence emission, the angled imaging system by OL4 (green cone) only collects partial spatial frequency range of OL2 (light pink cone). The overlapping area projected on the spherical dome ultimately defines the diffraction-limited resolution of the imaging system.

Characterization of the system resolutions

With the Fourier domain model of the OSLM, we can characterize the theoretical resolution in 3D by a Fourier transform (see methods for detail information),

$$I({\bf{r}})=\int f({\bf{k}})\,{e}^{j{\bf{k}}{\bf{r}}}d{\bf{k}},$$
(1)

where I(r) is light field at a spatial location r, and f(k) is the reciprocal Fourier domain distribution in k. Figure 2B shows the examples of the point spread function (PSF) of an oblique illumination by an effective NA = 0.04 at wavelength λ = 0.5 μm. We created the oblique illumination by offsetting the optical axis of the laser, which is equivalent by shifting the frequency range by k y,offset  = 0.4k, as illustrated in Fig. 2B. Because of the small NA, the illumination beam profile is fairly consistent within ±150 μm depth range beyond which the beam starts to defocus.

For fluorescence collection, only a portion of the spatial frequency can be detected due to the angled alignment of the final imaging system (Fig. 2A). The frequency range for collection is verified at the back pupil plane of OL4 by using a thin fluorescein solution sandwiched between two coverslips (Supplemental Fig. 3). The corresponding PSF for fluorescence emission is shown in Fig. 2C. By multiplying the PSF of illumination and collection, the final 3D PSF from fluorescence emission can be generated in Fig. 2D. We then characterized the resolutions over a range of NA of the objective lens (OL2) in Fig. 2E, with the same illumination NA. Because of the relative angle between the illumination and collection, the axial resolution reduced rapidly by ~10 fold from NA = 0.1 to 0.3.

The resolution for OCT is relatively straightforward since only the incident beam is relevant. The beam width defines the lateral resolution, which is estimated at ~7 μm. The depth resolution is determined by the OCT spectral coverage. A Gaussian spectral window centered at 562 nm with 30 nm FWHM was applied to reshape the spectrum to improve the image quality. Thus, the depth resolution in OCT is estimated to be ~3.5 μm in water.

Next, we experimentally characterized the fluorescence PSF by imaging fluorescent microspheres with 1 micron diameter. The microspheres was immobilized within a 0.5% agarose gel and the example of the images are shown in Fig. 3. The FOV is about 0.8 mm by 1 mm by 0.5 mm in x’, y’, z’ directions. Note that we used the subscription of prime to separate from conventional notations for Cartesian coordinate system, because z’ is along the direction of the oblique laser illumination (Fig. 1C). The zoomed-in images of one microsphere in the center of the FOV are displayed in Fig. 3E–G. The resolutions are characterized by the FWHMs of the fluorescence intensity cross the center of the sphere, which are measured around 3.6 μm, 4.2 μm, and 6.5 μm in x’, y’, z’ directions, respectively. The theoretical PSF is plotted in the same figure for comparison. The FWHM along the longest axis of the PSF in the simulation (Fig. 2D) and experiment (Fig. 3E) is ~5.1 and ~10.7 µm, respectively. The experimental values are larger than the simulation due to the optical aberration from the relay optics and the scatter light from the two parabolic mirrors in the scanning unit.

Phantom images of fluorescent and plain microspheres

To demonstrate the capability of simultaneous 3D structure and fluorescence imaging by OSLM, we imaged a mixture of fluorescent (FluoresbriteTM plain YG, 3 μm in diameter, Polysciences Inc.) and non-fluorescent (Latex microsphere suspensions, mean diameter 2 μm, Thermo scientific) microspheres sealed in Agarose gel (Fig. 4A). OCT is sensitive to refractive index fluctuations, and thus can image any structural heterogeneities. This is evidenced by both types of spheres appearing in OCT images with different sizes and brightness, as well as the agarose gel background, and a dust on the surface of the gel. On the other hand, the emission of fluorophore provided the molecular specification so that only the fluorescent microspheres appeared in the fluorescence images. The overlaid images in three projections show their distinct features in both modalities, and the co-registration in 3D (Fig. 4B–D).

In vitro intestinal organoids derived from GFP expressing induced pluripotent stems cells (iPSC)

Figure 5A–E shows images of in vitro human iPSC-derived intestinal organoids (HIOs) from a healthy individual. Intestinal organoids formed a structure with the intestinal epithelium bordering a central lumen, mimicking the natural anatomy of the digestive tract. Remarkably, mature intestinal organoids can faithfully recapitulate the in vivo tissue architecture and contain the full complement of stem, progenitor and differentiated cell types, which makes iPSC-derived organoids a valuable tool to study human diseases37. Figure 5A is the overlay 3D rendering of the GFP-expressing HIOs, and Fig. 5B–D are OCT, fluorescence imaging and their overlay images at different depth sections. At the topical section of the organoid in Fig. 5B, there is a lack of cellular or sub-cellular contrast in OCT because all the structures gave rise to OCT signal. In contrast, we can identify the cell nuclei and recognize individual cells in the zoomed in fluorescence images, presumably due to higher GFP expression in cytoplasm rather than in nuclei. In the cross sections through the center of the organoids (Fig. 5C,D), the inside lumen and the bordering epithelium can be clearly visualized and matched, as compared to the histological image in Fig. 5E.

Ex vivo autofluorescence imaging of rat colonic mucosa

We also demonstrated that the intrinsic fluorescence can be used as the label-free molecular contrast from an ex vivo sample of rat colonic mucosa as in Fig. 5F–I. While OCT provided the overall morphology of mucosa, the intracellular autofluorescence images highlighted the crypts as the cylindrical structures composed of epithelial cells. The anatomical structure is exemplified in the histology (Fig. 5I). Within epithelial cells, the autofluorescence is predominantly from Flavin group under 420–470 nm excitation in our current setup38, 39. A weak background fluorescence can also be detected from the lamina propria supporting the epithelium, largely composed of collagen networks. The penetration depth in autofluorescence 3D imaging was less than OCT, due to the strong attenuation of the excitation light.

Ex vivo imaging of 3D retinal vasculature

To demonstrate the potential applications of OSLM in the ophthalmic imaging, Fig. 6 shows a depth-resolved image of ex vivo retinal vasculature. After the dissection of mouse retina, the endothelium was stained by isolectin-B4 and the three layers of the retinal circulation can be discriminated by their individual depth (Fig. 6A). The three layers were taken at around NFL, IPL, and OPL. In the simultaneous OCT images, the anatomical layer structure can be seen as the typical OCT retinal images. As the overlaid image shows, the retinal circulation is located within inner retina, and the outer retina is avascular (Fig. 6B,C).

Discussion

We described a multimodal system termed OSLM capable of high resolution macroscopic volumetric imaging for simultaneously structural and molecular imaging. The oblique illumination scheme with a single objective lens circumvents the complexity of two orthogonal lenses and mechanical translations in conventional light sheet fluorescence microscopy. Instead of 2D light sheet illumination, OSLM uses a 1D scanning laser and thus allows the seamless integration of OCT. Therefore, structural and molecular volumetric imaging can be simultaneously achieved over a macroscopic volume with high resolution by using just one 2D raster scan. We demonstrated three independent mechanisms to provide the molecular specificity: intrinsically expressed fluorescent protein (GFP organoids as in Fig. 5), intrinsic autofluorescence (FAD in colon mucosa in Fig. 5) and exogenous antibody-conjugated dyes (Alexa conjugated isolectin B4 in Fig. 6). Other contrast mechanisms based on laser scanning microscopy can be potentially incorporated in OSLM to expand its applications, such as Raman/stimulated Raman scattering40, coherent anti-Stokes Raman scattering41, 42, second harmonic generation43, and others.

The major limitation of the current system is the speed. The CCD camera that we used for OSLM requires 30 ms read out time after each exposure, which only allows 40% duty cycle with 20 ms exposure. The speed of imaging can be drastically improved by using high speed sCMOS camera as previously used in OPM and SCAPE. Meanwhile, the image of OCT has been rapidly improved in recent years. Conventional Fourier domain OCT can operate at 312 kHz44 and 500 kHz45 A-line rate in vivo, and the state-of-the-art swept source OCT can achieve over 1 MHz A-line rate46. Assuming the volumetric imaging with a 200 × 200 pixel density in x’-y’ plane, the above OCT Aline rate would translate to 6.25, 12.5, 25 vps, which is similar to the reported imaging speed in SCAPE13. Another limitation of the current system is that the fluorescence imaging has a smaller field of view and lower depth resolution than OCT, due to the size of relay optics and the relatively small NA of the objective lens (OL2), respectively. This will be overcome by optimizing the optical components and choosing an objective lens with higher NA.

One major motivation behind this work is to seamlessly merge OCT structural imaging with fluorescence imaging in 3D. The benefit of structural imaging by OCT is not only to co-register molecular imaging to tissue morphology, but also offer excellent sensitivity to characterize the native structural changes. OCT relies on the elastic light scattering which is ultimately determined by the refractive index (RI) fluctuation. The RI in biological tissue is proportional to mass density across the major macromolecular compositions47, 48, making elastic light scattering an excellent measure of tissue structures. More importantly, the sensitivity of elastic light scattering to structural alteration can be at the scale of several tens of nanometers, beyond the resolution limit of conventional microscopy16, 49. We have also demonstrated a method using OCT spectroscopic analysis to sense structural changes down to ~40 nm15, without the need to resolve the detailed nanoarchitecture. This provides a powerful tool to characterize and measure the local structural context, and complement the molecule-specific fluorescence imaging.

Granted that the imaging speed will be significantly improved, there are several applications that can potentially benefit from high speed OSLM. For example, the vascular dysfunction has major implications in a broad range of diseases, including cancers, diabetes, cardiovascular diseases and neurodegenerative diseases. OCT is an excellent tool to study vascular functions by quantifying blood flow17, 18, capillary flux50, blood oxygenation19, 20 and microangiography21, 22. Combining a high speed OSLM, the 3D dynamics and interaction of different cell types could be visualized in real time with specific fluorescence reporters, and how they impact hemodynamics can be studied. Another example is the ophthalmic imaging, OCT has been the standard of care in eye care for preventing blindness. Application of OSLM with the ocular lens would allow a large FOV 3D fluorescence imaging in retina, with the simultaneous OCT structural imaging as exemplified in Fig. 6. When fully dilated, the ocular lens has the effective NA around 0.5 for rodents and 0.2 for human. Based on the theoretical prediction in Fig. 2, the depth resolution would be around 6 μm and 30 μm, respectively, which would be sufficient to resolve the major anatomical layers in vivo. Beyond the in vivo applications, the imaging of iPSC HIOs presents an example of in vitro applications. It has been reported that the scattering contrast from OCT can be a sensitive markers for early carcinogenesis before the microscopic structural changes51. Using patient’s specific iPSC organoids, OSLM can potentially produce combined optical markers to study early malignancy transformation for personalized cancer prevention and treatment.

References

1. 1.

Webb, R. H. Confocal optical microscopy. Rep. Prog. Phys. 59, 427–471 (1996).

2. 2.

Li, Y. et al. Dual Mode Reflectance and Fluorescence Confocal Laser Scanning Microscopy for In Vivo Imaging Melanoma Progression in Murine Skin. J. Invest. Dermatol. 125, 798–804 (2005).

3. 3.

Rajadhyaksha, M. et al. In Vivo Confocal Scanning Laser Microscopy of Human Skin: Melanin Provides Strong Contrast. J. Invest. Dermatol. 104, 946–952 (1995).

4. 4.

Beaurepaire, E., Moreaux, L., Amblard, F. & Mertz, J. Combined scanning optical coherence and two-photon-excited fluorescence microscopy. Opt. Lett. 24, 969–971 (1999).

5. 5.

Tang, S., Zhou, Y. & Ju, M. J. Multimodal optical imaging with multiphoton microscopy and optical coherence tomography. J. Biophotonics 5, 396–403 (2012).

6. 6.

Yuan, S. et al. Co-registered optical coherence tomography and fluorescence molecular imaging for simultaneous morphological and molecular imaging. Phys. Med. Biol. 55, 191 (2010).

7. 7.

Thouvenin, O., Fink, M. & Boccara, C. Dynamic multimodal full-field optical coherence tomography and fluorescence structured illumination microscopy. J. Biomed. Opt. 22, 026004 (2017).

8. 8.

Huisken, J. et al. Optical Sectioning Deep Inside Live Embryos by Selective Plane Illumination Microscopy. Science 305, 1007–1009 (2004).

9. 9.

Keller, P. J., Schmidt, A. D., Wittbrodt, J. & Stelzer, E. H. K. Reconstruction of Zebrafish Early Embryonic Development by Scanned Light Sheet Microscopy. Science 322, 1065–1069 (2008).

10. 10.

Dunsby, C. Optically sectioned imaging by oblique plane microscopy. Opt. Express 16, 20306–20316 (2008).

11. 11.

Sikkel, M. B. et al. High speed sCMOS-based oblique plane microscopy applied to the study of calcium dynamics in cardiac myocytes. J. Biophotonics 9, 311–323 (2016).

12. 12.

Kumar, S. et al. High-speed 2D and 3D fluorescence microscopy of cardiac myocytes. Opt. Express 19, 13839–13847 (2011).

13. 13.

Bouchard, M. B. et al. Swept confocally-aligned planar excitation (SCAPE) microscopy for high-speed volumetric imaging of behaving organisms. Nat. Photon. 9, 113–119 (2015).

14. 14.

Mayer, J. et al. OPTiSPIM: integrating optical projection tomography in light sheet microscopy extends specimen characterization to nonfluorescent contrasts. Opt. Lett. 39, 1053–1056 (2014).

15. 15.

Yi, J. et al. Can OCT be sensitive to nanoscale structural alterations in biological tissue? Opt. Express 21, 9043–9059 (2013).

16. 16.

Radosevich, A. J., Yi, J., Rogers, J. D. & Backman, V. Structural length-scale sensitivities of reflectance measurements in continuous random media under the Born approximation. Opt. Lett. 37, 5220–5222 (2012).

17. 17.

Izatt, J. A. et al. In vivo bidirectional color Doppler flow imaging of picoliter blood volumes using optical coherence tomography. Opt. Lett. 22, 1439–1441 (1997).

18. 18.

Leitgeb, R. A. et al. Real-time measurement of in vitro flow by Fourier-domain color Doppler optical coherence tomography. Opt. Lett. 29, 171–173 (2004).

19. 19.

Yi, J. et al. Visible light optical coherence tomography measures retinal oxygen metabolic response to systemic oxygenation. Light-Sci. Appl. 4, e334 (2015).

20. 20.

Yi, J. et al. Visible-light optical coherence tomography for retinal oximetry. Opt. Lett. 38, 1796–1798 (2013).

21. 21.

Baran, U. & Wang, R. K. Review of optical coherence tomography based angiography in neuroscience. Neurophotonics 3, 010902 (2016).

22. 22.

Chen, C.-L. et al. Optical coherence tomography based angiography [Invited]. Biomed. Opt. Express 8, 1056–1082 (2017).

23. 23.

Park, J. et al. A dual-modality optical coherence tomography and fluorescence lifetime imaging microscopy system for simultaneous morphological and biochemical tissue characterization. Biomed. Opt. Express 1, 186–200 (2010).

24. 24.

Yaseen, M. A. et al. Multimodal optical imaging system for in vivo investigation of cerebral oxygen delivery and energy metabolism. Biomed. Opt. Express 6, 4994–5007 (2015).

25. 25.

Yuan, S. et al. Combining optical coherence tomography with fluorescence molecular imaging: towards simultaneous morphology and molecular imaging. SPIE BiOS: Biomeical Optics. International Society for Optics and Photonics 71690O, 71690O–8 (2009).

26. 26.

Khan, K. M. et al. A dual-modal optical system combining depth-sensitive laser induced fluorescence (LIF) spectroscopy and optical coherence tomography (OCT) for analyzing layered biological tissue. Biomed. Spectrosc. Imaging 5, 313–324 (2016).

27. 27.

Scolaro, L. et al. Molecular imaging needles: dual-modality optical coherence tomography and fluorescence imaging of labeled antibodies deep in tissue. Biomed. Opt. Express 6, 1767–1781 (2015).

28. 28.

Yoo, H. et al. Intra-arterial catheter for simultaneous microstructural and molecular imaging in vivo. Nat. Med. 17, 1680–1684 (2011).

29. 29.

Mavadia, J. et al. An all-fiber-optic endoscopy platform for simultaneous OCT and fluorescence imaging. Biomed. Opt. Express 3, 2851–2859 (2012).

30. 30.

Xi, J. et al. Integrated multimodal endomicroscopy platform for simultaneous en face optical coherence and two-photon fluorescence imaging. Opt. Lett. 37, 362–364 (2012).

31. 31.

Song, W. et al. Integrating photoacoustic ophthalmoscopy with scanning laser ophthalmoscopy, optical coherence tomography, and fluorescein angiography for a multimodal retinal imaging platform. J. Biomed. Opt. 17, 0612061–0612067 (2012).

32. 32.

Dai, C., Liu, X. & Jiao, S. Simultaneous optical coherence tomography and autofluorescence microscopy with a single light source. J. Biomed. Opt. 17, 0805021–0805023 (2012).

33. 33.

Tang, Q. et al. High-dynamic-range fluorescence laminar optical tomography (HDR-FLOT). Biomed. Opt. Express 8, 2124–2137 (2017).

34. 34.

Chen, Y. et al. Integrated Optical Coherence Tomography (OCT) and Fluorescence Laminar Optical Tomography (FLOT). IEEE J. Sel. Top. Quant. 16, 755–766 (2010).

35. 35.

Negrean, A. et al. Optimal lens design and use in laser-scanning microscopy. Biomed. Opt. Express 5, 1588–1609 (2014).

36. 36.

Spence, J. R. et al. Directed differentiation of human pluripotent stem cells into intestinal tissue in vitro. Nature 470, 105–109 (2011).

37. 37.

Fatehullah, A., Tan, S. H. & Barker, N. Organoids as an in vitro model of human development and disease. Nat. Cell Biol. 18, 246–254 (2016).

38. 38.

Skala, M. C. et al. In vivo multiphoton microscopy of NADH and FAD redox states, fluorescence lifetimes, and cellular morphology in precancerous epithelia. P. Natl. Acad. Sci. USA 104, 19494–19499 (2007).

39. 39.

Georgakoudi, I. & Quinn, K. P. Optical imaging using endogenous contrast to assess metabolic state. Annu. Rev. Biomed. Eng. 14, 351–367 (2012).

40. 40.

Freudiger, C. W. et al. Label-Free Biomedical Imaging with High Sensitivity by Stimulated Raman Scattering Microscopy. Science 322, 1857–1861 (2008).

41. 41.

Evans, C. L. et al. Chemical imaging of tissue in vivo with video-rate coherent anti-Stokes Raman scattering microscopy. P. Natl. Acad. Sci. USA 102, 16807–16812 (2005).

42. 42.

Cheng, J.-X. Coherent Anti-Stokes Raman Scattering Microscopy. Appl. Spectrosc. 61, 197A–208A (2007).

43. 43.

Zipfel, W. R. et al. Live tissue intrinsic emission microscopy using multiphoton-excited native fluorescence and second harmonic generation. P. Natl. Acad. Sci. USA 100, 7075–7080 (2003).

44. 44.

Potsaid, B. et al. Ultrahigh speed Spectral/Fourier domain OCT ophthalmic imaging at 70,000 to 312,500 axial scans per second. Opt. Express 16, 15149–15169 (2008).

45. 45.

An, L. et al. High speed spectral domain optical coherence tomography for retinal imaging at 500,000 A‑lines per second. Biomed. Opt. Express 2, 2770–2783 (2011).

46. 46.

Klein, T. et al. Megahertz OCT for ultrawide-field retinal imaging with a 1050 nm Fourier domain mode-locked laser. Opt. Express 19, 3044–3062 (2011).

47. 47.

Davies, H. G., Wilkins, M. H. F., Chayen, J. & La Cour, L. F. The Use of the Interference Microscope to Determine Dry Mass in Living Cells and as a Quantitative Cytochemical Method. J. Cell Sci. 3, 271–304 (1954).

48. 48.

Barer, R. & Tkaczyk, S. Refractive index of concentrated protein solutions. Nature 173, 821–822 (1954).

49. 49.

Cherkezyan, L. et al. Interferometric Spectroscopy of Scattered Light Can Quantify the Statistics of Subdiffractional Refractive-Index Fluctuations. Phys. Rev. Lett. 111, 033903 (2013).

50. 50.

Lee, J. et al. Statistical intensity variation analysis for rapid volumetric imaging of capillary network flux. Biomed. Opt. Express 5, 1160–1172 (2014).

51. 51.

Yi, J. et al. Spatially resolved optical and ultrastructural properties of colorectal and pancreatic field carcinogenesis observed by inverse spectroscopic optical coherence tomography. J. Biomed. Opt. 19, 036013 (2014).

Acknowledgements

We acknowledge the general support of Evans Medical Foundation, and sub-contract from NIH 5R01CA183101. Gustavo Mostoslavsky was in part supported by NIH-R01CA175727-01. Amalia Capilla was supported by the National Center for Advancing Translational Sciences, National Institutes of Health, through BU-CTSI Grant Number 1UL1TR001430. Lei Zhang was supported in part by BU-CTSI pilot grant 1UL1TR001430.

Author information

Authors

Contributions

J. Yi designed the system. L. Zhang constructed the system, performed the measurement and analyzed data. A. Capilla prepared and cultured the induced pluripotent stem cells and intestinal organoids. W. Song performed partial measurements. G. Mostoslavsky and J. Yi supervised the study. L. Zhang, J. Yi wrote the manuscript.

Corresponding author

Correspondence to Ji Yi.

Ethics declarations

Competing Interests

The authors declare that they have no competing interests.

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

Zhang, L., Capilla, A., Song, W. et al. Oblique scanning laser microscopy for simultaneously volumetric structural and molecular imaging using only one raster scan. Sci Rep 7, 8591 (2017). https://doi.org/10.1038/s41598-017-08822-0

• Accepted:

• Published:

• Real-time volumetric microscopy of in vivo dynamics and large-scale samples with SCAPE 2.0

• Venkatakaushik Voleti
• , Kripa B. Patel
• , Wenze Li
• , Citlali Perez Campos
• , Hang Yu
• , Caitlin Ford
• , Malte J. Casper
• , Richard Wenwei Yan
• , Wenxuan Liang
• , Chentao Wen
• , Koutarou D. Kimura
• , Kimara L. Targoff
•  & Elizabeth M. C. Hillman

Nature Methods (2019)

• Volumetric fluorescein angiography (vFA) by oblique scanning laser ophthalmoscopy in mouse retina at 200 B-scans per second

• Weiye Song
• , Libo Zhou
•  & Ji Yi

Biomedical Optics Express (2019)

• Volumetric fluorescence retinal imaging in vivo over a 30-degree field of view by oblique scanning laser ophthalmoscopy (oSLO)

• Lei Zhang
• , Weiye Song
• , Di Shao
• , Sui Zhang
• , Manishi Desai
• , Steven Ness
• , Sayon Roy
•  & Ji Yi

Biomedical Optics Express (2018)