Two-photon excitation with temporally focused pulses can be combined with phase-modulation approaches, such as computer-generated holography and generalized phase contrast, to efficiently distribute light into two-dimensional, axially confined, user-defined shapes. Adding lens-phase modulations to 2D-phase holograms enables remote axial pattern displacement as well as simultaneous pattern generation in multiple distinct planes. However, the axial confinement linearly degrades with lateral shape area in previous reports where axially shifted holographic shapes were not temporally focused. Here we report an optical system using two spatial light modulators to independently control transverse- and axial-target light distribution. This approach enables simultaneous axial translation of single or multiple spatiotemporally focused patterns across the sample volume while achieving the axial confinement of temporal focusing. We use the system's capability to photoconvert tens of Kaede-expressing neurons with single-cell resolution in live zebrafish larvae.
Since its first demonstration1, nonlinear two-photon (2P) microscopy has revolutionized diverse research fields including neuronal structural and functional imaging, photostimulation, laser processing and lithography. Original configurations were based on scanning a tightly focused pulsed laser beam across a defined sample region with galvanometric mirrors, acousto-optic deflectors2,3,4 or resonant scanners5. Recently, applications including lithography, uncaging, optogenetics and fast functional imaging have motivated scanless 2P-excitation method development, enabling simultaneous illumination of laterally extended regions of interest while preserving micrometre axial confinement. This was achieved by axially confining large spots generated by low-numerical aperture (NA) Gaussian beams with temporal focusing (TF)6,7. In TF, a diffraction grating conjugated to the sample plane diffracts the different spectral frequencies comprising an ultrashort excitation pulse towards different directions. The various frequencies thus propagate towards the objective focal plane at different angles, such that spatiotemporal coupling effects8 lead to temporal pulse broadening above and below the focal plane, which remains the only region irradiated at peak powers efficient for 2P excitation. In this way, TF enables axial confinement equivalent to that of line-scanning microscopy that is independent of the excitation beam’s lateral extent. Investigators have applied TF to imaging9,10,11,12,13, functional imaging14,15, super-resolution imaging16, lithography17 and neuronal photostimulation18,19 by generating circular-spot shapes only.
As a more flexible way to elaborate light patterning, phase-modulation approaches using liquid-crystal spatial light modulators, such as computer-generated holography (CGH)20,21 and generalized phase contrast (GPC)22 have demonstrated efficient light sculpting in two-dimensional (2D) user-defined shapes. Combined with TF to axially confine the shapes, CGH and GPC can sculpt 2P-excitation volumes with the micrometre precision needed to illuminate small structures, such as neuronal dendrites22,23. These methods also enable 2P optogenetic stimulation with high temporal resolution and robustness to scattering23,24.
CGH can also sculpt light in three dimensions (3D)25, a feature used to generate multidiffraction-limited traps for optical tweezers26,27 and 3D glutamate uncaging28,29. Although not yet demonstrated with 2P excitation, adding lens-phase modulations to 2D-phase holograms also enables remote axial displacement and 3D positioning of laterally shaped targets27,30,31.
Combining CGH’s 3D light-shaping capability with 2P excitation can significantly broaden the range of possible applications. For example, simultaneous multiplane holographic pattern generation can enable fast 2P multiplane imaging, photostimulation and photo-polymerization methods. In addition, remote axial displacement of holographic targets can couple holographic illumination with a second imaging or stimulation channel, providing independent control of their respective focal planes32, as well as remote volume scanning. However, previous 3D CGH optical configurations could not be implemented with TF because axially shifted excitation planes cannot be simultaneously imaged on the TF grating. This shortcoming restricted CGH-TF to 2D patterns focused at the objective focal plane21.
Here we demonstrate a unique optical system overcoming this limitation. The system achieves remote axial displacement of temporally focused holographic beams as well as multiple temporally focused planes by shaping the incoming wavefront in two steps using two spatial light modulators (SLMs). A first SLM laterally shapes the target light distribution that is focused on the TF grating, while a second SLM, positioned after the grating, controls the axial position(s) of the spatiotemporal focal plane(s) in the sample volume. By integrating phase profiles that minimize optical aberrations and intensity compensation protocols, we generate spatiotemporally focused patterns with uniform light distribution throughout the entire accessible volume, and demonstrate generation of laterally shaped targets across an unprecedented axial range. We apply axially confined multiplane light illumination to photoconvert in vivo Kaede-protein-expressing neurons in zebrafish larvae. The system enables cellular resolution photoconversion of tens of spinal cord neurons occupying separate axial planes.
In the original optical system we designed (Fig. 1, see Methods), the output of a Ti:Sapphire laser was expanded to illuminate a first liquid crystal on silicon SLM (LCOS-SLM; SLM1) used to generate 2D holographic light patterns at the focal plane of a first lens where a blazed grating (G) was placed for TF. TF enables 2D CGH pattern generation with the axial confinement of a line-scanning microscope, practically decoupling axial confinement from lateral extent21 (Supplementary Fig. 1). Two telescopes (L2, L3; L4, OBJ1) relayed the holographic pattern on the sample plane. The phase holograms addressed on SLM1 were calculated using a Gerchberg and Saxton (GS)-based algorithm33. A second LCOS-SLM (SLM2) was placed at the confocal plane of the first telescope and imaged at the back focal plane of the microscope objective through the second telescope. By addressing SLM2 with single or multiple lens phases, we axially displaced single or multiple spatiotemporally focused patterns across the sample volume.
In order to characterize the optical properties of the holographic patterns, we used a microscope configuration using two opposite-facing objectives20,21. By doing so, holographic patterns illuminated a thin fluorescent film and 2P-excited fluorescence was collected by a second objective (OBJ2) placed opposite to OBJ1 and imaged on a CCD (charged couple device) camera. For 3D reconstruction of illumination volumes, OBJ2 was fixed and focused on the fluorescent layer, while OBJ1 was moved along the axial direction with a piezo-scanning stage20,21. For experiments on characterizing SLM’s diffraction efficiency, the holographic patterns were directly imaged on the CCD camera (image of the transmitted laser light). For the experiments of photoconversion and optogenetic stimulation in zebrafish larvae, the system was coupled to a HiLo imaging set-up (see following sections).
The optical system enabled remote axial displacement of temporally focused holographic patterns as well as generation of multiple spatiotemporally focused holographic targets in distinct axial planes. In a simplified configuration where mirrors replaced the SLM2 and the grating, the system also generated 2P multiplane arbitrarily shaped non-temporally focused patterns.
Remote axial shift of spatiotemporally focused patterns
First, we demonstrated remote axial displacement of a temporally focused holographic pattern by separating input-beam-phase modulation in two steps, controlling first the target lateral light distribution, and, second, its axial position. In contrast to conventional CGH, axial displacement of temporally focused holographic patterns cannot be achieved by simply adding a Fresnel lens to the phase hologram34 because the lens effect, by axially displacing the excitation plane with respect to the TF grating, would forbid the spatial and temporal focal planes to coincide35. We resolved this issue by implementing a novel, two-SLM strategy. SLM1 generated 2D CGH illumination patterns focused on the grating G, which dispersed the spectral components of the illumination pattern on SLM2. SLM2, conjugated to the objective back focal plane, was addressed with a Fresnel lens-phase profile to control the target’s axial position in the sample volume. This design enables the spatial and temporal focal planes to coincide at the grating, and to be jointly translated by SLM2 across the sample volume axial extent.
The effect of spherical aberrations on targets generated out of OBJ1’s nominal focal plane (Supplementary Fig. 2) was minimized by describing the objective focal sphere36 within the approximation of small defocus and high NA. We thus addressed SLM2 with lens-phase profiles featuring spherical phase28,37:
where k is the free-space wavenumber, n is the refractive index of the immersion medium, NA is the numerical aperture of the objective, (with feq being the equivalent focal length: and ) is the normalized pupil at the SLM2 plane and Δz the axial displacement of the holographic light pattern in the sample volume.
With the above strategy, we demonstrated remote axial translation of temporally focused holographic patterns by displacing a 20-μm-diameter holographic spot throughout a ±130-μm axial range (Fig. 2a–c), the accessible field of excitation (FOEz) without hologram aliasing (Supplementary Note 1). Within this range, we could remotely displace holographic patterns while conserving target shape sharpness (Fig. 2a, bottom) and axial confinement (5–10 μm; Fig. 2b,c). The integrated 2P fluorescence intensity decreased by approximately fivefold at the edges because of the diffraction efficiency of SLM2 (Supplementary Note 1 and Supplementary Fig. 3a–c).
Furthermore, we generated targets with micrometre axial confinement (10–25 μm) and sharp shapes across a broader axial range (±300 μm, that is, approximately two times greater than the FOEz). However, in this extended range, the full-width at half-maximum (FWHM) broadened (∼25 μm at ±300 μm; Fig. 2b,c), fluorescence intensity decreased (∼10 times at ±300 μm) and spot quality deteriorated (Supplementary Fig. 4) as a consequence of optical aberrations, SLM2 diffraction efficiency and the finite dimensions of mirrors and lenses placed after SLM2 that can vignette beam edges for highly diverging/converging wavefronts, among other factors.
For applications requiring constant illumination across the axial range, attenuating illumination intensity at axial positions near the centre of the FOE can compensate the position-dependent intensity decrease (Supplementary Fig. 3g). This can be accomplished either by reducing the incident laser power or by redirecting light into an extra spot similar to the procedure described in Supplementary Fig. 3d–f.
3D-CGH-TF spatiotemporally focused patterns
Next, we demonstrated that decoupling lateral and axial light shaping into two separate steps also enables generation of multiplane spatiotemporally focused patterns. In this configuration, SLM1 is tiled into n vertical regions (that is, parallel to the orientation of the grating lines and orthogonal to the grating linear dispersion), with n equal to the number of axial planes populated by the final illumination pattern. Each tile generates a 2D target shape focused through L1 on the TF grating (Fig. 3a, top, Supplementary Fig. 5). SLM2, vertically tiled into n independent lens-phase profiles, then axially displaces each shape into its target axial plane (Fig. 3a, bottom). In this configuration, for each of the n targeted planes, both spatial and temporal foci coincide at the grating, while the n phase-lens profiles addressed on SLM2 enable independent remote displacement of each shaped target in the sample volume (Fig. 3b,c).
In agreement with previous observations38, reducing the hologram width, Δy, along the direction perpendicular to the grating’s dispersion did not compromise spot axial confinement, as the reduction of the hologram width, Δx, in the orthogonal direction would do (Fig. 3d). Moreover, tiling holograms along the x axis would create crosstalk between axially separated planes because of the dispersion at the grating that generates at SLM2 a lateral spatial overlapping of the holograms generated by SLM1, making impossible to imprint independent axial shifts to the corresponding patterns.
However, vertical hologram resizing introduced a spatial filter that vertically elongated speckles (Fig. 3e). In particular, the vertical mean speckle size, estimated by calculating the vertical autocorrelation width39, σy, increased by a factor of two with respect to the original size () when the hologram vertical dimension was reduced to one-fourth of the full SLM aperture (Fig. 3f). In contrast, the horizontal autocorrelation width σx was unaffected by vertical hologram resizing (Fig. 3f). The limited size of the SLM can constitute the limiting factor defining the maximum number of axially separated planes in 3D-CGH-TF. Theoretically, the maximum number of planes is determined by the number of pixel rows on the SLM, but practically there is a tradeoff between the number of axial planes and the lateral resolution requirements for each application. As far as the spot shape is not distorted and spot’s contour remains well defined, the smoothing of the excitation holographic spot to some extent can be even beneficial21,38,40.
Moreover, vertical SLM tiling induced a lateral tilt on the intensity propagation due to the asymmetric illumination of the objective back focal plane. Addressing SLM1 and SLM2 symmetrically along the vertical axis of the SLM eliminated this effect (Supplementary Fig. 6). Hologram resizing also affected the intensity of the illumination pattern at the sample plane. Specifically, holograms projected at the centre of the objective back aperture generated brighter targets than holograms projected on the side (Supplementary Fig. 7 and Supplementary Note 2). This effect adds to the position-dependent diffraction efficiency determined by the SLM pixel size (Supplementary Note 1 and Supplementary Fig. 3). Thus, generation of homogeneous 3D-CGH-TF patterns required compensating both lateral and axial position-dependent intensity variations, which in both cases was higher at the FOE centre and falling off towards the periphery. For lateral shape generation with SLM1, we weighted target intensity input to the GS algorithm such that targets occupying low-efficiency regions were brighter than targets position at the efficient FOEx,y central zone (Supplementary Fig. 3). To achieve uniformity in the axial direction, we scaled the vertical tile size, allocating greater area to holograms projected at the objective pupil periphery with respect to the centre (Supplementary Note 2 and Supplementary Fig. 7). This enabled generation of homogeneous light patterns (Fig. 3g) across the whole excitation volume. Holographic patterns generated in distinct planes yielded fluorescence intensity distributions showing that axial confinement was also well conserved (Fig. 3g). However, an unavoidable background in the intermediate planes appeared when targets were laterally aligned (Fig. 3g, right bottom panel, and Supplementary Fig. 8).
3D computer-generated holography
We demonstrate a simplified, single-SLM system for non-temporally focused multiplane pattern generation, replacing the grating and second SLM with mirrors (Fig. 4a); we patterned multiple targets occupying separate axial planes (Fig. 4b,c, Supplementary Movie 1) with a modified GS algorithm for multiplane pattern projection41 (Supplementary Fig. 9). By using the spherical phase expression described in equation (1) to translate the various targets into different axial planes, with , we minimized the effects of spherical aberrations on targets generated out of the focal plane, improving agreement between experimental and expected axial positions for the different targets compared with 3D-CGH implemented with parabolic-lens phases42 (Supplementary Fig. 2). We compensated diffraction efficiency-induced intensity variations by weighting target intensity inputs to the multiplane GS algorithm, as previously described (Supplementary Fig. 3), achieving uniform intensity shape generation throughout the accessible ∼240 × 240 × 260 μm3 volume (Supplementary Note 1).
In vivo 3D-patterned selective photoconversion of neurons
We leveraged the axial specificity achievable with 3D-CGH-TF to photoconvert Kaede protein-expressing neurons in live Tg(HuC:Gal4; UAS:Kaede) double transgenic zebrafish larvae43. Kaede is a green photoactivable fluorescent protein that, when exposed to ultraviolet light, undergoes a photo-induced protein cleavage, red shifting its fluorescence emission spectrum44. With 2P excitation, efficient Kaede photoconversion can be obtained for wavelengths in the range of 760–800 nm45. We first performed Kaede photoconversion in spinal neurons (Fig. 5a, blue and red areas) to demonstrate the ability for single-cell resolution. Next, we demonstrated the robustness of 3D-CGH-TF to scattering by moving to the brain (Fig. 5a, dark yellow area) that is a more scattering region (Supplementary Fig. 10).
To monitor photoconversion in the spinal cord, we combined multiplane patterned photostimulation with a two-colour HiLo (high/low-frequency sequential acquisition) imaging system46 (see Methods and Supplementary Fig. 11). First, a HiLo z-stack exciting green fluorescence (excitation wavelength λexc=473 nm) was acquired to localize Kaede-expressing neurons from which we selected photoconversion targets. We then photoconverted selected cells with 2P holographically patterned illumination (stimulation time 0.20–100 s; excitation power density: 0.03–4.0 mW μm−2; Methods. We note that power densities are always given relatively to the area of the spots’ surface). A second HiLo z-stack exciting red fluorescence (λexc=561 nm) was acquired after the photostimulation protocol in order to assess the photoconversion efficiency. For photoconversion experiments in the brain, scattering quickly deteriorates the quality of HiLo images. We therefore monitored the extent of photoconversion by moving the sample to a 2P galvo-based scanning imaging system in another set-up (see Methods). Green and red fluorescence in the 2P imaging system were excited at 780 nm, and scanning was performed at 0.74 Hz.
In the spinal cord, we first used 2D-CGH-TF to demonstrate simultaneous photoconversion (λphot=800 nm) of multiple neurons in a single plane with cellular precision (Fig. 5a,b). Then, we used 3D-CGH-TF to photoconvert isolated neurons (Fig. 5c) or groups of multiple neurons (Fig. 5d) in distinct axial planes. The axial confinement achievable with 3D-CGH-TF enabled single-layer selectivity that would otherwise not be possible using CGH deprived of TF (Supplementary Fig. 12a). In all experiments performed, photoconversion induced a ∼10-fold increase in the ratio of pre- and post-photoconversion red fluorescence.
To demonstrate in-depth photoconversion, we performed a second set of experiments in the brain of zebrafish larvae by photoconverting neuronal ensembles in two different axial planes using 35-μm-diameter temporally focused holographic spots separated by ∼80 μm (Fig. 5e), with the first plane positioned at ∼90 μm from the surface. Although the axial confinement deteriorates with depth because of scattering, the red fluorescence intensity profiles along the axial direction showed selective and efficient photoconversion (Fig. 5d,e), which was not achievable with 3D-CGH alone (Supplementary Fig. 12b). Strikingly, axial resolution and overall shape were also preserved despite light propagation through the zebrafish brain (Supplementary Fig. 10). In agreement with previous results in rats23,24, these results demonstrate that TF enables robust in-depth propagation of shaped patterns through scattering media.
It is important to note that 2P Kaede photoconversion is a low-efficiency process and requires relatively high illumination doses (∼0.04–4 mW μm−2) and long (from 200 ms to a few hundreds of seconds) stimulation protocols. Other type of applications such as activation of neurons via 2P-mediated optogenetic stimulation can work with drastically reduced photostimulation time (5 pulses of 50 ms), as well as lower illumination doses (0.04–0.60 mW μm−2; Supplementary Note 3).
A still open question for multiplane multispot photostimulation concerns the possible temperature rise induced by laser illumination. For the illumination doses we used in the optogenetics experiments (Supplementary Note 3), we estimated that this does not exceed few degrees Celsius. Specifically, by solving the heat diffusion equation47 with typical thermal optical parameters of tissue found in literature48,49,50, we estimated the mean temperature rise to be of the order of 0.06–0.25 °C, using illumination pulses of 50 ms in the range of 0.04–0.6 mW μm−2 and a 10-μm diameter spot (Picot et al., private communication). Using 10 spots of the same size distributed randomly over a FOE of 100 × 100 μm2 would generate a mean temperature rise of 0.9–3.7 °C. Diffusion over the tissue volume enables the temperature to return to its equilibrium value in less than 150 ms, which was the interval between illumination pulses (Picot et al., private communication).
We have demonstrated a unique optical system enabling remote axial displacement of temporally focused holographic patterns, as well as generation of multiple temporally focused holographic targets occupying separate axial planes. In our two-step system, the first SLM is addressed with phase holograms controlling the transverse target light distribution. The second SLM, positioned after the TF grating, is addressed with Fresnel lens-phase functions and controls target axial position. We demonstrated that this configuration can jointly translate single or multiple spatiotemporally focused patterns across the sample volume.
We demonstrated axial displacement of a single temporally focused holographic pattern across an axial range (±300 μm), roughly two times greater than the nominal accessible axial FOE, FOEz (±130 μm). For axial shifts of , spot shape and axial resolution (5–10 μm) were well conserved, while fluorescence intensity decreased approximately fivefold (consistent with the roughly twofold decrease in illumination intensity, Supplementary Fig. 3). Displacements up to twice the accessible axial FOE were also possible, although requiring compensation mechanisms to correct for broadening of axial confinement (∼25 μm for Δz=±300 μm) and intensity losses.
With our approach, applications requiring continuous fast scanning of a single spatiotemporally focused target will be limited by the SLM refresh rate (60–200 Hz). Replacing SLM2 with a tunable lens51 would overcome this limitation. However, it would not enable generation of multiple spatiotemporally focused targets at distinct axial planes.
Alternative solutions for axial displacement of a temporally focused shape used either variable group velocity dispersion (GVD)38,52,53,54,55 or mechanical axial translation of the TF grating35. Indeed, introducing variable GVD to the input laser pulse enabled efficient axial displacement of a Gaussian beam’s temporal focal plane. However, GVD-induced axial displacement strongly depends on the autocorrelation width of the illumination patterns, which for holographic spots is small due to speckles. Therefore, in order to achieve axial displacement of temporally focused holographic patterns, spatial filtering is required to increase the correlation width. However, this degrades spatial resolution and decreases illumination intensity38. Furthermore, the GVD approach achieved axial displacements of only a few microns38. Greater scanning ranges could be obtained by combining 2D-CGH with the optical design proposed by Dana et al.35 for axial scanning of a temporally focused line. The system implemented on-axis-light propagation and mechanical axial translation of the TF grating. However, for high-magnification (M) objectives, the axial shift, d, was limited by the long required grating translation, D∝d × M2. Thus, the maximum shift achieved with a × 40 objective was inferior to 30 μm.
In addition to limited range, neither GVD shift nor grating translation enable the generation of multiple temporally focused targets at distinct axial planes. Here we overcome this limitation with a two-step, two-SLM system, addressing a first SLM with multiple vertically tiled phase holograms, each encoding the light distribution of a single plane, and a second SLM with an equal number of Fresnel lens phases, which individually control the axial position for each plane. In this way, all targets are projected to the TF plane, which is kept at a fixed position, while the second SLM imposes the spatial wavefront curvature needed to displace each plane axially.
The number of spatiotemporal focal planes that can be generated with this design is a tradeoff between the number of available pixels and spatial resolution. Here we demonstrated generation of up to four spatiotemporal focal planes. In this case, the vertical spatial resolution (that is, the average speckle size in the y axis), where tiling occurs, decreases roughly twofold because of the reduced size of the hologram at the objective back aperture. LCOS-SLM devices with increased number of pixels should increase the number of achievable planes and reduce hologram resolution deterioration.
Moreover, we implemented a simpler single-SLM system to generate multiplane CGH light patterns without TF. Although this approach has a poor axial confinement with respect to 3D-CGH-TF, it could still be a powerful method for applications using sparsely expressing samples. Previous schemes for multiplane generation of laterally extended shapes through high-NA objectives reported patterns spanning a limited (tens of microns) axial range27,30,31 and used linear excitation. Here we exploited the whole excitation volume reachable with the LCOS-SLM using high-NA objectives. This was achieved by minimizing spherical aberration of targets generated out of the nominal objective focal plane by accounting for the high-NA objective in the expression of the Fresnel lens-phase profile. In addition, throughout the accessible volume, we obtained uniform light distribution among the target shapes. Weighting the amplitude of each target input to the GS algorithm according to position enabled compensation of intensity loss because of diffraction efficiency, which decreases with increasing distance from the excitation volume centre.
We demonstrated the capabilities of the 3D-CGH-TF system by performing multiplane 2P photoconversion of Kaede-expressing neurons. Previous in vivo experiments photoconverting Kaede in single neurons of zebrafish larvae used one-photon visible light illumination43,56,57. Here we demonstrated 2P-mediated single-cell resolution simultaneous photoconversion of multiple Kaede-expressing neurons. The unprecedented spatial precision achieved by our approach can, in the future, be extended to track the morphology of single neurons across the entire nervous system of the zebrafish larva.
For multiplane photoconversion of multiple isolated targets (for instance, in sparsely expressing samples), 3D-CGH holds an advantage over 3D-CGH-TF by enabling light shaping in a greater number of planes. However, 3D-CGH-TF enables a better axial confinement, a key parameter for experiments requiring illumination of spatially nearby multiple targets or large areas. Moreover, generation of multiplane illumination patterns with 3D-CGH also produces spurious light in the intermediate planes absent in illumination geometries produced with 3D-CGH-TF. In addition, we have previously demonstrated that TF is particularly robust to scattering making 3D-CGH-TF more suitable than 3D-CGH for applications requiring in-depth illumination through scattering media23,24.
The same optical design could be used to photoswitch other proteins such as photactivatable green fluorescent protein58 or kindling fluorescent protein (KFP1)59 to precisely track the 3D position of specific cells in vivo during embryo development. Combined with optogenetics (Supplementary Note 3) or uncaging, multiplane generation of spatiotemporally focused patterns will enable simultaneous control of neurons and substructures in different planes, as well as provide a flexible mean to stimulate locations lying above or below the imaging plane. Combined with extended depth-of-field imaging60, multiplane light patterning could also improve the spatial specificity of functional voltage or calcium physiology by shaping light on cells or structures of interest61.
In this study, the two-SLM system is combined with HiLo imaging. Combining this approach with 2P imaging would also enable deep photostimulation and imaging in vivo. Decoupling of lateral and axial wavefront shaping could also be adopted in optical designs different from the one presented here. For example, placing a second SLM at the Fourier plane of a fast switchable array should enable 3D-encoded multisite 2P microscopy62 or high-speed 3D holographic light patterning63.
Two-SLM optical set-up
The optical system, schematically depicted in Fig. 1 and Supplementary Fig. 11, was built around a commercial Olympus IX71 inverted microscope, modified in order to accommodate two opposite-facing objectives, OBJ1 and OBJ2, for excitation and fluorescence collection, respectively. To this end, the condenser lens of the microscope was substituted with a dielectric mirror and an Olympus LUMPLFL60xW/IR2, NA 0.90 objective (OBJ1). The expanded (× 10) beam of a Ti:Sapphire laser (MaiTai Deep-See, Spectra-Physics) covered the active area of a first LCOS-SLM (X10468-07, Hamamatsu Photonics; SLM1), which modulated the phase of the incoming beam to create a first image of the desired intensity pattern on the diffraction grating (830 l/mm, 53004ZD02-035R, Richardson Gratings; G) for TF through the lens L1 (f1=500 mm). 2D-phase holograms were calculated using a standard GS algorithm20,33. The first diffraction order was subsequently collimated by lens L2 (f2=500 mm) and impinged on a second SLM (X10468-07, Hamamatsu Photonics; SLM2), which was imaged at the back focal plane of the excitation objective, OBJ1, via a 2:1 telescope (lenses L3, f3=1,000 mm and L4, f4=500 mm). Suppression of the zero-order spot arising from SLM1 was achieved by using two cylindrical lenses (fL1=1,000 mm and fL2=−1,000 mm) oriented at +45° and −45° with respect to the grating lines64.
Holographic light patterns generated at the sample volume illuminated a thin spin-coated fluorescent layer of rhodamine-6G in polymethyl methacrylate 2% w/v in chloroform and the induced fluorescence was imaged on a CCD camera (CoolSNAP HQ2, Roper Scientific) through OBJ2 (Olympus UPLSAPO60XW, NA 1.2). For 3D reconstruction of illumination volumes, OBJ2 was fixed and focused on the fluorescent layer, while OBJ1 was moved along the axial direction with a piezo positioner of 1 mm range when working in closed loop (PI N-725.2A PIFOC). The two SLMs, the CCD camera, the piezo positioner, lasers and other electronic components of the set-up were controlled by a custom-developed interface in LabVIEW. GS-based algorithms were run in MATLAB.
When the set-up was used for generation of multiplane holographic patterns (not temporally focused) a mirror replaced the diffraction grating, and SLM2 was either used in reflectance mode by applying only the flatness correction phase mask of the device or was replaced by a mirror. Both the grating and SLM2 were mounted on magnetic bases enabling fast switching between the different configurations. The multiplane GS algorithm used in this case was run in a custom-designed C++ software interface, Wavefront Designer20.
Two-colour HiLo imaging system
High-resolution multiplane fluorescence imaging of zebrafish larvae was achieved by coupling an optical set-up for two-colour HiLo microscopy46 to the Olympus IX71 microscope. Two continuous wave 473-nm (Laser Quantum, Ciel 350 mW) and 561-nm (CNI laser, MGL-N-561-500 mW) lasers were co-aligned in the same optical path with the dichroic mirror D2 (Semrock, Di02-R514) and collimated with lenses L6 (f6=125 mm), L7 (f7=150 mm) and L10 (f10=35 mm) to illuminate an oscillating diffuser plate (Optotune LSR-3005-10) that was imaged through lenses L8 (f8=75 mm) and L9 (f9=200 mm) at the back aperture of the excitation objective, OBJ1 (Supplementary Fig. 11). The D1 dichroic mirror reflected the collected fluorescence to a CMOS camera (Hamamatsu Photonics, Orca Flash 4.0-V2) through the appropriate filter cube (FC2) for green (dichroic mirror Semrock FF495-Di02, emission filter Semrock FF01-520/35-25) or red fluorescence (dichroic mirror Semrock Di02-R561, emission filter Semrock FF595-Di02).
The sectioned image was computed with custom scripts written in MATLAB65. The cutoff frequency used to merge the low- and high-frequency components was chosen such as kc≈0.1 klow, where klow is the frequency of the low-pass filter applied to the uniform illumination image. With those parameters, we measured an axial resolution of 3.2-μm FWHM for the emitted fluorescence (Supplementary Fig. 11b). The axial resolution was measured using a Rhodamine-6G thin layer. First, we recorded a z-stack with uniform illumination (oscillating diffuser on) and then with speckle illumination (oscillating diffuser off). The two stacks were then processed in MATLAB to generate an axially resolved HiLo z-stack using algorithms previously described34,65. The axial resolution shown in Supplementary Fig. 11 is the axial resolution measured on the processed HiLo z-stack.
2P galvo-based scanning imaging system
2P imaging of photoconverted zebrafish larvae in the brain performed by a mode-locked Ti-Sapphire laser source (Coherent Chameleon Vision II, pulse width 140 fs, tuning range 680–1,080 nm). The femtosecond pulsed beam was raster-scanned on the sample via a pair of xy galvanometric mirrors (3 mm aperture, 6215H series, Cambridge Technology) imaged at the back aperture of the microscope objective (× 40 W APO NIR, Nikon) through an afocal telescope (scan lens: f=100 mm, tube lens: f=300 mm). Galvanometric mirrors were driven by two servo drivers (MicroMax series 671, Cambridge Technology) controlled by a Digital/Analog converter board (PCI-6110, National Instrument). Emitted fluorescence was collected by a fibre-coupled detection scheme66. The fibre exit was imaged on two photomultiplier tubes GaAsP (H10770-40 SEL, Hamamatsu Photonics, active area 5 mm) by a set of three matching asphere lenses (f=23.5 mm, Melles Griot #LAG-32.5-23.5-C). Following the fibre exit, fluorescence light was filtered with an infrared-light-blocking filter (FF01-750sp, Semrock), split into two channels by a dichroic mirror (FF555-Di03, Semrock) and detected through two emission filters (FF01-510/84 and FF02-617/73, Semrock). The whole system was built around a commercial upright microscope (SliceScope, Scientifica). 2P imaging laser power was tuned by combining an electrically controlled liquid crystal variable phase retarder (LRC-200-IR1, Meadowlark Optics) and a polarizer cube (BB-050-IR1, Meadowlark Optics) at the exit of the laser source.
Green and red fluorescence z-stacks of photoconverted Kaede in the zebrafish brain were acquired by scanning the excitation beam (780 nm) at 0.74 Hz (full frame) and averaging 10–20 frames for each plane.
First, a HiLo z-stack in the green channel (200 × 200 × 100 μm3) was recorded to map the location of neuronal cells for photoconversion. On the basis of these images, we calculated phase holograms that produced the corresponding 2D or 3D illumination patterns. We typically used 5-μm-diameter holographic spots to target single cells and 30–35-μm-diameter holographic spots to target sets of neurons. In order to quantify the efficiency of photoconversion, we also recorded the corresponding z-stack in the red channel before photoconversion.
Simultaneous 2P photoconversion (λphot=800 nm) of all targets was performed while monitoring the fluorescence in the red channel. We typically observed a tenfold increase of red fluorescence in the targeted cells. Photoconversion during fluorescence imaging was minimized by keeping the total acquisition time below 2 min and laser power at the sample plane below 20 mW. To minimize thermal damage during photoconversion, we delivered trains of 50-ms pulses, low laser intensity ∼0.04–4.0 mW μm−2 (power densities are always given relatively to the area of the spots’ surface) for periods of time that ranged from 200 ms to a few hundred seconds depending on the laser intensity.
Experiments were performed on Danio rerio larvae between 2 and 6 days post fertilization following procedures approved by the Institutional Ethics Committee Darwin in the ‘Institut du Cerveau et de la Moelle épinière’ (ICM). AB and TL strains of wild-type (WT) larvae were obtained from laboratory’s stock of adults. Embryos and larvae were raised in an incubator at 28.5 °C until shortly before recordings were performed. For photoconversion experiments, we used Tg(HuC:gal4; UAS:kaede)43 where the HuC promoter drives pan-neuronal expression of Gal4 and Kaede at the larval stage. Tg(pkd2l1:gal4; UAS:ChR2-H134R-mCherry; UAS:GCaMP5G)65,67 were used for combination of optogenetics and calcium imaging in Supplementary Data. Before performing image acquisitions, embryos were dechorionated and screened for fluorescence at 1 days post fertilization. Larvae screened for Kaede fluorescence were later embedded laterally in 1.5% agarose. Larvae were anaesthetized in 0.02% tricain (MS-222, Sigma-Aldrich, USA).
The data that support the findings of this study are available from the corresponding author upon request.
How to cite this article: Hernandez, O. et al. Three-dimensional spatiotemporal focusing of holographic patterns. Nat. Commun. 7:11928 doi: 10.1038/ncomms11928 (2016).
Denk, W., Strickler, J. H. & Webb, W. W. Two-photon laser scanning fluorescence microscopy. Science 248, 73–76 (1990).
Salomé, R. et al. Ultrafast random-access scanning in two-photon microscopy using acousto-optic deflectors. J. Neurosci. Methods 154, 161–174 (2006).
Reddy, G. D., Kelleher, K., Fink, R. & Saggau, P. Three-dimensional random access multiphoton microscopy for functional imaging of neuronal activity. Nat. Neurosci. 11, 713–720 (2008).
Grewe, B. F., Langer, D., Kasper, H., Kampa, B. M. & Helmchen, F. High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision. Nat. Methods 7, 399–405 (2010).
Nguyen, Q. T., Callamaras, N., Hsieh, C. & Parker, I. Construction of a two-photon microscope for video-rate Ca2+ imaging. Cell Calcium 30, 383–393 (2001).
Oron, D., Tal, E. & Silberberg, Y. Scanningless depth-resolved microscopy. Opt. Express 13, 1468–1476 (2005).
Zhu, G., van Howe, J., Durst, M., Zipfel, W. & Xu, C. Simultaneous spatial and temporal focusing of femtosecond pulses. Opt. Express 13, 2153–2159 (2005).
Akturk, S., Gu, X., Bowlan, P. & Trebino, R. Spatio-temporal couplings in ultrashort laser pulses. J. Opt. 12, 093001 (2010).
Tal, E., Oron, D. & Silberberg, Y. Improved depth resolution in video-rate line-scanning multiphoton microscopy using temporal focusing. Opt. Lett. 30, 1686–1688 (2005).
Vaziri, A. & Shank, C. V. Ultrafast widefield optical sectioning microscopy by multifocal temporal focusing. Opt. Express 18, 19645–19655 (2010).
Isobe, K. et al. Enhancement of lateral resolution and optical sectioning capability of two-photon fluorescence microscopy by combining temporal-focusing with structured illumination. Biomed. Opt. Express 4, 2396–2410 (2013).
Choi, H. et al. Improvement of axial resolution and contrast in temporally focused widefield two-photon microscopy with structured light illumination. Biomed. Opt. Express 4, 995–1005 (2013).
Song, Q. et al. Two-dimensional spatiotemporal focusing of femtosecond pulses and its applications in microscopy. Rev. Sci. Instrum. 86, 083701 (2015).
Losonczy, A., Zemelman, B. V, Vaziri, A. & Magee, J. C. Network mechanisms of theta related neuronal activity in hippocampal CA1 pyramidal neurons. Nat. Neurosci. 13, 967–972 (2010).
Dana, H. et al. Hybrid multiphoton volumetric functional imaging of large-scale bioengineered neuronal networks. Nat. Commun. 5, 3997 (2014).
Vaziri, A., Tang, J., Shroff, H. & Shank, C. V. Multilayer three-dimensional super resolution imaging of thick biological samples. Proc. Natl Acad. Sci. USA 105, 20221–20226 (2008).
Kim, D. & So, P. T. C. High-throughput three-dimensional lithographic microfabrication. Opt. Lett. 35, 1602–1604 (2010).
Andrasfalvy, B. K., Zemelman, B. V, Tang, J. & Vaziri, A. Two-photon single-cell optogenetic control of neuronal activity by sculpted light. Proc. Natl. Acad. Sci. USA 107, 11981–11986 (2010).
Rickgauer, J. P., Deisseroth, K. & Tank, D. W. Simultaneous cellular-resolution optical perturbation and imaging of place cell firing fields. Nat. Neurosci. 17, 1816–1824 (2014).
Lutz, C. et al. Holographic photolysis of caged neurotransmitters. Nat. Methods 5, 821–827 (2008).
Papagiakoumou, E., de Sars, V., Oron, D. & Emiliani, V. Patterned two-photon illumination by spatiotemporal shaping of ultrashort pulses. Opt. Express 16, 22039–22047 (2008).
Papagiakoumou, E. et al. Scanless two-photon excitation of channelrhodopsin-2. Nat. Methods 7, 848–854 (2010).
Bègue, A. et al. Two-photon excitation in scattering media by spatiotemporally shaped beams and their application in optogenetic stimulation. Biomed. Opt. Express 4, 2869–2879 (2013).
Papagiakoumou, E. et al. Functional patterned multiphoton excitation deep inside scattering tissue. Nat. Photon. 7, 274–278 (2013).
Piestun, R., Spekor, B. & Shamir, J. Wave fields in three dimensions: analysis and synthesis. J. Opt. Soc. Am. A 13, 1837–1848 (1996).
Curtis, J. E., Koss, B. A. & Grier, D. G. Dynamic holographic optical tweezers. Opt. Commun. 207, 169–175 (2002).
Sinclair, G. et al. Interactive application in holographic optical tweezers of a multi-plane Gerchberg-Saxton algorithm for three-dimensional light shaping. Opt. Express 12, 1665–1670 (2004).
Yang, S. et al. Three-dimensional holographic photostimulation of the dendritic arbor. J. Neural Eng. 8, 46002 (2011).
Anselmi, F., Ventalon, C., Bègue, A., Ogden, D. & Emiliani, V. Three-dimensional imaging and photostimulation by remote-focusing and holographic light patterning. Proc. Natl Acad. Sci. USA 108, 19504–19509 (2011).
Hilario, P. L., Villangca, M. J. & Tapang, G. Independent light fields generated using a phase-only spatial light modulator. Opt. Lett. 39, 2036–2039 (2014).
Ma, B. et al. Generation of three-dimensional optical structures by dynamic holograms displayed on a twisted nematic liquid crystal display. Appl. Phys. B 110, 531–537 (2013).
Emiliani, V. et al. Wave front engineering for living cells microscopy. Opt. Express 13, 1395–1405 (2005).
Gerchberg, R. W. & Saxton, W. O. A pratical algorithm for the determination of the phase from image and diffraction pictures. Optik (Stuttg) 35, 237–246 (1972).
Zahid, M. et al. Holographic photolysis for multiple cell stimulation in mouse hippocampal slices. PLoS ONE 5, e9431 (2010).
Dana, H. & Shoham, S. Remotely scanned multiphoton temporal focusing by axial grism scanning. Opt. Lett. 37, 2913–2915 (2012).
Richards, B. & Wolf, E. Electromagnetic diffraction in optical systems. II. Structure of the image field in an aplanatic system. Proc. R Soc. Lond. A 253, 358–379 (1959).
Botcherby, E. J., Juskaitis, R., Booth, M. J. & Wilson, T. Aberration-free optical refocusing in high numerical aperture microscopy. Opt. Lett. 32, 2007–2009 (2007).
Leshem, B., Hernandez, O., Papagiakoumou, E., Emiliani, V. & Oron, D. When can temporally focused excitation be axially shifted by dispersion? Opt. Express 22, 7087–7098 (2014).
Dainty, J. C. Laser Speckle and Related Phenomena. Topics in Applied Physics 9 Springer-Verlag (1975).
Matar, S., Golan, L. & Shoham, S. Reduction of two-photon holographic speckle using shift-averaging. Opt. Express 19, 25891–25899 (2011).
Haist, T., Schönleber, M. & Tiziani, H. Computer-generated holograms from 3D-objects written on twisted-nematic liquid crystal displays. Opt. Commun. 140, 299–308 (1997).
Leach, J. et al. Interactive approach to optical tweezers control. Appl. Opt. 45, 897–903 (2006).
Scott, E. K. et al. Targeting neural circuitry in zebrafish using GAL4 enhancer trapping. Nat. Methods 4, 323–326 (2007).
Ando, R., Hama, H., Yamamoto-Hino, M., Mizuno, H. & Miyawaki, A. An optical marker based on the UV-induced green-to-red photoconversion of a fluorescent protein. Proc. Natl Acad. Sci. USA 99, 12651–12656 (2002).
Isobe, K. et al. Measurement of two-photon excitation spectrum used to photoconvert a fluorescent protein (Kaede) by nonlinear Fourier-transform spectroscopy. Biomed. Opt. Express 1, 687–693 (2010).
Lim, D., Chu, K. K. & Mertz, J. Wide-field fluorescence sectioning with hybrid speckle and uniform-illumination microscopy. Opt. Lett. 33, 1819–1821 (2008).
Carslaw, H. S. & Jaeger, J. C. Conduction of Heat in Solids Clarendon Press (1959).
Elwassif, M. M., Kong, Q., Vazquez, M. & Bikson, M. Bio-heat transfer model of deep brain stimulation induced temperature changes. Conf. Proc. IEEE Eng. Med. Biol. Soc. 1, 3580–3583 (2006).
Johansson, J. D. Spectroscopic method for determination of the absorption coefficient in brain tissue. J. Biomed. Opt. 15, 057005 (2010).
Yizhar, O., Fenno, L. E., Davidson, T. J., Mogri, M. & Deisseroth, K. Optogenetics in neural systems. Neuron 71, 9–34 (2011).
Grewe, B. F., Voigt, F. F., van ’t Hoff, M. & Helmchen, F. Fast two-layer two-photon imaging of neuronal cell populations using an electrically tunable lens. Biomed. Opt. Express 2, 2035–2046 (2011).
Durst, M. E., Zhu, G. & Xu, C. Simultaneous spatial and temporal focusing for axial scanning. Opt. Express 14, 12243–12254 (2006).
Durst, M. E., Zhu, G. & Xu, C. Simultaneous spatial and temporal focusing in nonlinear microscopy. Opt. Commun. 281, 1796–1805 (2008).
Suchowski, H., Oron, D., Silberberg, Y., Suchowski Oron, D. & Silberberg, Y., H. Generation of a dark nonlinear focus by spatio-temporal coherent control. Opt. Commun. 264, 482–487 (2006).
Du, R. et al. Analysis of fast axial scanning scheme using temporal focusing with acousto-optic deflectors. J. Mod. Opt. 56, 81–84 (2009).
Hatta, K., Tsujii, H. & Omura, T. Cell tracking using a photoconvertible fluorescent protein. Nat. Protoc. 1, 960–967 (2006).
Warp, E. et al. Emergence of patterned activity in the developing zebrafish spinal cord. Curr. Biol. 22, 93–102 (2012).
Patterson, G. H. A photoactivatable GFP for selective photolabeling of proteins and cells. Science 297, 1873–1877 (2002).
Chudakov, D. M. et al. Kindling fluorescent proteins for precise in vivo photolabeling. Nat. Biotechnol. 21, 191–194 (2003).
Quirin, S., Peterka, D. S. & Yuste, R. Instantaneous three-dimensional sensing using spatial light modulator illumination with extended depth of field imaging. Opt. Express 21, 16007 (2013).
Foust, A. J., Zampini, V., Tanese, D., Papagiakoumou, E. & Emiliani, V. Computer-generated holography enhances voltage dye fluorescence discrimination in adjacent neuronal structures. Neurophotonics 2, 021007 (2015).
Ducros, M., Goulam Houssen, Y., Bradley, J., de Sars, V. & Charpak, S. Encoded multisite two-photon microscopy. Proc. Natl Acad. Sci. USA 110, 13138–13143 (2013).
Go, M. A. et al. Four-dimensional multi-site photolysis of caged neurotransmitters. Front. Cell. Neurosci. 7, 231 (2013).
Hernandez, O., Guillon, M., Papagiakoumou, E. & Emiliani, V. Zero-order suppression for two-photon holographic excitation. Opt. Lett. 39, 5953–5956 (2014).
Lauterbach, M. A., Ronzitti, E., Sternberg, J. R., Wyart, C. & Emiliani, V. Fast calcium imaging with optical sectioning via HiLo microscopy. PLoS ONE 10, e0143681 (2015).
Ducros, M. et al. Efficient large core fiber-based detection for multi-channel two-photon fluorescence microscopy and spectral unmixing. J. Neurosci. Methods 198, 172–180 (2011).
Fidelin, K. et al. State-dependent modulation of locomotion by GABAergic spinal sensory neurons. Curr. Biol. 25, 3035–3047 (2015).
We thank Jenna Sternberg for help with the preparation of the biological samples, Marc Guillon for helpful discussion on the implementation of the multiplane GS algorithm, Marcel Lauterbach and Emiliano Ronzitti for discussions on the design of the HiLo set-up, Emiliano Ronzitti and Amanda Foust for building the 2P imaging system, Benoît Forget and Alexis Picot for useful discussions on heating effects, Vincent de Sars for the continued development of ‘Wavefront Designer’ software and Amanda Foust for critical reading of the manuscript. V.E. and E.P. acknowledge the ‘Agence Nationale de la Recherche’ (grants ANR-12-BSV5-0011-01, Neurholog and ANR-15-CE19-0001-01, 3DHoloPAc), VE acknowledges the National Institutes of Health (NIH 1-U01-NS090501-01). O.H. acknowledges the programme ‘Nanotechnologies France-Israel’ for financial support. C.W. and K.F. acknowledge the City of Paris Emergence programme, the Human Frontier Science Program (HFSP) Research Grant #RGP0063/2014 and the European Research Council (ERC) starter grant ‘OptoLoco’ #311673.
The authors declare no competing financial interests.
Supplementary Figures 1-14, Supplementary Notes 1-3 and Supplementary References. (PDF 5891 kb)
3D-CGH, Volumetric reconstruction of three-dimensional distribution of 5-μm diameter holographic spots. (AVI 1235 kb)
About this article
Cite this article
Hernandez, O., Papagiakoumou, E., Tanese, D. et al. Three-dimensional spatiotemporal focusing of holographic patterns. Nat Commun 7, 11928 (2016). https://doi.org/10.1038/ncomms11928
Annual Review of Biomedical Engineering (2020)
Cell Reports (2020)
Scientific Reports (2020)
Frontiers in Neuroscience (2020)
Nature Photonics (2019)