Article | Open | Published:

# Fast spectrally encoded Mueller optical scanning microscopy

Scientific Reportsvolume 9, Article number: 3972 (2019) | Download Citation

## Abstract

Mueller microscopes enable imaging of the optical anisotropic properties of biological or non-biological samples, in phase and amplitude, at sub-micrometre scale. However, the development of Mueller microscopes poses an instrumental challenge: the production of polarimetric parameters must be sufficiently quick to ensure fast imaging, so that the evolution of these parameters can be visualised in real-time, allowing the operator to adjust the microscope while constantly monitoring them. In this report, a full Mueller scanning microscope based on spectral encoding of polarization is presented. The spectrum, collected every 10 μs for each position of the optical beam on the specimen, incorporates all the information needed to produce the full Mueller matrix, which allows simultaneous display of all the polarimetric parameters, at the unequalled rate of 1.5 Hz (for an image of 256 × 256 pixels). The design of the optical blocks allows for the real-time display of linear birefringent images which serve as guidance for the operator. In addition, the instrument has the capability to easily switch its functionality from a Mueller to a Second Harmonic Generation (SHG) microscope, providing a pixel-to-pixel matching of the images produced by the two modalities. The device performance is illustrated by imaging various unstained biological specimens.

## Introduction

A key method in biological research, light microscopy has, for centuries, been looking for new approaches to enhance contrast by making use of the wave nature of light, the linear and/or non linear optical properties of matter and the addition of specific chromophores. Among numerous optical microscopy imaging modalities, polarized light microscopy1 is dedicated to the observation of biological structures2 that exhibit intrinsic optical anisotropic properties in phase (linear/circular birefringence) and amplitude (linear/circular diattenuation) at sub-micrometer scale. The main source of anisotropy in biological tissues, especially those of mammals, is linear birefringence caused by a few regular arrangements of lipids or proteins such as collagen and elastin fibres in connective tissues, microtubules and actin filaments in cytoskeleton, myelin sheath in brain tissue, amyloid fibrils related to Alzheimer’s and prion diseases. Plants also exhibit linear birefringence through structural (cellulose fibres) and storage (semi-crystalline starch) polysaccharide building blocks. Linear diattenuation of biological structures could originate from reflections by the curvature of the specimen surface through Fresnel’s laws, from scattering by particles (Rayleigh-Gans theory), but also from absorption associated to anisotropic transition moments. In the latter case, diattenuation is often called dichroism and it was, for instance, experimentally assessed in brain nerve fibres3. Circular birefringence (also called optical rotation) and circular diattenuation (also called circular dichroism) originates from chiral molecules and/or structures. In biological fluids or tissues, optical rotation is mainly significant in the presence of glucose and it was demonstrated that circular dichroism is for example sensitive to the structure of chromatin in cells4. Finally, due to multiple scattering on various centres through specimens, light polarization can also be randomly modified (depolarization), which cannot be circumvented in thick biological tissues. For the last decades, spatial mapping at microscopic scale of polarization-based optical effects was demonstrated to be a powerful label-free method to analyse the architecture of tissues and their alteration due to different kinds of pathologies.

The usual white light polarization microscope, in which the sample is placed between crossed polarizers, is routinely used for qualitative imaging but can sometimes provide ambiguous image contrasts in cases where several effects occur simultaneously. To obtain quantitative information and automate the measurement process, other schemes have been proposed involving compensators5, rotating optical components6 or electro-optic modulators7,8 to give only a few examples. Except Stokes microscopes9 that measure degree of polarization, most of them assumed that the specimens exhibit a pure polarimetric effect, i.e. linear birefringence, circular birefringence, linear diattenuation or circular diattenuation. As the need has arisen to take mixed polarimetric effects into account, confocal scanning Mueller microscopes10,11 and full-field transmission Mueller polarimetric microscopes have been successfully devised and then used for imaging biological tissues12,13,14,15,16,17. The full-field microscopes have been designed with incoherent light sources and CCD or CMOS sensors in various ways, from dual rotating compensators18 to liquid crystal variable retarders19, using different experimental strategies to measure the full Mueller matrix20,21,22,23 containing all the polarimetric features of specimens. Benefiting from the advances in Mueller matrix decomposition24,25, Mueller microscopes have the great advantage of providing all the elements that will produce multiple images resulting from the exhaustive polarimetric response of the specimen, such as linear retardance RL (associated to linear birefringence) and the orientation (or azimuth) of its slow axis αR, linear diattenuation DL and the orientation (or azimuth) of its axis αD, circular retardance RC (associated to circular birefringence), circular diattenuation DC, depolarization parameter26 Δ. Nevertheless, such microscopes still have limited performance due to: (i) the complexity of the polarization state generation and analysis and (ii) the time delay, typically from a few dozens of seconds to few minutes, for recording enough images to retrieve the 16-elements of the Mueller matrix with a suitable signal-to-noise ratio. Another limitation, usually not mentioned in most studies, is the difficulty of displaying these polarimetric parameters in real time, which is a huge issue when the operator adjusts the microscope to find a region of interest. Indeed, in addition to acquisition time, a long post-processing stage is necessary to compute the Mueller matrices, to correct numerically the polarimetric signature of the microscope itself and to interpret Mueller matrices physically. Due to these limitations, Mueller microscopy is not widespread yet despite its interesting use in imaging histological sections of liver collagen fibers27,28 stained with picro-sirius red to increase birefringence, Morpho butterfly29 or crystals30 for instance.

Recently, we have demonstrated as a proof of concept, the first full Mueller polarimetric scanning microscope based on an optical frequency swept-laser source implemented within a commercial confocal-like microscope31. The device did not use any moving parts for the polarized state generator (PSG) and analyser (PSA) blocks, but only static polarizers and retarders to spectrally encode light polarization32,33,34. From the channelled spectrum measured by a single-pixel detector, the full Mueller matrix was determined at each point of the specimen. The tuning speed of the swept-source laser, (10 μs in our case) determined the data acquisition time of our device. That enhanced microscope benefited from a simpler design due to the use of passive PSG and PSA blocks, and significantly improved signal-to-noise ratio as a result of the coherent point-to-point illumination.

This report presents a full Mueller scanning microscope based on new designs of passive PSA and PSG blocks in order to display in real-time linear birefringence and its orientation or more generally the change of polarization induced by the specimen as guidance for the operator whilst adjusting the microscope. In addition, the instrument is provided with another functionality allowing the operator to switch easily from a Mueller to a Second Harmonic Generation (SHG) imaging modality, while keeping a perfect point-to-point matching of the images. The performance of our new Mueller microscope is illustrated through imaging various unstained biological specimens such as potato starch granules, aponeurosis in chicken legs and human liver with fibrosis disease, in order to show the ability to separate different anisotropies within specimens. All the polarimetric features are recorded at frame rates of 1.5 Hz and 0.4 Hz from respectively single-scan 256 × 256 and 512 × 512 images (to our knowledge, this is the highest rate ever reported). Firstly, a video showing potato starch granules has been produced during the adjustment of the microscope, to demonstrate the possibility of real-time imaging of linear birefringence (amplitude and axis orientation) as guidance. Secondly the images of retardance, diattenuation and depolarization of the same potato starch granules have been made through a Mueller analysis. Thirdly another video shows aponeurosis being altered by hydrochloric acid to demonstrate the ability of the instrument to image simultaneously all the polarimetric effects at high speed. Finally, the same liver specimen has been scanned using both Mueller and SHG imaging pathways of our microscope. This illustrates how a well-designed Mueller modality is able to reveal unstained birefringent arrangements – such as fibrillar collagen within thin tissue sections – and competes with a much more expensive nonlinear SHG modality.

## Results

### Real-time image display

The measurement of the Mueller matrix of a specimen, allowing access to its complete polarimetric information, requires generating several input polarization states and analysing these states modified by the specimen. Instead of carrying out the measurements by active PSG and PSA blocks using rotating optical elements or polarization modulators, PSG and PSA blocks are made of thick chromatically dispersed retarders associating each polarization state to a wavelength and permitting to perform both generation and analysing in a passive way. The microscope is based on a standard upright confocal microscope with these PSG and PSA blocks respectively at the input and the output of the microscope in such a way that polarization states are generated and analysed for each wavelength delivered in time by the swept-source laser. The channelled spectrum Ix,y(t) measured in transmission (Fig. 1(a)) is the combination of 12 modulations from f0 to 12 f0 whose amplitudes and phases depend on the elements mij of the Mueller matrix related to the polarimetric signature at each point of the specimen, the microscope itself and the PSG and PSA blocks. The acquisition of the spectrum takes 10 μs per image pixel, according to the tuning speed of the swept-source used in these experiments, which allows for producing the Mueller components at the usual frame rate of optical scanning microscopes, once raw data are processed. To obtain images resulting from the polarimetric signature of the specimen only, several steps of post-processing detailed in the “Methods” section are carried out, which we refer to as the Mueller analysis. However, all the steps, from Fourier transformation – measuring the amplitude and phase of modulations – through the numerical correction of the polarimetric response of the microscope, to matrix decomposition, increase the processing time, and do not allow for displaying in real-time all the polarimetric images of the specimen. Instead of speeding up calculations by implementing the post-processing algorithms on FPGA or GPU, our approach was to display only specific images for guidance for the microscope operator through a software developed in LabVIEW 2017 (National Instruments, Austin, Texas). For this purpose, three modifications have been made to our Mueller microscope. First a Berek compensator was added to compensate at least for the linear birefringence induced by the fold mirrors used to convey light from the swept-source laser into the microscope and by the galvo-scanner mirrors. Second, one achromatic quarter-wave plate has been added to the initial PSG as well as PSA blocks so that particular modulations of the channelled spectrum Ix,y(t) are directly linked to linear birefringence as described in the “Methods” section. Third, the amplitude and the phase of the modulations of Ix,y(t) are measured with numerical oscillators35 instead of using a Fourier transform. This strategy is more efficient to tackle real-time issues, as the axial range of interest is shorter than the one obtained via Fast Fourier Transform36. To measure the complex values of the peaks Pk associated to the 12 modulations (k = 0 to 12), Ix,y(t) is only multiplied with 12 numerical oscillators $$Exp(i\,2\pi \,k\,{f}_{0}\,t)$$, and the difference between the peaks ΔPk with and without the specimen is calculated. Note that the peaks Pk (for k ≠ 0) are normalized according to the DC component P0 in order to remove the transmittance of the specimen. Figure 1(c–e) are images of a potato starch granule specimen obtained by displaying different peaks ΔPk. When observed under polarized light, starch granules exhibit a Maltese cross that indicates a radial orientation of the principle axis of birefringence, while retardance remains almost unchanged. Further details about starch granules will be given in the next section. Figure 1(c) corresponds to the peak ΔP0 in grey levels that is mainly sensitive to the transmittance of the sample. Figure 1(d) is an image for which the phase of the peak ΔP9 is colour-coded in Hue-Saturation-Value (HSV) space, while the brightness of colours is regulated by the amplitude of ΔP9, the saturation being set to 1. The peak ΔP9 has been chosen because it theoretically depends on the linear retardance RL(x,y) and its azimuth αR(x,y) through the expression $${\rm{\Delta }}{P}_{9}=2\,\sin \,{R}_{L(x,y)}\,Exp(-i\,2\,{\alpha }_{R(x,y)})$$, supposing that the anisotropy of the microscope has been compensated for. Thus, unlike Fig. 1(c,d) shows the birefringence of the starch granule and the rotation of its azimuth around a point whose retardance is zero. Figure 1(e) corresponds to ∑k=1,12 [|ΔPk|] in green levels that images the starch granule on a dark background and is sensitive to an overall change of polarization. This parameter is less sensitive to the orientation of the birefringence and exhibits a low contrasted Maltese cross. A recording of the computer screen that displays in real-time the image of the specimen during the microscope adjustments can be found as Supplementary Video S1. It demonstrates the possibility of switching between ΔP9 or ∑k=1,12 [|ΔPk|], zooming in and zooming out, and moving the specimen laterally. Peaks ΔP3, ΔP7 and ΔP11 are similar to ΔP9 and could have been used in the same way. As the other peaks depend on both birefringence and diattenuation, it is not possible to directly display the diattenuation unless the sample is a pure diattenuator. Figure 1(c–e) can be used conveniently as guidance for the specimen settings under the microscope objective. They cannot however replace images from the Mueller analysis to obtain truly quantitative information on the specimen.

### Imaging potato starch granule through the Mueller analysis

Starch granules37 are excellent specimens for highlighting the sensitivity of the swept source Mueller microscope. Starch is produced by green plants for energy storage over long periods of time and is mainly found in seeds, roots and tubers. Starch grains grow from a central point, the hilum, with growth rings alternating amorphous (amylose) and semi-crystalline line shells (amylopectin). The granules occur in all shapes and sizes (spheres, ellipsoids, polygons, irregular tubules, etc) according to their botanical origin. Figure 2 shows an image of a starch granule produced by our Mueller microscope through a Mueller analysis after Lu and Chipman matrix decomposition. Axis orientation values αR of linear retardance are colour-coded in Hue-Saturation-Value (HSV) space, while the brightness of colours is regulated by the retardance values RL, the saturation being fixed to 1. The same procedure has been used for the linear diattenuation with the value corresponding to diattenuation DL and hue representing its azimuth αD. Thus, Fig. 2 contains 6 images resulting from the cumulative effect of polarization modifications along the propagation of light in the specimen. Predictably, as shown in Fig. 2(a), the starch granule is mainly equivalent to a linear retarder whose azimuth rotates around the hilum, as the linear retardance reaches a maximum of 80°. Nevertheless, other polarimetric effects appear near the boundaries of the granule but also within the granule itself. This requires the use of the Mueller analysis to separate the effects without corrupting the linear retardance measurement. In particular, depolarization (Fig. 2(c)) is visible at the edges of the granule. The presence of circular retardance (Fig. 2(b)) superimposed with linear retardance indicates that the specimen is equivalent to an elliptical birefringent. Whereas circular retardance is weak, it is beyond the background noise of the Mueller microscope (evaluated at a later stage with reference samples). Ellipticity could be a result of the sample’s inhomogeneities from a distribution of the orientation of the optical retardance axes within the granule volume. Linear and circular diattenuations (Fig. 2(d,e)) also appear on the periphery of the granule and to a smaller extent on the inside. The origin of this effect is not clear and it could originate from the anisotropic Fresnel coefficients describing the transmission of the s and p polarizations incident upon the surfaces of the granule. The ellipticity of the diattenuation could be explained by a misalignment of the principal planes of the input and output surfaces with respect to the optical beam. Another explanation for diattenuation could be a possible anisotropic absorption of amylopectin, but this hypothesis is less likely because to our knowledge, there is no mention in literature of any significant dichroism of amylopectin at 1050 nm. Moreover, the images of retardance and diattenuation should be identical if they have a common origin (amylopectin), which is not the case when circular retardance and circular diattenuation are compared.

### Imaging degradation of aponeurosis in chicken leg tissues

Aponeurosis is a dense regular connective tissue which attaches muscles to bones. Structurally aponeuroses are flat sheets of densely oriented collagen fibres and generally consist of several layers of different orientations. As a result, aponeuroses can expand both parallel and perpendicular to a muscle’s line of action38. Figure 3 shows the images of the intramuscular aponeurosis of a chicken leg tissue, produced according to the same modality as in the last section, i.e. 6 images corresponding to linear retardance in HSV, circular retardance, linear diattenuation in HSV, circular diattenuation, depolarization and transmitted intensity. These images are obtained before and one minute after hydrochloric acid application. Before application, two layers of oriented collagen fibres can be seen through the linear retardance (Fig. 3(a)) and the circular retardance (Fig. 3(b)). In fact, the addition of two linear birefringent samples whose axes are not aligned is equivalent to an elliptical retardance that can be separated into linear and circular retardance. The meshing resulting from the superposition of layers is also highlighted in the linear diattenuation image (Fig. 3(d)). When acid is spread on the surface of the specimen, the collagen is denatured hence a decrease of the birefringence strength. This alteration is characterized by a drop of the value in the HSV image in Fig. 3(g) and the loss of circular birefringence structure in Fig. 3(h) suggests that one of the layers is totally altered. The polarimetric changes of the aponeurosis caused by acid have been recorded at the frame rate of 1.5 Hz and displayed 10 times as fast in the Supplementary Video S2.

### Imaging unstained liver fibres fixed in paraffin

An unstained liver specimen at F4 fibrosis stage (see “Methods section) was imaged by our microscope. It is well established that liver fibrosis is characterized by an over-production of fibrillar collagen as the disease progresses39. Figure 4(a,b) display respectively linear retardance and azimuth of retardance images. The specimen mainly exhibits linear birefringence, as expected for fibrillar collagen of type I40. All other polarimetric effects are weak at the locations of collagen within the specimen, and were thus not presented in this paper. It can be noticed that the linear retardance image is polluted by a strong background signal. This polarimetric signature can be attributed to paraffin that has not been correctly removed from the preparation as paraffin retardance values (up to 30°) are far above those of collagen fibres themselves (around 5°). Collagen fibres then clearly appear in negative contrast in Fig. 4(a). We have analysed the behaviour of the linear retardance and the azimuth of retardance within selected areas mainly constituted of collagen fibres and paraffin (respectively the red and blue boxes defined in Fig. 4(a,b)).

One can notice in Fig. 4(d) that the distribution of the linear retardance values in the paraffin area is wide (from 0° to 30°), preventing us from applying a numerical threshold method based on linear retardance value to remove paraffin from the images. However, Fig. 4(e) shows that the collagen area (red plot) is characterized by a narrow orientation distribution of birefringence axes unlike regions containing paraffin (blue plot). In order to remove paraffin from polarimetric images, we therefore defined a degree of alignment (DoA) of birefringence axes written as DoA = (<sin β>2 + <cos β>2)1/2 where < > is the mean value and β is the set of the considered birefringence azimuths. DoA values range from 0 for totally disordered to 1 for perfectly aligned azimuths of retardance between neighbouring pixels. Figure 4(f) shows the corresponding image of DoA applied to all the specimen, the averaged DoA values being equal to 0.72 and 0.95 for the region containing respectively paraffin and collagen fibres. From thresholds based first on the DoA image and secondly on the linear retardance image as evidenced by the green lines in Fig. 4(d,f), a binary mask (Fig. 4(c)) was then created and applied to the linear retardance image leading to Fig. 5(a).

In Fig. 5(a), most of the paraffin signature was removed by implementing the numerical method based on DoA filtering. Collagen fibres are now clearly visible as well as their orientation. To demonstrate the capability of the Mueller polarimetric microscope to image unstained liver biopsy embedded in paraffin, the same area was imaged using a standard transmission polarization microscope. The cross-polarized image is represented in Fig. 5(b). This image mainly reveals paraffin that is strongly birefringent and thus appears in white in the cross-polarized image. Collagen fibres have a much lower birefringence and are invisible in this image. Moreover, in a classical polarization microscope, the contrast of collagen fibres depends on the alignment with directions of the polarizers, and vanishes for a perfect alignment. Collagen fibres can be made visible by rotating the specimen. This makes the use of a standard polarization microscope for visualization of unstained liver biopsy embedded in paraffin very difficult unlike Mueller microscopes whose contrast is independent of the orientation of the specimen. In addition, a numerical method based on the azimuth of retardance enables to remove highly dispersed paraffin from the retardance image. The same region was imaged by switching the microscope to the SHG configuration (Fig. 5(c)). The SHG image specifically reveals type-I and III fibrillar collagen and was demonstrated to be a relevant tool for assessing liver fibrosis41,42 but its nonlinearity complicates polarization parameter extraction and interpretation43,44. One should note that residual paraffin is visible on the SHG image, corresponding to the “hot” regions in the cross-polarized image (Fig. 5(b)). This indicates a higher organization of paraffin at the scale of the focal excitation volume of the microscope. The HSV linear retardance and SHG images are very close, confirming that the retardance is indeed produced by fibrillar collagen. The pixel-to-pixel comparison of the two images has not been fully exploited in this paper and further studies will be dedicated to a thorough analysis of this comparison, adding a polarization-resolved modality for SHG to reach full linear/nonlinear polarimetric characterization. Note that specimens have seldom been imaged with the double Mueller/SHG modality of the same scanning microscope and have only been proposed recently in reflection45.

## Discussion

We have developed a multi-modal optical scanning microscope able to (i) display in real-time birefringent images coded in HSV space where hue is generated for any specimen orientation, (ii) measure the full Mueller matrix at each point on the specimen at the typical frame rate of optical scanning microscopes, (iii) produce SHG images with the same pixel-to-pixel matching as Mueller images. Our full Mueller scanning microscope benefits from the latest advances in Optical Coherent Tomography46 (OCT) technology in terms of light source, digital acquisition card and post-processing methods. Indeed, OCT and our Mueller microscope are both optical scanning methods and all the relevant information is contained in the modulations of the channelled spectra (the depth-resolved reflectivity profile for OCT, the elements of the Mueller matrix for the Mueller microscope). So far, swept-sources have been developed in the near-IR band, which can be a limitation if we are interested in the measurement of dichroism or depolarization related to absorption and/or scattering properties which are usually stronger in the visible band. Nevertheless, OCT technologies are continually evolving by increasing the speed of the swept-sources47 and developing new swept-sources in the visible range48, which could be an asset for future innovations in Mueller microscopy. To prevent negative impact of high NA on polarimetric parameters49, all images were produced using with microscope objectives whose NA is lower than 0.8, which limits the spatial resolution of the images. In Mueller microscopes, like in all polarized microscopes, a compromise between spatial resolution and precision of the polarimetric measurement must be made.

## Methods

### Experimental setup

#### Mueller polarization modality

The swept-source, (SSOCT-1060, Axsun Tech. Inc.) sweeps the optical frequency over a spectral range of 100 nm (before digitization) around 1050 nm at a rate of 100 kHz. Figure 6 shows the PSG and PSA blocks. They incorporate: a linear polarizer (Pol) oriented at 0° or 90°, YVO4 thick retarders oriented at 45° and 0°, achromatic quarter wave-plates at 45°, all the optical elements in the PSG and PSA being fixed. The YVO4 thickness is e = 0.4 mm for PSG and 5e = 2 mm for PSA. The electrical signal delivered by an avalanched photodiode (APD module C12703SPL, Hamamatsu) equipping a standard upright confocal microscope (Olympus BX51W1-FV300) is digitized by a data acquisition board (DAQ, ATS9350 digitizer, AlazarTech) in synchronism with the galvo-scanners the microscope is equipped with. Technical details of synchronization between the swept-source, galvo-scanners and DAQ have been disclosed in ref.31. The digitized signal includes a series of channelled spectra whose modulation is related to the polarimetric signature of each pixel of the image with a pixel-dwell time equal to 10 μs.

#### SHG modality

The femtosecond laser is a Coherent Mira-Verdi femtosecond laser tuned at 830 nm and the SHG signal is detected through a 415 nm filter by a photomultiplier module working in transmission. Flip mirrors have been added in the optical path to inject a femtosecond laser to switch from one imaging modality to the other. Using the same microscope for both Mueller matrix measurement and SHG detection allows a pixel-to-pixel comparison of the images while the usual practice consists in imaging specimen with two different devices50,51.

#### Addition of achromatic quarter wave plates

In the basic configuration of PSG and PSA blocks described in ref.33, each channelled spectrum Ix,y(t) obtained at the coordinate (x, y) in the sample is a multi-periodic signal corresponding to the first component of the output Stokes vector $${\overrightarrow{S}}_{o}$$ defined in the Stokes-Mueller formalism by

$${\overrightarrow{S}}_{o}=[{M}_{PSA(5{\rm{\Phi }})}]\cdot [M]\cdot [{M}_{PSG({\rm{\Phi }})}]\cdot {\overrightarrow{S}}_{i},$$
(1)
$${\rm{\Phi }}=\frac{2\pi \,{\rm{\Delta }}n\,e}{c}{\nu }_{(t)}\approx {{\rm{\Phi }}}_{0}+{f}_{0}\,t\,$$
(2)
$$[M]=[\begin{array}{cccc}{m}_{00} & {m}_{01} & {m}_{02} & {m}_{03}\\ {m}_{10} & {m}_{11} & {m}_{12} & {m}_{13}\\ {m}_{20} & {m}_{21} & {m}_{22} & {m}_{23}\\ {m}_{30} & {m}_{31} & {m}_{32} & {m}_{33}\end{array}],$$
(3)

where [M], [MPSG] and [MPSA] are respectively the Mueller matrices of the unknown sample, the PSG and PSA blocks, the optical frequency v(t) is delivered in time by the swept-source, Δn is the birefringence of the YVO4 retarders, $${\overrightarrow{S}}_{i}$$ is the input Stokes vector. With the addition of achromatic quarter wave-plates to devise the new PSG and PSA blocks, the relationships between the modulations of Ix,y(t) and mij elements can be inferred by noting that Eq. (1) can be written as follows with the initial PSG and PSA blocks, $$[{M}_{PSG}^{ref\,[33]}]$$ and $$[{M}_{PSA}^{ref\,[33]}]$$ defined in ref.33:

$${\overrightarrow{S}}_{o}=[{M}_{PSA\,(5{\rm{\Phi }})}^{ref\,[33]}]\cdot [M^{\prime} ]\cdot [{M}_{PSG\,({\rm{\Phi }})}^{ref\,[33]}]\cdot {\overrightarrow{S}}_{i},$$
(4)
$$[{M}^{{\rm{^{\prime} }}}]=[{M}_{{45}^{{}^{\circ }}}^{\lambda /4}]\cdot [M]\cdot [{M}_{{45}^{{}^{\circ }}}^{\lambda /4}]=[\begin{array}{cccc}{m}_{00} & -{m}_{03} & {m}_{02} & {m}_{01}\\ {m}_{30} & -{m}_{33} & {m}_{32} & {m}_{31}\\ {m}_{20} & -{m}_{23} & {m}_{22} & {m}_{21}\\ -{m}_{10} & {m}_{13} & -{m}_{12} & -{m}_{11}\end{array}],$$
(5)

with $$[{M}_{{45}^{^\circ }}^{\lambda /4}]$$ the Mueller matrix of an achromatic quarter-wave plate oriented at 45°. In particular the 9th peak ΔP9 can be expressed as $${\rm{\Delta }}{P}_{9}={e}^{2i\varepsilon }(2\,{m^{\prime} }_{21}-2i\,{m^{\prime} }_{31})={e}^{2i\varepsilon }(-2\,{m}_{23}-2i\,{m}_{13})$$ where ε is a constant coming from the thickness of YVO4 retarders that are not perfectly equal to e or 5e. For a specimen that does not exhibit any polarimetric effects or only diattenuation or circular birefringence, ΔP9 is zero. On the other hand for a pure linear birefringence, we have $${\rm{\Delta }}{P}_{9}=2\,\sin \,{R}_{L(x,y)}\,Exp(-i\,2({\alpha }_{R(x,y)}+\varepsilon ))$$, thus the amplitude of the peak is related to retardance and the phase to the orientation of its axis, facilitating real-time display of birefringence. Note that the addition of achromatic quarter-wave plates do not change the equally weighted variance52,53 (EWV) of the device (figure of merit quantifying the well-conditioning of the measurement) because they do not participate to the coding/decoding of the polarization states since they are achromatic while the coding/decoding is based on the chromatic dispersion of the optical elements.

#### Mueller analysis

Signal post-processing is implemented in MATLAB and run on a computer equipped with an Intel Xeon processor at 3.50 GHz (6 cores) CPU and 48 Gb of RAM. Currently, the processing time to produce 8 images of size 256 × 256 pixels (linear retardance (RL) and its azimuth (αR), linear diattenuation (DL) and its azimuth (αD), circular retardance (RC), circular diattenuation (DC), average depolarization (Δ) and the transmittance of the specimen (m00 element of the Mueller matrix)) is 10 s. Retardances RL and RC correspond to the phase anisotropy (optical path length) for respectively two orthogonal linear polarization states or two orthogonal circular polarization states. Retardance is measured here as a phase angle from 0° to 180°. Diattenuations DL and DC correspond to the amplitude anisotropy, defined as (Tmax − Tmin)/(Tmax + Tmin), where Tmax and Tmin are the maximum and minimum intensity transmittances for respectively two orthogonal linear polarization states or two orthogonal circular polarization states. Diattenuation is equal to 1 for a perfect polarizer (Tmin = 0) and to 0 without anisotropy effects in amplitude. Azimuths αR and αD are measured from −90° to 90°. Finally, depolarization parameter Δ is equal to 0 for a non-depolarizing specimen and to 1 for a total depolarizer. Steps of post-processing are described as follows:

1. 1.

Fourier Transform of the channelled spectra leads to 12 peaks whose complex values are expressed as linear combinations of Mueller components, plus a peak at zero frequency, so 25 real values to determine the 16 Mueller components.

2. 2.

Matrix inversion to solve the system of linear equations permits to obtain the Mueller matrix Mx,y at each point on the sample. This matrix inversion depends on the thickness of the chromatically dispersed retarders present in the PSG and PSA blocks that can change by thermal expansion. A protocol detailed in ref.31 and based on two reference linear polarizers inserted on either side of the microscope, is used to calibrate the spectrally encoded Mueller microscope.

3. 3.

Mueller matrix is multiplied by the inverse of the Mueller matrix measured without the specimen in order to correct the polarimetric response of the microscope at each pixel of the sample.

4. 4.

Mueller matrix images are interpreted by applying the polar decomposition proposed by Lu and Chipman24, the last step being the most time-consuming (6 s). Other matrix decompositions54,55 exist which have proved their efficiency for strong depolarized samples characterized in reflection. However, for thin biological specimens imaged in transmission under microscope, scattering is not the main effect – except sample interfaces – and Lu and Chipman decomposition, which is the most widely used, has been chosen for this report.

The precision of the Mueller microscope through the Mueller analysis was evaluated using a spatial homogeneous linear retarder (zero-order half-wave plate at 830 nm) and a linear polarizer (ColorPol VIS-IR polarizer, Codixx) according to the field of view and the objectives used in the manuscript. Mean values and standard deviations (std) are given in the following form: mean value ± (std at the centre of the image, std over the image) after the Lu and Chipman decomposition. The standard deviation at the centre of the image has been calculated with 1000 successive channelled spectra in time, while it has been calculated over the image with 256 × 256 channelled spectra associated to the pixels of the image. The zero-order half-wave plate at 830 nm is a quartz plate whose theoretical retardance is 138.79° at 1060 nm and 139.06° for a broadband source centred at 1060 nm with a 90 nm-bandwidth. Table 1 shows the polarimetric values associated to the half-wave plate at 830 nm according to the objective and the field of view. The mean values of the linear retardance RL are close to the theoretical value (maximum relative error of 0.5%) and vary slightly with the objective certainly due to the collection of light by the condenser lens. The standard deviation of RL is equal to 0.1° at the centre of the image and increases up to 0.3° for a 90 × 90 μm field of view and 1° for a 1.7 × 1.7 mm field of view. Even if the polarimetric response of the microscope is numerically corrected at each point, it is not enough to get rid of it completely, particularly on the edges of the image for large fields of view. Thus retardance resolution can be estimated as being equal to 0.1° at each point but a retardance image must exhibit a contrast greater than 0.3° (or 1°) over the 90 × 90 μm field of view (or 1.7 × 1.7 mm) to be above the background. Moreover, due to the angular distribution of the wave vectors at the sample, the measured depolarization parameter Δ is slightly biased by the NA of the objective from Δ = 0.045 for NA = 0.16 (4X objective) to Δ = 0.078 for NA = 0.75 (20X objective).

Table 2 shows the polarimetric values associated to the linear polarizer (105:1 extinction ratio, ±20° acceptance angle) according to the objective and the field of view. Retardance parameters are not presented in Table 2 because noise propagation through Lu and Chipman decomposition does not permit to calculate them for nearly perfect diattenuators (close to singular matrices). The mean values of the linear diattenuation DL are close to the theoretical value (maximum relative error of 1.1%) with a standard deviation equal to 0.005 at the centre of the image. However the standard deviation increases with the extension of the field of view from 0.005 for 90 × 90 μm image size to 0.013 for 1.7 × 1.7 mm. Lastly NA has an impact on the depolarization parameter Δ (Δ = 0.021 for NA = 0.16 and Δ = 0.048 for NA = 0.75) although the bias is less important due to the high acceptance angle of the linear polarizer used for the assessment of the Mueller microscope.

#### Potato starch granule specimen

Starch granules were isolated from a fresh cut of potato and placed on a microscope coverslip. Images have been produced within a few minutes after the cut.

#### Collagen specimen with acid

Aponeurosis tissue was harvested from the leg muscle of a raw chicken bought in a supermarket, transferred to a glass plate and frozen. The recording of images started one minute after removing from the freezer. Acid used in the paper is 37% hydrochloric acid.

#### Liver fibre specimen

The unstained liver specimen, provided by Bruno Turlin of the Department of Pathology (Pontchaillou hospital, Rennes, France), was obtained from a cohort of large surgical biopsies of human patients with chronic liver fibrosis, as previously described in the work published by one of the co-authors (Y. Le Grand56). The specimen consists in a 50 µm thick acute section from a surgical biopsy that had been embedded in paraffin and mounted between a glass slide and a coverslip. The liver histological status of the specimen was assessed by a trained pathologist using the Fibrosis-Metavir scoring system57 that ranges from F0 (no fibrosis) to F4 (cirrhosis). Briefly, fibrosis is staged on a scale from F0 to F4: F0 = no Fibrosis, F1 = fibrosis without septa, F2 = few septa, F3 = numerous septa without cirrhosis, and F4 = cirrhosis. The fibrosis stage for the specimen used in this paper is F4. Mueller and SHG microscopy was performed without dewaxing or staining the specimen. The cross-polarized image was acquired with a commercial microscope (Zeiss Axioskop 2) equipped with a 2.5X/0.075NA objective lens. All methods and protocols were performed in accordance with guidelines and regulations approved by the Regional University Hospital in Rennes, France. Informed consent was obtained from all patients in the original cohort for liver biopsies.

## Data Availability

The datasets generated and/or analysed in the current paper are available from the corresponding author on reasonable request.

## Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## References

1. 1.

Hartshorne, N. H. & Stuart, A. Crystals and the Polarising Microscope: A Handbook for Chemists and Others. (Edward Arnold Ltd, 1960).

2. 2.

Inoué, S. Collected Works of Shinya Inoué: microscopes, living cells, and dynamic molecules. (World Scientific Publishing Company, 2008).

3. 3.

Menzel, M. et al. Diattenuation of brain tissue and its impact on 3D polarized light imaging. Biomed. Opt. Express. 8, 3163–3197 (2017).

4. 4.

Diaspro, A. & Nicolini, C. A. Circular intensity differential scattering and chromatin-DNA structure. Cell Biophysics 10, 45–60 (1987).

5. 5.

Glazer, A. M., Lewis, J. G. & Kaminsky, W. An automatic optical imaging system for birefringent media. Proc. R. Soc. Lond. A 452, 2751–2765 (1996).

6. 6.

Jan, N.-J. et al. Polarization microscopy for characterizing fiber orientation of ocular tissues. Biomed. Opt. Express 6, 4705–4718 (2015).

7. 7.

Oldenbourg, R. & Mei, G. New polarized light microscope with precision universal compensator. J. Microsc. 180, 140–147 (1995).

8. 8.

Mehta, S. B., Shribak, M. & Oldenbourg, R. Polarized light imaging of birefringence and diattenuation at high resolution and high sensitivity. J. Opt. 15, 094007 (2013).

9. 9.

Hsu, W. L. et al. Polarization microscope using a near infrared full-Stokes imaging polarimeter. Opt. Express 23, 4357–4368 (2015).

10. 10.

Bueno, J. M., Cookson, C. J., Kisilak, M. L. & Campbell, M. C. W. Enhancement of confocal microscopy images using Mueller polarimetry. J. Microsc. 235, 84–93 (2009).

11. 11.

Lara, D. & Dainty, C. Axially resolved complete Mueller matrix confocal microscopy. Appl. Opt. 45, 1917–1930 (2006).

12. 12.

Chung, J., Jung, W., Hammer-Wilson, M. J., Wilder-Smith, P. & Chen, Z. Use of polar decomposition for the diagnosis of oral precancer. Appl. Opt. 46, 3038–3045 (2007).

13. 13.

Ghosh, N. et al. Mueller matrix decomposition for polarized light assessment of biological tissues. J. Biophotonics 2, 145–156 (2009).

14. 14.

Antonelli, M. R. et al. Mueller matrix imaging of human colon tissue for cancer diagnosis: how Monte Carlo modelling can help in the interpretation of experimental data. Opt. Express 18, 10200 (2010).

15. 15.

Dong, Y., He, H., Sheng, W., Wu, J. & Ma, H. A quantitative and non-contact technique to characterise microstructural variations of skin tissues during photo-damaging process based on Mueller matrix polarimetry. Sci. Rep. 7, 14702 (2017).

16. 16.

Kumar, S., Purwar, H., Ossikovski, R., Vitkin, I. A. & Ghosh, N. Comparative study of differential matrix and extended polar decomposition formalisms for polarimetric characterization of complex tissue-like turbid media. J. Biomed. Opt. 17, 105006 (2012).

17. 17.

Vizet, J. et al. In vivo imaging of uterine cervix with a Mueller polarimetric colposcope. Sci. Rep. 7, 2471 (2017).

18. 18.

Arteaga, O. et al. Mueller matrix microscope with a dual continuous rotating compensator setup and digital demodulation. Appl. Opt. 53, 2236–2244 (2014).

19. 19.

Laude-Boulesteix, B., De Martino, A., Drévillon, B. & Schwartz, L. Mueller polarimetric imaging system with liquid crystals. Appl. Opt. 43, 2824–2831 (2004).

20. 20.

Bernabeu, E. & Gil, J. J. An experimental device for the dynamic determination of Mueller matrices. J. Opt. 16, 139–141 (1985).

21. 21.

Artega, O., Freudenthal, J., Wang, B. & Kahr, B. Mueller matrix polarimetry with four photoelastic modulators: theory and calibration. Appl. Opt. 51, 6805–6817 (2012).

22. 22.

De Martino, A., Kim, Y. K., Garcia-Caurel, E., Laude, B. & Drévillon, B. Optimized Mueller polarimeter with liquid crystals. Opt. Lett. 28, 616–618 (2003).

23. 23.

Azzam, R. M. A. Division-of-amplitude photopolarimeter (DOAP) for the simultaneous measurement of all four Stokes parameters of light. Opt. Acta 29, 685–689 (1982).

24. 24.

Lu, S. Y. & Chipman, R. A. Interpretation of Mueller matrices based on polar decomposition. J. Opt. Soc. Am. A 13, 1106–1113 (1996).

25. 25.

Ossikovski, R., De Martino, A. & Guyot, S. Forward and reverse product decompositions of depolarizing Mueller matrices. Opt. Lett. 32, 689 (2007).

26. 26.

Gil, J. J. & Bernabeu, E. A depolarization criterion in Mueller matrices. Opt. Acta 32, 259–261 (1986).

27. 27.

Dubreuil, M. et al. Mueller matrix polarimetry for improved liver fibrosis diagnosis. Opt. Lett. 37, 1061–1063 (2012).

28. 28.

Wang, Y. et al. Mueller matrix microscope: a quantitative tool to facilitate detections and fibrosis scorings of liver cirrhosis and cancer tissues. J. Biomed. Opt. 21, 071112 (2016).

29. 29.

Arteaga, O. et al. Mueller matrix microscopy on a Morpho butterfly. J. Phys.: Conf. Ser. 605, 012008 (2015).

30. 30.

Dörling, B. et al. Controlled Pinning of Conjugated Polymer Spherulites and Its Application in Detectors. Adv. Optical Mater., 1700276 (2017).

31. 31.

Le Gratiet, A., Dubreuil, M., Rivet, S. & Le Grand, Y. Scanning Mueller polarimetric microscopy. Opt. Lett. 41, 4336–4339 (2016).

32. 32.

Dubreuil, M., Rivet, S., Le Jeune, B. & Cariou, J. Snapshot Mueller matrix polarimeter by wavelength polarization coding. Opt. Express 15, 13660–13668 (2007).

33. 33.

Dubreuil, M., Rivet, S., Le Jeune, B. & Cariou, J. Systematic errors specific to a snapshot Mueller matrix polarimeter. Appl. Opt. 48, 1135–1142 (2009).

34. 34.

Le Gratiet, A., Rivet, S., Dubreuil, M. & Le Grand, Y. 100kHz-Mueller polarimeter in reflection configuration. Opt. Lett. 40, 645–648 (2015).

35. 35.

Rivet, S. et al. Complex master slave interferometry. Opt. Express 7, 2885–2904 (2016).

36. 36.

Bradu, A., Rivet, S. & Podoleanu, A. Master-slave interferometry- ideal tool for coherence revival swept source OCT. Biomed. Opt. Express 7, 2453–2468 (2016).

37. 37.

Whistler, R. L., Bemiller, J. N. & Parschall, E. F. Starch: Chemistry and Technology. 183–247 (Academic Press, 1984).

38. 38.

Azizi, E. & Roberts, T. J. Biaxial strain and variable stiffness in aponeuroses. J. Physiol. 587, 4309–4318 (2009).

39. 39.

Bataller, R. & Brenner, D. A. Liver fibrosis. J Clin Invest 115, 209–218 (2005).

40. 40.

Modis, L. Organization of the Extracellular Matrix: A Polarisation Microscopic Approach. Boca Raton: CRC Press (1991).

41. 41.

Gaihouste, L. et al. Fibrillar collagen scoring by second harmonic microscopy: A new tool in the assessment of liver fibrosis. J. Hepatology 52, 398 (2010).

42. 42.

Xu, S. et al. qFibrosis: A fully-quantitative innovative method incorporating histological features to facilitate accurate fibrosis scoring in animal model and chronic hepatitis B patients. Journal of Hepatology 61, 260–269 (2014).

43. 43.

Samim, M., Krouglov, S. & Barzda, V. Nonlinear Stokes-Mueller polarimetry. Phys. Rev. A 93, 013847 (2016).

44. 44.

Okoro, C. & Toussaint, K. C. Experimental demonstration of two-photon Mueller matrix second harmonic generation microsocopy. J. Biomed. Opt. 21, 016011 (2016).

45. 45.

Okoro, C. & Toussain, K. C. Second-harmonic patterned polarization-analyzed reflection confocal microsocopy. J. Biomed. Opt. 22, 086007 (2017).

46. 46.

Fujimoto, J. Optical coherence tomography for ultrahigh resolution in vivo imaging. Nat. Biotechnol. 21, 1361–1367 (2003).

47. 47.

Potsaid, B. et al. MEMS tunable VCSEL light source for ultrahigh speed 60kHz - 1MHz axial scan rate and long range centimeter class OCT imaging. Proc. SPIE 8213, Optical Coherence Tomography and Coherence Domain Optical Methods in Biomedicine XVI, 82130M (SPIE, 2012).

48. 48.

Karpf, S. & Jalali, B. Frequency Doubled High Speed Fluorescence Lifetime Imaging. Conference on Lasers and Electro-Optics, STh3J.3 (Optical Society of America, 2018).

49. 49.

Török, P., Higdon, P. D. & Wilson, T. On the general properties of polarised light conventional and confocal microscopes. Optics Comm. 148, 300–315 (1998).

50. 50.

Bancelin, S. et al. Determination of collagen fiber orientation in histological slides using Mueller microscopy and validation by second harmonic generation imaging. Opt. Express 22, 22561–22574 (2014).

51. 51.

Ellingsen, P. G., Lilledahl, M. B., Aas, L. M. S. & Davies, C. L. Quantitative characterization of articular cartilage using Mueller matrix imaging and multiphoton microscopy. J. Biomed. Opt. 16, 116002 (2011).

52. 52.

Sabatke, D. et al. Optimization of retardance for a complete Stokes polarimeter. Opt. Lett. 25, 802–804 (2000).

53. 53.

Lemaillet, P., Rivet, S. & Le Jeune, B. Optimization of a snapshot Mueller matrix polarimeter. Opt. Lett. 33, 144–146 (2008).

54. 54.

Ossikovski, R. Analysis of depolarization Mueller matrices through a symmetric decomposition. J. Opt. Soc. Am. A 26, 11096–1118 (2009).

55. 55.

Ossikovski, R. Differential matrix formalism for depolarizing anisotropic media. Opt. Lett. 36, 2330–2332 (2011).

56. 56.

Guilbert, T. et al. A robust collagen scoring method for human liver fibrosis by second harmonic Microscopy. Opt. Express 18, 25794–25807 (2010).

57. 57.

The French METAVIR Cooperative Study Group. Intraobserver, interobservervariations in liver biopsy interpretation in patients with chronic hepatitis C. Hepatology 20, 15–20 (1999).

Download references

## Acknowledgements

This work was supported by the CPER (Contrat de Plan État-Région) SOPHIE Photonic project of Région Bretagne, France. A.B. acknowledges the Engineering and Physical Sciences Research Council (EPSRC) (grant REBOT EP/N019229/1) as well as Université de Bretagne Occidentale for the visiting grant. The authors thank Gael Leroux for technical assistance and Bruno Turlin of the Department of Pathology (Pontchaillou hospital, Rennes, France) for the liver fibre specimen.

## Author information

### Author notes

1. Sylvain Rivet and Matthieu Dubreuil contributed equally.

### Affiliations

1. #### Laboratoire d’Optique et de Magnétisme, Université de Bretagne Occidentale, IBSAM, 6 avenue Le Gorgeu, 29238, Brest, France

• Sylvain Rivet
• , Matthieu Dubreuil
•  & Yann Le Grand
2. #### Applied Optics Group, School of Physical Sciences, University of Kent, Canterbury, CT2 7NH, UK

• Adrian Bradu

### Contributions

S.R. and M.D. conceived the experiments, wrote the paper and conducted the experiments. A.B. and Y.L.G. contributed to useful discussions, manuscript preparation and revision. All the authors analysed the results, reviewed and approved the manuscript.

### Competing Interests

The authors declare no competing interests.

### Corresponding author

Correspondence to Sylvain Rivet.

## About this article

### DOI

https://doi.org/10.1038/s41598-019-40467-z

## Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.