Abstract
Both high resolution and high precision are required to quantitatively determine the atomic structure of complex nanostructured materials. However, for conventional imaging methods in scanning transmission electron microscopy (STEM), atomic resolution with picometer precision cannot usually be achieved for weaklyscattering samples or radiationsensitive materials, such as 2D materials. Here, we demonstrate lowdose, subangstrom resolution imaging with picometer precision using mixedstate electron ptychography. We show that correctly accounting for the partial coherence of the electron beam is a prerequisite for highquality structural reconstructions due to the intrinsic partial coherence of the electron beam. The mixedstate reconstruction gains importance especially when simultaneously pursuing high resolution, high precision and large fieldofview imaging. Compared with conventional atomicresolution STEM imaging techniques, the mixedstate ptychographic approach simultaneously provides a fourtimesfaster acquisition, with double the information limit at the same dose, or up to a fiftyfold reduction in dose at the same resolution.
Similar content being viewed by others
Introduction
Determining the local atomic arrangement of complex nanostructures can provide fundamental insights into the properties of materials^{1,2}. Compared to traditional metals and semiconductors, newer materials systems as metalorganic frameworks and organic perovskites are more radiation sensitive^{3,4,5}, requiring more doseefficient imaging techniques in order to allow highresolution imaging with comparable level of detail. Solving the structure of biological macromolecules or small molecular at atomic level is even more challenging^{6}. The main problem is that, as a consequence of Poisson statistics, the required illumination dose is inversely proportional to the square of the spatial resolution^{7}, and thus improving spatial resolution means quadratically higher doses. The increased dose may destroy the structure of the sample before sufficient image signaltonoise is reached. The widely adopted atomicresolution imaging methods in scanning transmission electron microscopy (STEM), such as annular darkfield (ADF) or coherent brightfield (cBF) imaging, are intrinsically dose inefficient as they use only a small fraction of the scattered electrons, being constructed via a simple integration of a limited portion of phase space. Therefore, conventional STEM imaging methods usually cannot achieve subangstrom resolution or even atomicresolution for electron radiationsensitive materials^{8}. Meanwhile, highprecision measurement of local atomic positions is also fundamentally hindered by the poor signaltonoise ratio of ADF images from electronradiation sensitive or weakly scattering samples, such as monolayer 2D materials. Picometer precision via ADF imaging can only be achieved in electronradiationrobust and strongly scattering bulk samples^{9,10,11}.
Electron ptychography, however, can potentially use the entire diffraction patterns either via a Wignerdistribution deconvolution (WDD)^{12,13} or iterative algorithms^{14,15} in a way that can account for the probe damping effect and extract the electrostatic potential of the sample. Electron ptychography has been demonstrated as a promising phasecontrast imaging technique with advantages such as high dose efficiency^{13,16}, high resolution^{5,17,18}, and high contrast^{5,13}. In particular, ptychography has now surpassed the resolution of best physical lenses, reaching deep subangstrom resolution^{5}. Simulations have suggested the possibility of extremely lowdose imaging by electron ptychography, in principle beyond that of all other electron imaging approaches to date including highresolution TEM imaging widely used in CryoEM community—a potential outcome of considerable importance for the study of electron radiationsensitive materials including biological macromolecules.
Imperfections of the STEM imaging system especially the partial coherence of the illumination probe reduces the image resolution and contrast of conventional STEM imaging methods^{19}. Partial coherence also limits the performance of ptychography, although in a more indirect manner, impacting the signaltonoise ratio of the reconstruction^{5,20}. WDDbased electron ptychographic phasecontrast imaging has been demonstrated to outperform the commonly adopted phasecontrast conventional highresolution TEM imaging by retaining resolution beyond the temporal incoherent limit^{16,20}. However, the partial coherence in the probe can be modeled more explicitly in iterative ptychography algorithms by decomposing the probe wavefunction into a linear combination of pure states, i.e., a mixed quantum state^{21}. As first demonstrated in coherent diffractive imaging^{22} and Xray ptychography^{23}, partial coherence of the probe can be well accounted for by introducing such state mixtures into the reconstruction method^{21,24,25}. High coherent fieldemission guns are widely used as the electron sources in modern electron microscopes and so electron ptychography usually assumes only a pure coherent state of the illumination probe^{5,26,27}. This assumption is often sufficient when an infocusillumination probe is adopted^{5,27} or when a nanometer spatial resolution is targeted^{26}. The effects of incoherence, which are inevitably present in electron ptychography, on the reconstruction quality remains underexplored. There are only a few proofofprinciple demonstrations of electron ptychography considering the partial coherence via approaches either Gaussian blind deconvolution^{18} or modal decomposition^{28,29}, and while these suggest the promise of the approach, to date no subangstrom resolution reconstructions have been achieved, even on instruments capable of subangstrom resolution in conventional imaging modes.
Here, we demonstrate the capability of fast, subangstrom resolution and picometerprecision imaging with a large fieldofview (FOV) by mixedstate electron ptychography. We find that a complete description of the partial coherence of the electron wavefunction using a mixed quantum state is required to accomplish reconstructions with a subangstrom resolution, high contrast, high precision and a large FOV via defocused probe electron ptychography. We also demonstrate lowdose atomicresolution ptychographic imaging using dose levels up to 50 times lower than conventional STEM imaging techniques.
Results
Experimental setup of electron ptychography
Figure 1a shows a schematic workflow of the defocused electron ptychography. Instead of focusing the electron probe on the sample, the focal plane is set to a distance away from the sample. Because the illumination area is broadened, a larger scan step can be used given that there are sufficient overlaps between adjacent scan positions required by ptychographic reconstruction algorithms. The sample was raster scanned along two perpendicular directions as indicated in Fig. 1b. A highdynamicrange electron microscope pixelarray detector (EMPAD)^{30} used for diffraction pattern acquisition enables capture of both the shadow image^{31} in the center disk formed by the large defocused probe and the muchweaker high scatteringangle darkfield signal, as illustrated by three simulated diffraction patterns in Fig. 1c. Similar setups with a defocused probe have been adopted previously^{17,18,26}, which has shown benefits for overcoming the slow readout speed of conventional CCD cameras and limited stability of the imaging systems. However, usually only a few dozen diffraction patterns were acquired, whereas fast pixelarray detectors like the EMPAD^{30} enables the acquisition of more than 50,000 diffraction patterns per minute.
Conventional iterative ptychographic algorithms^{14,15} assume a coherent illumination. The diffraction pattern is considered as the square of the amplitude of a single probe state multiplied by a sample transmission function within the multiplicative approximation (an extension of the strong phase approximation, allowing for both phase and amplitude variations)^{12}. However, due to experimentally unavoidable partial coherence of the imaging system, single purestate coherent probe illumination is never achieved in real experiments. To account for the partial coherence, the illumination is represented by several mutually incoherent probe modes instead of using only a single coherent probe mode^{21}. Each mode is then propagated independently to the detector as the measured diffraction is an incoherent superposition of the contributions from all probe modes^{21,28,32}. For practical implementations, we chose the modal decomposition approach^{21,28} and the probe is expanded into several eigenmodes of the density matrix formed by a mixed state. The total intensity of all eigenmodes are normalized to the measured intensity of the diffraction patterns. A flowchart of the algorithms showing the basic principle is given in Supplementary Fig. 1. Details of the reconstruction algorithms are summarized in the Methods section.
Mixedstate ptychographic imaging to subangstrom resolution
We performed a scanning diffraction experiment on a sample of a monolayer WS_{2} with bilayer islands of WS_{2}/MoSe_{2}. The MoSe_{2} and WS_{2} layers have the same crystalline orientation, which is verified by the diffractogram of the ADF image, as shown in Supplementary Fig. 2. Owing to the 4% lattice mismatch between WS_{2} and MoSe_{2}, the bilayer regions have a complex projected atomic structure with a continuous transition from a full MoSe (or W–S) bond length to intermediate misaligned projected distances (a structural model is given in Supplementary Fig. 2c). The resulting Moiré pattern serves as a good resolution test for our method.
Figure 2a shows a mixedstate ptychographic reconstruction of a dataset with an FOV of 30 × 30 nm^{2} corresponding to 1500 × 1500 pixels. The selected sample region contains various structural features, such as a monolayer of WS_{2} and both wellaligned and misaligned stacking bilayer MoSe_{2}/WS_{2} regions. An enlarged view of the bilayer region shown in Fig. 2b from the position marked on Fig. 2a shows the sliding structure of bilayer WS_{2}/MoSe_{2}. The Moirélike pattern changes continuously from hexagonal rings in wellaligned stacking regions to stripe features in the misaligned regions (see the structural model in Supplementary Fig. 2c). Unambiguous subÅngstrom resolution can be illustrated in both Fourier space and real space. First, the isotropic information limit shown in the diffractogram of the reconstruction in Fig. 2d better than 1.4 Å^{−1} and the diffraction spots circled on Fig. 2d correspond to a realspace distance of 0.69 Å. Second, the line profiles in Fig. 2e from atomic pairs marked on Fig. 2b demonstrate realspace peak separations down to 0.6 Å. In addition, the Fourier ring correlation (FRC) analysis^{33}, widely adopted for resolution estimation in cryoelectron microscopy and Xray ptychography, also demonstrates spatial resolution down to 0.66 Å. This is shown in Supplementary Fig. 3, which is very close to the 0.69 Å resolution determined from the diffractogram in Fig. 2d. Figure 2c shows a conventional ADF image acquired with the same aperture size and a similar dose using an infocused probe, limiting the resolution to worse than 1 Å. Compared with the ADF image in Fig. 2c, the ptychographic reconstruction in Fig. 2b demonstrates a significant and simultaneous improvement in contrast, signaltonoise, and resolution.
What is more important is that the large FOV and subangstrom resolution ptychographic reconstruction are both achieved using a lowdose illumination. Typical doses used for atomicresolution (1.5–2 Å) STEM ADF images of monolayer transitionmetal dichalcogenides at 80 keV are ~10^{5} e Å^{−2} ^{34,35}. The dose for the dataset used in Fig. 2a is 1.6 × 10^{4} e Å^{−2}. The ptychographic reconstruction has a 0.69 Å Abbe resolution, which doubles the resolution of ADF images achievable from the same imaging condition, ~1.37 Å (e.g., in Fig. 3). Furthermore, subangstrom resolution was reached for a dataset with doses down to 4.0 × 10^{3} e Å^{−2} (e.g., in Supplementary Fig. 4)—50 times lower than the dose for ADF images for the same resolution, with lower dose lattice images discussed below.
In addition, ptychography with a large defocused probe allows us to use a large scan step size of about 30% of the probe diameter^{15,36}, because the realspace pixel size of ptychographic reconstruction is determined by the maximum scattering angle of the diffraction pattern instead of scan step size in the conventional STEM ADF or BF images. This decouples the scan step size from the realspace sampling required by Nyquist–Shannon sampling theorem^{37} for a certain resolution. This option enables a fast acquisition despite the framerate of current 2D array detectors being usually two to three orders slower than the acquisition rate of point detectors^{30,38,39}. The dataset used for the ptychographic reconstruction shown in Supplementary Fig. 4a contains 64 × 64 diffraction patterns and the total acquisition time was 7.6 s. Assuming the same FOV and the typical acquisition conditions for ADF imaging—a step size of 0.2 Å with 1500 × 1500 pixels, a beam current of 10–40 pA, which requires 64–16 μs per pixel dwell time to achieve 10^{5} e Å^{−2} dose^{34,35}—the total acquisition time would be 144–36 s. Therefore, the highquality ptychographic reconstruction with the same FOV is more than four times faster in acquisition while still using one order of magnitude lower dose compared with conventional ADF imaging.
Further tests of the practical experimental conditions show that much relaxed realspace overlap constraints, defined as (1 − r/D)^{36}, where r is the scan step size and D is the diameter of probe, is required by mixedstate ptychography. As shown in Supplementary Fig. 5, mixedstate ptychography with only two probe modes provides a stable highquality reconstruction for a much larger scan step size up to 5.08 Å, corresponding to only 72% probe overlap, whereas artifact free reconstruction by singlestate ptychography can only be achieved with a very small step size, 0.85 Å, corresponding to a 95% probe overlap. For larger scan step sizes, shown in Supplementary Fig. 5b, c, the singlestate reconstructions fail to converge to the correct structure and generate artificial periodicities of the sample. At large step sizes, the errors in modeling of the probe partial coherence by the singlestate reconstruction accumulate, leading to a solution that is not able to describe the measured data well and therefore, in combination with the weaker constrains due to larger scanning step, it leads to nonphysical reconstructions. Even in the case of a large probe overlap where the singlestate reconstruction works, 95%, the mixedstate reconstruction has about two times better resolution and enhanced contrast than that from the singlestate (Supplementary Fig. 5). We also find that four eigenmodes are sufficient to capture the incoherence properties of our probe, and additional modes do not lead to improvement of the reconstruction quality. A comparison of reconstructions with different numbers of modes is presented in Supplementary Fig. 6. Therefore, under practical conditions of partially coherent illumination, mixedstate ptychography significantly relaxes the requirement of the realspace constraint, i.e., scan step, and makes large FOV atomicresolution imaging feasible.
Lowdose atomicresolution imaging
Lowdose electron ptychography was first suggested via the Wignerdistribution deconvolution (WDD) approach^{13}, but only 10^{4} e Å^{−2} or higher dose for atomicresolution imaging has been realized experimentally by this approach^{16}. In principle, the lowdose performance should be comparable for WDD and iterative ptychography algorithms^{5}, but the high sampling density required and currently slow detector readouts make working at low dose more challenging for WDD^{40}. For iterative electron ptychography, the doselimit has been explored previously via simulations^{5,18,41,42} and some experimental attempts^{40}. Simulations usually show one to two orders lower dose than what has been realized by experiments^{5}. This discrepancy may be caused by experimental limitations, such as sample stability, limited beam stability, and partial coherence, which were neglected in simulations. Recent work using a highly coherent defocused probe and singlestate electron ptychography has demonstrated a lattice resolution image from a monolayer MoS_{2} using lowdose illumination^{40}. However, only resolution worse than 1 Å was achieved and partial coherence of the illumination was not considered in the ptychographic reconstruction. To explore the impact of partial coherence on the practical limit of the lowdose imaging, we show the dose dependence of ptychographic reconstructions using experimental datasets and find benefits for both resolution and required dose after accounting for partial coherence.
Figure 4 shows a series of reconstructions using datasets acquired from monolayer WS_{2} by varying the illumination dose via changing the beam current. For a dose higher than 3300 e Å^{−2} (Fig. 4a, b), both the W and S sublattice can be resolved unambiguously and the isotropic information transfer is higher than 1.1 Å^{−1}, corresponding to a realspace resolution better than 0.9 Å as shown in Fig. 4f, g. For doses of 1500 and 790 e Å^{−2} shown in Fig. 4c, d, the reconstruction quality is slightly reduced but both sublattices are still resolvable and the information transfer is higher than 0.73 Å^{−1}, corresponding to a realspace resolution of 1.37 Å. Even for a dose of 375 e Å^{−2}, shown in Fig. 4e, the lattice can still be recognized, and the information transfer is up to ~0.63 Å^{−1}, corresponding to a realspace resolution of 1.59 Å. As mentioned above, the dose commonly used for atomicresolution (~1.5–2.0 Å) ADF images is about 10^{5} e Å^{−2} ^{34,35}. Therefore, the minimum dose in the ptychographic reconstruction with atomicresolution demonstrated here is more than two orders smaller.
We also compared the reconstructions from mixedstate and singlestate ptychography in the lowdose conditions. As demonstrated in Fig. 4a–e, k–o, both the resolution and contrast of the reconstructions from mixedstate ptychography are enhanced compared with singlestate ptychography using the same dose. The mixedstate ptychographic reconstruction has a better resolution at half the dose than that for singlestate reconstruction; see for example, Figs. 4m and 4d. Similarly, the mixedstate reconstructions in Fig. 4 show better quality and higher information limit compared with singlestate reconstructions at similar doses reported recently^{40}. A summary of the doseresolution dependence including the results in Fig. 4 and previous reported ptychographic results^{5,40,41} is given in Fig. 3. Some general trends and scaling behaviors can be noted, even though the samples and experimental conditions for all the data are not identical, which may slightly affect the absolute resolution value at a certain dose. In the low doselimit where performance is limited by counting statistics, the resolution is wellaligned along a family of doselimit lines, \(k/\sqrt N\). N is the dose, and k is a constant that depends on the imaging method and the scattering power of the diagnosed samples^{43}. Compared with conventional ADF images, for a certain information limit, the dose required for the mixedstate ptychographic reconstructions is 10–50 times lower. At higher doses, the resolution is limited by the largest angle of information transfer. Ptychography is limited by the cutoff angle of the diffraction patterns used in the reconstruction and can demonstrate a much better resolution limit than ADF imaging, which is limited by the probeforming aperture.
The negligible readout noise (1/40 e^{−}) and singleelectron sensitivity of detector used^{30} is critical for approaching the limits of the lowdose ptychographic reconstruction. As shown in Supplementary Fig. 7a–d, a single diffraction pattern with dose smaller than 3300 e Å^{−2} contains only a few electrons per pixel in the center disk and a very large fraction of pixels with fewer than single electron in darkfield region. Despite the very low dose, which provides only ~500 electrons per scan position for a dose of 790 e Å^{−2}, the averaged diffraction patterns shown in Supplementary Fig. 7e–h still retain sharp edges of the diffraction disks. This demonstrates that the interference between different diffraction paths has been well encoded in these sparsesignal diffraction patterns. The lattice fringes in Fig. 4d reveal that the sample phase information contained in the lowdose diffraction patterns have been retrieved via electron ptychography.
Highprecision atomic position measurements
One of the advantages of ptychography is the ability to correct for positioning errors^{44,45,46} by maximization of mutual consistency between the adjacent regions. These methods can serve as an independent estimation of the position measurements, which can in principle correct for sample drifts and improve the precision of atomic position measurement.
We have selected an area of monolayer WS_{2} (4.0 × 5.2 nm^{2}) shown in Fig. 5a. The contrast from light sulfur elements in the ptychographic reconstruction is very strong, because the contrast of the phase image is roughly linearly proportional to Z, the atomic number^{47}, whereas the contrast in ADF is close to a Z^{2} dependence^{8,48}. Therefore, atomic positions of sulfur atoms can be readily obtained with high precision even in the vicinity of heavy W atoms. In conventional ADF images, the sulfur atoms are shadowed by the strong scattering from W atoms, which hinders the estimation of the sulfur positions. The recorded EMPAD dataset shows sample drift during the data acquisition. However, the relative probe position errors can be very well estimated via the gradientbased probe position refinement algorithm^{49}. At first, the global geometry errors, such as scan step size scaling, axis rotation or skewness, are fitted and corrected via an affine transformation between the nominal probe positions and estimated probe positions. Owing to the raster position scanning, a constant velocity drift of the sample will result in a skewness of up to a few degrees for long acquisition datasets. When the geometry model is refined, the residual position errors are estimated. Figure 5b, c shows the residual position errors along the horizontal (fast scan) and vertical (slow scan) direction, respectively. The standard deviation (st.d.) of the residual errors along both directions shown in Fig. 5b, c is ~0.16 Å with a maximum error of ~0.6 Å. The atomic column positions were estimated using a 2D Gaussian function fit of the reconstructed phase. The positions were used to calculate the nearest neighbor W–W and S–S atomic distances. The distributions of the S–S and W–W distances are plotted in Fig. 5d, e. The st.d. of the S–S distance is 5.8 pm and the st.d. of W–W distance is 5.2 pm, which is a precision measurement of the atomic positions as the monolayer WS_{2} region shown in Fig. 5a has negligible structural distortions. The intensity variations in Fig. 5a are from residual polymer residue, and likely degrade the precision of the bondlength measurements. Therefore, the reported precision of the ptychography method should be viewed as an upper bound.
For transitionmetal dichalcogenides imaged by 80 keV electrons, the dose must be kept below ~10^{6} e Å^{−2} to avoid significant structural damage^{50}. An even lower dose beneath 10^{4} e Å^{−2} is required to avoid the formation of sulfur point vacancies or structural alterations around deficient regions^{51}. Therefore, it is important to see the performance of ptychography for estimating atomic positions at low dose. Figure 5f shows the dosedependent precision estimation of W–W and S–S distances. Precisions of about 10 pm for both W–W and S–S distances can still be achieved using doses as low as 10^{4} e Å^{−2}. However, from a conventional ADF image, the precision of W–W atomic distance with a single fast scan (6 μs per pixel chosen to match dose and pixel sampling) is only 13.6 pm as shown in Supplementary Fig. 8, which is about twice as large as that from ptychography with a similar dose. Using a more stable imaging system, multiple scans and drift correction algorithms, precision for both ADF imaging and ptychography can be further improved^{10,11}. As detector speeds increase, the multiple scan strategy becomes more practical for ptychography. Denoising and deconvolution algorithms can also help with peak location^{41,52}. However, sulfur atoms in the ADF image are not visible due to their muchweaker scattering, shown in Supplementary Fig. 8a. Although sulfur atoms can be seen by using a lower collection angle for ADF^{35}, the precision of S atomic positions determined from lowdose ADF image is much worse than that from W. Therefore, the lowdose and high contrast capabilities of ptychography provide a picometerprecision technique for atomic position determination of single atoms including light sulfur atoms in 2D materials.
Discussion
We have demonstrated that mixedstate electron ptychography provides simultaneously improved imaging capabilities, including high resolution, large FOV, low dose, high contrast/signaltonoise ratio, and high precision. A mixedstate model is beneficial for ptychographic reconstructions using the data from current electron microscopes, as it is able to account for many of the different factors that result in decoherencelike effects in measured diffraction patterns^{20,21,42,53}, such as the finite electron source size, chromatic aberration, sample vibration, and fast instabilities of the imageforming system. With further improved coherence of the electron source, such as a cold fieldemission gun, a larger scan step sizes with a reduced overlap ratio could be achieved^{54}. Loss of speckle contrast in diffraction, which has similar effects as partial spatial coherence of the probe, can be introduced due to a finite detector pixel size and limit the largest applicable probe size^{20,55}. Therefore, with further improvement of the source coherence and the area of the detectors, increased scan step sizes can be utilized, which further enlarges the FOV given the same number of scanning positions. Furthermore, requirements of the illumination stability in ptychography can be relaxed by use of multiple scans with shared object information^{56} or other probe relaxation extension^{49,57}. These approaches can largely overcome the longterm stability limitations of the current scanning systems, which makes even micron length scale with subangstrom resolution imaging feasible.
Ptychography requires a forward model for the interaction of the beam with the sample. One limitation of the current mixedstate ptychographic imaging is that it can only be applied in relatively thin samples because it uses a generalized strong phase approximation that neglects the effects of beam propagation. The generalized phase grating approximation for the interaction of the incident probe with a projected object function can be written as, \(\psi _{{\mathrm{exit}}}({\mathbf{r}}_i,{\mathbf{r}}) = \psi _{{\mathrm{in}}}\left( {{\mathbf{r}}  {\mathbf{r}}_i} \right)O\left( {\mathbf{r}} \right)\), where ψ_{exit} (r_{i}, r) is the electron wavefunction passing through the sample, ψ_{in} (r − r_{i}) is the incident electron wavefunction centered at position \({\mathbf{r}}_i\), with \({\mathbf{r}}_i\) and \({\mathbf{r}}\) being 2D coordinates. The complex object function, O (r) is a generalized strong phase object, \(O({\mathbf{r}}) = A\left( {\mathbf{r}} \right){\mathrm{exp}}\left( {i\sigma V\left( {\mathbf{r}} \right)} \right)\), where A (r) is the amplitude, σ is the interaction constant depending on the electron energy and V (r) is the projected electrostatic potential of the sample. The amplitude term is included to allow for a weak absorption effect, e.g., scattering outside the detector and should be close to unity if the sample is thin^{58}. Failures of the model for practical samples might be suspected if the amplitude either deviates by more than 10% from unity or resembles the phase term such that phaseamplitude mixing has likely occurred^{59}.
If the probe shape changes significantly during propagation within the sample, then the probe–sample interaction cannot be well described in a single plane and a full multislice calculation may need to be considered. Both probe freespace propagation and scattering by the sample can change the probe shape. The thickness limit T due to the propagation effect can be expressed as^{60}, \(T = 1.3\lambda /\theta _{{\mathrm{max}}}^2\), where θ_{max} is the maximum scattering angle of the diffraction pattern and \(\lambda\) is the wavelength of electrons. For a typical scattering angle targeting a resolution better than 0.5 Å, \(\theta _{{\mathrm{max}}} = 20\) mrad at 300 keV, the thickness limit is ~6.4 nm, which is within the achievable thickness for many samples. For heavy elements, a single atom can induce a large phase shift and a strong amplitude damping to the electron wavefunction, and the probe shape can be changed significantly by only a few atoms. Therefore, a much more rigorous thickness limit must be adapted for samples containing high atomic number elements^{61}. Recent attempts to solve the multiple scattering problem in thick samples include multislice ptychography^{60,62,63} and scattering matrix phase retrieval^{64}. Although the robustness and convergence must be further improved to achieve practical applications in thick samples^{63,65}, mixedstate ptychography could be extended to include multiple scattering^{49}.
Data processing speed is another limiting factor for applications of ptychography. However, with graphics processing unit (GPU) acceleration, the reconstruction of the large FOV image shown in Fig. 2a only takes less than one hour on a typical GPU card. The processing time largely scales linearly with number of diffraction patterns, therefore, fewer patterns with the defocused probe setup can significantly accelerate the reconstruction.
The flexibility and robustness of mixedstate electron ptychography enable many potential applications. Large FOV high resolution imaging is critical for uncovering both the overall morphology and the local atomic arrangement in complex nanostructures^{66}. High contrast and high precision coupled with lowdose imaging can be used to measure the atomic scale dynamics of light elements, such as Li, O, or S in lithium battery materials. Fast singlepass acquisition with scan drift correction opens the door to in situ phasecontrast STEM imaging of dynamical processes during heating, cooling, or even chemical reaction. Use of a largeilluminatedarea probe enables a larger scan step size and fewer diffraction patterns for a given FOV, which reduces the computational effort during data reconstruction and analysis and accelerates data processing of ptychographic reconstruction. Rapid data processing is critical for live imaging and 3D structural reconstruction, such as ptychographic tomography^{67,68}. Our demonstration of lowdose imaging at atomicresolution is within the allowable dose for many beamsensitive materials^{69}. Further dose reduction could be potentially realized by improvements of the reconstruction algorithm and experimental setup such as the averaging of multiple images from structurally identical particles that is commonly used in singleparticle CryoEM. The high dose efficiency of mixedstate ptychography may also be helpful for reconstructing biological molecules using cryoelectron microscopy, potentially reducing the number of particles needed in an averaging class to achieve a desired resolution^{41}. With the anticipated next generation pixelarray detectors that will be even larger and faster, the probe size can be further increased and thus a larger scan step size can be chosen, which will further enlarge the FOV and increase the acquisition speed. Furthermore, mixedstate electron ptychography, besides the retrieval of the probe mixture, can also be adapted to retrieve mixed quantum states within a sample^{21,32}, which could expand the reach of quantumstate tomography by using a matter wave.
Methods
Experimental method
The scanning diffraction experiments were carried out using an electron microscope pixelarray detector (EMPAD)^{30} installed on a probe aberration corrected Thermo Scientific™ Titan Themis electron microscope. The EMPAD has 128 × 128 pixels, a readout speed of 0.86 ms per frame, and 1,000,000:1 electron linear response. All the datasets were acquired using a probe at 80 keV beam energy, 21.4 mrad probeforming semiangle, and ~55 nm defocus value. The exposure time was 1 ms per frame. The beam current varied from 0.09 to 14.3 pA via defocusing a monochromator. The coherence of the electron probe increases slightly when the beam current reduces but the change is not significant (<3%) as the beam current used (0.1–14 pA) is always much lower than the coherent current of the source (~50 pA). The large 30 × 30 nm^{2} FOV image in Fig. 2 is reconstructed from a dataset with a scan step size of 2.36 Å containing 128 × 128 diffraction patterns, which were selected in an interval of two from a larger dataset with 256 × 256 diffraction patterns. A reconstruction of a fourtimes downsampled dataset with a 4.72 Å scan step size is shown in Supplementary Fig. 4. The imaged sample contains MoSe_{2} islands on a large area of monolayer WS_{2}. The relative orientation of MoSe_{2} and WS_{2} is identical, as we have verified using the Fourier transform of the ADF image shown in Supplementary Fig. 2.
Mixedstate ptychography
We adapted the generalized maximumlikelihood ptychography method^{49,70} initially developed for Xray ptychography. This method solves the phase retrieval problem by preconditioned gradient descentbased optimization. Optimization of amplitude likelihood function^{49,70} provides more robust convergence than direction optimization of Poisson likelihood. Multiple optimization directions, such as probe and object updates, probe position displacements, or wavefront variation can be carried out jointly in a consistent way. In combination with a neuralnetworksinspired minibatch optimization scheme^{49}, our approach enables a compromise between convergence speed and noise robustness, and thus it significantly improves the usability of ptychography for lowdose imaging.
The mixedstate description is implemented using the modal decomposition approach^{21}. Minor time variations of the illumination probe due to the instability of the electron optics or small sample height variation are accounted for by using an illumination wavefront correction method^{49}, which is a computationally faster and more memoryefficient approximation of the orthogonal probe relaxation (OPR) approach^{57}. The OPR method describes small variations of the illumination probe by a linear decomposition into a set of several orthogonal mutually coherent modes. The workflow of the algorithm is schematically shown in Supplementary Fig. 1 and more details are described as a ptychography toolkit in ref. ^{71}.
We have observed that the reconstruction quality of the mixedstate ptychography algorithm is not sensitive to the initial guess of the illumination probe and the number of the mixed modes for datasets with a sufficient probe overlap, although a good initial guess may accelerate the convergence. On the other hand, the single probe mode ptychography requires a good initial probe guess to provide stable convergence for our experimental datasets. This seems counterintuitive but it is not surprising. Because mixedstate ptychography can account for the nonnegligible partial coherence of the probe and provide a more accurate reciprocal model, whereas singlemode ptychography is not sufficient for modeling the probe incoherence and its convergence can become instable if the initial probe deviates from the real probe significantly.
Fourier ring correlation
For Fourier ring correlation (FRC)^{33,72}, we used two phase images reconstructed from two separate datasets from the same scan region, which serves as two independent measurements. Practically, two datasets were selected from one single dataset in every two diffractions at each dimension but with different starting points. After ptychographic reconstruction, a global linear phase term due to the inherent ambiguities of ptychography^{73} is removed by fitting as a 2D linear function. Two phase images are aligned using the subpixel precision crosscorrelation algorithm^{74}. Before FRC analysis, the edges of the phase images were Apodized to avoid the artifacts introduced from the boundary discontinuities^{33}. The resolution is estimated by using the 1bit threshold^{33}.
Data availability
A small (200 Mb) data subset is available from PARADIM, a National Science Foundation Materials Innovation Platform [https://doi.org/10.34863/G4WA0J57]^{75}. Full datasets are available from the corresponding author (david.a.muller@cornell.edu) on request.
Code availability
The codes developed at Cornell University is published on GitHub, mullergroupcornell [https://github.com/mullergroupcornell]. The ptychography reconstruction toolkit, PtychoShelves developed at Paul Scherrer Institut, Switzerland, is available on the website [https://www.psi.ch/en/sls/csaxs].
References
Huang, P. Y. et al. Grains and grain boundaries in singlelayer graphene atomic patchwork quilts. Nature 469, 389–392 (2011).
Fujita, T. et al. Atomic origins of the high catalytic activity of nanoporous gold. Nat. Mater. 11, 775–780 (2012).
Furukawa, H., Cordova, K. E., O'Keeffe, M. & Yaghi, O. M. The chemistry and applications of metalorganic frameworks. Science 341, 1230444 (2013).
Green, M. A., HoBaillie, A. & Snaith, H. J. The emergence of perovskite solar cells. Nat. Photonics 8, 506–514 (2014).
Jiang, Y. et al. Electron ptychography of 2D materials to deep subångström resolution. Nature 559, 343–349 (2018).
Grigorieff, N. & Harrison, S. C. Nearatomic resolution reconstructions of icosahedral viruses from electron cryomicroscopy. Curr. Opin. Struct. Biol. 21, 265–273 (2011).
Saxberg, B. E. H. & Saxton, W. O. Quantum noise in 2D projections and 3D reconstructions. Ultramicroscopy 6, 85–89 (1981).
Hovden, R. & Muller, D. A. Efficient elastic imaging of single atoms on ultrathin supports in a scanning transmission electron microscope. Ultramicroscopy 123, 59–65 (2012).
Kimoto, K. et al. Local crystal structure analysis with several picometer precision using scanning transmission electron microscopy. Ultramicroscopy 110, 778–782 (2010).
Sang, X. & LeBeau, J. M. Revolving scanning transmission electron microscopy: Correcting sample drift distortion without prior knowledge. Ultramicroscopy 138, 28–35 (2014).
Yankovich, A. B. et al. Picometreprecision analysis of scanning transmission electron microscopy images of platinum nanocatalysts. Nat. Commun. 5, 4155 (2014).
Rodenburg, J. M. & Bates, R. H. T. The theory of superresolution electron microscopy via Wignerdistribution deconvolution. Philos. Trans. R. Soc. A 339, 521–553 (1992).
Yang, H. et al. Simultaneous atomicresolution electron ptychography and Zcontrast imaging of light and heavy elements in complex nanostructures. Nat. Commun. 7, 12532 (2016).
Thibault, P. et al. Highresolution scanning Xray diffraction microscopy. Science 321, 379–382 (2008).
Maiden, A. M. & Rodenburg, J. M. An improved ptychographical phase retrieval algorithm for diffractive imaging. Ultramicroscopy 109, 1256–1262 (2009).
Pennycook, T. J., Martinez, G. T., Nellist, P. D. & Meyer, J. C. High dose efficiency atomic resolution imaging via electron ptychography. Ultramicroscopy 196, 131–135 (2019).
Humphry, M. J., Kraus, B., Hurst, A. C., Maiden, A. M. & Rodenburg, J. M. Ptychographic electron microscopy using highangle darkfield scattering for subnanometre resolution imaging. Nat. Commun. 3, 730 (2012).
Putkunz, C. T. et al. Atomscale ptychographic electron diffractive imaging of boron nitride cones. Phys. Rev. Lett. 108, 073901 (2012).
Dwyer, C., Erni, R. & Etheridge, J. Measurement of effective source distribution and its importance for quantitative interpretation of STEM images. Ultramicroscopy 110, 952–957 (2010).
Nellist, P. D. & Rodenburg, J. M. Beyond the conventional information limit: the relevant coherence function. Ultramicroscopy 54, 61–74 (1994).
Thibault, P. & Menzel, A. Reconstructing state mixtures from diffraction measurements. Nature 494, 68–71 (2013).
Miao, J., Ishikawa, T., Robinson, I. K. & Murnane, M. M. Beyond crystallography: Diffractive imaging using coherent Xray light sources. Science 348, 530–535 (2015).
Pfeiffer, F. Xray ptychography. Nat. Photonics 12, 9–17 (2017).
Whitehead, L. W. et al. Diffractive imaging using partially coherent x rays. Phys. Rev. Lett. 103, 243902 (2009).
Enders, B. et al. Ptychography with broadbandwidth radiation. Appl. Phys. Lett. 104, 171104 (2014).
Hue, F., Rodenburg, J. M., Maiden, A. M., Sweeney, F. & Midgley, P. A. Wavefront phase retrieval in transmission electron microscopy via ptychography. Phys. Rev. B 82, 121415 (2010).
Song, B. et al. Hollow electron ptychographic diffractive imaging. Phys. Rev. Lett. 121, 146101 (2018).
Cao, S., Kok, P., Li, P., Maiden, A. M. & Rodenburg, J. M. Modal decomposition of a propagating matter wave via electron ptychography. Phys. Rev. A 94, 063621 (2016).
Cao, S., Maiden, A. M. & Rodenburg, J. M. Image feature delocalization in defocused probe electron ptychography. Ultramicroscopy 187, 71–83 (2018).
Tate, M. W. et al. High dynamic range pixel array detector for scanning transmission electron microscopy. Microsc. Microanal. 22, 237–249 (2016).
Dowell, W. C. T. Selectedarea diffraction in the shadow electron microscope. Z. Naturforsch. 31a, 1435 (1976).
Batey, D. J., Claus, D. & Rodenburg, J. M. Information multiplexing in ptychography. Ultramicroscopy 138, 13–21 (2014).
van Heel, M. & Schatz, M. Fourier shell correlation threshold criteria. J. Struct. Biol. 151, 250–262 (2005).
Lin, Y.C., Dumcenco, D. O., Huang, Y.S. & Suenaga, K. Atomic mechanism of the semiconductingtometallic phase transition in singlelayered MoS_{2}. Nat. Nano 9, 391–396 (2014).
Azizi, A. et al. Dislocation motion and grain boundary migration in twodimensional tungsten disulphide. Nat. Commun. 5, 4867 (2014).
Bunk, O. et al. Influence of the overlap parameter on the convergence of the ptychographical iterative engine. Ultramicroscopy 108, 481–487 (2008).
Shannon, C. E. A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948).
Ophus, C., Ercius, P., Sarahan, M., Czarnik, C. & Ciston, J. Recording and using 4DSTEM datasets in materials science. Microsc. Microanal. 20, 62–63 (2014).
Mir, J. A. et al. Characterisation of the Medipix3 detector for 60 and 80 keV electrons. Ultramicroscopy 182, 44–53 (2017).
Song, J. et al. Atomic resolution defocused electron ptychography at low dose with a fast, direct electron detector. Sci. Rep. 9, 3919 (2019).
Pelz, P. M., Qiu, W. X., Bucker, R., Kassier, G. & Miller, R. J. D. Lowdose cryo electron ptychography via nonconvex Bayesian optimization. Sci. Rep. 7, 9883 (2017).
Uhlemann, S., Müller, H., Hartel, P., Zach, J. & Haider, M. Thermal magnetic field noise limits resolution in transmission electron microscopy. Phys. Rev. Lett. 111, 046101 (2013).
Henderson, R. The potential and limitations of neutrons, electrons and Xrays for atomic resolution microscopy of unstained biological molecules. Q. Rev. Biophys. 28, 171–193 (1995).
Maiden, A. M., Humphry, M. J., Sarahan, M. C., Kraus, B. & Rodenburg, J. M. An annealing algorithm to correct positioning errors in ptychography. Ultramicroscopy 120, 64–72 (2012).
Beckers, M. et al. Drift correction in ptychographic diffractive imaging. Ultramicroscopy 126, 44–47 (2013).
Zhang, F. et al. Translation position determination in ptychographic coherent diffraction imaging. Opt. Express 21, 13592–13606 (2013).
Cao, M. C. et al. Theory and practice of electron diffraction from single atoms and extended objects using an EMPAD. Microscopy 67, i150–i161 (2018).
Treacy, M. M. J. Z dependence of electron scattering by single atoms into annular darkfield detectors. Microsc. Microanal. 17, 847–858 (2011).
Odstrcil, M., Menzel, A. & GuizarSicairos, M. Iterative leastsquares solver for generalized maximumlikelihood ptychography. Opt. Express 26, 3108–3123 (2018).
Liu, X. et al. Topdown fabrication of subnanometre semiconducting nanoribbons derived from molybdenum disulfide sheets. Nat. Commun. 4, 1776 (2013).
Komsa, H.P., Kurasch, S., Lehtinen, O., Kaiser, U. & Krasheninnikov, A. V. From point to extended defects in twodimensional MoS_{2}: evolution of atomic structure under electron irradiation. Phys. Rev. B 88, 035301 (2013).
Tian, X. et al. Correlating the threedimensional atomic defects and electronic properties of twodimensional transition metal dichalcogenides. Nat. Mater. https://doi.org/10.1038/s4156302006365 (2020).
Clark, J. N., Huang, X., Harder, R. J. & Robinson, I. K. Dynamic imaging using ptychography. Phys. Rev. Lett. 112, 113901 (2014).
Stachnik, K. et al. Influence of finite spatial coherence on ptychographic reconstruction. Appl. Phys. Lett. 107, 011105 (2015).
Edo, T. B. et al. Sampling in xray ptychography. Phys. Rev. A 87, 053850 (2013).
GuizarSicairos, M. et al. Highthroughput ptychography using Eiger: scanning Xray nanoimaging of extended regions. Opt. Express 22, 14859–14870 (2014).
Odstrcil, M. et al. Ptychographic coherent diffractive imaging with orthogonal probe relaxation. Opt. Express 24, 8360–8369 (2016).
Humphreys, C. J. The scattering of fast electrons by crystals. Rep. Prog. Phys. 42, 1825 (1979).
Liu, C., Walther, T. & Rodenburg, J. M. Influence of thick crystal effects on ptychographic image reconstruction with moveable illumination. Ultramicroscopy 109, 1263–1275 (2009).
Tsai, E. H., Usov, I., Diaz, A., Menzel, A. & GuizarSicairos, M. Xray ptychography with extended depth of field. Opt. Express 24, 29089–29108 (2016).
Close, R., Chen, Z., Shibata, N. & Findlay, S. D. Towards quantitative, atomicresolution reconstruction of the electrostatic potential via differential phase contrast using electrons. Ultramicroscopy 159, 124–137 (2015).
Maiden, A. M., Humphry, M. J. & Rodenburg, J. M. Ptychographic transmission microscopy in three dimensions using a multislice approach. J. Opt. Soc. Am. A 29, 1606–1614 (2012).
Jiang, Y. et al. Breaking the Rayleigh limit in thick samples with multislice ptychography. Microsc. Microanal. 24, 192–193 (2018).
Brown, H. G. et al. Structure retrieval at atomic resolution in the presence of multiple scattering of the electron probe. Phys. Rev. Lett. 121, 266102 (2018).
Jiang, Y. Investigation of Advanced Image Reconstruction Algorithms for Electron Microscopy. Ph.D. thesis, Cornell University (2018).
Ly, T. H. et al. Hyperdislocations in van der Waals layered materials. Nano Lett. 16, 7807–7813 (2016).
Dierolf, M. et al. Ptychographic Xray computed tomography at the nanoscale. Nature 467, 436–439 (2010).
Li, P. & Maiden, A. Multislice ptychographic tomography. Sci. Rep. 8, 2049 (2018).
Karuppasamy, M., Karimi Nejadasl, F., Vulovic, M., Koster, A. J. & Ravelli, R. B. Radiation damage in singleparticle cryoelectron microscopy: effects of dose and dose rate. J. Synchrotron Radiat. 18, 398–412 (2011).
Thibault, P. & GuizarSicairos, M. Maximumlikelihood refinement for coherent diffractive imaging. N. J. Phys. 14, 063004 (2012).
Wakonig, K. et al. PtychoShelves, a versatile highlevel framework for highperformance analysis of ptychographic data. J. Appl. Crystallogr. 53, 574–586 (2020).
VilaComamala, J. et al. Characterization of highresolution diffractive Xray optics by ptychographic coherent diffractive imaging. Opt. Express 19, 21333–21344 (2011).
GuizarSicairos, M. et al. Phase tomography from xray coherent diffractive imaging projections. Opt. Express 19, 21345–21357 (2011).
GuizarSicairos, M., Thurman, S. T. & Fienup, J. R. Efficient subpixel image registration algorithms. Opt. Lett. 33, 156–158 (2008).
Chen, Z. et al. Data set: Mixedstate electron ptychography enables subangstrom resolution imaging with picometer precision at low dose. PARADIM, an NSF Materials Innovation Platform, https://doi.org/10.34863/G4WA0J57 (2020).
Acknowledgements
Z.C. and D.A.M. are supported by the PARADIM Materials Innovation Platform program inhouse program by NSF Grant DMR1539918. Y.H. is supported by the NSF MRSEC program (DMR1429155). This work made use of the Cornell Center for Materials Research facility supported by NSF grant DMR1719875. We thank Tsai Esther Hsiao Rho and Manuel GuizarSicairos for useful discussions.
Author information
Authors and Affiliations
Contributions
Experiments and data analysis were performed by Z.C. under the supervision of D.A.M. The main ptychographic algorithms were implemented by M.O. for Xray ptychography with the adaption to electron ptychography by Z.C. and Y.J. Sample preparation was done by Y.H. from thin films synthesized by M.C. and L.J. Z.C. wrote the manuscript with revisions from M.O. and D.A.M. All authors discussed the results and implications throughout the investigation, and all authors have given approval to the final version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
Cornell University has licensed the EMPAD hardware to Thermo Scientific.
Additional information
Peer review information Nature Communications thanks Christian Dwyer, Jianwei Miao and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer review reports are available.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Chen, Z., Odstrcil, M., Jiang, Y. et al. Mixedstate electron ptychography enables subangstrom resolution imaging with picometer precision at low dose. Nat Commun 11, 2994 (2020). https://doi.org/10.1038/s41467020166886
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467020166886
This article is cited by

Exact inversion of partially coherent dynamical electron scattering for picometric structure retrieval
Nature Communications (2024)

Wavelengthmultiplexed multimode EUV reflection ptychography based on automatic differentiation
Light: Science & Applications (2024)

Direct observation of singleatom defects in monolayer twodimensional materials by using electron ptychography at 200 kV acceleration voltage
Scientific Reports (2024)

Cryogenic electron ptychographic single particle analysis with wide bandwidth information transfer
Nature Communications (2023)

Machine learning for automated experimentation in scanning transmission electron microscopy
npj Computational Materials (2023)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.