The coherent interaction between an electromagnetic field and a 3D weakly scattering medium results in a simple Fourier transform relationship between the object’s structure and the complex scattered field1. As a result, knowledge about the phase of the scattered field is necessary for solving this inverse problem with a unique solution. However, in applications, such as X-ray crystallography, typically one only has experimental access to the amplitude of the diffracted field, which results in ambiguities of the reconstruction. This century-old challenge, known as “the phase problem”2 motivated the development of computational algorithms combined with a priori knowledge about the object of interest to limit the solution space. While generally successful, this approach sometimes led to multiple solutions, i.e., different inferred object structures for the same set of data: “Not all the guesses have been successful. This is clear, for example, from the following: Two different structures were predicted for the mineral bixbyite, one by L. Pauling, the other by W. H. Zachariasen. It is not known which, if either, is correct.” (Chapter 7 in ref. 2).
In the optical regime, due to the luxury of available coherent sources, virtually perfect lenses, and high-resolution detectors, extracting the phase of the scattered field from intensity measurements has been a solved problem for many decades, using off-axis3 or phase-shifting interferometry4. In recent years, quantitative phase maps associated with transparent biospecimens have found multiple biomedical applications5, in a rising field known as quantitative phase imaging (QPI)6. Traditional interferometric systems (e.g., Michaelson, Mach-Zehnder) are typically associated with experimental complexity, temporal noise due to temporal instability, and spatial noise due to laser speckles. However, recent interests in QPI have triggered the development of stable, speckle-free methods that can be used for routine biological investigations7.
Despite these experimental advances in phase retrieval, computational algorithms have continued to develop even for optical domain applications, mainly to afford simple imaging systems and take advantage of the computational power that is now readily available. Of course, this simpler optical approach brings back the convergence problems associated with all computational phase retrieval methods8. The study by Chang et al. 9 tackles this challenge and provides a solution for high space-bandwidth phase retrieval using deep learning. The authors demonstrated that their technique holds some advantages over existing alternatives: “Extensive simulations and experiments validate that the technique outperforms the existing PR algorithms with as much as 17 dB enhancement on signal-to-noise ratio, and more than one order-of-magnitude increased running efficiency.” At the same time, they acknowledge remaining convergence issues that grant further investigation: “The PNP (plug-and-play) framework has a theoretical guarantee of convergence for most real-domain tasks, such as denoising, deblurring, etc. However, to the best of our knowledge, there is no theoretical proof of PNP’s convergence in the complex domain. Further, there is also no theoretical guarantee of convergence for the alternating projection solver that has been widely used for ~50 years.” The authors’ correct assertion is not a shortcoming of their computational algorithm, but rather, it is rooted in the physics of image formation. The intensity detected in Gabor’s in-line holography (Chang et al. 9), or any other interferometry experiments for that matter, simply contains too many unknowns in a single measurement of intensity I, namely
where A1,2 are the unknown amplitudes and ϕ1,2 are the unknown phases of the two interfering fields. Thus, without prior knowledge about the object, a single intensity measurement is simply insufficient for extracting the phase difference ϕ2-ϕ1 of interest.
It is likely that such fast deep learning-enabled algorithms, like the ones presented by Chang et al. 9, will be valuable in combination with optical experiments that can solve the convergence problem. At the same time, today there is an enormous opportunity in the biophotonics field for boosting the resolution10 and chemical specificity11 of optical systems, as well as extracting accurate medical information from optical imaging data12,13,14.
References
Wolf, E. Three-dimensional structure determination of semi-transparent objects from holographic data. Opt. Commun. 1, 153 (1969).
Wolf, E. In Advances in Imaging and Electron Physics. Vol. 165 (ed. Hawkes, P. W.) Ch. 7 (Academic Press, 2011).
Takeda, M., Ina, H. & Kobayashi, S. Fourier-transform method of fringe-pattern analysis for computer-based topography and interferometry. JOSA 72, 156–160 (1982).
Creath, K. Phase-measurement interferometry techniques. Prog. Opt. 26, 349–393 (1988).
Park, Y., Depeursinge, C. & Popescu, G. Quantitative phase imaging in biomedicine. Nat. Photonics 12, 578, https://doi.org/10.1038/s41566-018-0253-x (2018).
Popescu, G. Quantitative Phase Imaging of Cells and Tissues (McGraw-Hill, 2011).
Chen, X., Kandel, M. E. & Popescu, G. Spatial light interference microscopy: principle and applications to biomedicine. Adv. Opt. Photonics 13, 353–425 (2021).
Bian, L. et al. Fourier ptychographic reconstruction using Poisson maximum likelihood and truncated Wirtinger gradient. Sci. Rep. 6, 1–10 (2016).
Chang, X., Bian, L. & Zhang, J. Large-scale phase retrieval. eLight 1, 4, https://doi.org/10.1186/s43593-021-00004-w (2021).
Wang, H. et al. Deep learning enables cross-modality super-resolution in fluorescence microscopy. Nat. Methods 16, 103–110 (2019).
Kandel, M. E. et al. Phase imaging with computational specificity (PICS) for measuring dry mass changes in sub-cellular compartments. Nat. Commun. 11, 6256, https://doi.org/10.1038/s41467-020-20062-x (2020).
Rivenson, Y. et al. Virtual histological staining of unlabelled tissue-autofluorescence images via deep learning. Nat. Biomed. Eng. 3, 466–477, https://doi.org/10.1038/s41551-019-0362-y (2019).
Nygate, Y. N. et al. Holographic virtual staining of individual biological cells. Proc. Natl Acad. Sci. 117, 9223–9231, https://doi.org/10.1073/pnas.1919569117 (2020).
Kandel, M. E. et al. Reproductive outcomes predicted by phase imaging with computational specificity of spermatozoon ultrastructure. Proc. Natl Acad. Sci. 117, 18302–18309, https://doi.org/10.1073/pnas.2001754117 (2020).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The author declares no competing interests.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Popescu, G. Large-scale phase retrieval. Light Sci Appl 10, 175 (2021). https://doi.org/10.1038/s41377-021-00616-4
Published:
DOI: https://doi.org/10.1038/s41377-021-00616-4
This article is cited by
-
High-resolution single-photon imaging with physics-informed deep learning
Nature Communications (2023)