Abstract
Optical imaging through and inside complex samples is a difficult challenge with important applications in many fields. The fundamental problem is that inhomogeneous samples such as biological tissue randomly scatter and diffuse light, preventing the formation of diffraction-limited images. Despite many recent advances, no current method can perform non-invasive imaging in real-time using diffused light. Here, we show that, owing to the ‘memory-effect’ for speckle correlations, a single high-resolution image of the scattered light, captured with a standard camera, encodes sufficient information to image through visually opaque layers and around corners with diffraction-limited resolution. We experimentally demonstrate single-shot imaging through scattering media and around corners using spatially incoherent light and various samples, from white paint to dynamic biological samples. Our single-shot lensless technique is simple, does not require wavefront-shaping nor time-gated or interferometric detection, and is realized here using a camera-phone. It has the potential to enable imaging in currently inaccessible scenarios.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Goodman, J. W. Speckle Phenomena in Optics: Theory and Applications (Roberts & Co., 2007).
Ntziachristos, V. Going deeper than microscopy: the optical imaging frontier in biology. Nature Methods 7, 603–614 (2010).
Goodman, J. W., Huntley Jr, W. H., Jackson, D. W. & Lehmann, M. Wavefront-reconstruction imaging through random media. Appl. Phys. Lett. 8, 311–313 (1966).
Kogelnik, H. & Pennington, K. S. Holographic imaging through a random medium. J. Opt. Soc. Am. 58, 273–274 (1968).
Tyson, R. K. Principles of Adaptive Optics 3rd edn (Academic, 2010).
Débarre, D. et al. Image-based adaptive optics for two-photon microscopy. Opt. Lett. 34, 2495–2497 (2009).
Mosk, A. P., Lagendijk, A., Lerosey, G. & Fink, M. Controlling waves in space and time for imaging and focusing in complex media. Nature Photon. 6, 283–292 (2012).
Vellekoop, I. M. & Mosk, A. P. Focusing coherent light through opaque strongly scattering media. Opt. Lett. 32, 2309–2311 (2007).
Popoff, S. M. et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. Phys. Rev. Lett. 104, 100601 (2010).
Cizmar, T., Mazilu, M. & Dholakia, K. In situ wavefront correction and its application to micromanipulation. Nature Photon. 4, 388–394 (2010).
Katz, O., Small, E., Bromberg, Y. & Silberberg, Y. Focusing and compression of ultrashort pulses through scattering media. Nature Photon. 5, 372–377 (2011).
Aulbach, J., Gjonaj, B., Johnson, P. M., Mosk, A. P. & Lagendijk, A. Control of light transmission through opaque scattering media in space and time. Phys. Rev. Lett. 106, 103901 (2011).
Popoff, S., Lerosey, G., Fink, M., Boccara, A. C. & Gigan, S. Image transmission through an opaque material. Nature Commun. 1, 81 (2010 10.1038/ncomms1078).
Conkey, D. B., Caravaca-Aguirre, A. M. & Piestun, R. High-speed scattering medium characterization with application to focusing light through turbid media. Opt. Express 20, 1733–1740 (2012).
Vellekoop, I. M. & Aegerter, C. M. Scattered light fluorescence microscopy: imaging through turbid layers. Opt. Lett. 35, 1245–1247 (2010).
Vellekoop, I. M., Lagendijk, A. & Mosk, A. P. Exploiting disorder for perfect focusing. Nature Photon. 4, 320–322 (2010).
Hsieh, C.-L., Pu, Y., Grange, R., Laporte, G. & Psaltis, D. Imaging through turbid layers by scanning the phase conjugated second harmonic radiation from a nanoparticle. Opt. Express 18, 20723–20731 (2010).
Katz, O., Small, E. & Silberberg, Y. Looking around corners and through thin turbid layers in real time with scattered incoherent light. Nature Photon. 6, 549–553 (2012).
He, H., Guan, Y. & Zhou, J. Image restoration through thin turbid layers by correlation with a known object. Opt. Express 21, 12539–12545 (2013).
Xu, X., Liu, H. & Wang, L. V. Time-reversed ultrasonically encoded optical focusing into scattering media. Nature Photon. 5, 154–157 (2011).
Si, K., Fiolka, R. & Cui, M. Fluorescence imaging beyond the ballistic regime by ultrasound-pulse-guided digital phase conjugation. Nature Photon. 6, 657–661 (2012).
Wang, Y. M., Judkewitz, B., DiMarzio, C. A. & Yang, C. Deep-tissue focal fluorescence imaging with digitally time-reversed ultrasound-encoded light. Nature Commun. 3, 928 (2012).
Kong, F. et al. Photoacoustic-guided convergence of light through optically diffusive media. Opt. Lett. 36, 2053–2055 (2011).
Judkewitz, B., Wang, Y. M., Horstmeyer, R., Mathy, A. & Yang, C. Speckle-scale focusing in the diffusive regime with time reversal of variance-encoded light (TROVE). Nature Photon. 7, 300–305 (2013).
Chaigne, T. et al. Controlling light in scattering media non-invasively using the photoacoustic transmission matrix. Nature Photon. 8, 58–64 (2014).
Tang, J., Germain, R. N. & Cui, M. Superpenetration optical microscopy by iterative multiphoton adaptive compensation technique. Proc. Natl Acad. Sci. USA 109, 8434–8439 (2012).
Bertolotti, J. et al. Non-invasive imaging through opaque scattering layers. Nature 491, 232–234 (2012).
Yang, X., Pu, Y. & Psaltis, D. Imaging blood cells through scattering biological tissue using speckle scanning microscopy. Opt. Express 22, 3405–3413 (2014).
Labeyrie, A. Attainment of diffraction limited resolution in large telescopes by Fourier analysing speckle patterns in star images. Astron. Astrophys. 6, 85–87 (1970).
Dainty, J. C. Laser Speckle and Related Phenomena (Springer, 1984).
Ayers, G., Northcott, M. & Dainty, J. Knox–Thompson and triple-correlation imaging through atmospheric turbulence. J. Opt. Soc. Am. A 5, 963–985 (1988).
Freund, I., Rosenbluh, M. & Feng, S. Memory effects in propagation of optical waves through disordered media. Phys. Rev. Lett. 61, 2328–2331 (1988).
Feng, S., Kane, C., Lee, P. A. & Stone, A. D. Correlations and fluctuations of coherent wave transmission through disordered media. Phys. Rev. Lett. 61, 834–837 (1988).
Freund, I. Looking through walls and around corners. Phys. A 168, 49–65 (1990).
Fienup, J. R. Phase retrieval algorithms: a comparison. Appl. Opt. 21, 2758–2769 (1982).
Fienup, C. D. J. in Image Recovery: Theory and Application (ed. Stark, H.) 231–275 (Academic, 1987).
Dowski, J. E. R. & Cathey, W. T. Extended depth of field through wave-front coding. Appl. Opt. 34, 1859–1866 (1995).
Cathey, W. T. & Dowski, E. R. New paradigm for imaging systems. Appl. Opt. 41, 6080–6092 (2002).
Curry, N. et al. Direct determination of diffusion properties of random media from speckle contrast. Opt. Lett. 36, 3332–3334 (2011).
Velten, A. et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Commun. 3, 745 (2012).
Betzig, E. et al. Imaging intracellular fluorescent proteins at nanometer resolution. Science 313, 1642–1645 (2006).
Van Beijnum, F., van Putten, E. G., Lagendijk, A. & Mosk, A. P. Frequency bandwidth of light focused through turbid media. Opt. Lett. 36, 373–375 (2011).
Small, E., Katz, O. & Silberberg, Y. Spatiotemporal focusing through a thin scattering layer. Opt. Express 20, 5189–5195 (2012).
Cheong, W.-F., Prahl, S. A. & Welch, A. J. A review of the optical properties of biological tissues. IEEE J. Quantum Electron. 26, 2166–2185 (1990).
Vellekoop, I. M., Cui, M. & Yang, C. Digital optical phase conjugation of fluorescence in turbid tissue. Appl. Phys. Lett. 101, 081108 (2012).
Elson, D. S., Li, R., Dunsby, C., Eckersley, R. & Tang, M.-X. Ultrasound-mediated optical tomography: a review of current methods. Interface Focus 1, 632–648 (2011).
Skipetrov, S. E. et al. Noise in laser speckle correlation and imaging techniques. Opt. Express 18, 14519–14534 (2010).
Moravec, M. L., Romberg, J. K. & Baraniuk, R. G. Wavelets XII. Proc. SPIE 6701, 670120 (2007).
Shechtman, Y., Beck, A. & Eldar, Y. GESPAR: Efficient phase retrieval of sparse signals. IEEE Trans. Signal Process. 62, 928–938 (2014).
Fink, M. Time reversed acoustics. Phys. Today 50, 34–40 (March, 1997).
Weaver, R. L. & Lobkis, O. I. Ultrasonics without a source: thermal fluctuation correlations at MHz frequencies. Phys. Rev. Lett. 87, 134301 (2001).
Acknowledgements
The authors thank D. Martina and A. Liutkus for help with the GPU implementation of the algorithm, P. Ducellier for the Nokia Lumia 1020 camera-phone, J. Bertolotti for discussions and D. Andreoli for the spectral decorrelation measurements. This work was funded by the European Research Council (grant no. 278025). O.K. was supported by the Marie Curie Intra-European fellowship for career development (IEF) and a Rothschild fellowship.
Author information
Authors and Affiliations
Contributions
O.K. conceived the idea, performed the numerical simulations, wrote the reconstruction algorithm and designed the initial experiments. O.K., P.H. and S.G. discussed the experimental implementation. O.K. and P.H. performed the experiments and analysed the results. O.K, M.F. and S.G. discussed the results. O.K. wrote the manuscript with contributions from all authors.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Supplementary information
Supplementary information
Supplementary information (PDF 1320 kb)
Supplementary movie 1
Supplementary movie 1 (AVI 802 kb)
Rights and permissions
About this article
Cite this article
Katz, O., Heidmann, P., Fink, M. et al. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nature Photon 8, 784–790 (2014). https://doi.org/10.1038/nphoton.2014.189
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nphoton.2014.189
This article is cited by
-
Pilot-assisted beam and correlation to recover information through scattering media [Invited]
Applied Physics B (2024)
-
Directly and instantly seeing through random diffusers by self-imaging in scattering speckles
PhotoniX (2023)
-
Different channels to transmit information in scattering media
PhotoniX (2023)
-
All-optical image classification through unknown random diffusers using a single-pixel diffractive network
Light: Science & Applications (2023)
-
Tracing multiple scattering trajectories for deep optical imaging in scattering media
Nature Communications (2023)