The ability to detect motion and track a moving object hidden around a corner or behind a wall provides a crucial advantage when physically going around the obstacle is impossible or dangerous. Previous methods have demonstrated that it is possible to reconstruct the shape of an object hidden from view. However, these methods do not enable the tracking of movement in real time. We demonstrate a compact non-line-of-sight laser ranging technology that relies on the ability to send light around an obstacle using a scattering floor and then detect the return signal from a hidden object within only a few seconds of acquisition time. By detecting this signal with a single-photon avalanche diode (SPAD) camera, we follow the movement of an object located a metre away from the camera with centimetre precision. We discuss the possibility of applying this technology to a variety of real-life situations in the near future.
Subscribe to Journal
Get full journal access for 1 year
only $15.58 per issue
All prices are NET prices.
VAT will be added later in the checkout.
Rent or Buy article
Get time limited or full article access on ReadCube.
All prices are NET prices.
Kirmani, A. et al. First-photon imaging. Science 343, 58–61 (2014).
Sun, B. et al. 3d computational imaging with single-pixel detectors. Science 340, 844–847 (2013).
Wandinger, U. Introduction to Lidar (Springer, 2005).
Massa, J. S., Wallace, A. M., Buller, G. S., Fancey, S. J. & Walker, A. C. Laser depth measurement based on time-correlated single-photon counting. Opt. Lett. 22, 543–545 (1997).
Velten, A. et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Commun. 3, 745 (2012).
Gao, L., Liang, J., Li, C. & Wang, L. V. Single-shot compressed ultrafast photography at one hundred billion frames per second. Nature 516, 74–77 (2015).
Gariepy, G. et al. Single-photon sensitive light-in-flight imaging. Nature Commun. 6, 6021 (2015).
Buttafava, M., Zeman, J., Tosi, A., Eliceiri, K. & Velten, A. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 23, 20997 (2015).
Sume, A. et al. Radar detection of moving objects around corners. Proc. SPIE 7308, 73080V (2009).
Chakraborty, B. et al. in 2010 IEEE Int. Conf. Acoust, Speech Signal Process. 3894–3897 (2010).
Gupta, O., Willwacher, T., Velten, A., Veeraraghavan, A. & Raskar, R. Reconstruction of hidden 3d shapes using diffuse reflections. Opt. Express 20, 19096–19108 (2012).
Repasi, E. et al. Advanced short-wavelength infrared range-gated imaging for ground applications in monostatic and bistatic configurations. Appl. Opt. 48, 5956–5969 (2009).
Vellekoop, I. M. & Mosk, A. P. Universal optimal transmission of light through disordered materials. Phys. Rev. Lett. 101, 120601 (2008).
Mosk, A. P., Lagendijk, A., Lerosey, G. & Fink, M. Controlling waves in space and time for imaging and focusing in complex media. Nature Photon. 6, 283–292 (2012).
Bertolotti, J. et al. Non-invasive imaging through opaque scattering layers. Nature 491, 232–234 (2012).
Katz, O., Small, E. & Silberberg, Y. Looking around corners and through thin turbid layers in real time with scattered incoherent light. Nature Photon. 6, 459–553 (2012).
Katz, O., Heidmann, P., Fink, M. & Gigan, S. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nature Photon. 8, 784–790 (2014).
Richardson, J. et al. A 32×32 50ps resolution 10 bit time to digital converter array in 130nm CMOS for time correlated imaging. In Custom Integr. Circ. Conf. 2009 77–80 (IEEE, 2009).
Richardson, J., Grant, L. & Henderson, R. Low dark count single-photon avalanche diode structure compatible with standard nanometer scale CMOS technology. Photon. Technol. Lett. IEEE 21, 1020–1022 (2009).
Niclass, C., Rochas, A., Besse, P.-A. & Charbon, E. Design and characterization of a CMOS 3-d image sensor based on single photon avalanche diodes. IEEE J. Solid-State Circuits 40, 1847–1854 (2005).
O'Connor, D. & Phillips, D. Time-Correlated Single Photon Counting (Academic Press, 1984).
Becker, W. Advanced Time-correlated Single Photon Counting Techniques (Springer, 2005).
Anderson, B. D. & Moore, J. B. Optimal Filtering (Prentice-Hall, 1979).
Cucchiara, R., Grana, C., Piccardi, M. & Prati, A. Detecting moving objects, ghosts, and shadows in video streams. IEEE Trans. Pattern Anal. Machine Intel. 25, 1337–1342 (2003).
Cutler, R. & Davis, L. in Proc. Int. Conf. Pattern Recog. 1, 495 (IEEE, 1998).
Buller, G. S. & Wallace, A. M. Ranging and three-dimensional imaging using time-correlated single-photon counting and point-by-point acquisition. IEEE J. Sel. Top. Quant. Electron. 13, 1006–1015 (2007).
Ho, C. et al. Demonstration of literal three-dimensional imaging. Appl. Opt. 38, 1833–1840 (1999).
Albota, M. A. et al. Three-dimensional imaging laser radar with a photon-counting avalanche photodiode array and microchip laser. Appl. Opt. 41, 7671–7678 (2002).
We acknowledge support from the European Research Council under the European Union's Seventh Framework Programme (FP/2007-2013)/ERC GA 306559, the Engineering and Physical Sciences Research Council (EPSRC, UK, grants EP/M006514/1, EP/M01326X/1, EP/ K03197X/1), and ST Microelectronics, Imaging Division, Edinburgh, for their support in the manufacture of the Megaframe chip. The Megaframe project has been supported by the European Community within the Sixth Framework Programme IST FET Open. G.G. acknowledges the financial support of the Fonds de Recherche Nature et Technologies du Quebec (grant no. 173779).
The authors declare no competing financial interests.
About this article
Cite this article
Gariepy, G., Tonolini, F., Henderson, R. et al. Detection and tracking of moving objects hidden from view. Nature Photon 10, 23–26 (2016). https://doi.org/10.1038/nphoton.2015.234
Journal of the Optical Society of America A (2020)
Optics Express (2020)
Optics Communications (2020)
Nature Communications (2020)
Advanced Photonics (2020)