Letter | Published:

Detection and tracking of moving objects hidden from view

Nature Photonics volume 10, pages 2326 (2016) | Download Citation

Abstract

The ability to detect motion and track a moving object hidden around a corner or behind a wall provides a crucial advantage when physically going around the obstacle is impossible or dangerous. Previous methods have demonstrated that it is possible to reconstruct the shape of an object hidden from view. However, these methods do not enable the tracking of movement in real time. We demonstrate a compact non-line-of-sight laser ranging technology that relies on the ability to send light around an obstacle using a scattering floor and then detect the return signal from a hidden object within only a few seconds of acquisition time. By detecting this signal with a single-photon avalanche diode (SPAD) camera, we follow the movement of an object located a metre away from the camera with centimetre precision. We discuss the possibility of applying this technology to a variety of real-life situations in the near future.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    et al. First-photon imaging. Science 343, 58–61 (2014).

  2. 2.

    et al. 3d computational imaging with single-pixel detectors. Science 340, 844–847 (2013).

  3. 3.

    Introduction to Lidar (Springer, 2005).

  4. 4.

    , , , & Laser depth measurement based on time-correlated single-photon counting. Opt. Lett. 22, 543–545 (1997).

  5. 5.

    et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Commun. 3, 745 (2012).

  6. 6.

    , , & Single-shot compressed ultrafast photography at one hundred billion frames per second. Nature 516, 74–77 (2015).

  7. 7.

    et al. Single-photon sensitive light-in-flight imaging. Nature Commun. 6, 6021 (2015).

  8. 8.

    , , , & Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 23, 20997 (2015).

  9. 9.

    et al. Radar detection of moving objects around corners. Proc. SPIE 7308, 73080V (2009).

  10. 10.

    et al. in 2010 IEEE Int. Conf. Acoust, Speech Signal Process. 3894–3897 (2010).

  11. 11.

    , , , & Reconstruction of hidden 3d shapes using diffuse reflections. Opt. Express 20, 19096–19108 (2012).

  12. 12.

    et al. Advanced short-wavelength infrared range-gated imaging for ground applications in monostatic and bistatic configurations. Appl. Opt. 48, 5956–5969 (2009).

  13. 13.

    & Universal optimal transmission of light through disordered materials. Phys. Rev. Lett. 101, 120601 (2008).

  14. 14.

    , , & Controlling waves in space and time for imaging and focusing in complex media. Nature Photon. 6, 283–292 (2012).

  15. 15.

    et al. Non-invasive imaging through opaque scattering layers. Nature 491, 232–234 (2012).

  16. 16.

    , & Looking around corners and through thin turbid layers in real time with scattered incoherent light. Nature Photon. 6, 459–553 (2012).

  17. 17.

    , , & Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nature Photon. 8, 784–790 (2014).

  18. 18.

    et al. A 32×32 50ps resolution 10 bit time to digital converter array in 130nm CMOS for time correlated imaging. In Custom Integr. Circ. Conf. 2009 77–80 (IEEE, 2009).

  19. 19.

    , & Low dark count single-photon avalanche diode structure compatible with standard nanometer scale CMOS technology. Photon. Technol. Lett. IEEE 21, 1020–1022 (2009).

  20. 20.

    , , & Design and characterization of a CMOS 3-d image sensor based on single photon avalanche diodes. IEEE J. Solid-State Circuits 40, 1847–1854 (2005).

  21. 21.

    & Time-Correlated Single Photon Counting (Academic Press, 1984).

  22. 22.

    Advanced Time-correlated Single Photon Counting Techniques (Springer, 2005).

  23. 23.

    & Optimal Filtering (Prentice-Hall, 1979).

  24. 24.

    , , & Detecting moving objects, ghosts, and shadows in video streams. IEEE Trans. Pattern Anal. Machine Intel. 25, 1337–1342 (2003).

  25. 25.

    & in Proc. Int. Conf. Pattern Recog. 1, 495 (IEEE, 1998).

  26. 26.

    & Ranging and three-dimensional imaging using time-correlated single-photon counting and point-by-point acquisition. IEEE J. Sel. Top. Quant. Electron. 13, 1006–1015 (2007).

  27. 27.

    et al. Demonstration of literal three-dimensional imaging. Appl. Opt. 38, 1833–1840 (1999).

  28. 28.

    et al. Three-dimensional imaging laser radar with a photon-counting avalanche photodiode array and microchip laser. Appl. Opt. 41, 7671–7678 (2002).

Download references

Acknowledgements

We acknowledge support from the European Research Council under the European Union's Seventh Framework Programme (FP/2007-2013)/ERC GA 306559, the Engineering and Physical Sciences Research Council (EPSRC, UK, grants EP/M006514/1, EP/M01326X/1, EP/ K03197X/1), and ST Microelectronics, Imaging Division, Edinburgh, for their support in the manufacture of the Megaframe chip. The Megaframe project has been supported by the European Community within the Sixth Framework Programme IST FET Open. G.G. acknowledges the financial support of the Fonds de Recherche Nature et Technologies du Quebec (grant no. 173779).

Author information

Affiliations

  1. Institute of Photonics and Quantum Sciences, Heriot-Watt University, David Brewster Building, Edinburgh EH14 4AS, UK

    • Genevieve Gariepy
    • , Francesco Tonolini
    • , Jonathan Leach
    •  & Daniele Faccio
  2. Institute for Micro and Nano Systems, University of Edinburgh, Alexander Crum Brown Road, Edinburgh EH9 3FF, UK

    • Robert Henderson

Authors

  1. Search for Genevieve Gariepy in:

  2. Search for Francesco Tonolini in:

  3. Search for Robert Henderson in:

  4. Search for Jonathan Leach in:

  5. Search for Daniele Faccio in:

Contributions

D.F. and J.L. conceived the experiment. R.K.H. designed the CMOS SPAD pixel architecture. G.G.performed the experiment. F.T. developed the tracking algorithm. G.G. and F.T. analysed the data and drafted the manuscript. All authors discussed the data and contributed to the manuscript.

Competing interests

The authors declare no competing financial interests.

Corresponding authors

Correspondence to Genevieve Gariepy or Daniele Faccio.

Supplementary information

PDF files

  1. 1.

    Supplementary information

    Supplementary information

Videos

  1. 1.

    Supplementary information

    Supplementary Movie 1

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/nphoton.2015.234

Further reading