Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Letter
  • Published:

A parallel algorithm for real-time computation of optical flow

Abstract

The precise measurement of the two-dimensional field of velocities from time-varying two-dimensional images is impossible in general. It is, however, possible to compute suitable 'optical flows' that are qualitatively similar to the velocity field in most cases. We describe a simple, parallel algorithm that computes an optical flow from sequences of real images, which is consistent with human psychophysics and suggests plausible physiological models. In particular, our algorithm runs on a Connection Machine supercomputer in close-to-real time. It shows several of the same "illusions9 that are perceived by humans. A natural physiological implementation of the model is consistent with data from cortical areas V1 and MT.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Similar content being viewed by others

References

  1. Drumheller, M. & Poggio, T. in Proc. IEEE Conf. on Robotics and Automation 1439–1448 (1986).

    Google Scholar 

  2. Poggio, T. et al. in Proc. Image Understanding Workshop (Morgan Kaufmann, San Mateo, California, 1988).

    Google Scholar 

  3. Bülthoff, H. H., Little, J. J. & Poggio, T. J. opt. Soc. Am. 4, 34 (1987).

    Article  ADS  Google Scholar 

  4. Hildreth, E. C. The Measurement of Visual Motion (MIT, Cambridge, Massachusetts, 1984).

    MATH  Google Scholar 

  5. Nakayama, K. & Silverman, G. H. Vision Res. 28, 739–746 (1988).

    Article  CAS  Google Scholar 

  6. Horn, B. K. P. & Schunck, B. G. Artif. Intell. 17, 185–203 (1981).

    Article  Google Scholar 

  7. Bülthoff, H. H. & Little, J. J. in Motion Workshop (IEEE, Washington, DC, in the press).

  8. Ramachandran, V. & Inada, V. Spatial Vision 1, 57–67 (1985).

    Article  CAS  Google Scholar 

  9. Ramachandran, V. S. & Anstis, S. M. Scient. Am. 254, 102–109 (1986).

    Article  CAS  Google Scholar 

  10. Wallach, H. in On Perception (Quadrangle, New York, 1976).

    Google Scholar 

  11. Adelson, E. & Movshon, J. Nature 300, 523–525 (1982).

    Article  ADS  CAS  Google Scholar 

  12. Movshon, J. A., Adelson, E. H., Gizzi, M. S. & Newsome, W. T. in Pattern Recognition Mechanisms (ed. Chagas, C. G. G. & Gattas, R.) (Vatican, Rome, 1985).

    Google Scholar 

  13. Hassenstein, B. & Reichardt, W. Z. Naturf. IIb, 513–524 (1956).

    Article  Google Scholar 

  14. Poggio, G. F. & Poggio, T. A. Rev. Neurosci. 7, 379–412 (1984).

    Article  CAS  Google Scholar 

  15. Hutchinson, J., Koch, C., Luo, J. & Mead, C. IEEE Computer Magazine 21, 52–64 (1988).

    Article  Google Scholar 

  16. Yuille, A. L. & Grzywacz, N. M. Nature 333, 71–74 (1988).

    Article  ADS  CAS  Google Scholar 

  17. Nishihara, H. Optical Engng 23, 536–545 (1984).

    Article  ADS  Google Scholar 

  18. Little, J. J., Bülthoff, H. H. & Poggio, T. in Proc. Image Understanding Workshop 915–920 (Morgan Kaufmann, San Mateo, California, 1987).

    Google Scholar 

  19. Poggio, T., Gamble, E. B. & Little, J. J. Science 242, 436–440 (1988).

    Article  ADS  MathSciNet  CAS  Google Scholar 

  20. Horn, B. et al. Technical report (Artificial Intelligence Laboratory, MIT, 1988).

    Google Scholar 

  21. Little, J. J., Bülthoff, H. H. & Poggio, T. in Proc. Int. Conf. Computer Vision (IEEE, Washington, DC, 1988).

    Google Scholar 

  22. Canny, J. F. IEEE Trans. Patten Analysis and Machine Intelligence 8, 679–698 (1986).

    Article  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bülthoff, H., Little, J. & Poggio, T. A parallel algorithm for real-time computation of optical flow. Nature 337, 549–553 (1989). https://doi.org/10.1038/337549a0

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1038/337549a0

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing