Abstract

Holography is a method of recording and reproducing three-dimensional (3D) images, and the widespread availability of computers has encouraged the development of holographic 3D screens (electroholography). However, the technology has not yet been used in practical applications because a hologram requires an enormous volume of data and modern computing power is inadequate to process this volume of data in real time. Here, we show that a special-purpose holography computing board, which uses eight large-scale field-programmable gate arrays, can be used to generate 108-pixel holograms that can be updated at a video frame rate. With our approach, we achieve a parallel operation of 4,480 hologram calculation circuits on a single board, and by clustering eight of these boards, we can increase the number of parallel calculations to 35,840. Using a 3D image composed of 7,877 points, we show that 108-pixel holograms can be updated at a video rate, thus allowing 3D movies to be projected. We also demonstrate that the system speed scales up in a linear manner as the number of parallel circuits is increased. The system operates at 0.25 GHz with an effective speed equivalent to 0.5 petaflops (1015 floating-point operations per second), matching that of a high-performance computer.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Hilaire, P. S. et al. Electronic display system for computational holography. Proc. SPIE 1212, 174–182 (1990).

  2. 2.

    Lucente, M. Interactive three-dimensional holographic displays: seeing the future in depth. Comp. Graph. 31, 63–67 (1997).

  3. 3.

    Aoshima, K. et al. Submicron magneto-optical spatial light modulation device for holographic displays driven by spin-polarized electrons. J. Disp. Technol. 6, 374–380 (2010).

  4. 4.

    Lucente, M. Interactive computation of holograms using a look-up table. J. Electron. Imaging 2, 28–34 (1993).

  5. 5.

    Yoshikawa, H., Iwase, S. & Oneda, T. Fast computation of Fresnel holograms employing difference. Proc. SPIE 3956, 48–55 (2000).

  6. 6.

    Nishitsuji, T., Shimobaba, T., Kakue, T. & Ito, T. Review of fast calculation techniques for computer-generated holograms with the point light source-based model. IEEE Trans. Ind. Inform. 13, 2447–2454 (2017).

  7. 7.

    Shimobaba, T., Kakue, T. & Ito, T. Review of fast algorithms and hardware implementations on computer holography. IEEE Trans. Ind. Inform. 12, 1611–1622 (2016).

  8. 8.

    Masuda, N., Ito, T., Tanaka, T., Shiraki, A. & Sugie, T. Computer generated holography using a graphics processing unit. Opt. Express 14, 603–608 (2006).

  9. 9.

    Takada, N. et al. Fast high-resolution computer-generated hologram computation using multiple graphics processing unit cluster system. Appl. Opt. 51, 7303–7307 (2012).

  10. 10.

    Song, J., Park, J., Park, H. & Park, J.-Il Real-time generation of high-definition resolution digital holograms by using multiple graphic processing units. Opt. Eng. 52, 015803 (2013).

  11. 11.

    Watlington, J. A., Lucente, M., Sparrell, C. J., Bove, V. M. Jr & Tamitani, I. A hardware architecture for rapid generation of electro-holographic fringe patterns. Proc. SPIE 2406, 172–183 (1995).

  12. 12.

    Lucente, M. & Galyean, T. A. Rendering interactive holographic images. Proc. ACM SIGGRAPH 95, 387–394 (1995).

  13. 13.

    Buckley, E. Real-time error diffusion for signal-to-noise ratio improvement in a holographic projection system. J. Disp. Technol. 7, 70–76 (2011).

  14. 14.

    Seo, Y. H., Choi, H. J., Yoo, J. S. & Kim, D. W. An architecture of a high-speed digital hologram generator based on FPGA. J. Syst. Architect. 56, 27–37 (2010).

  15. 15.

    Masuda, N. et al. Special purpose computer for digital holographic particle tracking velocimetry. Opt. Express 14, 587–592 (2006).

  16. 16.

    Abe, Y. et al. Special purpose computer system for flow visualization using holography technology. Opt. Express 16, 7686–7692 (2008).

  17. 17.

    Masuda, N. et al. Special purpose computer system with highly parallel pipelines for flow visualization using holography technology. Comput. Phys. Commun. 181, 1986–1989 (2010).

  18. 18.

    Cheng, C. J., Hwang, W. J., Chen, C. T. & Lai, X. J. Efficient FPGA-based Fresnel transform architecture for digital holography. J. Disp. Technol. 10, 272–281 (2014).

  19. 19.

    Ito, T., Yabe, T., Okazaki, M. & Yanagi, M. Special-purpose computer HORN-1 for reconstruction of virtual image in three dimensions. Comp. Phys. Commun. 82, 104–110 (1994).

  20. 20.

    Ito, T. et al. Special-purpose computer for holography HORN-2. Comp. Phys. Commun. 93, 13–20 (1996).

  21. 21.

    Shimobaba, T. et al. Special-purpose computer for holography HORN-3 with PLD technology. Comp. Phys. Commun. 130, 75–82 (2000).

  22. 22.

    Shimobaba, T. & Ito, T. Special-purpose computer for holography HORN-4 with recurrence algorithm. Comp. Phys. Commun. 148, 160–170 (2002).

  23. 23.

    Ito, T. et al. A special-purpose computer HORN-5 for a real-time electroholography. Opt. Express 13, 1923–1932 (2005).

  24. 24.

    Ichihashi, Y. et al. HORN-6 special-purpose clustered computing system for electroholography. Opt. Express 17, 13895–13903 (2009).

  25. 25.

    Okada, N. et al. Special-purpose computer HORN-7 with FPGA technology for phase modulation type electroholography. IDW/AD’12 Proc. Int. Display Workshops 3Dp-26 (Society for Information Display, 2012).

  26. 26.

    Ito, T. & Shimobaba, T. One-unit system for electroholography by use of a special-purpose computational chip with a high-resolution liquid-crystal display toward a three-dimensional television. Opt. Express 12, 1788–1793 (2004).

  27. 27.

    Shimobaba, T., Shiraki, T., Masuda, N. & Ito, T. Electroholographic display unit for three-dimensional display by use of special-purpose computational chip for holography and reflective LCD panel. Opt. Express 13, 4196–4201 (2005).

  28. 28.

    Ichikawa, T., Yamaguchi, K. & Sakamoto, Y. Realistic expression for full-parallax computer-generated holograms with the ray-tracing method. Appl. Opt. 52, A201–A209 (2013).

  29. 29.

    Pan, Y. et al. Fast CGH computation using S-LUT on GPU. Opt. Express 17, 18543–18555 (2009).

  30. 30.

    Matsushima, K. & Nakahara, S. Extremely high-definition full-parallax computer-generated hologram created by the polygon-based method. Appl. Opt. 48, H54–H63 (2009).

  31. 31.

    Ogihara, Y., Ichikawa, T. & Sakamoto, Y. Fast calculation with point based method to make CGHs of the polygon model. Proc. SPIE 9006, 90060T–90061T (2014).

  32. 32.

    Chen, J.-S., Chu, D. & Smithwick, Q. Rapid hologram generation utilizing layer-based approach and graphic rendering for realistic three-dimensional image reconstruction by angular tiling. J. Electron. Imaging 23, 023016 (2014).

  33. 33.

    Chen, J.-S. & Chu, D. P. Improved layer-based method for rapid hologram generation and real-time interactive holographic display applications. Opt. Express 23, 18143–18155 (2015).

  34. 34.

    Shimobaba, T. & Ito, T. An efficient computational method suitable for hardware of computer-generated hologram with phase computation by addition. Comp. Phys. Commun. 138, 44–52 (2001).

  35. 35.

    Nishitsuji, T., Shimobaba, T., Kakue, T., Arai, D. & Ito, T. Simple and fast cosine approximation method for computer-generated hologram calculation. Opt. Express 23, 32465–32470 (2015).

  36. 36.

    Niwase, H. et al. Real-time spatiotemporal division multiplexing electroholography with a single graphics processing unit utilizing movie features. Opt. Express 22, 28052–28057 (2014).

  37. 37.

    Shimobaba, T. et al. Computational wave optics library for C++: CWO++ library. Comput. Phys. Commun. 183, 1124–1138 (2012).

Download references

Acknowledgements

This work was supported by the Japan Society for the Promotion of Science (Grant-in-Aid No. 25240015).

Author information

Affiliations

  1. Chiba University, Chiba, Japan

    • Takashige Sugie
    • , Takanori Akamatsu
    • , Takashi Nishitsuji
    • , Ryuji Hirayama
    • , Atsushi Shiraki
    • , Yutaka Endo
    • , Takashi Kakue
    • , Tomoyoshi Shimobaba
    •  & Tomoyoshi Ito
  2. Tokyo University of Science, Tokyo, Japan

    • Nobuyuki Masuda
  3. National Astronomical Observatory of Japan, Mitaka, Japan

    • Hirotaka Nakayama
  4. National Institute of Information and Communications Technology, Koganei, Japan

    • Yasuyuki Ichihashi
  5. Kochi University, Kochi, Japan

    • Minoru Oikawa
    •  & Naoki Takada

Authors

  1. Search for Takashige Sugie in:

  2. Search for Takanori Akamatsu in:

  3. Search for Takashi Nishitsuji in:

  4. Search for Ryuji Hirayama in:

  5. Search for Nobuyuki Masuda in:

  6. Search for Hirotaka Nakayama in:

  7. Search for Yasuyuki Ichihashi in:

  8. Search for Atsushi Shiraki in:

  9. Search for Minoru Oikawa in:

  10. Search for Naoki Takada in:

  11. Search for Yutaka Endo in:

  12. Search for Takashi Kakue in:

  13. Search for Tomoyoshi Shimobaba in:

  14. Search for Tomoyoshi Ito in:

Contributions

T.I. planed the project. T.Sugie and T.I designed the HORN-8 board, and T.Sugie and M.O. developed it. T.A., T.Sugie and T.I. designed the circuit of the HORN-8 system, and T.A. implemented it to FPGA. R.H., H.N., T.Sugie, T.A, T.Shimobaba and T.I. evaluated the HORN-8 system. H.N. and R.H. created 3D models for holography. T.N., N.T., Y.E., N.M. and T.Shimobaba developed the supported algorithms for the HORN-8 system. Y.I., A.S. and T.K. built the optical system. All authors contributed to the discussions and reviewed the manuscript.

Competing interests

The authors declare no competing interests.

Corresponding author

Correspondence to Tomoyoshi Ito.

Supplementary information

  1. Supplementary Video 1

    Real-time optical reconstruction of electroholography from the eight-board HORN-8 cluster system. The image was reconstructed from a 2-million-pixel hologram with 6.5-μm pixel pitch.

  2. Supplementary Video 2

    Simulation of a wide field-of-view electroholography from the eight-board HORN-8 cluster system. The image was computationally reconstructed from a 100-million-pixel hologram with 1-μm pixel pitch. The viewing angle of the hologram is approximately 30°.

  3. Supplementary Video 3

    Large-scale electroholographic image obtained using the eight-board HORN-8 cluster system. A 100-million-pixel hologram was generated from a 10-million-point object and reconstructed via simulation. The object data were divided into 160 blocks, and a separate hologram was prepared for each. These were then reconstructed by the time-division method to obtain a single still image.

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/s41928-018-0057-5

Further reading