Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

An aquatic-vision-inspired camera based on a monocentric lens and a silicon nanorod photodiode array

Nature Electronics volume 3, pages 546–553 (2020)Cite this article

Subjects

An Author Correction to this article was published on 12 July 2022

This article has been updated

Abstract

Conventional wide-field-of-view cameras consist of multi-lens optics and flat image sensor arrays, which makes them bulky and heavy. As a result, they are poorly suited to advanced mobile applications such as drones and autonomous vehicles. In nature, the eyes of aquatic animals consist of a single spherical lens and a highly sensitive hemispherical retina, an approach that could be beneficial in the development of synthetic wide-field-of-view imaging systems. Here, we report an aquatic-vision-inspired camera that consists of a single monocentric lens and a hemispherical silicon nanorod photodiode array. The imaging system features a wide field of view, miniaturized design, low optical aberration, deep depth of field and simple visual accommodation. Furthermore, under vignetting, the photodiode array enables high-quality panoramic imaging due to the enhanced photodetection properties of the silicon nanorod photodiodes.

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on SpringerLink
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Structural and functional features of aquatic vision in nature.
Fig. 2: Monocentric lens inspired by the protruding monocentric lens of aquatic eyes.
Fig. 3: h-SiNR-PDA inspired by the retina of aquatic eyes.
Fig. 4: Imaging demonstration with the integrated camera module.

Similar content being viewed by others

Data availability

The data that support the plots within this paper and other findings of this study are available from the corresponding author upon reasonable request.

Code availability

The source codes for Matlab are available from the corresponding authors upon request.

Change history

References

  1. Floreano, D. & Wood, R. J. Science, technology and the future of small autonomous drones. Nature 521, 460–466 (2015).

    Article  Google Scholar 

  2. Jang, H. S. et al. A bezel-less tetrahedral image sensor formed by solvent-assisted plasticization and transformation of an acrylonitrile butadiene styrene framework. Adv. Mater. 30, 1801256 (2018).

    Article  Google Scholar 

  3. Lee, G. J., Choi, C., Kim, D.-H. & Song, Y. M. Bioinspired artificial eyes: optic components, digital cameras and visual prostheses. Adv. Funct. Mater. 28, 1705202 (2018).

    Article  Google Scholar 

  4. Chung, T. et al. Mining the smartness of insect ultrastructures for advanced imaging and illumination. Adv. Funct. Mater. 28, 1705912 (2018).

    Article  Google Scholar 

  5. Lee, G. J., Nam, W. I. & Song, Y. M. Robustness of an artificially tailored fisheye imaging system with a curvilinear image surface. Opt. Laser Technol. 96, 50–57 (2017).

    Article  Google Scholar 

  6. Zhou, F. et al. Optoelectronic resistive random access memory for neuromorphic vision sensors. Nat. Nanotechnol. 14, 776–782 (2019).

    Article  Google Scholar 

  7. Lee, W. et al. Two-dimensional materials in functional three-dimensional architectures with applications in photodetection and imaging. Nat. Commun. 9, 1417 (2018).

    Article  Google Scholar 

  8. Tsai, W.-L. et al. Band tunable microcavity perovskite artificial human photoreceptors. Adv. Mater. 31, 1900231 (2019).

    Article  Google Scholar 

  9. Choi, C. et al. Human eye-inspired soft optoelectronic device using high-density MoS2–graphene curved image sensor array. Nat. Commun. 8, 1664 (2017).

    Article  Google Scholar 

  10. Zhang, K. et al. Origami silicon optoelectronics for hemispherical electronic eye systems. Nat. Commun. 8, 1782 (2017).

    Article  Google Scholar 

  11. Ko, H. C. et al. A hemispherical electronic eye camera based on compressible silicon optoelectronics. Nature 454, 748–753 (2008).

    Article  Google Scholar 

  12. Artal, P. Optics of the eye and its impact in vision: a tutorial. Adv. Opt. Photon. 6, 340–367 (2014).

    Article  Google Scholar 

  13. Song, Y. M. et al. Digital cameras with designs inspired by the arthropod eye. Nature 497, 95–99 (2013).

    Article  Google Scholar 

  14. Floreano, D. et al. Miniature curved artificial compound eyes. Proc. Natl Acad. Sci. USA 110, 9267–9272 (2013).

    Article  Google Scholar 

  15. Jeong, K.-H., Kim, J. & Lee, L. P. Biologically inspired artificial compound eyes. Science 312, 557–561 (2006).

    Article  Google Scholar 

  16. Huang, C.-C. et al. Large-field-of-view wide-spectrum artificial reflecting superposition compound eyes. Small 10, 3050–3057 (2014).

    Article  Google Scholar 

  17. Jagger, W. S. & Sands, P. J. A wide-angle gradient index optical model of the crystalline lens and eye of the rainbow trout. Vis. Res. 36, 2623–2639 (1996).

    Article  Google Scholar 

  18. Jagger, W. S. & Sands, P. J. A wide-angle gradient index optical model of the crystalline lens and eye of the octopus. Vis. Res. 39, 2841–2852 (1999).

    Article  Google Scholar 

  19. Mass, A. M. & Supin, A. Y. Adaptive features of aquatic mammals’ eye. Anat. Rec. 290, 701–715 (2007).

    Article  Google Scholar 

  20. Charman, W. N. & Tucker, J. The optical system of the goldfish eye. Vis. Res. 13, 1–8 (1973).

    Article  Google Scholar 

  21. Ott, M. Visual accommodation in vertebrates: mechanisms, physiological response and stimuli. J. Comp. Physiol. A 192, 97–111 (2006).

    Article  Google Scholar 

  22. Wagner, H.-J., Frohlich, E., Negishi, K. & Collin, S. P. The eyes of deep-sea fish. II. Functional morphology of the retina. Prog. Retin. Eye Res. 17, 637–685 (1998).

    Article  Google Scholar 

  23. Partridge, J. C., Archer, S. N. & Lythgoe, J. N. Visual pigments in the individual rods of deep-sea fishes. J. Comp. Physiol. A 162, 543–550 (1988).

    Article  Google Scholar 

  24. Wu, T. et al. Design and fabrication of silicon-tessellated structures for monocentric imagers. Microsyst. Nanoeng. 2, 16019 (2016).

    Article  Google Scholar 

  25. Liu, H. W., Huang, Y. & Jiang, H. Artificial eye for scotopic vision with bioinspired all-optical photosensitivity enhancer. Proc. Natl Acad. Sci. USA 113, 3982–3985 (2016).

    Article  Google Scholar 

  26. Zukauskas, A. et al. Tuning the refractive index in 3D direct laser writing lithography: towards GRIN microoptics. Laser Photon. Rev. 9, 706–712 (2015).

    Article  Google Scholar 

  27. Yu, N. & Capasso, F. Flat optics with designer metasurfaces. Nat. Mater. 13, 139–150 (2014).

    Article  Google Scholar 

  28. Steel, W. H. On the choice of glasses for cemented achromatic aplanatic doublets. Aust. J. Phys. 7, 244–253 (1954).

    Article  Google Scholar 

  29. Lee, W. et al. High-resolution spin-on-patterning of perovskite thin films for a multiplexed image sensor array. Adv. Mater. 29, 1702902 (2017).

    Article  Google Scholar 

  30. Sim, K. et al. Three-dimensional curvy electronics created using conformal additive stamp printing. Nat. Electron. 2, 471–479 (2019).

    Article  Google Scholar 

  31. Shin, G. et al. Micromechanics and advances designs for curved photodetector arrays in hemispherical electronic-eye cameras. Small 6, 851–856 (2010).

    Article  Google Scholar 

  32. Huang, Z. et al. Three-dimensional integrated stretchable electronics. Nat. Electron. 1, 473–480 (2018).

    Article  Google Scholar 

  33. Park, S.-I. et al. Theoretical and experimental studies of bending of inorganic electronic materials on plastic substrates. Adv. Funct. Mater. 18, 2673–2684 (2008).

    Article  Google Scholar 

  34. Choi, M. K. et al. Wearable red-green-blue quantum dot light-emitting diode array using high-resolution intaglio transfer printing. Nat. Commun. 6, 7149 (2015).

    Article  Google Scholar 

  35. Kim, J. et al. Stretchable silicon nanoribbon electronics for skin prosthesis. Nat. Commun. 5, 5747 (2014).

    Article  Google Scholar 

  36. Rim, S.-B., Catrysse, P. B., Dinyari, R., Huang, K. & Peumans, P. The optical advantages of curved focal plane arrays. Opt. Express 16, 4965–4971 (2008).

    Article  Google Scholar 

  37. Sheng, X., Johnson, S. G., Michel, J. & Kimerling, L. C. Optimization-based design of surface textures for thin-film Si solar cells. Opt. Express 19, A841–A850 (2011).

    Article  Google Scholar 

  38. Sheng, X. et al. Printing-based assembly of quadruple-junction four-terminal microscale solar cells and their use in high-efficiency modules. Nat. Mater. 13, 593–598 (2014).

    Article  Google Scholar 

  39. Hoang, N.-V. et al. Giant enhancement of luminescence down-shifting by a doubly resonant rare-earth-doped photonic metastructure. ACS Photonics 4, 1705–1712 (2017).

    Article  Google Scholar 

  40. Savin, H. et al. Black silicon solar cells with interdigitated back-contacts achieve 22.1% efficiency. Nat. Nanotechnol. 10, 624–628 (2015).

    Article  Google Scholar 

  41. Gao, Y. et al. Photon-trapping microstructures enable high-speed high-efficiency silicon photodiodes. Nat. Photon. 11, 301–308 (2017).

    Article  Google Scholar 

  42. Lucovsky, G., Schwarz, R. F. & Emmons, R. B. Transit‐time considerations in p–i–n diodes. J. Appl. Phys. 35, 622–628 (1964).

    Article  Google Scholar 

  43. Kyomasu, Mikio Development of an integrated high speed silicon PIN photodiode sensor. IEEE Trans. Electron Devices 42, 1093–1099 (1995).

    Article  Google Scholar 

  44. Gao, M., Cho, M., Han, H.-J., Jung, Y. S. & Park, I. Palladium-decorated silicon nanomesh fabricated by nanosphere lithography for high performance, room temperature hydrogen sensing. Small 14, 1703691 (2018).

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the Institute for Basic Science (IBS-R006-A1). This research was also supported by the National Research Foundation (NRF) of Korea (2017M3D1A1039288/2018R1A4A1025623).

Author information

Author notes

  1. These authors contributed equally: Min Sung Kim, Gil Ju Lee, Changsoon Choi, Min Seok Kim.

Authors and Affiliations

  1. Center for Nanoparticle Research, Institute for Basic Science (IBS), Seoul, Republic of Korea

    Minsung Kim, Changsoon Choi, Mincheol Lee, Kyoung Won Cho, Hyojin Cho & Dae-Hyeong Kim

  2. School of Chemical and Biological Engineering, Institute of Chemical Processes, Seoul National University, Seoul, Republic of Korea

    Minsung Kim, Changsoon Choi, Mincheol Lee, Kyoung Won Cho, Hyojin Cho & Dae-Hyeong Kim

  3. School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, Republic of Korea

    Gil Ju Lee, Min Seok Kim, Hyun Myung Kim & Young Min Song

  4. Center for Mechanics of Solids, Structures and Materials, Department of Aerospace Engineering and Engineering Mechanics, Department of Biomedical Engineering, Texas Materials Institute, University of Texas at Austin, Austin, TX, USA

    Siyi Liu & Nanshu Lu

  5. School of Materials Science and Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan, Republic of Korea

    Moon Kee Choi

  6. Department of Materials Science and Engineering, Seoul National University, Seoul, Republic of Korea

    Dae-Hyeong Kim

Authors
  1. Minsung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gil Ju Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Changsoon Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Min Seok Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mincheol Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Siyi Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kyoung Won Cho
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Hyun Myung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Hyojin Cho
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Moon Kee Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Nanshu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Young Min Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Dae-Hyeong Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

M.K., G.J.L., C.C., M.S.K., K.W.C., Y.M.S. and D.-H.K. designed the experiments, analysed the data and wrote the paper. M.S.K., C.C., M.L., H.C. and M.K.C. fabricated the photodiode array and performed characterization of individual devices. G.J.L., M.S.K. and H.M.K. performed theoretical analysis on optics. S.L. and N.L. performed theoretical analysis on mechanics. All authors discussed the results and commented on the manuscript.

Corresponding authors

Correspondence to Young Min Song or Dae-Hyeong Kim.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary Information

Supplementary Notes 1–6, Figs. 1–35 and Tables 1–6.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, M., Lee, G.J., Choi, C. et al. An aquatic-vision-inspired camera based on a monocentric lens and a silicon nanorod photodiode array. Nat Electron 3, 546–553 (2020). https://doi.org/10.1038/s41928-020-0429-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41928-020-0429-5

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing