Article | Open | Published:

# Single-shot on-chip spectral sensors based on photonic crystal slabs

## Abstract

Miniaturized spectrometers have significant potential for portable applications such as consumer electronics, health care, and manufacturing. These applications demand low cost and high spectral resolution, and are best enabled by single-shot free-space-coupled spectrometers that also have sufficient spatial resolution. Here, we demonstrate an on-chip spectrometer that can satisfy all of these requirements. Our device uses arrays of photodetectors, each of which has a unique responsivity with rich spectral features. These responsivities are created by complex optical interference in photonic-crystal slabs positioned immediately on top of the photodetector pixels. The spectrometer is completely complementary metal–oxide–semiconductor (CMOS) compatible and can be mass produced at low cost.

## Introduction

Current use of spectroscopy is still largely confined to laboratories because spectrometers are bulky, expensive, and delicate. There has been tremendous interest in miniaturizing spectrometers to enable a broader range of applications1. There are two classes of compact spectrometers: waveguide-coupled2,3,4,5,6,7,8,9,10 and free-space coupled11,12,13,14,15,16,17,18,19,20,21. The waveguide-coupled spectrometers have limited applications, because they require delicate couplers and do not offer spatial information. On the other hand, free-space coupled devices offer much broader use11,12,18,22,23,24,25,26,27,28,29,30,31 such as imaging. The most important example is the color camera that relies three spectral filters: Red(R), Green(G), Blue(B). To go beyond three spectral bands, Fabry-Perot13 and plasmonic filters12,27,29 have been developed. However, these resonant filters have simple Lorentz line shapes and lack the spectral diversity to provide high spectral resolution. It was theoretically shown that random spectral filters can offer high spectral resolution when combined with advanced signal processing methods such as compressive sensing32. Recently, a seminal work by Bao and Bawendi17 experimentally demonstrated a high-resolution spectrometer based on random spectral filters. It showcased a different path other than the resonant filters. The diverse range of spectral features are created by absorption of colloidal quantum dots.

Built upon these progresses, here we developed a scalable method to realize random spectral filters based on photonic crystals (PCs). In contrast to quantum dots where the fabrication could be complicated by the use of non-standard complementary metal–oxide–semiconductor (CMOS) materials and processes, PC slabs can be defined via single exposure photolithography and only require standard CMOS materials. As the spectral response functions are entirely extrinsic and enabled by structures instead of materials’ properties, the concept can be applied to any wavelength range by scaling the dimension of PC. They are also extremely compact, with sizes similar to light-sensing pixels in CMOS image sensors. They provide single-shot measurement, which is particularly important for mobile applications.

## Results

### Working principle of PC spectrometers

The difficulty of reducing spectrometer size arises from the fact that a long propagation path is needed for light of similar wavelengths to accumulate a detectable difference in phase. In typical monochromators or Fourier-transform spectrometers, light only passes through the instrument once or twice. As a result, the optical path length is limited by the physical size of the instrument. One effective way to reduce the spectrometer size is to utilize multiple reflections of light within microstructures. Microcavities have been shown to increase the optical path length to millions of times larger than their physical size. Compact spectrometers have been demonstrated based on photonic-crystal cavities33, micro-donut6, and micro-ring resonators34,35. However, the path enhancement in microcavities only occurs at selected wavelengths. As a result, many distinct cavities are needed to continuously cover even a small spectral range. The larger the enhancement of the optical path, the narrower the cavity linewidth becomes, which further exacerbates the issue of spectral coverage. Narrow linewidths also reject most of incident light, making such spectrometers particularly susceptible to detector noise.

To overcome issues with narrow-band filters, we propose to miniaturize spectrometers based on PC slabs, which are micrometer-thin dielectric layers with periodic patterning. Light incident from free-space can couple to lateral propagation modes, where the periodic nanostructures allow light to bounce back and forth many times. Unlike microcavities, where the path enhancement only occurs at resonant frequencies, the effect of path enhancement in PC slabs spreads over a broader spectral range and creates a transmission spectrum with rich spectral features, including sharp peaks due to guided resonances36,37, broad background variation by Fabry-Perot resonance, and irregular line shapes due to Fano interference38,39. To work as a spectrometer, arrays of different PC slabs are fabricated on top of a CMOS imaging sensor. Each PC slab has a different periodicity, lattice constant, and hole sizes. These slabs produce different transmission spectra Ti(λ), where λ is the free-space wavelength. Thus, the photodetector underneath the ith PC slab receives the following signal:

$$S_i = {\int} {\kern 1pt} I(\lambda )T_i(\lambda )\eta (\lambda ){\kern 1pt} d\lambda ,$$
(1)

where I(λ) is the spectrum of incident light and $$\eta (\lambda )$$ is the spectral responsivity of the photodetector, which can be characterized in experiments (Supplementary Note 1).

Spectrometers can be characterized by the spectral response Ti(λ) that they use to sample the incident light. As shown in Fig. 1a, b, conventional spectrometers such as monochromators and Fourier-transform spectrometers use delta-like or sinusoidal functions to sample incident light. However, creating such spectral response in a compact device can be challenging. Instead of relying on these conventional sampling functions, PC slabs, which are extremely compact, rely on a set of complex and variable spectral functions, as shown in Fig. 1c. These functions form a random basis that allows the incident spectrum to be efficiently recovered using least-square methods40 or compressive sensing32.

### Fabrication and characterization of devices

In this work, we realized a spectrometer, as illustrated in Fig. 2a, operating in the wavelength range of 550 to 750 nm, with a resolution of approximately 1 nm. We used 36 different PC structures. Each PC has a size of 32 × 32 μm, and the entire spectrometer size is 210 × 210 μm (Fig. 2b). The PC structures are chosen to minimize the correlation among different Ti(λ), as shown in Supplementary Note 2. Nano-patterns are defined by electron-beam lithography and transferred into a silicon-on-sapphire (SOS) substrate using reactive-ion etching.

After fabrication, we first measured the spectral responsivities of all individual PC slabs Ti(λ) using a wavelength-tunable light source incident from the normal direction. Each PC slab covers tens of CMOS pixels (the pixel size is 5.86 μm). Excluding the pixels at the boundaries, which may be only partially covered by the PC slab due to misalignment, we sum signals from all pixels, resulting in a measured responsivity, which is normalized by the CMOS sensor signal without PC slabs. Three representative measurements are shown in Fig. 2c. All Ti(λ) were measured at the same time, using an expanded beam that illuminated the entire chip.

The inversion of Eq. 1 to obtain I(λ) from Si is generally an under-determined problem. We used a reconstruction algorithm based on minimizing regularized squares error with nonnegativity constraints (Supplementary Note 1)41,42.

To test our spectrometer, we first measured light sources with varying intensity and bandwidth. We combined beams from a green LED (Thorlabs, LED570L) and a red LED (Thorlabs, LED630L), as shown Fig. 3a. The combined spectrum was first measured using a commercial monochromator (Spectral Products DK480), and has two broad peaks centered at 570 and 630 nm (red curve in Fig. 3a). The reconstructed spectrum using our PC spectrometer is shown with blue circles, and agrees very well with the reference. Unlike the monochromator, the PC spectrometer captures a spectrum in a single-shot, within tens of milliseconds when the incident power is tens of μW. By comparison, it took a few seconds for the monochromator to acquire the spectrum. Another multi-color LED (Thorlabs, LEDRY) was tested as shown in Fig. 3b, also resulting in good agreement. We then use the spectrometer to study the metamerism effect, where two different spectra are perceived as the same by human eyes or RGB cameras. The first spectrum is the combination of green and red light in a 3:4 power ratio. The second spectrum has one narrow peak centered at 590 nm. The PC slab spectrometer easily distinguishes the two signals and reconstructs the exact spectral components (Fig. 3c, d). In all of the above measurements, we used the same reconstruction algorithm with identical parameters. The performance can be further improved by tuning the reconstruction algorithm to take advantage of prior knowledge, such as the approximate bandwidth of the measured spectrum.

Next, we tested the resolution of the spectrometer using narrow-band spectra. Here, we further optimized the reconstruction algorithm for narrow-band signals, which involved decreasing the weight of the term that regulates the smoothness of reconstructed spectrum. We measured the emission spectra of HeNe lasers at 594 nm (JDSU, 1137) and 633 nm (Melles Griot, 25-LYR-173-249), respectively (Fig. 4a). The PC spectrometer correctly identified the peak wavelengths, and the results matched well with those obtained using the monochromator. As a further test, we used the spectrometer to measure a series of narrow-band spectra generated by the monochromator. The spectral peaks have bandwidths of about 1.4 nm and wavelengths varying from 550 to 750 nm with a 1 nm step. Figure 4b shows examples of spectra obtained by our spectrometer, which are compared with the specification of the monochromator. A total of 201 spectra are measured. The peak positions agree with monochromator specification (Fig. 4c). The shift of the peak position is within ±0.2 nm for 90% of the measurements, and within ±1 nm for all measurements. The bandwidths also match the specification of monochromator well, as shown in Fig. 4d.

The transmission through PC slabs is angle dependent. Thus, our spectrometer requires the incidence angle to be the same for the calibration and measurement. For our device, the performance degrades if the two angles are different by more than 1 degree (See more details in Supplementary Note 3). Practically, this can be overcome by using a collimating aperture to ensure a consistent incident angle. We note that angular sensitivity is not a problem unique to PC slabs, but is also found in other high-resolution spectrometers including grating monochromators and Fourier-transform spectrometers. PC slabs offer additional design flexibility to trade spectral resolution for angular tolerance. For example, we could use fewer periods in the PC slabs. Reduced sizes weaken the effect of the photonic-crystal, and smooth the sharp spectral features, which reduces the spectral resolution but also makes the spectral responsivity less angle dependent.

### Hyperspectral imaging

Finally, we demonstrated the potential of PC-slab spectrometers for single-shot hyperspectral imaging. The size of each of our spectrometers is around 200 μm on a side. We fabricated 10 × 10 identical spectrometers on an SOS substrate, comprising a total of 3600 PC slabs. Each spectrometer serves as a single spatial pixel. The fabricated device was then attached onto a CMOS sensor chip. As a proof-of-principle demonstration, we used this 10 × 10 pixel imager to acquire a hyperspectral image. Our target was formed by projecting the numbers “5” and “9” on a piece of paper, as shown in Fig. 5a. The “5” is illuminated with light at a wavelength of 610 ± 5 nm, and the “9” is illuminated at 670 ± 1 nm. These two numbers overlap spatially, and are not easily differentiated using a conventional RGB camera.

A 35-mm lens was used to form an image on the PC-slab sensor chip. We calibrated the spectral responsivity of the device with lens in place. Using a similar reconstruction algorithm as what we used for broadband signals, we obtained a hyperspectral image from which the two numbers can be readily distinguished. Figure 5b shows five images from the reconstructed data from 610 to 690 nm, at increments of 20 nm. Both the spectral and spatial data were successfully retrieved.

The number of pixels of our hyperspectral imager is limited by the throughput of electron-beam lithography, resulting in the low-resolution image in Fig. 5. In practice, more pixels could be added efficiently by using high-throughput photolithography. Hundreds of spatial pixels in each dimension can be realized using the present design. To further increase the spatial resolution, we can also reduce the size of PC slabs with less number of periods used for each PC structure, thus trading spectral resolution for spatial resolution.

## Discussion

In conclusion, we proposed and experimentally demonstrated a spectrometer and a hyperspectral imager based on photonic-crystal (PC) slabs. Traditional hyperspectral imaging techniques often include spatial or spectral scanning, which usually require long acquisition time and are only accurate for stationary scene. Existing non-scanning methods43,44,45,46,47,48,49 often require large optical components and precision alignment. PC slabs enable non-scanning single-shot imaging method on a compact and reliable CMOS chip, which allows low-cost, portable applications. The performance of demonstrated devices can be readily improved. For example, the spectral resolution can be improved by replacing silicon PC with silicon nitride or silicon carbide, which would create more diverse spectral features due to the lack of light absorption. Spatial resolution and angle tolerance can be improved by using smaller PC slabs.

## Data availability

The data that support the finding of this study are available from the corresponding author upon reasonable request.

Journal peer review information: Nature Communications thanks John D. Joannopoulos and the other anonymous reviewers for their contribution to the peer review of this work. Peer reviewer reports are available.

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## References

1. 1.

Bacon, C. P., Mattley, Y. & DeFrece, R. Miniature spectroscopic instrumentation: applications to biology and chemistry. Rev. Sci. Instrum. 75, 1–16 (2004).

2. 2.

Wolffenbuttel, R. F. State-of-the-art in integrated optical microspectrometers. IEEE Trans. Instrum. Meas. 53, 197–202 (2004).

3. 3.

Florjańczyk, M. et al. Multiaperture planar waveguide spectrometer formed by arrayed mach-zehnder interferometers. Opt. Express 15, 18176–18189 (2007).

4. 4.

Momeni, B., Hosseini, E. S., Askari, M., Soltani, M. & Adibi, A. Integrated photonic crystal spectrometers for sensing applications. Opt. Commun. 282, 3168–3171 (2009).

5. 5.

Pervez, N. K. et al. Photonic crystal spectrometer. Opt. Express 18, 8277–8285 (2010).

6. 6.

Xia, Z. et al. High resolution on-chip spectroscopy based on miniaturized microdonut resonators. Opt. Express 19, 12356–12364 (2011).

7. 7.

Redding, B., Liew, S. F., Sarma, R. & Cao, H. Compact spectrometer based on a disordered photonic chip. Nat. Photonics 7, 746 (2013).

8. 8.

Li, L. et al. Mini 12, miniature mass spectrometer for clinical and other applications introduction and characterization. Anal. Chem. 86, 2909–2916 (2014).

9. 9.

Calafiore, G. et al. Holographic planar lightwave circuit for on-chip spectroscopy. Light: Sci. Appl. 3, e203 (2014).

10. 10.

Kita, D. M. et al. High-performance and scalable on-chip digital fourier transform spectroscopy. Nat. Commun. 9, 4405 (2018).

11. 11.

Wang, S.-W. et al. Concept of a high-resolution miniature spectrometer using an integrated filter array. Opt. Lett. 32, 632–634 (2007).

12. 12.

Kurokawa, U., Choi, B. I. & Chang, C.-C. Filter-based miniature spectrometers: spectrum reconstruction using adaptive regularization. IEEE Sens. J. 11, 1556–1563 (2011).

13. 13.

Emadi, A., Wu, H., de Graaf, G. & Wolffenbuttel, R. Design and implementation of a sub-nm resolution microspectrometer based on a linear-variable optical filter. Opt. Express 20, 489–507 (2012).

14. 14.

August, Y. & Stern, A. Compressive sensing spectrometry based on liquid crystal devices. Opt. Lett. 38, 4996–4999 (2013).

15. 15.

Culka, A., Košek, F., Drahota, P. & Jehlička, J. Use of miniaturized raman spectrometer for detection of sulfates of different hydration states–significance for mars studies. Icarus 243, 440–453 (2014).

16. 16.

Wang, P. & Menon, R. Computational spectrometer based on a broadband diffractive optic. Opt. Express 22, 14575–14587 (2014).

17. 17.

Bao, J. & Bawendi, M. G. A colloidal quantum dot spectrometer. Nature 523, 67 (2015).

18. 18.

Yang, T. et al. Miniature spectrometer based on diffraction in a dispersive hole array. Opt. Lett. 40, 3217–3220 (2015).

19. 19.

Baeck, P. et al. High resolution vegetation mapping with a novel compact hyperspectral camera system. In 13th International Conference on Precision Agriculture in St. Louis, Missouri, United States (2016).

20. 20.

Pügner, T., Knobbe, J. & Grüger, H. Near-infrared grating spectrometer for mobile phone applications. Appl. Spectrosc. 70, 734–745 (2016).

21. 21.

Foo, W. C., Widjaja, E., Khong, Y. M., Gokhale, R. & Chan, S. Y. Application of miniaturized near-infrared spectroscopy for quality control of extemporaneous orodispersible films. J. Pharm. Biomed. Anal. 150, 191–198 (2018).

22. 22.

Nelson, E. & Fredman, M. Hadamard spectroscopy. JOSA 60, 1664–1669 (1970).

23. 23.

Oliver, J., Lee, W., Park, S. & Lee, H.-N. Improving resolution of miniature spectrometers by exploiting sparse nature of signals. Opt. Express 20, 2613–2625 (2012).

24. 24.

Oliver, J., Lee, W.-B. & Lee, H.-N. Filters with random transmittance for improving resolution in filter-array-based spectrometers. Opt. Express 21, 3969–3989 (2013).

25. 25.

Lee, W.-B., James, O., Kim, S.-C. & Lee, H.-N. Random optical scatter filters for spectrometers: Implementation and estimation. In Imaging Systems and Applications, JTu4A–33 (Optical Society of America, Arlington, VA, United States, 2013).

26. 26.

Huang, Z. et al. Nonnegative matrix factorization numerical method for integrated photonic cavity based spectroscopy. J. Nanomater. 2014, 6 (2014).

27. 27.

Chong, X., Li, E., Squire, K. & Wang, A. X. On-chip near-infrared spectroscopy of co2 using high resolution plasmonic filter array. Appl. Phys. Lett. 108, 221106 (2016).

28. 28.

Frey, L., Masarotto, L., Armand, M., Charles, M.-L. & Lartigue, O. Multispectral interference filter arrays with compensation of angular dependence or extended spectral range. Opt. Express 23, 11799–11812 (2015).

29. 29.

Jang, W.-Y. et al. Experimental demonstration of adaptive infrared multispectral imaging using plasmonic filter array. Sci. Rep. 6, 34876 (2016).

30. 30.

Lee, W.-B., Kim, C., Ju, G. W., Lee, Y. T. & Lee, H.-N. Design of thin-film filters for resolution improvements in filter-array based spectrometers using dsp. In Next-Generation Spectroscopic Technologies IX, Vol. 9855, 98550Q (International Society for Optics and Photonics, Baltimore, MD, United States, 2016).

31. 31.

Huang, E., Ma, Q. & Liu, Z. Etalon array reconstructive spectrometry. Sci. Rep. 7, 40693 (2017).

32. 32.

Wang, Z. & Yu, Z. Spectral analysis based on compressive sensing in nanophotonic structures. Opt. Express 22, 25608–25614 (2014).

33. 33.

Gan, X., Pervez, N., Kymissis, I., Hatami, F. & Englund, D. A high-resolution spectrometer based on a compact planar two dimensional photonic crystal cavity array. Appl. Phys. Lett. 100, 231104 (2012).

34. 34.

Nitkowski, A., Chen, L. & Lipson, M. Cavity-enhanced on-chip absorption spectroscopy using microring resonators. Opt. Express 16, 11930–11936 (2008).

35. 35.

Chen, Y., Lin, H., Hu, J. & Li, M. Heterogeneously integrated silicon photonics for the mid-infrared and spectroscopic sensing. ACS Nano 8, 6955–6961 (2014).

36. 36.

Johnson, S. G., Fan, S., Villeneuve, P. R., Joannopoulos, J. D. & Kolodziejski, L. Guided modes in photonic crystal slabs. Phys. Rev. B 60, 5751 (1999).

37. 37.

Fan, S. & Joannopoulos, J. Analysis of guided resonances in photonic crystal slabs. Phys. Rev. B 65, 235112 (2002).

38. 38.

Fan, S., Suh, W. & Joannopoulos, J. D. Temporal coupled-mode theory for the fano resonance in optical resonators. JOSA A 20, 569–572 (2003).

39. 39.

Wang, K. X., Yu, Z., Sandhu, S. & Fan, S. Fundamental bounds on decay rates in asymmetric single-mode optical resonators. Opt. Lett. 38, 100–102 (2013).

40. 40.

Xu, Z. et al. Multimodal multiplex spectroscopy using photonic crystals. Opt. Express 11, 2126–2133 (2003).

41. 41.

Grant, M., Boyd, S. & Ye, Y. Cvx: Matlab software for disciplined convex programming, CVX Research, Inc. is a corporation created to support the development of convex optimization tools, including the eponymous package CVX (2008).

42. 42.

Grant, M. C. & Boyd, S. P. Graph implementations for nonsmooth convex programs. In Recent Advances in Learning and Control, 95–110 (Springer, London, UK, 2008).

43. 43.

Meaburn, J. Versatile nebular insect-eye fabry-perot spectrograph. Appl. Opt. 14, 465–469 (1975).

44. 44.

Okamoto, T. & Yamaguchi, I. Simultaneous acquisition of spectral image information. Opt. Lett. 16, 1277–1279 (1991).

45. 45.

Harvey, A. R. & Fletcher-Holmes, D. W. High-throughput snapshot spectral imaging in two dimensions. In Spectral Imaging: Instrumentation, Applications, and Analysis II, Vol. 4959, 46–55 (International Society for Optics and Photonics, San Jose, CA, United States, 2003).

46. 46.

George, T. C. et al. Distinguishing modes of cell death using the imagestream multispectral imaging flow cytometer. Cytom. Part A 59, 237–245 (2004).

47. 47.

Gehm, M., John, R., Brady, D., Willett, R. & Schulz, T. Single-shot compressive spectral imaging with a dual-disperser architecture. Opt. Express 15, 14013–14027 (2007).

48. 48.

Wagadarikar, A. A., Pitsianis, N. P., Sun, X. & Brady, D. J. Video rate spectral imaging using a coded aperture snapshot spectral imager. Opt. Express 17, 6368–6388 (2009).

49. 49.

Bland-Hawthorn, J. et al. Hexabundles: imaging fiber arrays for low-light astronomical applications. Opt. Express 19, 2649–2661 (2011).

## Acknowledgements

We would like to thank Dr. Chun-Chieh Chang at Los Alamos National Laboratory for assistance on developing electron-beam lithography recipe. We thank Denise Webb at Sandia National Laboratories for making photomasks  for our test patterns. We also thank Liang Zhang at University of Minnesota for help with signal recovery algorithm. The work was partially supported by NSF CAREER Award and DARPA Young Faculty Award (YFA).

## Author information

Z.W. performed the numerical simulation, designed the device structure, and performed experimental data analysis. S.Y., T.L., A.J., J.N., Z.W. and W.R. fabricated the device. Z.W., S.Y. and A.C. designed the experimental set-up and performed the measurements. G.J., A.S. and M.K. performed FTIR measurement. All authors contributed to the writing  of the manuscript.

### Competing interests

Ken Xingze Wang and Zongfu Yu hold financial interests in Coherent AI LLC, a company that licensed the technology for commercialization. The remaining authors declare no competing interests.

Correspondence to Zongfu Yu.