Abstract
Newly developed scientific complementary metal-oxide semiconductor (sCMOS) cameras have the potential to dramatically accelerate data acquisition, enlarge the field of view and increase the effective quantum efficiency in single-molecule switching nanoscopy. However, sCMOS-intrinsic pixel-dependent readout noise substantially lowers the localization precision and introduces localization artifacts. We present algorithms that overcome these limitations and that provide unbiased, precise localization of single molecules at the theoretical limit. Using these in combination with a multi-emitter fitting algorithm, we demonstrate single-molecule localization super-resolution imaging at rates of up to 32 reconstructed images per second in fixed and living cells.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$259.00 per year
only $21.58 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
Accession codes
References
Hell, S.W. Microscopy and its focal switch. Nat. Methods 6, 24–32 (2009).
Gould, T.J., Hess, S.T. & Bewersdorf, J. Optical nanoscopy: from acquisition to analysis. Annu. Rev. Biomed. Eng. 14, 231–254 (2012).
van de Linde, S., Heilemann, M. & Sauer, M. Live-cell super-resolution imaging with synthetic fluorophores. Annu. Rev. Phys. Chem. 63, 519–540 (2012).
Mortensen, K.I., Churchman, L.S., Spudich, J.A. & Flyvbjerg, H. Optimized localization analysis for single-molecule tracking and super-resolution microscopy. Nat. Methods 7, 377–381 (2010).
Chao, J., Ram, S., Ward, E.S. & Ober, R.J. Ultrahigh accuracy imaging modality for super-localization microscopy. Nat. Methods 10, 335–338 (2013).
Hess, S.T. et al. Dynamic clustered distribution of hemagglutinin resolved at 40 nm in living cell membranes discriminates between raft theories. Proc. Natl. Acad. Sci. USA 104, 17370–17375 (2007).
Jones, S.A., Shim, S.-H., He, J. & Zhuang, X. Fast, three-dimensional super-resolution imaging of live cells. Nat. Methods 8, 499–505 (2011).
Shim, S.-H. et al. Super-resolution fluorescence imaging of organelles in live cells with photoswitchable membrane probes. Proc. Natl. Acad. Sci. USA 109, 13978–13983 (2012).
Saurabh, S., Maji, S. & Bruchez, M.P. Evaluation of sCMOS cameras for detection and localization of single Cy5 molecules. Opt. Express 20, 7338–7349 (2012).
Long, F., Zeng, S. & Huang, Z.-L. Localization-based super-resolution microscopy with an sCMOS camera. Part II: experimental methodology for comparing sCMOS with EMCCD cameras. Opt. Express 20, 17741–17759 (2012).
Ober, R.J., Ram, S. & Ward, E.S. Localization accuracy in single-molecule microscopy. Biophys. J. 86, 1185–1200 (2004).
Smith, C.S., Joseph, N., Rieger, B. & Lidke, K.A. Fast, single-molecule localization that achieves theoretically minimum uncertainty. Nat. Methods 7, 373–375 (2010).
Huang, F., Schwartz, S.L., Byars, J.M. & Lidke, K.A. Simultaneous multiple-emitter fitting for single molecule super-resolution imaging. Biomed. Opt. Express 2, 1377–1393 (2011).
Zhu, L., Zhang, W., Elnatan, D. & Huang, B. Faster STORM using compressed sensing. Nat. Methods 9, 721–723 (2012).
Zhang, M. et al. Rational design of true monomeric and bright photoactivatable fluorescent proteins. Nat. Methods 9, 727–729 (2012).
Collins, A., Warrington, A., Taylor, K.A. & Svitkina, T. Structural organization of the actin cytoskeleton at sites of clathrin-mediated endocytosis. Curr. Biol. 21, 1167–1175 (2011).
Sironi, L. et al. Automatic quantification of microtubule dynamics enables RNAi-screening of new mitotic spindle regulators. Cytoskeleton (Hoboken) 68, 266–278 (2011).
Biteen, J.S., Goley, E.D., Shapiro, L. & Moerner, W.E. Three-dimensional super-resolution imaging of the midplane protein FtsZ in live Caulobacter crescentus cells using astigmatism. ChemPhysChem 13, 1007–1012 (2012).
Doherty, G.J. & McMahon, H.T. Mechanisms of endocytosis. Annu. Rev. Biochem. 78, 857–902 (2009).
Juette, M.F. & Bewersdorf, J. Three-dimensional tracking of single fluorescent particles with submillisecond temporal resolution. Nano Lett. 10, 4657–4663 (2010).
Lukinavičius, G. et al. A near-infrared fluorophore for live-cell super-resolution microscopy of cellular proteins. Nat. Chem. 5, 132–139 (2013).
Benke, A. & Manley, S. Live-cell dSTORM of cellular DNA based on direct DNA labeling. ChemBioChem 13, 298–301 (2012).
Vaughan, J.C., Jia, S. & Zhuang, X. Ultrabright photoactivatable fluorophores created by reductive caging. Nat. Methods 9, 1181–1184 (2012).
Lee, M.K., Williams, J., Twieg, R.J., Rao, J. & Moerner, W.E. Enzymatic activation of nitro-aryl fluorogens in live bacterial cells for enzymatic turnover-activated localization microscopy. Chem. Sci. 4, 220–225 (2013).
Manley, S. et al. High-density mapping of single-molecule trajectories with photoactivated localization microscopy. Nat. Methods 5, 155–157 (2008).
Juette, M.F. et al. Three-dimensional sub–100 nm resolution fluorescence microscopy of thick samples. Nat. Methods 5, 527–529 (2008).
Aquino, D. et al. Two-color nanoscopy of three-dimensional volumes by 4Pi detection of stochastically switched fluorophores. Nat. Methods 8, 353–359 (2011).
Testa, I. et al. Multicolor fluorescence nanoscopy in fixed and living cells by exciting conventional fluorophores with a single wavelength. Biophys. J. 99, 2686–2694 (2010).
Gunewardene, M.S. et al. Superresolution imaging of multiple fluorescent proteins with highly overlapping emission spectra in living cells. Biophys. J. 101, 1522–1528 (2011).
Wilks, S.S. The large-sample distribution of the likelihood ratio for testing composite hypotheses. Ann. Math. Stat. 9, 60–62 (1938).
Shore, E. & Small, A. Optimal acquisition scheme for subwavelength localization microscopy of bleachable fluorophores. A. Opt. Lett. 36, 289–291 (2011).
Lidke, K.A., Rieger, B., Lidke, D.S. & Jovin, T.M. The role of photon statistics in fluorescence anisotropy imaging. IEEE Trans. Image Process. 14, 1237–1245 (2005).
Acknowledgements
We thank J. Munro, P. Pellett, L. Schroeder, F. Bottanelli and M. Gudheti for helpful discussions about the buffer and sample preparation, J. Spatz for support, and P. de Camilli, O. Idevall-Hagren, T. Gould, E. Allgeyer and E. Kromann for helpful comments on the manuscript. We thank P. Xu (Chinese Academy of Sciences) for providing the mEos3.2 plasmid for initial experiments and G. Patterson (US National Institutes of Health) for the human clathrin light chain plasmid. This work was supported by grants from the Wellcome Trust (095927/A/11/Z), US National Institutes of Health (R01 CA098727 to W.M.) and Raymond and Beverly Sackler Institute for Biological, Physical and Engineering Sciences.
Author information
Authors and Affiliations
Contributions
F.H. and J.B. conceived the project. F.H., T.M.P.H., Y.L. and J.B. built the setup and designed the bead experiments. All authors designed the biological imaging experiments. F.H., T.M.P.H., Y.L., J.J.L., P.D.U. and J.R.M. performed the fixed-cell experiments. F.H., F.E.R.-M., W.C.D. and J.J.L. performed the live-cell experiments. M.A.B. and M.W.D. generated the mEos3.2 and tdEos plasmids. F.H. wrote the software and performed the simulations and analysis. All authors wrote the manuscript.
Corresponding author
Ethics declarations
Competing interests
F.H. and J.B. are co-inventors on a patent application related in part to the material presented here. J.B. is consultant, equity holder and member of the scientific advisory board of Vutara, Inc., which makes super-resolution microscopes.
Supplementary information
Supplementary Text and Figures
Supplementary Figures 1–13, Supplementary Table 1 and Supplementary Note (PDF 4240 kb)
Supplementary Data
ZIP archive of obtained localization estimates and uncompressed super-resolution images for Figure 2a. (i) Uncompressed super-resolution image stretched for visualization purpose. (ii) Uncompressed 2D histogram image. (iii) List of localization estimates containing x, y position estimates and their averaged localization uncertainty (square root of their mean variance from CRLBsCMOS). Units are in pixels (103 nm). (ZIP 53695 kb)
Supplementary Software
Example of the developed algorithms implemented in Matlab and CUDA. (ZIP 50737 kb)
Super-resolution video of mEOS3.2-labeled CCPs in a live HeLa cell
Raw data were recorded as described in the Online Methods. Acquired images were analyzed using single-emitter fitting (Online Methods). 1,200 frames were combined to reconstruct each super-resolution image corresponding to a 2-s time window. Localization estimates in each image were binned into 20-nm pixels for display. To generate the video, we combined all 40 super-resolution images into a three-dimensional (3D) data stack and smoothed with a 3D Gaussian kernel with σx,y = 20 nm and σt = 2 s to aid visualization. The resulting stack was converted into a video playing back at 15 frames per second. Scale bar, 5 μm. (AVI 105080 kb)
Super-resolution video of mEOS3.2-labeled CCPs in a second live HeLa cell
This video corresponds to the data set shown in Figure 3a–c. Raw data were recorded as described in the Online Methods. Acquired images were analyzed using single-emitter fitting (Online Methods). 1,200 frames were combined to reconstruct each super-resolution image corresponding to a 2-s time window. Localization estimates in each image were binned into 20-nm pixels for display. To generate the video, we combined all 22 super-resolution images into a 3D data stack and smoothed with a 3D Gaussian kernel with σx,y = 20 nm and σt = 2 s to aid visualization. The resulting stack was converted into a video playing back at 15 frames per second. Scale bar, 5 μm. (AVI 57801 kb)
Super-resolution video for a small cutout of a larger data set of mEOS3.2-labeled CCPs in a live HeLa cell (1)
Raw data were recorded as described in the Online Methods. Acquired images were analyzed using single-emitter fitting (Online Methods). 1,200 frames were combined to reconstruct each super-resolution image corresponding to a 2-s time window. Localization estimates in each image were binned into 10-nm pixels for display. To generate the video, we combined all 28 super-resolution images into a 3D data stack and smoothed with a 3D Gaussian kernel with σx,y = 10 nm and σt = 2 s to aid visualization. The resulting stack was converted into a video playing back at 15 frames per second. Scale bar, 500 nm. (AVI 55160 kb)
Super-resolution video for a small cutout of a larger data set of mEOS3.2-labeled CCPs in a live HeLa cell (2)
This video corresponds to the data set shown in Figure 3a–c. Raw data were recorded as described in the Online Methods. Acquired images were analyzed using single-emitter fitting (Online Methods). 1,200 frames were combined to reconstruct each super-resolution image corresponding to a 2-s time window. Localization estimates in each image were binned into 10-nm pixels for display. To generate the video, we combined all 19 super-resolution images into a 3D data stack and smoothed with a 3D Gaussian kernel with σx,y = 10 nm and σt = 2 s to aid visualization. The resulting stack was converted into a video playing back at 15 frames per second. Scale bar, 500 nm. (AVI 37431 kb)
Super-resolution video for a small cutout of a larger data set of mEOS3.2-labeled CCPs in a live HeLa cell (3)
This video corresponds to the data set shown in Figure 3a–c. Raw data were recorded as described in the Online Methods. Acquired images were analyzed using single-emitter fitting (Online Methods). 1,200 frames were combined to reconstruct each super-resolution image corresponding to a 2-s time window. Localization estimates in each image were binned into 10-nm pixels for display. To generate the video, we combined all 29 super-resolution images into a 3D data stack and smoothed with a 3D Gaussian kernel with σx,y = 10 nm and σt = 2 s to aid visualization. The resulting stack was converted into a video playing back at 15 frames per second. Scale bar, 500 nm. (AVI 57130 kb)
Super-resolution video of tdEos-labeled human PDHA1 in COS-7 cells
Raw data were recorded as described in the Online Methods. Acquired images were analyzed using our multi-emitter fitting algorithm. 200 frames were combined to reconstruct each super-resolution image corresponding to a 0.5-s time window. Localization estimates in each image were binned into 20-nm pixels for display. To generate the video, we combined all 144 super-resolution images into a 3D data stack and smoothed with a 3D Gaussian kernel with σx,y = 20 nm and σt = 2 s to aid visualization. The resulting stack was converted into a video playing back at 25 frames per second. Scale bar , 5 μm. (AVI 225904 kb)
Super-resolution video of mEOS3.2-labeled EB3 in live HeLa cells
Raw data were recorded as described in the Online Methods. This video corresponds to one of the data sets shown in Supplementary Figure 11. Acquired images were analyzed using our multi-emitter fitting algorithm. 600 frames were combined to reconstruct each super-resolution image corresponding to a 1-s time window. Localization estimates in each image were binned into 20-nm pixels for display. To generate the video, we combined all 21 super-resolution images into a 3D data stack and smoothed with a 3D Gaussian kernel with σx,y = 20 nm and σt = 2 s to aid visualization. The resulting stack was converted into a video playing back at 15 frames per second. Scale bar , 5 μm. (AVI 41371 kb)
Super-resolution video of tdEos-labeled peroxisome membrane protein in live COS-7 cells
This video corresponds to the dat aset shown in Figure 3d–f. Raw data were recorded as described in Online Methods. Acquired images were analyzed using our single-emitter fitting algorithm. 300 frames were combined to reconstruct each super-resolution image corresponding to a 0.5-s time window. Localization estimates in each image were binned into 20-nm pixels for display. To generate the video, we smoothed all 165 super-resolution images with a 2D Gaussian kernel with σx,y = 20 nm to aid visualization and then combined them into a 3D data stack. The resulting stack was converted into a video playing back at 15 frames per second. Scale bar, 5 μm. (AVI 433405 kb)
Super-resolution video of Alexa Fluor 647–labeled transferrin receptor cluster dynamics as shown in Figure 4a
Each frame corresponds to a 31-ms reconstructed super-resolution image and is played back at four frames per second. (AVI 1538 kb)
Super-resolution video of Alexa Fluor 647–labeled transferrin receptor cluster dynamics as shown in Figure 4b
Each frame corresponds to a 31-ms reconstructed super-resolution image and is played back at four frames per second. (AVI 1922 kb)
Rights and permissions
About this article
Cite this article
Huang, F., Hartwich, T., Rivera-Molina, F. et al. Video-rate nanoscopy using sCMOS camera–specific single-molecule localization algorithms. Nat Methods 10, 653–658 (2013). https://doi.org/10.1038/nmeth.2488
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nmeth.2488
This article is cited by
-
An integrated platform for high-throughput nanoscopy
Nature Biotechnology (2023)
-
Stepwise requirements for polymerases δ and θ in theta-mediated end joining
Nature (2023)
-
Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging
Nature Communications (2023)
-
HyU: Hybrid Unmixing for longitudinal in vivo imaging of low signal-to-noise fluorescence
Nature Methods (2023)
-
Rapid detection of neurons in widefield calcium imaging datasets after training with synthetic data
Nature Methods (2023)