Abstract
Light-sheet microscopy is a powerful method for imaging the development and function of complex biological systems at high spatiotemporal resolution and over long time scales. Such experiments typically generate terabytes of multidimensional image data, and thus they demand efficient computational solutions for data management, processing and analysis. We present protocols and software to tackle these steps, focusing on the imaging-based study of animal development. Our protocols facilitate (i) high-speed lossless data compression and content-based multiview image fusion optimized for multicore CPU architectures, reducing image data size 30–500-fold; (ii) automated large-scale cell tracking and segmentation; and (iii) visualization, editing and annotation of multiterabyte image data and cell-lineage reconstructions with tens of millions of data points. These software modules are open source. They provide high data throughput using a single computer workstation and are readily applicable to a wide spectrum of biological model systems.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$259.00 per year
only $21.58 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Voie, A.H., Burns, D.H. & Spelman, F.A. Orthogonal-plane fluorescence optical sectioning: three-dimensional imaging of macroscopic biological specimens. J. Microsc. 170, 229–236 (1993).
Fuchs, E., Jaffe, J., Long, R. & Azam, F. Thin laser light sheet microscope for microbial oceanography. Opt. Express 10, 145–154 (2002).
Huisken, J., Swoger, J., Del Bene, F., Wittbrodt, J. & Stelzer, E.H.K. Optical sectioning deep inside live embryos by selective plane illumination microscopy. Science 305, 1007–1009 (2004).
Keller, P.J., Schmidt, A.D., Wittbrodt, J. & Stelzer, E.H. Reconstruction of zebrafish early embryonic development by scanned light sheet microscopy. Science 322, 1065–1069 (2008).
Ahrens, M.B., Orger, M.B., Robson, D.N., Li, J.M. & Keller, P.J. Whole-brain functional imaging at cellular resolution using light-sheet microscopy. Nat. Methods 10, 413–420 (2013).
Wu, Y. et al. Spatially isotropic four-dimensional imaging with dual-view plane illumination microscopy. Nat. Biotechnol. 31, 1032–1038 (2013).
Krzic, U., Gunther, S., Saunders, T.E., Streichan, S.J. & Hufnagel, L. Multiview light-sheet microscope for rapid in toto imaging. Nat. Methods 9, 730–733 (2012).
Tomer, R., Khairy, K., Amat, F. & Keller, P.J. Quantitative high-speed imaging of entire developing embryos with simultaneous multiview light-sheet microscopy. Nat. Methods 9, 755–763 (2012).
Schmid, B. et al. High-speed panoramic light-sheet microscopy reveals global endodermal cell dynamics. Nat. Commun. 4, 2207 (2013).
Holekamp, T.F., Turaga, D. & Holy, T.E. Fast three-dimensional fluorescence imaging of activity in neural populations by objective-coupled planar illumination microscopy. Neuron 57, 661–672 (2008).
Truong, T.V., Supatto, W., Koos, D.S., Choi, J.M. & Fraser, S.E. Deep and fast live imaging with two-photon scanned light-sheet microscopy. Nat. Methods 8, 757–760 (2011).
Gao, L. et al. Noninvasive imaging beyond the diffraction limit of 3D dynamics in thickly fluorescent specimens. Cell 151, 1370–1385 (2012).
Chen, B.C. et al. Lattice light-sheet microscopy: imaging molecules to embryos at high spatiotemporal resolution. Science 346, 1257998 (2014).
Keller, P.J. et al. Fast, high-contrast imaging of animal development with scanned light sheet-based structured-illumination microscopy. Nat. Methods 7, 637–642 (2010).
Capoulade, J., Wachsmuth, M., Hufnagel, L. & Knop, M. Quantitative fluorescence imaging of protein diffusion and interaction in living cells. Nat. Biotechnol. 29, 835–839 (2011).
Keller, P.J. Imaging morphogenesis: technological advances and biological insights. Science 340, 1234168 (2013).
Pantazis, P. & Supatto, W. Advances in whole-embryo imaging: a quantitative transition is underway. Nat. Rev. Mol. Cell Biol. 15, 327–339 (2014).
Stelzer, E.H. Light-sheet fluorescence microscopy for quantitative biology. Nat. Methods 12, 23–26 (2014).
Huisken, J. Slicing embryos gently with laser light sheets. Bioessays 34, 406–411 (2012).
Pampaloni, F., Reynaud, E.G. & Stelzer, E.H. The third dimension bridges the gap between cell culture and live tissue. Nat. Rev. Mol. Cell Biol. 8, 839–845 (2007).
Keller, P.J., Ahrens, M.B. & Freeman, J. Light-sheet imaging for systems neuroscience. Nat. Methods 12, 27–29 (2014).
Keller, P.J. & Ahrens, M.B. Visualizing whole-brain activity and development at the single-cell level using light-sheet microscopy. Neuron 85, 462–483 (2015).
Lemon, W.C. & Keller, P.J. Live imaging of nervous system development and function using light-sheet microscopy. Mol. Reprod. Dev. 82, 605–618 (2015).
Megason, S.G. & Fraser, S.E. Imaging in systems biology. Cell 130, 784–795 (2007).
Khairy, K. & Keller, P.J. Reconstructing embryonic development. Genesis 49, 488–513 (2011).
McMahon, A., Supatto, W., Fraser, S.E. & Stathopoulos, A. Dynamic analyses of Drosophila gastrulation provide insights into collective cell migration. Science 322, 1546–1550 (2008).
Fernandez, R. et al. Imaging plant growth in 4D: robust tissue reconstruction and lineaging at cell resolution. Nat. Methods 7, 547–553 (2010).
Bosveld, F. et al. Mechanical control of morphogenesis by Fat/Dachsous/Four-jointed planar cell polarity pathway. Science 336, 724–727 (2012).
Murray, J.I. et al. Automated analysis of embryonic gene expression with cellular resolution in C. elegans. Nat. Methods 5, 703–709 (2008).
Liu, X. et al. Analysis of cell fate from single-cell gene expression profiles in C. elegans. Cell 139, 623–633 (2009).
Trichas, G. et al. Multi-cellular rosettes in the mouse visceral endoderm facilitate the ordered migration of anterior visceral endoderm cells. PLoS Biol. 10, e1001256 (2012).
Xiong, F. et al. Specified neural progenitors sort to form sharp domains after noisy Shh signaling. Cell 153, 550–561 (2013).
Du, Z., Santella, A., He, F., Tiongson, M. & Bao, Z. De novo inference of systems-level mechanistic models of development from live-imaging-based phenotype analysis. Cell 156, 359–372 (2014).
Panier, T. et al. Fast functional imaging of multiple brain regions in intact zebrafish larvae using selective plane illumination microscopy. Front. Neural Circuits 7, 65 (2013).
Lemon, W. et al. Whole central nervous system functional imaging in larval Drosophila. Nat. Commun. 6, 7924 (2015).
Alivisatos, A.P. et al. The brain activity map project and the challenge of functional connectomics. Neuron 74, 970–974 (2012).
Saalfeld, S., Cardona, A., Hartenstein, V. & Tomancˇák, P CATMAID: collaborative annotation toolkit for massive amounts of image data. Bioinformatics 25, 1984–1986 (2009).
Cardona, A. Collaborative annotation toolkit for massive amounts of image data (CATMAID) GitHub repository https://github.com/acardona/CATMAID (2015).
Amat, F. et al. Fast, accurate reconstruction of cell lineages from large-scale fluorescence microscopy data. Nat. Methods 11, 951–958 (2014).
Lauri, A. et al. Development of the annelid axochord: insights into notochord evolution. Science 345, 1365–1368 (2014).
Preibisch, S., Saalfeld, S., Schindelin, J. & Tomancak, P. Software for bead-based registration of selective plane illumination microscopy data. Nat. Methods 7, 418–419 (2010).
Bao, Z. et al. Automated cell lineage tracing in Caenorhabditis elegans. Proc. Natl. Acad. Sci. USA 103, 2707–2712 (2006).
Murray, J.I., Bao, Z., Boyle, T.J. & Waterston, R.H. The lineaging of fluorescently-labeled Caenorhabditis elegans embryos with StarryNite and AceTree. Nat. Protoc. 1, 1468–1476 (2006).
Giurumescu, C.A. et al. Quantitative semi-automated analysis of morphogenesis with single-cell resolution in complex embryos. Development 139, 4271–4279 (2012).
Olivier, N. et al. Cell lineage reconstruction of early zebrafish embryos using label-free nonlinear microscopy. Science 329, 967–971 (2010).
Kausler, B.X. et al. A discrete chain graph model for 3D+t cell tracking with high misdetection robustness. ECCV 7574, 144–157 (2012).
Stegmaier, J. et al. Fast segmentation of stained nuclei in terabyte-scale, time resolved 3D microscopy image stacks. PLoS ONE 9, e90036 (2014).
Schiegg, M. et al. Graphical model for joint segmentation and tracking of multiple dividing cells. Bioinformatics 31, 948–956 (2014).
Allan, C. et al. OMERO: flexible, model-driven data management for experimental biology. Nat. Methods 9, 245–253 (2012).
Megason, S.G. In toto imaging of embryogenesis with confocal time-lapse microscopy. Methods Mol. Biol. 546, 317–332 (2009).
Schroeder, W., Martin, K. & Lorensen, B. The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics. 4th edn. (Kitware, 2006).
Peng, H., Ruan, Z., Long, F., Simpson, J.H. & Myers, E.W. V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets. Nat. Biotechnol. 28, 348–353 (2010).
Bria, A., Iannello, G. & Peng, H. An open-source VAA3D plugin for real-time 3D visualization of terabyte-sized volumetric images. ISBI, 520–523 (2015).
Pietzsch, T., Saalfeld, S., Preibisch, S. & Tomancak, P. BigDataViewer: visualization and processing for large image data sets. Nat. Methods 12, 481–483 (2015).
Akerboom, J. et al. Optimization of a GCaMP calcium indicator for neural activity imaging. J. Neurosci. 32, 13819–13840 (2012).
Chen, T.W. et al. Ultrasensitive fluorescent proteins for imaging neuronal activity. Nature 499, 295–300 (2013).
Kanodia, J.S. et al. A computational statistics approach for estimating the spatial range of morphogen gradients. Development 138, 4867–4874 (2011).
Pitrone, P.G. et al. OpenSPIM: an open-access light-sheet microscopy platform. Nat. Methods 10, 598–599 (2013).
Gualda, E.J. et al. OpenSpinMicroscopy: an open-source integrated microscopy platform. Nat. Methods 10, 599–600 (2013).
Bock, D.D. et al. Network anatomy and in vivo physiology of visual cortical neurons. Nature 471, 177–182 (2011).
Tomer, R., Ye, L., Hsueh, B. & Deisseroth, K. Advanced CLARITY for rapid and high-resolution imaging of intact tissues. Nat. Protoc. 9, 1682–1697 (2014).
Susaki, E.A. et al. Whole-brain imaging with single-cell resolution using chemical cocktails and computational analysis. Cell 157, 726–739 (2014).
Dodt, H.U. et al. Ultramicroscopy: three-dimensional visualization of neuronal networks in the whole mouse brain. Nat. Methods 4, 331–336 (2007).
Schindelin, J. et al. Fiji: an open-source platform for biological-image analysis. Nat. Methods 9, 676–682 (2012).
Schneider, C.A., Rasband, W.S. & Eliceiri, K.W. NIH image to ImageJ: 25 years of image analysis. Nat. Methods 9, 671–675 (2012).
Acknowledgements
We thank A. Cardona and the participants of the Janelia CATMAID hackathon for help with modifying the open-source code of CATMAID; K. Khairy for his contributions to exploring approaches to multiview image fusion and SiMView data management; and K. Branson and A. Cardona for helpful comments on the manuscript. This work was supported by the Howard Hughes Medical Institute.
Author information
Authors and Affiliations
Contributions
F.A. and B.H. developed the KLB file format and related software infrastructure. P.J.K. developed the multiview registration and fusion software, with contributions from F.A. F.A. developed the TGMM framework and related software infrastructure. Y.W., W.C.L. and K.M. performed light-sheet microscopy experiments and contributed image data sets. F.A. and P.J.K. wrote the manuscript, with input from all authors.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Integrated supplementary information
Supplementary Figure 1 Local performance of lossless compression image file formats
Performance of the KLB lossless compression format vs. LZW-TIFF (green) and JPEG 2000 (blue) lossless compression formats with respect to write speed (first column) and read speed (second column). The JPEG 2000 benchmark utilizes the multi-threaded commercial library PICTools Medical SDK (Accusoft). A performance comparison of KLB and uncompressed TIFF formats is included as well (orange). LZW-TIFF and uncompressed TIFF benchmarks utilize the imread and imwrite functions provided by the Image Processing Toolbox in Matlab. All performance data are provided as ratios with KLB performance in the numerator, i.e. ratios larger than one (grey lines) indicate superior performance of the KLB format. The comparison was performed using a variety of fluorescence microscopy image data sets stored locally on a high-performance RAID array built from solid-state drives (SSDs) and thus complements the network-based analysis shown in Fig. 3 (note that performance with respect to compression ratios is identical to the data shown in Fig. 3). Benchmark data sets include SiMView light-sheet microscopy recordings of fruit fly, mouse and zebrafish embryonic development (data sets 1-8), confocal microscopy data of a zebrafish embryo (data set 9) and SiMView functional image data of brain activity in a larval zebrafish (data set 10). Developmental data sets (data sets 1-8) were analyzed as raw and masked versions in order to illustrate the importance of background masking for maximizing data storage and access efficiency. Please see Steps I-III in Fig. 2 for a description of the concepts underlying background masking.
Supplementary Figure 2 Block-size dependency of KLB file size and read/write speeds
Performance comparison for KLB versus JPEG 2000 (JP2) with respect to file size (a), write time (b) and read time (c), as a function of KLB block size (in pixels). The results represent average performance across five data sets, including developmental image data from a fruit fly embryo, a zebrafish embryo and early-/late-stage mouse embryos as well as functional image data from a zebrafish larva. The larger the block size, the better the KLB compression ratio; however, this ratio reaches saturation already for relatively small block sizes. Read and write times are not optimal for extreme block sizes, i.e. both for very small and for very large blocks. If blocks are too small, communication overhead in processing threads becomes an issue. If blocks are too large, computations cannot be parallelized to the maximum extent (in the most extreme scenario, a single thread has to handle the entire image). The figure shows a diagonal band, where all three metrics are optimal or near optimal at the same time. Based on these benchmarks, we chose the default block size as 96 x 96 x 8 pixels. The JPEG 2000 benchmark utilizes the multi-threaded commercial library PICTools Medical SDK (Accusoft). Lateral size refers to the X and Y axes of the image volume. Axial size refers to the Z axis of the image volume, which is typically smaller than the lateral size in light microscopy due to anisotropic spatial resolution in the microscope and anisotropic spatial sampling of the specimen volume.
Supplementary Figure 3 KLB performance comparison for local vs. network data storage
Comparison of KLB read and write speeds on a local data drive versus a data drive mounted over the network (using a 10 Gb/s glass fiber connection). Speeds are comparable since most of the time is spent on data compression and decompression, respectively, and physical disk access introduces relatively little overhead. Moreover, most modern operating systems and RAID hardware improve I/O performance by caching and by using dedicated processors that avoid load on primary CPUs. Thus, while some blocks are compressed or decompressed others are written or read, respectively, masking I/O costs. All data points are averages based on n = 5 iterations of the benchmark.
Supplementary information
Supplementary Text and Figures
Supplementary Figures 1–3, Supplementary Note 1, Supplementary Table 1 (PDF 1261 kb)
Supplementary Software 1
KLB lossless compression file format. This software package contains the C++11 source code for the KLB file format implementation as well as wrappers for Matlab and Java. The folder bin contains the precompiled static and shared (DLL) libraries for Windows 7 64-bit as well as a simple executable test_KLBIO.exe for testing read/write operations. The source code of this executable represents a good example of how to use the API for the KLB file format. For Windows 7 64-bit, we also provide precompiled MEX files in the folder matlabWrapper. Linux and Mac OS users need to compile both the source code and the Matlab wrappers to obtain libraries and executables. For the first part, a CMake file is available in the folder src. For the second part, the folder matlabWrapper contains the script compileMex.m for generating MEX files. The C++ libraries need to be compiled in release mode before compiling the MEX files. In order to keep track of possible software updates, the user can also clone all files from the primary public software repository using the following git command: git clone https://fernandoamat@bitbucket.org/fernandoamat/keller-lab-block-filetype.git (ZIP 4460 kb)
Supplementary Software 2
KLB Java Native Interface library and SCIFIO implementation. This software package exposes the C++ API on the Java side and includes a functional implementation of a SCIFIO format that provides KLB support to image processing frameworks such as ImageJ and Knime. Precompiled native libraries for Windows and Linux (64-bit) are bundled inside the JAR file included in this software package. For convenience, ImageJ users can follow the update site at http://sites.imagej.net/SiMView (for instructions, see http://wiki.imagej.net/How_to_follow_a_3rd_party_update_site). (ZIP 1099 kb)
Supplementary Software 3
Image processing pipeline for light-sheet microscopy. This software package contains our Matlab code for image processing of light-sheet microscopy data sets, including (1) sCMOS image correction, background masking and KLB lossless image compression (using script clusterPT.m), (2) content-based multi-view image registration and fusion (using scripts clusterMF.m, localAP.m and clusterTF.m), (3) spatial drift correction and intensity normalization (using scripts localEC.m and clusterCS.m) and (4) adaptive local background correction (using script clusterFR.m). Please see the README file for detailed information about these software modules. (ZIP 1003 kb)
Supplementary Software 4
TGMM software for segmentation and cell tracking. This software package contains the C++ and CUDA source code for the Tracking with Gaussian Mixture Models (TGMM) software for automated segmentation and cell tracking in light microscopy time-lapse data sets. The software package includes the following folders: src: contains all source code files. This folder also includes the file CMakeList.txt that can be used to compile the source code. doc: contains the documentation of the TGMM software. bin: contains Windows 7 64bit executables for running the TGMM software. When compiling the source code, the executables for the release version will be placed here. This folder also contains all necessary DLLs (CUDA and MSVC runtime) as well as the text files containing machine learning classifiers for cell division detection. Please see the README file for detailed information on how to run and compile the TGMM software. In order to keep track of possible software updates, the user can also clone all files from the primary public software repository using the following git command: git clone git://git.code.sf.net/p/tgmm/code tgmm-code (ZIP 72857 kb)
Supplementary Software 5
CATMAID branch for 5D image visualization and lineage editing. This software package contains our branch of the open source software CATMAID. The software can also be cloned using the following git command: git clone -b 5Dvisualization --single-branch https://fernandoamat@bitbucket.org/fernandoamat/catmaid_5d_visualization_annotation.git The PDF file UserGuide.pdf in the root folder of this software package and the website http://catmaid.org/ provide detailed instructions for setting up a CATMAID server. (ZIP 19979 kb)
Supplementary Software 6
Matlab import/export scripts for TGMM, CATMAID and Imaris. This software package contains Matlab code for transferring results between TGMM, CATMAID and Imaris. In order to optimize read speed, the code for reading XML files generated by TGMM needs to be compiled into MEX files. The folder readTGMM_XMLoutput contains the script compileMex.m for this purpose. The README file contains further details on this topic and a description of the main Matlab functions included in this software package. Briefly, these Matlab functions facilitate: (1) import of TGMM tracking and segmentation results into Matlab, (2) export of image data and tracking results from Matlab to CATMAID, (3) import of cell lineage information from CATMAID into Matlab, (4) export of cell lineage information from Matlab to Imaris. (ZIP 3470 kb)
Rights and permissions
About this article
Cite this article
Amat, F., Höckendorf, B., Wan, Y. et al. Efficient processing and analysis of large-scale light-sheet microscopy data. Nat Protoc 10, 1679–1696 (2015). https://doi.org/10.1038/nprot.2015.111
Published:
Issue Date:
DOI: https://doi.org/10.1038/nprot.2015.111
This article is cited by
-
Imagining the future of optical microscopy: everything, everywhere, all at once
Communications Biology (2023)
-
Lossy Image Compression in a Preclinical Multimodal Imaging Study
Journal of Digital Imaging (2023)
-
Practical considerations for quantitative light sheet fluorescence microscopy
Nature Methods (2022)
-
Harnessing non-destructive 3D pathology
Nature Biomedical Engineering (2021)
-
Light sheet fluorescence microscopy
Nature Reviews Methods Primers (2021)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.