Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Open-source image reconstruction of super-resolution structured illumination microscopy data in ImageJ

Abstract

Super-resolved structured illumination microscopy (SR-SIM) is an important tool for fluorescence microscopy. SR-SIM microscopes perform multiple image acquisitions with varying illumination patterns, and reconstruct them to a super-resolved image. In its most frequent, linear implementation, SR-SIM doubles the spatial resolution. The reconstruction is performed numerically on the acquired wide-field image data, and thus relies on a software implementation of specific SR-SIM image reconstruction algorithms. We present fairSIM, an easy-to-use plugin that provides SR-SIM reconstructions for a wide range of SR-SIM platforms directly within ImageJ. For research groups developing their own implementations of super-resolution structured illumination microscopy, fairSIM takes away the hurdle of generating yet another implementation of the reconstruction algorithm. For users of commercial microscopes, it offers an additional, in-depth analysis option for their data independent of specific operating systems. As a modular, open-source solution, fairSIM can easily be adapted, automated and extended as the field of SR-SIM progresses.

Introduction

The improvement in spatial resolution achieved in super-resolved structured illumination fluorescence microscopy (SR-SIM) is accomplished by illuminating a sample with a well-defined set of sinusoidal illumination intensity patterns, that is, typically a set of interference patterns1. The light modulation leads to frequency mixing between the harmonic pattern frequency and the sample frequencies, which is then demodulated by a digital image reconstruction step2. This enables access to previously unobservable high-frequency components, and thus improves spatial resolution. For linear SR-SIM, the illumination pattern adheres to (approximately) the same resolution limit as the imaging path, hence SR-SIM doubles the spatial resolution in comparison with a wide-field image3.

The principle and design of the instrumentation for SR-SIM is well documented in the literature1,2, and the technique is now in wide use4,5,6,7,8,9,10. It has also been successfully combined with other optical techniques11,12,13,14,15,16, where non-linear approaches17,18,19,20 allow to surpass the factor of 2 × in resolution improvement.

SIM data sets are usually acquired by a modified wide-field microscope, where a light-modulating component is introduced into the excitation path. Nowadays, commercial SR-SIM platforms are available by different manufacturers. Also, spatial light modulators (SLMs) offer a simple, robust and cost-efficient way to custom-build such systems. Recent publications provide detailed blueprints for home-built SR-SIM microscope set-ups21,22,23, focusing on the design of customizable, cost-effective and fast systems.

The algorithm required for SR-SIM reconstructions can readily be found in the literature, for example, in the publication by Gustafsson et al.2. However, as of now, there is no implementation available for ImageJ. Existing solutions are either provided as proprietary components of commercial SIM microscopes, often bound to a dedicated workstation computer, or exist as purpose-written tools by different research groups24. In the related field of super-resolved localization microscopy, the situation is rather different. Various well-known open-source solutions, for example, QuickPALM25 and rapidSTORM26, with different feature sets (a summary of which was published recently27), and often direct integration with ImageJ, are available for data analysis.

This, together with our own need for a SIM reconstruction software, motivated the development of fairSIM (free analysis and interactive reconstruction for structured illumination microscopy). FairSIM is aimed at providing a ready to use, easy to operate, free and open-source solution for SR-SIM. It features a plugin that integrates directly into ImageJ28/Fiji29, allowing it to use all image formats supported by ImageJ, and easy integration with its other pre- and post-processing steps.

Results

Concept and motivation for developing fairSIM

FairSIM was primarily designed to provide single-slice reconstructions of SR-SIM systems working with both two-beam interference (utilized by many home-built and total internal reflection-excited fluorescence (TIRF)-based systems) and three-beam interference (utilized in all commercially available systems) for pattern generation. This development was motivated by the need for both a rapid and flexible single-slice reconstruction mode for our own commercial SR-SIM system30, and a stand-alone reconstruction tool for our home-built, two-beam illumination SIM set-ups.

FairSIM is implemented as Java plugin, so it allows to carry out SR-SIM reconstructions directly from within ImageJ/Fiji. It is based on the well-established SIM illumination technique introduced by Gustaffson1,2 and Heintzmann31, and the corresponding reconstruction algorithms. By combining multiple raw images, each acquired under structured illumination by a defined pattern, these algorithms allow to enhance the resolution twofold in comparison with the corresponding wide-field image.

The advantage of single-slice reconstruction of SR-SIM images is that only raw images from one focal plane are needed. Thus, because it is not necessary to acquire multiple image sequences obtained at different vertical focus positions (z-stacks), image acquisition is much quicker. This is especially useful for live-cell applications, where short exposure times reduce photodamage and motion blur. As a drawback, however, the axial resolution is not improved. Lateral resolution enhancement is not impaired, and fairSIM retains optical sectioning through optical transfer function (OTF) attenuation32,33,34. Employable especially for three-beam interference data, the attenuation greatly reduces background contributions in thicker samples and thus mitigates reconstruction artefacts (Supplementary Fig. 1). Importantly, for advanced users and in-depth analysis, fairSIM also provides access to various intermediate results of the parameter estimation and reconstruction process in both frequency and spatial domains (Fig. 1). This greatly helps expert users to quickly judge progress and quality of the image reconstruction process, as well as in the analysis of more critical data sets, obtained for example when tuning home-built SR-SIM set-ups.

Testing fairSIM with different samples and microscopes

We extensively tested the capabilities of fairSIM with SR-SIM data sets acquired on different microscope platforms. A commercial DeltaVision|OMX (GE Healthcare, Issaquah, WA, USA) was used to provide the high-quality three-beam interference illumination data, and a much simpler, home-built, SLM-based two-beam interference illumination system was used to test the compatibility with less refined systems. Furthermore, data sets from systems available by other commercial manufacturers were also tested as described in detail below.

To characterize SR-SIM set-ups and software, fluorescent bead surfaces have become a standard test sample, as they provide easily quantifiable results. Using a defined bead size slightly below the optical resolution limit, beads in a dense surface cannot be distinguished in a wide-field fluorescence image. Only after applying SR-SIM, and thus improving the resolution twofold, individual beads become distinguishable. We imaged fluorescent Tetraspeck bead surfaces on both our home-built system (Fig. 2) and on the OMX (Fig. 3). In both cases, the beads are only separable in the SR-SIM reconstruction, but not in the wide-field image assembled from the SR-SIM image stack. A comparison with a full three-dimensional (3D) reconstruction is provided for images acquired on the OMX, where the cross-section plots show that both single-slice and full 3D reconstruction achieve a comparable improvement in lateral resolution.

Figure 1: Examples for intermediate SR-SIM results displayed as power spectra in frequency space.
figure 1

(a) Visualization of the cross-correlation used for parameter estimation, with circles marking the low-frequency region excluded from the fit and the detected modulation frequency. The three insets on the upper left visualize the iterative sub-pixel fits and provide a quick feedback if the fit was successful. (b) Power spectrum of the complete, reassembled SR-SIM reconstruction of fluorescent beads (Fig. 3). The circular structure visible in the spectrum is located at 4.5 μm−1, which coincides with the beads’ size of 200 nm, and is thus expected. Scale bar, 2.5 μm−1.

Figure 2: FairSIM reconstruction of data sets obtained on a simple SLM-based SR-SIM setup.
figure 2

A glass surface with 200 nm Tetraspeck beads was used as test sample, excitated at 642 nm wavelength. In contrast to the (Wiener filtered) wide-field image (a), the SR-SIM reconstruction by fairSIM (b) yields clearly distinct beads. This can be found quantitatively from the cross-section plots, given for a single bead in c and two close-by beads (indistinguishable in wide-field mode) in d. A simplified sketch of the set-up used is given in e. Scale bar, 5 μm, inset 1.2 μm.

Figure 3: FairSIM reconstruction of data sets obtained on the GE Healthcare DeltaVision|OMX.
figure 3

A glass surface with 200 nm Tetraspeck beads was used as a test sample, excitated at 642 nm wavelength. In contrast to the wide-field image (a) and its Wiener-filtered version (b), the 2D reconstruction by fairSIM (c) yields clearly distinct beads. The 3D SR-SIM reconstruction by SoftWORX (manufacturer’s software) is provided in d for comparison. Please note that the 3D reconstruction is based on a larger amount of input data (complete z-stack), thus resulting in an improved signal-to-noise ratio. A quantitative comparison between all four images can be found as cross-section plots for a single bead in e and for two adjacent beads (indistinguishable in wide-field mode) in f. Scale bar, 5 μm, inset 1.2 μm.

As a typical sample encountered in biological applications, liver sinusoidal endothelial cells (LSECs) stained with a fluorophore that selectively stains the plasma membrane of cells (Fig. 4) were imaged on the DeltaVision|OMX and reconstructed both as single slice (fairSIM) images and in full 3D (SoftWORX by DeltaVision). The main structural feature of these rather flat cells, that is, the cellular fenestrations (nano-sized pores that cross the cytoplasm), vary in size between 50 and 200 nm (typically 120 nm)16,36,37,38, and are thus ideal candidates for SR-SIM imaging. As with the fluorescent beads, they are too blurred in standard wide-field images, but become clearly visible in both single-slice and full 3D SIM reconstructions. The dynamics of fenestrations in living LSECs is a subject of current research. Therefore, being able to successfully image these submicroscopic structures in single-slice mode (and thus very fast) is of high interest.

Figure 4: SR-SIM measurement of an LSEC membrane stain obtained on a GE Healthcare DeltaVision|OMX.
figure 4

Wide-field image (a), Wiener-filtered wide-field (b), single-slice/2D SR-SIM reconstruction by fairSIM (c) and full 3D SR-SIM reconstruction by SoftWORX (manufacturer’s software) (d) are shown for comparison. Both SR-SIM reconstructions allow to clearly identify the cell's fenestrations (tiny membrane pores), which is not possible in the wide-field images. The single-slice reconstructions by fairSIM can be performed with a much lower number of input images, as no z-stack has to be acquired. Scale bar, 5 μm, inset 1.6 μm, cells stained with CellMask Deep Red.

As additional tests, other typical cellular structures often imaged by super-resolution optical microscopy methods, namely, cytoskeletal protein fibrils (actin and tubulin) and mitochondria were imaged (Supplementary Figs 2, 3 and 4). Again, comparison between single-slice and full 3D reconstructions demonstrates the validity and usefulness of our plugin.

Data sets of actin filaments and mitochondria, acquired on another commercial SR-SIM system (Elyra S1, Zeiss, Jena, Germany—see Supplementary Figs 5 and 6), were also reconstructed by fairSIM as single-slice images and by the manufacturer software in full 3D and further demonstrate the compatibility with other commercial implementations. A TIRF SR-SIM data set of tubulin fibres (Supplementary Fig. 7), acquired on the set-up built and used by Kner et al.5, shows the compatibility with other, advanced custom-built SR-SIM systems.

Compatibility with different SR-SIM microscopes

FairSIM has been developed with a focus on compatibility with a wide range of experimental SR-SIM implementations. Besides providing support for both two-beam and three-beam interference-based illumination, SR-SIM datasets can be acquired with any reasonable number of pattern orientations and phases. Thus, fairSIM is able to handle data sets from all SR-SIM microscope platforms using standard sinusoidal illumination patterns as introduced by Gustafsson1,2, including the currently available commercial platforms (GE Healthcare, Zeiss, Nikon) and the now popular custom-built setups.

Precise knowledge of the SR-SIM acquisition parameters (pattern orientation, frequency and phases) is required for a successful image reconstruction. Indeed, most often reliable parameter estimation is much more involved than the image reconstruction process itself. State-of-the-art parameter estimation employs weighted cross-correlation of frequency components to obtain these parameters2,32,39. By default, fairSIM uses the Gustafsson approach2 (briefly described in Supplementary Note 1 and visualized in Supplementary Fig. 8) to obtain reconstruction parameters, and also features an implementation of a more current phase-optimization algorithm32.

Automated reconstruction parameter estimation

For data sets of adequate quality, fairSIM offers a largely automated mode of operation. Here the user selects the raw images for reconstruction and provides basic parameters of the microscope optics and acquisition mode, that is, the number of bands (two- or three-beam interference illumination), the number of SR-SIM pattern orientations, the number of phases used in the illumination, the effective pixel size and order of the image sequence. For the commercial GE Healthcare DeltaVision|OMX and the Zeiss Elyra systems, presets are available. Also, an OTF, matching the microscope and the emission wavelength, has to be set. Ideally, the OTF has been measured experimentally, and can be read in from file. Alternatively, a basic estimation based on the numerical aperture and main emission wavelength of the fluorophores used in the sample is available.

After this initial set-up and raw data import step, the parameter estimation extracts pattern orientation, angle and phase from the data automatically via cross-correlation (Supplementary Note 1), optionally providing visual feedback to check for plausibility. Obtaining a precise estimate of the SIM reconstruction parameters is a crucial step for successful image reconstruction, because even a small error in these parameters will degrade the quality of the reconstructed image39,40,41. Providing an algorithm that automatically extracts these parameters with little knowledge of the microscope platform in use, without much user interaction and with an easily interpretable feedback was a major point in the development of fairSIM.

In the second step, the actual image reconstruction process is run. As this reconstruction step is much faster than the parameter estimation, it can easily be run multiple times, either to reconstruct multiple images where no changes to the illumination parameters have been made or to tweak image reconstruction filter settings (OTF attenuation, Wiener filter and apodization).

For both the parameter estimation and the image reconstruction steps, different levels of intermediate output (results per band, per pattern orientation, in frequency and spatial domain) can be selected.

Technical realization of fairSIM

FairSIM features a plugin that readily integrates into Fiji29/ImageJ28, allowing it to use all image formats supported by ImageJ and seamless integration with other pre- and post-processing steps available in ImageJ. Written entirely in Java, fairSIM supports all computer platforms and operating systems that run ImageJ without much installation effort. FairSIM takes advantage of current multi-core central processing units, running computationally intensive functions in parallel. On a typical desktop computer, that is, using a current-generation quadcore processor, 15 raw images of 512 × 512 pixels reconstruct to a high-resolution image of 1,024 × 1,024 pixels in <3 s. The initial parameter estimation is performed in <20 s, providing all intermediate output takes at most 60 s.

A modular layout, providing defined interfaces for, for example, basic linear algebra, the SR-SIM algorithm, the graphical user interface and the integration with ImageJ, allows one to easily reuse and extend fairSIM’s components. Most importantly, low- and high-level functionality of the SR-SIM algorithm module can easily be used through Fiji’s scripting facilities, allowing advanced users to run reconstructions without resorting to the graphical user interface, and thus to automate their workflow. Also, data structures and functionality in our linear algebra package can be employed to implement new reconstruction methods, providing much more convenience than working with pure Java data types.

Our source code is freely available under GNU general public license (GPL) and managed on Github. Together with the modular layout, this facilitates the ease of modifications and extensions, for example, towards the reconstruction of non-linear SR-SIM data sets17,18,19,20 or to implement novel reconstruction techniques42,43,44,45.

Discussion

We expect that fairSIM will become a highly useful tool for super-resolution structured illumination microscopy. With the current advent of blue prints for cost-effective, fast and customizable SR-SIM microscopes, research groups building these set-ups benefit from a ready-to-use reconstruction software, so they do not have to create their own customized implementation. Our solution is also modular and flexible enough to be adapted to new needs, for example, the automated processing of large time series or the extension to non-linear SR-SIM methods. Users of commercial SR-SIM microscope platforms obtain a tool to perform reconstructions independent of the manufacturer software, which allows in-depth data analysis and is not bound to a specific microscope workstation. FairSIM is freely available as a system-independent, ready-to-use ImageJ plugin and as open-source code. We provide a collection of raw test image sequences, including all raw data sets needed to reproduce the figures presented here, as an additional download for fairSIM. We also provide a short user manual, which includes all parameters needed for these reconstructions.

Methods

Access to the plugin and source code

A ready-to-use version of the plugin, the source code, example data sets and a short user manual can be found online. All resources are hosted publicly on github, accessible via http://fairsim.org or https://github.com/fairsim, and can also be reached through our institute website, http://www.bio-photonics.de.

SR-SIM microscopy systems

Images from two commercially available SIM microscopes were analysed, obtained on a Delta-Vision|OMX v4 by GE Healthcare (Issaquah, WA, USA) and on an Elyra S1 by Zeiss (Jena, Germany). Also, raw images were acquired on a home-built, SLM-based two-beam interference illumination SR-SIM microscope. This system consists of a 60 × , 1.2 numerical aperture water immersion objective (Olympus, Hamburg, Germany), a 642 nm, 85 mW fiber-coupled diode laser for excitation, a charge-coupled device camera (Coolsnap HQ, Photometrics, Tuscon, AZ, USA) and a liquid crystal display-based SLM for light modulation (LC-R 1920, Holoeye Photonics, Berlin, Germany). A sketch of the set-up can be found in Fig. 2e. The TIRF SR-SIM set-up is documented by Kner et al.5.

Preparation of TetraSpeck bead surfaces

TetraSpeck microspheres (0.2 μm, T-7280) were purchased from Thermo Fisher (Waltham, MA, USA). Commercially available coverslips (150 μm) with 24 × 60 mm in size were carefully cleaned with HelmanexIII (Hellma GmbH Göttingen, Germany) for 20 min in a supersonic bath at 45 °C. Then, the coverslides were rinsed for two times with pure H2O, followed by another 20 min in the supersonic bath in pure H2O. Then, the coverslides were dried in an air flow prior use. A silicone sheet (self-adhesive; Sigma-Aldrich (GBL666182-5EA)) with a hole of 4 mm in diameter was disposed to the coverslip. A measure of 5 μl stock solution of TetraSpeck Microspheres was mixed with 5 μl H2O and vortexed for 2 min. The solution was dispensed onto the coverslip and dried headfirst over night at 4 °C.

Cells

Rat LSECs were isolated from Sprague Dawley male rats (Scanbur BK, Sollentuna, Sweden) kept and fed under standard conditions. The treatment of the animals was performed in accordance with the Norwegian Animal Experimental and Scientific Purposes Act of 1986. The experimental protocols were approved by the Norwegian National Animal Research Authority (NARA). Young rats with a body weight between 150 and 300 g were killed with a mixture of medetomidin (Domitor vet, Orion, Turku, Finland) and ketamine (Ketalar, Pfizer, New York, NY). The liver was perfused with collagenase and the isolated liver cells were centrifuged on a Percoll density cushion. The fraction containing the LSECS was plated for selective adherence on fibronectin coated #1.5H coverslips (Paul Marienfeld GmbH & Co KG, Germany) for 3 h in RPMI-1640. At 3 h after plating, they were fixed with 4% paraformaldehyde for 15 min. For fluorescent staining of membranes, the LSECs were incubated with CellMask Deep Red plasma membrane stain (Thermo Fisher, #C10046; 1:2,000) for 10 min at room temperature (Fig. 4). LSECs were additionally permeabilized with 0.5% Triton-X for 30 s prior staining with 165 nM phalloidin Atto488 (Sigma Aldrich, #49409) for 20 min at room temperature (Supplementary Fig. 2). Human osteosarcoma cells U2OS (ACC785—DSMZ, Braunschweig, Germany) plated on uncoated #1.5H cover glass were fixed with 4% paraformaldehyde for 10 min. The U2OS cells shown were permeabilized with 0.5% Triton-X100 for 30 s prior staining with 165 nM phalloidin Atto488 (Sigma Aldrich, 49409) for 20 min at room temperature (Supplementary Fig. 1). For additional immunofluorescent staining, U2OS cells were permeabilized for 60 s with 0.5% Triton-X100, then washed in PBS, blocked with a 5% bovine serum albumin in PBS solution for 60 min at room temperature and incubated with 5 μg ml−1 of mouse anti-α-tubulin-Alexa488 (Thermo Fisher, #322588) in PBS containing 5% bovine serum albumin for 90 min at room temperature. Prior mounting, the samples were washed three times for 5 min with 0.1% Tween-20 in PBS and once with PBS (Supplementary Fig. 3). All fixed samples were mounted in Vectashield (Vector Laboratories, H-1200) on a glass slide and sealed with nailpolish. In Supplementary Fig. 4, the live U2OS were stained for 30 min with 500 nM MitoTracker Red CM-H2Xros (Thermo Fisher, #M-7513) in DMEM for 30 min at 37 °C and then imaged at room temperature on the Deltavision|OMX.

Additional information

How to cite this article: Müller, M. et al. Open-source image reconstruction of super-resolution structured illumination microscopy data in ImageJ. Nat. Commun. 7:10980 doi: 10.1038/ncomms10980 (2016).

References

  1. Gustafsson, M. G. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. J. Microsc. 198, 82–87 (2000).

    CAS  Article  PubMed  Google Scholar 

  2. Gustafsson, M. G. L. et al. Three-dimensional resolution doubling in wide-field fluorescence microscopy by structured illumination. Biophys. J. 94, 4957–4970 (2008).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  3. Schermelleh, L., Heintzmann, R. & Leonhardt, H. A guide to super-resolution fluorescence microscopy. J. Cell Biol. 190, 165–175 (2010).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  4. Schermelleh, L. et al. Subdiffraction multicolor imaging of the nuclear periphery with 3D structured illumination microscopy. Science 320, 1332–1336 (2008).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  5. Kner, P., Chhun, B. B., Griffis, E. R., Winoto, L. & Gustafsson, M. G. L. Super-resolution video microscopy of live cells by structured illumination. Nat. Methods 6, 339–342 (2009).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  6. Hirvonen, L. M., Wicker, K., Mandula, O. & Heintzmann, R. Structured illumination microscopy of a living cell. Eur. Biophys. J. 38, 807–812 (2009).

    Article  PubMed  Google Scholar 

  7. Shao, L., Kner, P., Rego, E. H. & Gustafsson, M. G. L. Super-resolution 3D microscopy of live whole cells using structured illumination. Nat. Methods 8, 1044–1046 (2011).

    CAS  Article  PubMed  Google Scholar 

  8. Fiolka, R., Shao, L., Rego, E. H., Davidson, M. W. & Gustafsson, M. G. Time-lapse two-color 3D imaging of live cells with doubled resolution using structured illumination. Proc. Natl Acad. Sci. USA 109, 5311–5315 (2012).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  9. Lesterlin, C., Ball, G., Schermelleh, L. & Sherratt, D. J. RecA bundles mediate homology pairing between distant sisters during DNA break repair. Nature 506, 249–253 (2014).

    ADS  CAS  Article  PubMed  Google Scholar 

  10. Sonnen, K. F., Schermelleh, L., Leonhardt, H. & Nigg, E. A. 3D-structured illumination microscopy provides novel insight into architecture of human centrosomes. Biol. Open 1, 965–976 (2012).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  11. Planchon, T. A. et al. Rapid three-dimensional isotropic imaging of living cells using Bessel beam plane illumination. Nat. Methods 8, 417–423 (2011).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  12. Gao, L. et al. Noninvasive imaging beyond the diffraction limit of 3D dynamics in thickly fluorescent specimens. Cell 151, 1370–1385 (2012).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  13. Mandula, O. et al. Line scan—structured illumination microscopy super-resolution imaging in thick fluorescent samples. Opt. Express 20, 24167–24174 (2012).

    ADS  Article  PubMed  Google Scholar 

  14. Rossberger, S. et al. Combination of structured illumination and single molecule localization microscopy in one setup. J. Opt. 15, 094003–24174 (2013).

    ADS  Article  Google Scholar 

  15. Hamel, V. et al. Correlative multicolor 3D SIM and STORM microscopy. Biomed. Opt. Express 5, 3326–3336 (2014).

    Article  PubMed  PubMed Central  Google Scholar 

  16. Monkemoller, V., Oie, C., Hubner, W., Huser, T. & McCourt, P. Multimodal super-resolution optical microscopy visualizes the close connection between membrane and the cytoskeleton in liver sinusoidal endothelial cell fenestrations. Sci. Rep. 5, 16279 (2015).

    ADS  Article  PubMed  PubMed Central  Google Scholar 

  17. Heintzmann, R., Jovin, T. M. & Cremer, C. Saturated patterned excitation microscopy - a concept for optical resolution improvement. J. Opt. Soc. Am. A 19, 1599–1609 (2002).

    ADS  Article  Google Scholar 

  18. Gustafsson, M. G. Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution. Proc. Natl Acad. Sci. USA 102, 13081–13086 (2005).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  19. Rego, E. H. et al. Nonlinear structured-illumination microscopy with a photoswitchable protein reveals cellular structures at 50-nm resolution. Proc. Natl Acad. Sci. USA 109, E135–E143 (2012).

    CAS  Article  PubMed  Google Scholar 

  20. Li, D. et al. Extended resolution structured illumination imaging of endocytic and cytoskeletal dynamics. Science 349, aab3500 (2015).

    Article  PubMed  PubMed Central  Google Scholar 

  21. Chang, B. J., Chou, L. J., Chang, Y. C. & Chiang, S. Y. Isotropic image in structured illumination microscopy patterned with a spatial light modulator. Opt. Express 17, 14710–14721 (2009).

    ADS  CAS  Article  PubMed  Google Scholar 

  22. Dan, D. et al. DMD-based LED-illumination super-resolution and optical sectioning microscopy. Sci. Rep. 3, 1116 (2013).

    Article  PubMed  PubMed Central  Google Scholar 

  23. Lu-Walther, H. W. et al. fastSIM: a practical implementation of fast structured illumination microscopy. Methods Appl. Fluoresc. 3, 014001 (2015).

    ADS  Article  PubMed  Google Scholar 

  24. Krizek, P., Lukes, T., Ovesny, M., Fliegel, K. & Hagen, G. M. SIMToolbox: a MATLAB toolbox for structured illumination fluorescence microscopy. Bioinformatics 32, 318–320 (2015).

    PubMed  Google Scholar 

  25. Henriques, R. et al. QuickPALM: 3D real-time photoactivation nanoscopy image processing in ImageJ. Nat .Methods 7, 339–340 (2010).

    CAS  Article  PubMed  Google Scholar 

  26. Wolter, S. et al. rapidSTORM: accurate, fast open-source software for localization microscopy. Nat. Methods 9, 1040–1041 (2012).

    CAS  Article  PubMed  Google Scholar 

  27. Sage, D. et al. Quantitative evaluation of software packages for single-molecule localization microscopy. Nat. Methods 12, 717–724 (2015).

    CAS  Article  PubMed  Google Scholar 

  28. Schneider, C. A., Rasband, W. S. & Eliceiri, K. W. NIH Image to ImageJ: 25 years of image analysis. Nat. Methods 9, 671–675 (2012).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  29. Schindelin, J. et al. Fiji – an open source platform for biological image analysis. Nat. Methods 9, 676–682 (2012).

    CAS  Article  PubMed  Google Scholar 

  30. Hennig, S., Monkemoller, V., Boger, C., Muller, M. & Huser, T. Nanoparticles as nonfluorescent analogues of fluorophores for optical nanoscopy. ACS Nano 9, 6196–6205 (2015).

    CAS  Article  PubMed  Google Scholar 

  31. Heintzmann, R. & Cremer, C. G. BiOS Europe'98. Proc. SPIE 3568, 185–196 (1999).

    ADS  Article  Google Scholar 

  32. Wicker, K., Mandula, O., Best, G., Fiolka, R. & Heintzmann, R. Phase optimisation for structured illumination microscopy. Opt. Express 21, 2032–2049 (2013).

    ADS  Article  PubMed  Google Scholar 

  33. O'Holleran, K. & Shaw, M. Optimized approaches for optical sectioning and resolution enhancement in 2D structured illumination microscopy. Biomed. Opt. Express 5, 2580–2590 (2014).

    Article  PubMed  PubMed Central  Google Scholar 

  34. Shaw, M., Zajiczek, L. & O'Holleran, K. High speed structured illumination microscopy in optically thick samples. Methods 88, 11–19 (2015).

    CAS  Article  PubMed  Google Scholar 

  35. Svistounov, D. et al. The relationship between Fenestrations, sieve plates and rafts in liver sinusoidal endothelial cells. PLoS ONE 7, e46134 (2012).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  36. Svistounov, D. et al. The relationship between Fenestrations, sieve plates and rafts in liver sinusoidal endothelial cells. PLoS ONE 7, e46134 (2012).

    ADS  CAS  Article  PubMed  PubMed Central  Google Scholar 

  37. Cogger, V. C. et al. Three-dimensional structured illumination microscopy of liver sinusoidal endothelial cell fenestrations. J. Struct. Biol. 171, 382–388 (2010).

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  38. Monkemoller, V. et al. Imaging fenestrations in liver sinusoidal endothelial cells by optical localization microscopy. Phys. Chem. Chem. Phys. 16, 12576–12581 (2014).

    Article  PubMed  Google Scholar 

  39. Wicker, K. Non-iterative determination of pattern phase in structured illumination microscopy using auto-correlations in Fourier space. Opt. Express 21, 24692–24701 (2013).

    ADS  Article  PubMed  Google Scholar 

  40. Shroff, S. A., Fienup, J. R. & Williams, D. R. Lateral superresolution using a posteriori phase shift estimation for a moving object: experimental results. J. Opt. Soc. Am. A 27, 1770–1782 (2010).

    ADS  Article  Google Scholar 

  41. Shroff, S. A., Fienup, J. R. & Williams, D. R. Phase-shift estimation in sinusoidally illuminated images for lateral superresolution. J. Opt. Soc. Am. A 26, 413–424 (2009).

    ADS  Article  Google Scholar 

  42. Chu, K. et al. Image reconstruction for structured-illumination microscopy with low signal level. Opt. Express 22, 8687–8702 (2014).

    ADS  Article  PubMed  Google Scholar 

  43. Ayuk, R. et al. Structured illumination fluorescence microscopy with distorted excitations using a filtered blind-SIM algorithm. Opt. Lett. 38, 4723–4726 (2013).

    ADS  CAS  Article  PubMed  Google Scholar 

  44. Mudry, E. et al. Structured illumination microscopy using unknown speckle patterns. Nat. Photon. 6, 312–315 (2012).

    ADS  CAS  Article  Google Scholar 

  45. Jost, A. et al. Optical sectioning and high resolution in single-slice structured illumination microscopy by thick slice blind-SIM reconstruction. PLoS ONE 10, e0132174 (2015).

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank Peter Kner (University of Georgia), as well as Marcus Behringer and Markus Sauer (Julius-Maximilians-University Würzburg) for providing us with SR-SIM test data sets. We thank Cristina Øie and Peter McCourt (University of Tromsø—The Arctic University of Norway) for providing the LSEC samples. We also thank Peter Kner (University of Georgia), Kaiqin Chu and Stephen Lane (University of California, Davis), and especially Rainer Heintzmann and his group (Friedrich-Schiller-University Jena) for very fruitful discussions on SR-SIM reconstruction algorithms. The purchase of the DeltaVision|OMX microscope was supported by grant INST 215/435-1 FUGG from the German Research Foundation (DFG). This work was supported in parts by the Ministry of Innovation, Science, Research and Technology of the State of North Rhine-Westphalia (MIWFT) as part of the research cooperation ‘MoRitS—Model-based Realization of intelligent Systems in Nano- and Biotechnologies’ (grant no. 321—8.03.04.03—2012/02).

Author information

Authors and Affiliations

Authors

Contributions

M.M. implemented the software and wrote the manuscript. V.M. and W.H. performed the DeltaVision|OMX measurements and cell sample preparation. S.H. built the SLM SR-SIM and prepared Tetraspeck bead samples. T.H. conceived and supervised the project, and helped in writing the manuscript.

Corresponding authors

Correspondence to Marcel Müller or Thomas Huser.

Ethics declarations

Competing interests

The authors declare no competing financial interests.

Supplementary information

Supplementary Information

Supplementary Figures 1-8, Supplementary Note 1 and Supplementary References (PDF 2082 kb)

Rights and permissions

This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Müller, M., Mönkemöller, V., Hennig, S. et al. Open-source image reconstruction of super-resolution structured illumination microscopy data in ImageJ. Nat Commun 7, 10980 (2016). https://doi.org/10.1038/ncomms10980

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1038/ncomms10980

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing