Technical Report

High-accuracy neurite reconstruction for high-throughput neuroanatomy

Published online:


Neuroanatomic analysis depends on the reconstruction of complete cell shapes. High-throughput reconstruction of neural circuits, or connectomics, using volume electron microscopy requires dense staining of all cells, which leads even experts to make annotation errors. Currently, reconstruction speed rather than acquisition speed limits the determination of neural wiring diagrams. We developed a method for fast and reliable reconstruction of densely labeled data sets. Our approach, based on manually skeletonizing each neurite redundantly (multiple times) with a visualization-annotation software tool called KNOSSOS, is 50-fold faster than volume labeling. Errors are detected and eliminated by a redundant-skeleton consensus procedure (RESCOP), which uses a statistical model of how true neurite connectivity is transformed into annotation decisions. RESCOP also estimates the reliability of consensus skeletons. Focused reannotation of difficult locations promises a rather steep increase of reliability as a function of the average skeleton redundancy and thus the nearly error-free analysis of large neuroanatomical datasets.

  • Subscribe to Nature Neuroscience for full access:



Additional access options:

Already a subscriber?  Log in  now or  Register  for online access.


  1. 1.

    Textura del Sistema Nervioso del Hombre y de los Vertebrados (Moya, Madrid, 1899).

  2. 2.

    Sulla struttura della sostanza grigia del cervelo. Gazzetta Medica Italiana Lombardia 33, 244–246 (1873).

  3. 3.

    & Dendritic spines of CA 1 pyramidal cells in the rat hippocampus: serial electron microscopy with reference to their biophysical characteristics. J. Neurosci. 9, 2982–2997 (1989).

  4. 4.

    & A versatile means of intracellular labeling: injection of biocytin and its detection with avidin conjugates. J. Neurosci. Methods 25, 1–11 (1988).

  5. 5.

    & Neuronal geometry: determination with a technique of intracellular dye injection. Science 162, 132–134 (1968).

  6. 6.

    et al. Monosynaptic restriction of transsynaptic tracing from single, genetically targeted neurons. Neuron 53, 639–647 (2007).

  7. 7.

    et al. Transgenic strategies for combinatorial expression of fluorescent proteins in the nervous system. Nature 450, 56–62 (2007).

  8. 8.

    , & The human connectome: A structural description of the human brain. PLoS Comput. Biol. 1, e42 (2005).

  9. 9.

    , & A technicolour approach to the connectome. Nat. Rev. Neurosci. 9, 417–422 (2008).

  10. 10.

    , & 3D structural imaging of the brain with photons and electrons. Curr. Opin. Neurobiol. 18, 633–641 (2008).

  11. 11.

    , , & The structure of the nervous system of the nematode Caenorhabditis elegans. Phil. Trans. R. Soc. Lond. B 314, 1–340 (1986).

  12. 12.

    & Serial block-face scanning electron microscopy to reconstruct three-dimensional tissue nanostructure. PLoS Biol. 2, e329 (2004).

  13. 13.

    , , & Automating the collection of ultrathin serial sections for large volume TEM reconstructions. Microsc. Microanal. 12, 86–87 (2006).

  14. 14.

    , , & Serial section scanning electron microscopy of adult brain tissue using focused ion beam milling. J. Neurosci. 28, 2959–2964 (2008).

  15. 15.

    & Towards neural circuit reconstruction with volume electron microscopy techniques. Curr. Opin. Neurobiol. 16, 562–570 (2006).

  16. 16.

    , & Wiring specificity in the direction-selectivity circuit of the retina. Nature (in the press) (2011).

  17. 17.

    Reconstruct: a free editor for serial section microscopy. J. Microsc. 218, 52–61 (2005).

  18. 18.

    et al. Ssecrett and NeuroTrace: interactive visualization and analysis tools for large-scale neuroscience data sets. IEEE Comput. Graph. Appl. 30, 58–70 (2010).

  19. 19.

    et al. Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex. Nature 420, 788–794 (2002).

  20. 20.

    , & Toward a functional architecture of the retina: serial reconstruction of adjacent ganglion cells. Science 207, 317–319 (1980).

  21. 21.

    , & Wiring optimization can relate neuronal structure and function. Proc. Natl. Acad. Sci. USA 103, 4723–4728 (2006).

  22. 22.

    , & Semi-automated reconstruction of neural circuits using electron microscopy. Curr. Opin. Neurobiol. 20, 667–675 (2010).

  23. 23.

    et al. Ultrastructural analysis of hippocampal neuropil from the connectomics perspective. Neuron 67, 1009–1020 (2010).

  24. 24.

    et al. Supervised learning of image restoration with convolutional networks. IEEE 11th Int. Conf. Comput. Vis. 1–8 (2007).

  25. 25.

    , , , & Segmentation of SBFSEM volume data of neural tissue by hierarchical classification. in Pattern Recognition: Lecture Notes in Computer Science (ed. Rigoll, G.) 142–152 (Springer-Verlag, 2008).

  26. 26.

    et al. Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput. 22, 511–538 (2010).

  27. 27.

    , , & A Database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. IEEE 8th Int. Conf. Comput. Vis. 2, 416–423 (2001).

  28. 28.

    , & Validation of image segmentation by estimating rater bias and variance. Philos. Transact. A Math. Phys. Eng. Sci. 366, 2361–2375 (2008).

  29. 29.

    , & Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans. Med. Imaging 23, 903–921 (2004).

  30. 30.

    et al. A classifier ensemble based on performance level estimation. IEEE Int. Symposium on Biomed. Imaging: from Nano to Micro, 342–345 (2009).

  31. 31.

    Decision theory: what “should” the nervous system do? Science 318, 606–610 (2007).

  32. 32.

    , , , & MorphML: level 1 of the NeuroML standards for neuronal morphology data and model specification. Neuroinformatics 5, 96–104 (2007).

Download references


We thank B. Andres, F. Hamprecht, U. Köthe, V. Jain, S. Seung and S. Turaga for many fruitful discussions and comments on the manuscript, J. Bollmann and A. Schaefer for helpful comments on the manuscript, C. Roome for information technology support, J. Kornfeld and F. Svara for programming KNOSSOS, and J. Hanne, H. Jakobi and H. Wissler for help with annotator training. We thank N. Abazova, E. Abs, A. Antunes, P. Bastians, J. Bauer, M. Beez, M. Beining, S. Bender, S. Best, L. Brosi, M. Bucher, E. Buckler, J. Buhmann, C. Burkhardt, F. Drawitsch, L. Ehm, S. Ehm, C. Fianke, R. Foltin, S. Freiss, M. Funk, A. Gebhardt, M. Gruen, K. Haase, J. Hammerich, J. Hanne, B. Hauber, M. Hensen, L. Hofmann, P. Hofmann, M. Hülser, F. Isensee, H. Jakobi, M. Jonczyk, A. Joschko, A. Juenger, S. Kaspar, K. Kessler, A. Khan, M. Kiapes, A. Klein, C. Klein, S. Laiouar, T. Lang, L. Lebelt, H. Lesch, C. Lieven, D. Luft, E. Moeller, A. Muellner, M. Mueller, D. Ollech, A. Oppold, T. Otolski, S. Oumohand, S. Pfarr, M. Pohrath, A. Poos, S. Putzke, J. Reinhardt, A. Rommerskirchen, M. Roth, J. Sambel, K. Schramm, C. Sellmann, J. Sieber, I. Sonntag, M. Stahlberg, T. Stratmann, J. Trendel, F. Trogisch, M. Uhrig, A. Vogel, J. Volz, C. Weber, P. Weber, K. Weiss, L. Weisshaar, E. Wiegand, T. Wiegand, M. Wiese, R. Wiggers, C. Willburger and A. Zegarra for neurite skeletonizations. This work was funded by the Max Planck Society.

Author information


  1. Max Planck Institute for Medical Research, Heidelberg, Germany.

    • Moritz Helmstaedter
    • , Kevin L Briggman
    •  & Winfried Denk


  1. Search for Moritz Helmstaedter in:

  2. Search for Kevin L Briggman in:

  3. Search for Winfried Denk in:


M.H. and W.D. designed the study and devised the analysis algorithms; K.L.B. carried out the SBEM experiments; M.H., K.L.B. and W.D. specified the KNOSSOS software; M.H. analyzed the data; M.H., K.L.B. and W.D. wrote the paper.

Competing interests

Moritz Helmstaedter and Winfried Denk have applied for a patent (Published Patent Application US 20100183217). Winfried Denk receives IP license income from Gatan Inc. for serial blockface imaging.

Corresponding author

Correspondence to Moritz Helmstaedter.

Supplementary information

PDF files

  1. 1.

    Supplementary Text and Figures

    Supplementary Figures 1–5

Zip files

  1. 1.

    Supplementary Movie 1

    Skeleton tracing with KNOSSOS. 3 orthogonal views are displayed (xy, top left, yz, top right, xz, bottom left) and a 3-dimensional view of the dataset bounding box and the skeleton being created (bottom right). The 19MB version requires a video player compatible with DivX-encoded files. The 68MB version can be viewed with a generic player but is shorter.

  2. 2.

    Supplementary Image Stack 1

  3. 3.

    Supplementary Image Stack 2

  4. 4.

    Supplementary Image Stack 3

  5. 5.

    Supplementary Image Stack 4

  6. 6.

    Supplementary Image Stack 5

  7. 7.

    Supplementary Image Stack 6

  8. 8.

    Supplementary Image Stack 7

  9. 9.

    Supplementary Image Stack 8

  10. 10.

    Supplementary Image Stack 9

  11. 11.

    Supplementary Image Stack 10

  12. 12.

    Supplementary Image Stack 11

  13. 13.

    Supplementary Image Stack 12

  14. 14.

    Supplementary Image Stack 13

  15. 15.

    Supplementary Image Stack 14

  16. 16.

    Supplementary Image Stack 15