Abstract
Neuroscientists have devoted substantial effort to the creation of standard brain reference atlases for high-throughput registration of anatomical regions of interest. However, the variability in brain size and form across individuals poses a considerable challenge for such reference atlases. To overcome these limitations, we introduce a fully automated deep neural network-based method (named SeBRe) for segmenting brain regions of interest with minimal human supervision. We demonstrate the validity of our method on brain images from different developmental time points of mice, across a range of neuronal markers and imaging modalities. We further assess the performance of our method on images of magnetic resonance-scanned human brains. Our registration method can accelerate brain-wide exploration of region-specific changes in brain development and, by easily segmenting brain regions of interest for high-throughput brain-wide analysis, offer an alternative to existing complex brain registration techniques.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 digital issues and online access to articles
$119.00 per year
only $9.92 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the corresponding author on reasonable request. The publicly available datasets that are used in this study are available at brain-map.org/api/index.html and https://www.nitrc.org/frs/shownotes.php?release_id=2316. The annotated datasets that are used in this study are available at https://github.com/itsasimiqbal/SeBRe and https://bitbucket.org/theolab/.
Code availability
We provide the code for the SeBRe toolbox at https://github.com/itsasimiqbal/SeBRe and https://bitbucket.org/theolab/.
References
Lein, Ed. S. et al. Genome-wide atlas of gene expression in the adult mouse brain. Nature 445, 168 (2007).
Fürth, D. et al. An interactive framework for whole-brain maps at cellular resolution. Nat. Neurosci. 21, 139 (2018).
Niedworok, C. J. et al. aMAP is a validated pipeline for registration and segmentation of high-resolution mouse brain data. Nat. Commun. 7, 11879 (2016).
Jarrett, K., Kavukcuoglu, K. & LeCun, Y. What is the best multi-stage architecture for object recognition? In IEEE 12th International Conference on Computer Vision 2146–2153 (IEEE, 2009).
Ren, S., He, K., Girshick, R. & Sun, J. Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems 91–99 (NIPS, 2015).
He, K., Gkioxari, G., Dollár, P., & Girshick, R. Mask R-CNN. In Proc. IEEE International Conference on Computer Vision 2961–2969 (IEEE, 2017).
de Vos, B. D., Berendsen, F. F., Viergever, M. A., Staring, M. & Išgum, I. in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support 204–212 (Springer, 2017).
Li, H. & Fan, Y. Non-rigid image registration using fully convolutional networks with deep self-supervision. Preprint at https://arxiv.org/abs/1709.00799 (2017).
Milletari, F. et al. Hough-CNN: deep learning for segmentation of deep brain regions in MRI and ultrasound. Comput. Vis. Image Underst. 164, 92–102 (2017).
Lin, T.-Y. et al. Microsoft COCO: common objects in context. In European Conference on Computer Vision (Springer, 2014).
Allen Brain Atlas API (Allen Institute for Brain Science, 2015); https://brain-map.org/api/index.html
Rohlfing, T. Image similarity and tissue overlaps as surrogates for image registration accuracy: widely used but unreliable. IEEE Trans. Med. Imaging 31, 153–163 (2012).
Klein, S. et al. Elastix: a toolbox for intensity-based medical image registration. IEEE Trans. Med. Imaging 29, 196–205 (2010).
Kutten, K. S. et al. A large deformation diffeomorphic approach to registration of CLARITY images via mutual information. In International Conference on Medical Image Computing and Computer-assisted Intervention (Springer, 2017).
Shakeri, Mahsa, et al. Sub-cortical brain structure segmentation using F-CNN’s. In IEEE 13th International Symposium on Biomedical Imaging (IEEE, 2016).
Mehta, R., Majumdar, A. & Sivaswamy, J. BrainSegNet: a convolutional neural network architecture for automated segmentation of human brain structures. J. Med. Imaging 4, 024003 (2017).
Roy, A. G., Conjeti, S., Navab, N. & Wachinger, C. & Alzheimer’s Disease Neuroimaging Initiative. QuickNAT: a fully convolutional network for quick and accurate segmentation of neuroanatomy. NeuroImage 186, 713–727 (2019).
He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 770–778 (IEEE, 2016).
Lin, T.-Y. et al. Feature pyramid networks for object detection. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2017).
Girshick, R. Fast R-CNN. In Proc. IEEE International Conference on Computer Vision 1440–1448 (IEEE, 2015).
Acknowledgements
This work was supported by a grant from the European Research Council (ERC, 679175, T.K.).
Author information
Authors and Affiliations
Contributions
A.I., R.K. and T.K. conceptualized the study and wrote the paper. A.I and R.K. developed the SeBRe method and performed the quantitative comparison with other registration and segmentation methods.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary Information
Supplementary Figs. 1–9.
Rights and permissions
About this article
Cite this article
Iqbal, A., Khan, R. & Karayannis, T. Developing a brain atlas through deep learning. Nat Mach Intell 1, 277–287 (2019). https://doi.org/10.1038/s42256-019-0058-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s42256-019-0058-8
This article is cited by
-
D-LMBmap: a fully automated deep-learning pipeline for whole-brain profiling of neural circuitry
Nature Methods (2023)
-
Web Intelligence meets Brain Informatics: Towards the future of artificial intelligence in the connected world
World Wide Web (2022)
-
Constructing the rodent stereotaxic brain atlas: a survey
Science China Life Sciences (2022)
-
An automatic multi-tissue human fetal brain segmentation benchmark using the Fetal Tissue Annotation Dataset
Scientific Data (2021)
-
Neutralizing the impact of atmospheric turbulence on complex scene imaging via deep learning
Nature Machine Intelligence (2021)