Abstract
In microscopy-based drug screens, fluorescent markers carry critical information on how compounds affect different biological processes. However, practical considerations, such as the labour and preparation formats needed to produce different image channels, hinder the use of certain fluorescent markers. Consequently, completed screens may lack biologically informative but experimentally impractical markers. Here we present a deep learning method for overcoming these limitations. We accurately generated predicted fluorescent signals from other related markers and validated this new machine learning (ML) method on two biologically distinct datasets. We used the ML method to improve the selection of biologically active compounds for Alzheimer’s disease from a completed high-content high-throughput screen (HCS) that only contained the original markers. The ML method identified novel compounds that effectively blocked tau aggregation, which had been missed by traditional screening approaches unguided by ML. The method improved triaging efficiency of compound rankings over conventional rankings by raw image channels. We reproduced this ML pipeline on a biologically independent cancer-based dataset, demonstrating its generalizability. The approach is disease-agnostic and applicable across diverse fluorescence microscopy datasets.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 digital issues and online access to articles
$99.00 per year
only $8.25 per issue
Rent or buy this article
Get just this article for as long as you need it
$39.95
Prices may be subject to local taxes which are calculated during checkout






Data availability
All image data are freely available at https://osf.io/xntd658 and https://doi.org/10.17605/OSF.IO/XNTD6.
Code availability
The full source code and fully trained models are available at https://github.com/keiserlab/trans-channel-paper59 and https://doi.org/10.5281/zenodo.6336183.
References
Li, Z., Cvijic, M. E. & Zhang, L. in Comprehensive Medicinal Chemistry III (eds Chackalamannil, S., Rotella, D. & Ward, S. E.) 362–387 (Elsevier, 2017); https://doi.org/10.1016/B978-0-12-409547-2.12328-5
Kim, S.-W., Roh, J. & Park, C.-S. Immunohistochemistry for pathologists: protocols, pitfalls and tips. J. Pathol. Transl. Med. 50, 411–418 (2016).
Cardoso, M. C. in Encyclopedic Reference of Genomics and Proteomics in Molecular Medicine 583–586 (Springer, 2006); https://doi.org/10.1007/3-540-29623-9_5560
Lao, K. et al. Drug development for Alzheimer’s disease. J. Drug Target. 27, 164–173 (2019).
Cummings, J., Lee, G., Ritter, A., Sabbagh, M. & Zhong, K. Alzheimer’s disease drug development pipeline: 2019. Alzheimers Dement. 5, 272–293 (2019).
Iqbal, K., Liu, F. & Gong, C.-X. Tau and neurodegenerative disease: the story so far. Nat. Rev. Neurol. 12, 15–27 (2016).
Eckermann, K. et al. The β-propensity of tau determines aggregation and synaptic loss in inducible mouse models of tauopathy. J. Biol. Chem. 282, 31755–31765 (2007).
Fatouros, C. et al. Inhibition of tau aggregation in a novel Caenorhabditis elegans model of tauopathy mitigates proteotoxicity. Hum. Mol. Genet. 21, 3587–3603 (2012).
Goedert, M., Clavaguera, F. & Tolnay, M. The propagation of prion-like protein inclusions in neurodegenerative diseases. Trends Neurosci. 33, 317–325 (2010).
Jucker, M. & Walker, L. C. Self-propagation of pathogenic protein aggregates in neurodegenerative diseases. Nature 501, 45–51 (2013).
Clavaguera, F. et al. Transmission and spreading of tauopathy in transgenic mouse brain. Nat. Cell Biol. 11, 909–913 (2009).
Aoyagi, A. et al. Aβ and tau prion-like activities decline with longevity in the Alzheimer’s disease human brain. Sci. Transl. Med. 11, eaat8462 (2019).
Sanders, D. W. et al. Distinct tau prion strains propagate in cells and mice and define different tauopathies. Neuron 82, 1271–1288 (2014).
Jackson, S. J. et al. Short fibrils constitute the major species of seed-competent tau in the brains of mice transgenic for human P301S tau. J. Neurosci. 36, 762–772 (2016).
Furman, J. L. et al. Widespread tau seeding activity at early Braak stages. Acta Neuropathol. 133, 91–100 (2017).
Despres, C. et al. Identification of the tau phosphorylation pattern that drives its aggregation. Proc. Natl. Acad. Sci. USA 114, 9080–9085 (2017).
Lai, R., Harrington, C. & Wischik, C. Absence of a role for phosphorylation in the tau pathology of Alzheimer’s disease. Biomolecules 6, 19 (2016); erratum 6, 35 (2016).
Goedert, M. et al. Assembly of microtubule-associated protein tau into Alzheimer-like filaments induced by sulphated glycosaminoglycans. Nature 383, 550–553 (1996).
Grundke-Iqbal, I. et al. Abnormal phosphorylation of the microtubule-associated protein τ (tau) in Alzheimer cytoskeletal pathology. Proc. Natl. Acad. Sci. USA 83, 4913–4917 (1986).
Sengupta, A. et al. Phosphorylation of tau at both Thr 231 and Ser 262 is required for maximal inhibition of its binding to microtubules. Arch. Biochem. Biophys. 357, 299–309 (1998).
Alonso, A. C., Zaidi, T., Grundke-Iqbal, I. & Iqbal, K. Role of abnormally phosphorylated tau in the breakdown of microtubules in Alzheimer disease. Proc. Natl. Acad. Sci. USA 91, 5562–5566 (1994).
Lindwall, G. & Cole, R. D. Phosphorylation affects the ability of tau protein to promote microtubule assembly. J. Biol. Chem. 259, 5301–5305 (1984).
Johnson, G. V. W. & Stoothoff, W. H. Tau phosphorylation in neuronal cell function and dysfunction. J. Cell Sci. 117, 5721–5729 (2004).
Gong, C.-X. & Iqbal, K. Hyperphosphorylation of microtubule-associated protein tau: a promising therapeutic target for Alzheimer disease. Curr. Med. Chem. 15, 2321–2328 (2008).
Grandjean, J.-M. M. et al. Discovery of 4-piperazine isoquinoline derivatives as potent and brain-permeable tau prion inhibitors with CDK8 activity. ACS Med. Chem. Lett. 11, 127–132 (2020).
Preuss, U., Döring, F., Illenberger, S. & Mandelkow, E. M. Cell cycle-dependent phosphorylation and microtubule binding of tau protein stably transfected into Chinese hamster ovary cells. Mol. Biol. Cell 6, 1397–1410 (1995).
Malia, T. J. et al. Epitope mapping and structural basis for the recognition of phosphorylated tau by the anti-tau antibody AT8. Proteins 84, 427–434 (2016).
Goedert, M., Jakes, R. & Vanmechelen, E. Monoclonal antibody AT8 recognises tau protein phosphorylated at both serine 202 and threonine 205. Neurosci. Lett. 189, 167–169 (1995).
Duka, V. et al. Identification of the sites of tau hyperphosphorylation and activation of tau kinases in synucleinopathies and Alzheimer’s diseases. PLoS ONE 8, e75025 (2013).
Jensen, E. C. Overview of live-cell imaging: requirements and methods used. Anat. Rec. 296, 1–8 (2013).
Sung, M.-H. & McNally, J. G. Live cell imaging and systems biology. Wiley Interdiscip. Rev. Syst. Biol. Med. 3, 167–182 (2011).
Wang, C. et al. Scalable production of iPSC-derived human neurons to identify tau-lowering compounds by high-content screening. Stem Cell Rep. 9, 1221–1233 (2017).
Azorsa, D. O. et al. High-content siRNA screening of the kinome identifies kinases involved in Alzheimer’s disease-related tau hyperphosphorylation. BMC Genomics 11, 25 (2010).
Narayan, P. J. et al. Assessing fibrinogen extravasation into Alzheimer’s disease brain using high-content screening of brain tissue microarrays. J. Neurosci. Methods 247, 41–49 (2015).
Vatansever, S. et al. Artificial intelligence and machine learning-aided drug discovery in central nervous system diseases: state-of-the-arts and future directions. Med. Res. Rev. 41, 1427–1473 (2021).
Kim, S.-H. et al. Prediction of Alzheimer’s disease-specific phospholipase c gamma-1 SNV by deep learning-based approach for high-throughput screening. Proc. Natl. Acad. Sci. USA 118, e2011250118 (2021).
Bermudez-Lugo, A, J., Rosales-Hernandez, M. C., Deeb, O., Trujillo-Ferrara, J. & Correa-Basurto, J. In silico methods to assist drug developers in acetylcholinesterase inhibitor design. Curr. Med. Chem. 18, 1122–1136 (2011).
Basile, L. in Computational Modeling of Drugs Against Alzheimer’s Disease (ed. Roy, K.) 107–137 (Humana Press, 2018); https://doi.org/10.1007/978-1-4939-7404-7_4
Carpenter, K. A. & Huang, X. Machine learning-based virtual screening and its applications to Alzheimer’s drug discovery: a review. Curr. Pharm. Des. 24, 3347–3358 (2018).
Christiansen, E. M. et al. In silico labeling: predicting fluorescent labels in unlabeled images. Cell 173, 792–803 (2018).
Ounkomol, C., Seshamani, S., Maleckar, M. M., Collman, F. & Johnson, G. R. Label-free prediction of three-dimensional fluorescence images from transmitted-light microscopy. Nat. Methods 15, 917–920 (2018).
Moen, E. et al. Deep learning for cellular image analysis. Nat. Methods 16, 1233–1246 (2019).
Ronneberger, O., Fischer, P. & Brox, T. U-Net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science (ed. Navab, N., et al.) 9351. (Springer, Cham, 2015). https://doi.org/10.1007/978-3-319-24574-4_28
Liu, G. et al. Image inpainting for irregular holes using partial convolutions. In Proc. European Conference on Computer Vision (ECCV) 85–100 (Springer, 2018).
Caicedo, J. C. et al. Data-analysis strategies for image-based cell profiling. Nat. Methods 14, 849–863 (2017).
Hughes, J. P., Rees, S., Kalindjian, S. B. & Philpott, K. L. Principles of early drug discovery. Br. J. Pharmacol. 162, 1239–1249 (2011).
Huang, N., Shoichet, B. K. & Irwin, J. J. Benchmarking sets for molecular docking. J. Med. Chem. 49, 6789–6801 (2006).
Carpenter, A. E. et al. CellProfiler: image analysis software for identifying and quantifying cell phenotypes. Genome Biol. 7, R100 (2006).
Müllers, E., Cascales, H. S., Burdova, K., Macurek, L. & Lindqvist, A. Residual Cdk1/2 activity after DNA damage promotes senescence. Aging Cell 16, 575–584 (2017).
Chuang, K. V. & Keiser, M. J. Comment on ‘Predicting reaction performance in C-N cross-coupling using machine learning’. Science 362, eaat8603 (2018).
Soekhoe, D., van der Putten, P. & Plaat, A. in Advances in Intelligent Data Analysis XV (ed. Boström, H., et al.) 50–60 (Springer, 2016); https://doi.org/10.1007/978-3-319-46349-0_5
Williams, E. et al. Image Data Resource: a bioimage data integration and publication platform. Nat. Methods 14, 775–781 (2017).
Allen, B. et al. Abundant tau filaments and nonapoptotic neurodegeneration in transgenic mice expressing human P301S tau protein. J. Neurosci. 22, 9340–9351 (2002).
Lee, I. S., Long, J. R., Prusiner, S. B. & Safar, J. G. Selective precipitation of prions by polyoxometalate complexes. J. Am. Chem. Soc. 127, 13802–13803 (2005).
Wager, T. T., Hou, X., Verhoest, P. R. & Villalobos, A. Central nervous system multiparameter optimization desirability: application in drug discovery. ACS Chem. Neurosci. 7, 767–775 (2016).
Wager, T. T., Hou, X., Verhoest, P. R. & Villalobos, A. Moving beyond rules: the development of a central nervous system multiparameter optimization (CNS MPO) approach to enable alignment of druglike properties. ACS Chem. Neurosci. 1, 435–449 (2010).
Bray, M.-A. et al. Cell Painting, a high-content image-based assay for morphological profiling using multiplexed fluorescent dyes. Nat. Protoc. 11, 1757–1774 (2016).
Wong, D. & Keiser, M. Trans-channel Fluorescence Learning (OSFHOME, 2020); https://doi.org/10.17605/OSF.IO/XNTD6
Keiser, M. keiserlab/trans-channel-paper: v1.0.0 (Zenodo, 2022); https://doi.org/10.5281/zenodo.6336183
Acknowledgements
This work was supported by grant no. 2018-191905 from the Chan Zuckerberg Initiative DAF, an advised fund of the Silicon Valley Community Foundation (M.J.K.), the National Institutes of Health (AG002132; S.B.P.), as well as by support from the Brockman Foundation (S.B.P.) and the Sherman Fairchild Foundation (S.B.P.).
Author information
Authors and Affiliations
Contributions
Conceptualization was provided by D.R.W., J.C., N.J., N.A.P. and M.J.K., methodology by D.R.W., J.C., N.J., N.A.P. and M.J.K., software by D.R.W., validation by D.R.W., A.L. and S.B.P., formal analysis by D.R.W., investigations by D.R.W., J.C., N.J., J.C.L., J.A., J.L. and A.L., resources by S.B.P., S.B., A.J.B., N.A.P. and M.J.K. and data curation by D.R.W. The original draft was written by D.R.W. Reviewing and editing was carried out by D.R.W. and M.J.K. Visualization was provided by D.R.W., supervision by S.B.P., S.B., A.J.B., N.A.P. and M.J.K., project administration by D.R.W. and M.J.K. and funding acquisition by S.B.P. and M.J.K.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests. S.B.P. is a member of the Scientific Advisory Board of ViewPoint Therapeutics and a member of the Board of Directors of Trizell, Ltd, neither of which have contributed financial or any other support to the studies discussed here.
Peer review
Peer review information
Nature Machine Intelligence thanks Florian Heigwer and Hao Zhu for their contribution to the peer review of this work.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Supplementary Information
Supplementary Figs. 1–13.
Supplementary Table 1
Supplementary Tables
Rights and permissions
About this article
Cite this article
Wong, D.R., Conrad, J., Johnson, N.R. et al. Trans-channel fluorescence learning improves high-content screening for Alzheimer’s disease therapeutics. Nat Mach Intell 4, 583–595 (2022). https://doi.org/10.1038/s42256-022-00490-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s42256-022-00490-8
This article is cited by
-
Learning the missing channel
Nature Machine Intelligence (2022)