Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

Smart microscopes of the future

We dream of a future where light microscopes have new capabilities: language-guided image acquisition, automatic image analysis based on extensive prior training from biologist experts, and language-guided image analysis for custom analyses. Most capabilities have reached the proof-of-principle stage, but implementation would be accelerated by efforts to gather appropriate training sets and make user-friendly interfaces.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: A vision for a microscope of the future.

References

  1. Rueden, C. T. et al. PLoS Biol. 17, e3000340 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  2. Schneider, C. A., Rasband, W. S. & Eliceiri, K. W. Nat. Methods 9, 671–675 (2012).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Carpenter, A. E. et al. Genome Biol. 7, R100 (2006).

    Article  PubMed  PubMed Central  Google Scholar 

  4. Scherf, N. & Huisken, J. Nat. Biotechnol. 33, 815–818 (2015).

    Article  CAS  PubMed  Google Scholar 

  5. Strack, R. Nat. Methods 17, 23 (2020).

    Article  CAS  PubMed  Google Scholar 

  6. Royer, L. A. et al. Nat. Biotechnol. 34, 1267–1278 (2016).

    Article  CAS  PubMed  Google Scholar 

  7. Carpenter, A. E., Ashouri, A. & Belmont, A. S. Cytometry A 58, 157–166 (2004).

    Article  PubMed  Google Scholar 

  8. Conrad, C. et al. Nat. Methods 8, 246–249 (2011).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Mahecic, D. et al. Nat. Methods 19, 1262–1267 (2022).

    Article  CAS  PubMed  Google Scholar 

  10. Pinkard, H. & Waller, L. Nat. Methods 19, 1175–1176 (2022).

    Article  CAS  PubMed  Google Scholar 

  11. Caicedo, J. C. et al. Nat. Methods 16, 1247–1253 (2019).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Schmidt, U., Weigert, M., Broaddus, C. & Myers, G. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2018 265–273 (Springer International, 2018).

  13. Pachitariu, M. & Stringer, C. Nat. Methods 19, 1634–1641 (2022).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Greenwald, N. F. et al. Nat. Biotechnol. 40, 555–565 (2022).

    Article  CAS  PubMed  Google Scholar 

  15. Sommer, C., Straehle, C., Kothe, U. & Hamprecht, F. A. In 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro 230–233 (IEEE, 2011); https://doi.org/10.1109/ISBI.2011.5872394

  16. Ouyang, W., Mueller, F., Hjelmare, M., Lundberg, E. & Zimmer, C. Nat. Methods 16, 1199–1200 (2019).

    Article  CAS  PubMed  Google Scholar 

  17. Gómez-de-Mariscal, E. et al. Nat. Methods 18, 1192–1195 (2021).

    Article  PubMed  Google Scholar 

  18. Weigert, M. et al. Nat. Methods 15, 1090–1097 (2018).

    Article  CAS  PubMed  Google Scholar 

  19. von Chamier, L. et al. Nat. Commun. 12, 2276 (2021).

    Article  Google Scholar 

  20. Brown, T. et al. Adv. Neural Inf. Process. Syst. 33, 1877–1901 (2020).

    Google Scholar 

  21. Bengio, Y., Courville, A. & Vincent, P. Preprint at arXiv https://doi.org/10.48550/arXiv.1206.5538 (2012).

  22. Markov, T. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2208.03274 (2022).

  23. Ouyang, L. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2203.02155 (2022).

  24. Qin, C. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2302.06476 (2023).

  25. Gozalo-Brizuela, R. & Garrido-Merchan, E. C. Preprint at arXiv https://doi.org/10.48550/arXiv.2301.04655 (2023).

Download references

Acknowledgements

This work was supported by the National Institutes of Health (NIH P41 GM135019 to A.E.C., B.A.C. and K.W.E.).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anne E. Carpenter.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Methods thanks Henry Pinkard for his contribution to the peer review of this work.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Carpenter, A.E., Cimini, B.A. & Eliceiri, K.W. Smart microscopes of the future. Nat Methods 20, 962–964 (2023). https://doi.org/10.1038/s41592-023-01912-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41592-023-01912-0

This article is cited by

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing