Although examples of algorithms designed to improve healthcare delivery abound, for many, clinical integration will not be achieved. The deployment cost of machine learning models is an underappreciated barrier to success. Experts propose three criteria that, assessed early, could help estimate the deployment cost.
This is a preview of subscription content, access via your institution
Relevant articles
Open Access articles citing this article.
-
Implementation of machine learning in the clinic: challenges and lessons in prospective deployment from the System for High Intensity EvaLuation During Radiation Therapy (SHIELD-RT) randomized controlled study
BMC Bioinformatics Open Access 30 September 2022
-
Evaluation of domain generalization and adaptation on improving model robustness to temporal dataset shift in clinical medicine
Scientific Reports Open Access 17 February 2022
-
Deploying digital health tools within large, complex health systems: key considerations for adoption and implementation
npj Digital Medicine Open Access 27 January 2022
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Change history
14 April 2020
A Correction to this paper has been published: https://doi.org/10.1038/s41591-020-0862-z
References
Yu, K.-H., Beam, A. L. & Kohane, I. S. Nat. Biomed. Eng. 2, 719–731 (2018).
Topol, E. J. Nat. Med. 25, 44–56 (2019).
Esteva, A. et al. Nat. Med. 25, 25–29 (2019).
Amarasingham, R., Patzer, R. E., Huesch, M., Nguyen, N. Q. & Xie, B. Health Aff. 33, 1148–1154 (2014).
Wiens, J. et al. Nat. Med. https://doi.org/10.1038/s41591-019-0548-6 (2019).
Shah, N. H., Milstein, A. & Bagley, S. C. JAMA https://doi.org/10.1001/jama.2019.10306 (2019).
Cresswell, K. & Sheikh, A. Int. J. Med. Inform. 82, e73–e86 (2013).
Larson, D. B. et al. Radiology 287, 313–322 (2018).
Halabi, S. S. Validation of an artificial intelligence-based algorithm for skeletal age assessment. ClinicalTrials.gov https://clinicaltrials.gov/ct2/show/NCT03530098 (last updated October 2019).
Escobar, G. J. et al. J. Hosp. Med. 11 (Suppl. 1), S18–S24 (2016).
Dummett, B. A. et al. J. Hosp. Med. 11 (Suppl. 1), S25–S31 (2016).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Rights and permissions
About this article
Cite this article
Morse, K.E., Bagley, S.C. & Shah, N.H. Estimate the hidden deployment cost of predictive models to improve patient care. Nat Med 26, 18–19 (2020). https://doi.org/10.1038/s41591-019-0651-8
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41591-019-0651-8
This article is cited by
-
Implementation of machine learning in the clinic: challenges and lessons in prospective deployment from the System for High Intensity EvaLuation During Radiation Therapy (SHIELD-RT) randomized controlled study
BMC Bioinformatics (2022)
-
Artificial intelligence-enabled decision support in nephrology
Nature Reviews Nephrology (2022)
-
Deploying digital health tools within large, complex health systems: key considerations for adoption and implementation
npj Digital Medicine (2022)
-
Evaluation of domain generalization and adaptation on improving model robustness to temporal dataset shift in clinical medicine
Scientific Reports (2022)
-
How can we discover the most valuable types of big data and artificial intelligence-based solutions? A methodology for the efficient development of the underlying analytics that improve care
BMC Medical Informatics and Decision Making (2021)
