Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Patients should be informed when AI systems are used in clinical trials

Nature Medicine (2023)Cite this article

Subjects

Artificial intelligence (AI) systems are increasingly being investigated in clinical trials. Trials that use AI must be held to the same ethical standards for risk assessment and disclosure as all human participant studies. All clinical AI systems, especially those under active investigation, have new risks, including human–machine interactions, interpretability and data limitations. The full magnitude and scope of these risks is not yet known because clinical AI integration is still in its infancy. We argue that in light of these risks and the uncertainty therein, disclosure is a minimal standard when patients’ data are being used in an AI clinical trial that may affect clinical decisions, even if written informed consent is not required.

This is a preview of subscription content, access via your institution

Access options

Rent or buy this article

Get just this article for as long as you need it

$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

References

  1. US Food and Drug Administration. https://go.nature.com/41xD0em (2022).

  2. US Food and Drug Administration. https://go.nature.com/3zefINL (2019).

  3. Bitterman, D. S. et al. Lancet Digit. Health 2, e447–e449 (2020).

    Article  PubMed  Google Scholar 

  4. He, J. et al. Nat. Med. 25, 30–36 (2019).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Reyes, M. et al. Radiol. Artif. Intell. 2, e190043 (2020).

    Article  PubMed  PubMed Central  Google Scholar 

  6. Kaushal, A. et al. JAMA 324, 1212–1213 (2020).

    Article  PubMed  PubMed Central  Google Scholar 

  7. Panch, T. et al. J. Glob. Health 9, 010318 (2019).

    Article  PubMed  Google Scholar 

  8. Finlayson, S. G. et al. N. Engl. J. Med. 385, 283–286 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

  9. US Department of Health and Human Services. 45 CFR 46 https://go.nature.com/3yl1Rq4 (2018).

  10. The Pew Charitable Trusts. https://go.nature.com/3I4ZuwJ (2021).

Download references

Author information

Authors and Affiliations

  1. Artificial Intelligence in Medicine Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA

    Subha Perni & Danielle S. Bitterman

  2. Department of Radiation Oncology, Brigham and Women’s Hospital/Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA, USA

    Subha Perni, Lisa Soleymani Lehmann & Danielle S. Bitterman

  3. MD Anderson Cancer Center, Houston, TX, USA

    Subha Perni

  4. Harvard T.H. Chan School of Public Health, Harvard Medical School, Boston, MA, USA

    Lisa Soleymani Lehmann

Authors
  1. Subha Perni
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lisa Soleymani Lehmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Danielle S. Bitterman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Danielle S. Bitterman.

Ethics declarations

Competing interests

D.S.B. is an associate editor of Radiation Oncology, HemOnc.org, unrelated to this work, for which she receives no financial compensation; and funding from American Association for Cancer Research, unrelated to this work.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Perni, S., Lehmann, L.S. & Bitterman, D.S. Patients should be informed when AI systems are used in clinical trials. Nat Med (2023). https://doi.org/10.1038/s41591-023-02367-8

Download citation

  • Published:

  • DOI: https://doi.org/10.1038/s41591-023-02367-8

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing