To gauge the relative efficacy of treatments, authors of review articles and commentary might attempt to compare results across clinical trials, but failure to recognize inherent differences across studies or apply proper statistical principles could yield flawed conclusions. Several approaches can mitigate the risks in these cross-trial comparisons.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
References
Gasparyan, A. Y., Ayvazyan, L., Blackmore, H. & Kitas, G. D. Writing a narrative biomedical review: considerations for authors, peer reviewers and editors. Rheumatol. Int. 31, 1409–1417 (2011).
Naylor, C. D. Grey zones of clinical practice: some limits to evidence-based medicine. Lancet 345, 840–842 (1995).
Chang, S. & Lee, T. H. Beyond evidence-based medicine. N. Engl. J. Med. 379, 1983–1985 (2018).
Lee, C. K. et al. Historical cross-trial comparisons for competing treatments in advanced breast cancer-an empirical analysis of bias. Eur. J. Cancer 46, 541–548 (2010).
Bergeris, A., Tse, T. & Zarin, D. A. Trialists’ intent to share individual participant data as disclosed at ClinicalTrials.gov. JAMA 319, 406–408 (2018).
Bucher, H. C., Guyatt, G. H., Griffith, L. E. & Walter, S. D. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J. Clin. Epidemiol. 50, 683–691 (1997).
Warren, R. B. et al. Matching-adjusted indirect comparison of efficacy in patient with moderate-to-severe plaque psoriasis treated with ixekizumab versus secukinumab. Br. J. Dermatol. 178, 1064–1071 (2018).
Mills, E. J., Ghement, I., O’Regan, C. & Thorlund, K. Estimating the power of indirect comparisons: a simulation study. PLoS ONE 6, 1–8 (2011).
Collins, R., Bowman, L., Landray, M. & Peto, R. The magic of randomization versus the myth of real-world evidence. N. Engl. J. Med. 382, 674–678 (2020).
Hutton, B. et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann. Intern. Med. 162, 777–784 (2015).
Acknowledgements
The authors thank E. Brittain and E. Goldmuntz for their review of and assistance with the manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Rights and permissions
About this article
Cite this article
Sullivan, K.M., Keyes-Elstein, L. Cross-trial comparisons in reviews: proceed with caution. Nat Rev Rheumatol 16, 663–664 (2020). https://doi.org/10.1038/s41584-020-0492-3
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41584-020-0492-3
This article is cited by
-
Safety and efficacy of HSCT for systemic sclerosis across clinical trials
Nature Reviews Rheumatology (2020)