Abstract
Hematopoietic stem cell transplantation is a high-risk procedure. Auditing and yearly outcome reviews help keep optimal quality of care and come with increased survival, but also has significant recurring costs. When data has been entered in a standardized registry, outcome analyses can be automated, which reduces work and increases standardization of performed analyses. To achieve this, we created the Yearly Outcome Review Tool (YORT), an offline, graphical tool that gets data from a single center EBMT registry export, allows the user to define filters and groups, and performs standardized analyses for overall survival, event-free survival, engraftment, relapse rate and non-relapse mortality, complications including acute and chronic Graft vs Host Disease (GvHD), and data completeness. YORT allows users to export data as analyzed to allow you to check data and perform manual analyses. We show the use of this tool on a two-year single-center pediatric cohort, demonstrating how the results for both overall and event-free survival and engraftment can be visualized. The current work demonstrates that using registry data, standardized tools can be made to analyze this data, which allows users to perform outcome reviews for local and accreditation purposes graphically with minimal effort, and help perform detailed standardized analyses. The tool is extensible to be able to accommodate future changes in outcome review and center-specific extensions.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$259.00 per year
only $21.58 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
Data availability
The most recent version of the tool is available on Zenodo on https://doi.org/10.5281/zenodo.7318445, both as source code and as an installer, under the open GPLv3 license. The version of the tool as of the writing of this manuscript, version 0.1.0, is available on Zenodo under https://doi.org/10.5281/zenodo.7318446.
References
Copelan EA. Hematopoietic stem-cell transplantation. N. Engl J Med. 2006;354:1813–26.
Foundation for the accreditation of cellular therapy (FACT), Joint accreditation committee - ISCT and EBMT (JACIE). International standards for hematopoietic cellular therapy product collection, processing, and administration. Clinical program standards: quality management; 2021.
Gratwohl A, Brand R, Mcgrath E, Van Biezen A, Sureda A, Ljungman P, et al. Use of the quality management system “JACIE” and outcome after hematopoietic stem cell transplantation. Haematologica 2014;99:908–15.
Snowden JA, Badoglio M, Labopin M, Giebel S, Mcgrath E, Marjanovic Z, et al. Evolution, trends, outcomes, and economics of hematopoietic stem cell transplantation in severe autoimmune diseases. Blood Adv. 2017;1:2742–55.
Schetelig J, De Wreede LC, Andersen NS, Moreno C, Van Gelder M, Vitek A, et al. Centre characteristics and procedure-related factors have an impact on outcomes of allogeneic transplantation for patients with CLL: A retrospective analysis from the European Society for Blood and Marrow Transplantation (EBMT). Br J Haematol. 2017;178:521–33.
Zahnd D, Leibundgut K, Zenhäusern R, Pabst T, Fontana S, Schneider R, et al. Implementation of the JACIE standards for a haematopoietic progenitor cell transplantation programme: A cost analysis. Bone Marrow Transplant. 2004;34:847–53.
Snowden JA, Mcgrath E, Duarte RF, Saccardi R, Orchard K, Worel N, et al. JACIE accreditation for blood and marrow transplantation: past, present and future directions of an international model for healthcare quality improvement. Bone Marrow Transplant. 2017;52:1367–71.
R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2022.
Kanda Y. Investigation of the freely available easy-to-use software ‘EZR’ for medical statistics. Bone Marrow Transplant. 2013;48:452–8.
Wickham H. Mastering Shiny: O’Reilly Media, Inc.; 2021.
Iacobelli S. Suggestions on the use of statistical methodologies in studies of the European Group for Blood and Marrow Transplantation. Bone Marrow Transplant. 2013;48:S1–S37.
OpenJS Foundation. Electron | Build cross-platform desktop apps with JavaScript, HTML, and CSS; 2022. Available from: https://www.electronjs.org/.
von Asmuth EGJ Yearly Outcome Review Tool (YORT): A tool to review clinical outcome after stem cell transplantation. Leiden, The Netherlands: Zenodo; 2023. https://doi.org/10.5281/zenodo.7318445.
Snowden JA, Mcgrath E, Orchard K, Kröger N, Sureda A, Gratwohl A. Visions for a JACIE quality management system 4.0. Bone Marrow Transplant. 2021;56:2876–81.
Atsuta Y. Introduction of Transplant Registry Unified Management Program 2 (TRUMP2): Scripts for TRUMP data analyses, part I (variables other than HLA-related data). Int J Hematol. 2016;103:3–10.
Snowden JA, Saccardi R, Orchard K, Ljungman P, Duarte RF, Labopin M, et al. Benchmarking of survival outcomes following haematopoietic stem cell transplantation: A review of existing processes and the introduction of an international system from the European Society for Blood and Marrow Transplantation (EBMT) and the Joint Accred. Bone Marrow Transplant. 2020;55:681–94.
The European Society for Blood and Marrow Transplantation. EBMT works together with edenceHealth, Studio Hyperdrive and De Cronos Groep to develop a new data platform. Vol. 2022; 2022. Available from: https://www.ebmt.org/ebmt/news/ebmt-works-together-edencehealth-studio-hyperdrive-and-de-cronos-groep-develop-new-data.
Acknowledgements
We thank the EBMT executive committee for evaluating and supporting the tool. We thank Dr. Dirk-Jan Eikema for helping with the development and validation of a filter that corresponds exactly to the filter used currently for benchmarking. We thank Eoin McGrath for giving feedback during the early development of the tool. We thank all testers for trying the tool and giving feedback. We thank Michel Dieben for his input regarding data security.
Author information
Authors and Affiliations
Contributions
EvA designed the study, developed the tool, performed analyses and drafted the manuscript. HP gave input on filters and analyses and reviewed the manuscript. AM, MS, and JS reviewed the manuscript. RS gave input on the tool, tested it at his center, and reviewed the manuscript. AL designed the study, gave input on the tool, and reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
All authors declared no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
von Asmuth, E.G.J., Putter, H., Mohseny, A.B. et al. Automating outcome analysis after stem cell transplantation: The YORT tool. Bone Marrow Transplant 58, 1017–1023 (2023). https://doi.org/10.1038/s41409-023-02009-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41409-023-02009-0