Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

Automating outcome analysis after stem cell transplantation: The YORT tool

Bone Marrow Transplantation volume 58, pages 1017–1023 (2023)Cite this article

Abstract

Hematopoietic stem cell transplantation is a high-risk procedure. Auditing and yearly outcome reviews help keep optimal quality of care and come with increased survival, but also has significant recurring costs. When data has been entered in a standardized registry, outcome analyses can be automated, which reduces work and increases standardization of performed analyses. To achieve this, we created the Yearly Outcome Review Tool (YORT), an offline, graphical tool that gets data from a single center EBMT registry export, allows the user to define filters and groups, and performs standardized analyses for overall survival, event-free survival, engraftment, relapse rate and non-relapse mortality, complications including acute and chronic Graft vs Host Disease (GvHD), and data completeness. YORT allows users to export data as analyzed to allow you to check data and perform manual analyses. We show the use of this tool on a two-year single-center pediatric cohort, demonstrating how the results for both overall and event-free survival and engraftment can be visualized. The current work demonstrates that using registry data, standardized tools can be made to analyze this data, which allows users to perform outcome reviews for local and accreditation purposes graphically with minimal effort, and help perform detailed standardized analyses. The tool is extensible to be able to accommodate future changes in outcome review and center-specific extensions.

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Graphical user inteface for YORT.
Fig. 2: Survival outcomes as reported by YORT.

Similar content being viewed by others

Data availability

The most recent version of the tool is available on Zenodo on https://doi.org/10.5281/zenodo.7318445, both as source code and as an installer, under the open GPLv3 license. The version of the tool as of the writing of this manuscript, version 0.1.0, is available on Zenodo under https://doi.org/10.5281/zenodo.7318446.

References

  1. Copelan EA. Hematopoietic stem-cell transplantation. N. Engl J Med. 2006;354:1813–26.

    Article  CAS  PubMed  Google Scholar 

  2. Foundation for the accreditation of cellular therapy (FACT), Joint accreditation committee - ISCT and EBMT (JACIE). International standards for hematopoietic cellular therapy product collection, processing, and administration. Clinical program standards: quality management; 2021.

  3. Gratwohl A, Brand R, Mcgrath E, Van Biezen A, Sureda A, Ljungman P, et al. Use of the quality management system “JACIE” and outcome after hematopoietic stem cell transplantation. Haematologica 2014;99:908–15.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Snowden JA, Badoglio M, Labopin M, Giebel S, Mcgrath E, Marjanovic Z, et al. Evolution, trends, outcomes, and economics of hematopoietic stem cell transplantation in severe autoimmune diseases. Blood Adv. 2017;1:2742–55.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Schetelig J, De Wreede LC, Andersen NS, Moreno C, Van Gelder M, Vitek A, et al. Centre characteristics and procedure-related factors have an impact on outcomes of allogeneic transplantation for patients with CLL: A retrospective analysis from the European Society for Blood and Marrow Transplantation (EBMT). Br J Haematol. 2017;178:521–33.

    Article  PubMed  Google Scholar 

  6. Zahnd D, Leibundgut K, Zenhäusern R, Pabst T, Fontana S, Schneider R, et al. Implementation of the JACIE standards for a haematopoietic progenitor cell transplantation programme: A cost analysis. Bone Marrow Transplant. 2004;34:847–53.

    Article  CAS  PubMed  Google Scholar 

  7. Snowden JA, Mcgrath E, Duarte RF, Saccardi R, Orchard K, Worel N, et al. JACIE accreditation for blood and marrow transplantation: past, present and future directions of an international model for healthcare quality improvement. Bone Marrow Transplant. 2017;52:1367–71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2022.

  9. Kanda Y. Investigation of the freely available easy-to-use software ‘EZR’ for medical statistics. Bone Marrow Transplant. 2013;48:452–8.

    Article  CAS  PubMed  Google Scholar 

  10. Wickham H. Mastering Shiny: O’Reilly Media, Inc.; 2021.

  11. Iacobelli S. Suggestions on the use of statistical methodologies in studies of the European Group for Blood and Marrow Transplantation. Bone Marrow Transplant. 2013;48:S1–S37.

    Article  PubMed  Google Scholar 

  12. OpenJS Foundation. Electron | Build cross-platform desktop apps with JavaScript, HTML, and CSS; 2022. Available from: https://www.electronjs.org/.

  13. von Asmuth EGJ Yearly Outcome Review Tool (YORT): A tool to review clinical outcome after stem cell transplantation. Leiden, The Netherlands: Zenodo; 2023. https://doi.org/10.5281/zenodo.7318445.

  14. Snowden JA, Mcgrath E, Orchard K, Kröger N, Sureda A, Gratwohl A. Visions for a JACIE quality management system 4.0. Bone Marrow Transplant. 2021;56:2876–81.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Atsuta Y. Introduction of Transplant Registry Unified Management Program 2 (TRUMP2): Scripts for TRUMP data analyses, part I (variables other than HLA-related data). Int J Hematol. 2016;103:3–10.

    Article  PubMed  Google Scholar 

  16. Snowden JA, Saccardi R, Orchard K, Ljungman P, Duarte RF, Labopin M, et al. Benchmarking of survival outcomes following haematopoietic stem cell transplantation: A review of existing processes and the introduction of an international system from the European Society for Blood and Marrow Transplantation (EBMT) and the Joint Accred. Bone Marrow Transplant. 2020;55:681–94.

    Article  CAS  PubMed  Google Scholar 

  17. The European Society for Blood and Marrow Transplantation. EBMT works together with edenceHealth, Studio Hyperdrive and De Cronos Groep to develop a new data platform. Vol. 2022; 2022. Available from: https://www.ebmt.org/ebmt/news/ebmt-works-together-edencehealth-studio-hyperdrive-and-de-cronos-groep-develop-new-data.

Download references

Acknowledgements

We thank the EBMT executive committee for evaluating and supporting the tool. We thank Dr. Dirk-Jan Eikema for helping with the development and validation of a filter that corresponds exactly to the filter used currently for benchmarking. We thank Eoin McGrath for giving feedback during the early development of the tool. We thank all testers for trying the tool and giving feedback. We thank Michel Dieben for his input regarding data security.

Author information

Authors and Affiliations

  1. Department of Pediatrics, Willem Alexander Children’s Hospital, Leiden, The Netherlands

    Erik G. J. von Asmuth, Alexander B. Mohseny, Marco W. Schilham & Arjan C. Lankester

  2. Department of Medical Statistics, Leiden University Medical Centre, Leiden, The Netherlands

    Hein Putter

  3. Department of Haematology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK

    John A. Snowden

  4. Cellular Therapy and Transfusion Medicine, Careggi University Hospital, Firenze, Italy

    Riccardo Saccardi

Authors
  1. Erik G. J. von Asmuth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hein Putter
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alexander B. Mohseny
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marco W. Schilham
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. John A. Snowden
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Riccardo Saccardi
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Arjan C. Lankester
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

EvA designed the study, developed the tool, performed analyses and drafted the manuscript. HP gave input on filters and analyses and reviewed the manuscript. AM, MS, and JS reviewed the manuscript. RS gave input on the tool, tested it at his center, and reviewed the manuscript. AL designed the study, gave input on the tool, and reviewed the manuscript.

Corresponding author

Correspondence to Erik G. J. von Asmuth.

Ethics declarations

Competing interests

All authors declared no competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

von Asmuth, E.G.J., Putter, H., Mohseny, A.B. et al. Automating outcome analysis after stem cell transplantation: The YORT tool. Bone Marrow Transplant 58, 1017–1023 (2023). https://doi.org/10.1038/s41409-023-02009-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41409-023-02009-0

Search

Advanced search

Quick links