Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Special Report
  • Published:

Development, preliminary usability and accuracy testing of the EBMT ‘eGVHD App’ to support GvHD assessment according to NIH criteria—a proof of concept

Bone Marrow Transplantation volume 51, pages 1062–1065 (2016)Cite this article

Subjects

Abstract

The EBMT Complications and Quality of Life Working Party has developed a computer-based algorithm, the ‘eGVHD App’, using a user-centered design process. Accuracy was tested using a quasi-experimental crossover design with four expert-reviewed case vignettes in a convenience sample of 28 clinical professionals. Perceived usefulness was evaluated by the technology acceptance model (TAM) and User satisfaction by the Post-Study System Usability Questionnaire (PSSUQ). User experience was positive, with a median of 6 TAM points (interquartile range: 1) and beneficial median total, and subscale PSSUQ scores. The initial standard practice assessment of the vignettes yielded 65% correct results for diagnosis and 45% for scoring. The ‘eGVHD App’ significantly increased diagnostic and scoring accuracy to 93% (+28%) and 88% (+43%), respectively (both P<0.05). The same trend was observed in the repeated analysis of case 2: accuracy improved by using the App (+31% for diagnosis and +39% for scoring), whereas performance tended to decrease once the App was taken away. The ‘eGVHD App’ could dramatically improve the quality of care and research as it increased the performance of the whole user group by about 30% at the first assessment and showed a trend for improvement of individual performance on repeated case evaluation.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Figure 1

References

  1. Filipovich AH, Weisdorf D, Pavletic S, Socie G, Wingard JR, Lee SJ et al. National Institutes of Health consensus development project on criteria for clinical trials in chronic graft-versus-host disease: I. Diagnosis and staging working group report. Biol Blood Marrow Transplant 2005; 11: 945–956.

    Article  Google Scholar 

  2. Jagasia MH, Greinix HT, Arora M, Williams KM, Wolff D, Cowen EW et al. National Institutes of Health Consensus Development Project on criteria for clinical trials in chronic graft-versus-host disease: I. The 2014 Diagnosis and Staging Working Group report. Biol Blood Marrow Transplant 2015; 21: 389–401.

    Article  Google Scholar 

  3. Duarte RF, Greinix H, Rabin B, Mitchell SA, Basak G, Wolff D et al. Uptake and use of recommendations for the diagnosis, severity scoring and management of chronic GVHD: an international survey of the EBMT-NCI Chronic GVHD Task Force. Bone Marrow Transplant 2014; 49: 49–54.

    Article  CAS  Google Scholar 

  4. De Vito Dabbs A, Myers BA, Mc Curry KR, Dunbar-Jacob J, Hawkins RP, Begey A et al. User-centered design and interactive health technologies for patients. Comput Inform Nurs 2009; 27: 175–183.

    Article  Google Scholar 

  5. Rowlings PA, Przepiorka D, Klein JP, Gale RP, Passweg JR, Henslee-Downey PJ et al. IBMTR Severity Index for grading acute graft-versus-host disease: retrospective comparison with Glucksberg grade. Br J Haematol 1997; 97: 855–864.

    Article  CAS  Google Scholar 

  6. Davis F . Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quart 1989; 13: 319–340.

    Article  Google Scholar 

  7. Masrom M . Technology Acceptance Model and E-learning. 12th International Conference on Education, Sultan Hassanal Bolkiah Institute of Education, Universiti Brunei Darussalam, Darussalam, Indonesia, 21–24 May 2007.

  8. Lewis JR . IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int J Hum-Comput Int 1995; 7: 57–78.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge and thank the whole Department of Hematology of UZ Leuven for participating in this study. We also deeply thank Sofhea (Sociaal Fonds voor Hematologische Aandoeningen of Bloedziekten) for funding this research project.

Author information

Author notes

  1. F Dobbels and R F Duarte: These authors contributed equally to this work.

Authors and Affiliations

  1. Department of Hematology, University Hospital Leuven, KU Leuven, Leuven, Belgium

    H Schoemans, K Goris & J Maertens

  2. Department of Information Technology, University Hospital Leuven, KU Leuven, Leuven, Belgium

    R V Durm

  3. Academic Centre for Nursing and Midwifery, University of Leuven, Leuven, Belgium

    J Vanhoof, S D Geest & F Dobbels

  4. Department of Internal Medicine III, Hematology and Oncology, University Medical Center of Regensburg, Regensburg, Germany

    D Wolff

  5. Division of Hematology, Medical University of Graz, Graz, Austria

    H Greinix

  6. Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA

    S Pavletic

  7. Clinical Research Division, Fred Hutchinson Cancer Research Center, Seattle, WA, USA

    S J Lee

  8. Institute of Nursing Science, University of Basel, Basel, Switzerland

    S D Geest & F Dobbels

  9. Hospital Universitario Puerta de Hierro Majadahonda, Calle Joaquín Rodrigo 2, Majadahonda, Madrid, Spain

    R F Duarte

Authors
  1. H Schoemans
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K Goris
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. R V Durm
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. J Vanhoof
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. D Wolff
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. H Greinix
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. S Pavletic
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. S J Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. J Maertens
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. S D Geest
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. F Dobbels
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. R F Duarte
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

for the EBMT Complications and Quality of Life Working Party

Corresponding author

Correspondence to H Schoemans.

Ethics declarations

Competing interests

The authors declare no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schoemans, H., Goris, K., Durm, R. et al. Development, preliminary usability and accuracy testing of the EBMT ‘eGVHD App’ to support GvHD assessment according to NIH criteria—a proof of concept. Bone Marrow Transplant 51, 1062–1065 (2016). https://doi.org/10.1038/bmt.2016.26

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/bmt.2016.26

This article is cited by

Search

Advanced search

Quick links