Abstract
Risk stratification and prognosis evaluation of severe thrombocytopenia are essential for clinical treatment and management. Currently, there is currently no reliable predictive model to identify patients at high risk of severe thrombocytopenia. This study aimed to develop and validate a prognostic nomogram model to predict in-hospital mortality in patients with severe thrombocytopenia in the intensive care unit. Patients diagnosed with severe thrombocytopenia (N = 1561) in the Medical Information Mart for Intensive Care IV database were randomly divided into training (70%) and validation (30%) cohorts. In the training cohort, univariate and multivariate logistic regression analyses with positive stepwise selection were performed to screen the candidate variables, and variables with p < 0.05 were included in the nomogram model. The nomogram model was compared with traditional severity assessment tools and included the following 13 variables: age, cerebrovascular disease, malignant cancer, oxygen saturation, heart rate, mean arterial pressure, respiration rate, mechanical ventilation, vasopressor, continuous renal replacement therapy, prothrombin time, partial thromboplastin time, and blood urea nitrogen. The nomogram was well-calibrated. According to the area under the receiver operating characteristics, reclassification improvement, and integrated discrimination improvement, the nomogram model performed better than the traditional sequential organ failure assessment (SOFA) score and simplified acute physiology score II (SAPS II). Additionally, according to decision curve analysis, a threshold probability between 0.1 and 0.75 indicated that our constructed nomogram model showed more net benefits than the SOFA score and SAPS II. The nomogram model we established showed superior predictive performance and can assist in the quantitative assessment of the prognostic risk in patients with severe thrombocytopenia.
Similar content being viewed by others
Introduction
Platelets are produced by megakaryocytes in the bone marrow and participate in hemostasis and thrombosis. In healthy individuals, platelets exhibit normal physiological functions, and their number remains above 150 × 109/L1. However, increased platelet consumption, impaired production, or severe destruction may lead to varying degrees of platelet reduction2. To date, there is no consistent definition of thrombocytopenia. Generally, thrombocytopenia is classified into mild (100–149 × 109/L), moderate (50–99 × 109/L) and severe (< 50 × 109/L), according to the absolute number of platelets3.
Thrombocytopenia is common in critically ill patients. Studies have found that more than 60% of intensive care unit (ICU) patients develop thrombocytopenia4, with severe thrombocytopenia occurring in 2.3–27% of them5 As the most common cause of hemostatic disorders in ICUs, thrombocytopenia is associated with a higher risk of bleeding and blood transfusion6. Although the mechanisms leading to thrombocytopenia vary, severe thrombocytopenia indicates a worse clinical prognosis in critically ill patients7,8.
Identifying risk factors for mortality in patients with severe thrombocytopenia can help clinicians develop individualized treatment strategies and enhanced care management to reduce the risk of adverse events and improve patient outcomes. Thus, risk stratification and prognosis evaluation of patients with severe thrombocytopenia are essential for clinical treatment and management. Currently, there is currently no reliable predictive model that can be used to identify patients at a high risk of severe thrombocytopenia.
The visual nomogram is an intuitive and easy-to-use predictive tool whose performance has been validated in predictive models for multiple diseases9,10. This study aimed to develop and verify a nomogram model to predict mortality in patients with severe thrombocytopenia during ICU admission based on a large dataset of diagnosis and treatment from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database.
Results
Patient characteristics
In total, 1,561 patients with severe thrombocytopenia were enrolled in this study and randomly divided into a training cohort of 1,093 patients and a validation cohort of 468 patients. The in-hospital mortality rate of the training cohort was 31.5%, and that of the validation cohort was 35.5%. As shown in Table 1, no significant differences were observed in any of the variables between the training and validation cohorts.
Screening of prognostic factors
As shown in Table 2, in the univariate logistic regression analysis, 23 variables were significantly related to the in-hospital mortality rate in severe thrombocytopenia (p < 0.05). Based on the multivariate logistic regression analysis with positive stepwise selection, the following were identified as independent factors for in-hospital mortality in patients with severe thrombocytopenia: age, cerebrovascular disease, malignant cancer, oxygen saturation, heart rate, respiration rate, mean arterial pressure, mechanical ventilation, vasopressors, continuous renal replacement therapy (CRRT), prothrombin time (PT), partial thromboplastin time (PTT), and blood urea nitrogen (BUN). Moreover, the variance inflation factor (VIF) of all variables was < 10, indicating no significant collinearity.
Construction and verification of nomogram
Based on the results of the multivariate logistic regression analysis, we constructed a nomogram to predict the in-hospital mortality of patients with severe thrombocytopenia (Fig. 1). For patients aged 26 years who were prescribed vasopressor agents, underwent CRRT, and presented oxygen saturation of 93.3%; mean arterial pressure of 72 mmHg; heart rate of 112 bpm; respiration rate of 21 bpm; PT of 25 s; PTT of 36 s; and BUN of 58 mg/dL, the total number of points on the nomogram was 208, which predicted an in-hospital mortality of 0.601.
The C-indices of the nomogram in the training and validation cohorts were 0.846 (95% confidence interval [CI]: 0.806–0.886) and 0.828 (95% CI: 0.791–0.865), respectively, indicating excellent prediction performance. In addition, the Hosmer–Lemeshow goodness-of-fit test indicated that the predicted outcome of the patient agreed with the actual outcome (Fig. 2).
To compare the predictive performance of the nomogram model and the most commonly used severity assessment scales in the ICU, we constructed receiver operating characteristics (ROC) curves (Fig. 3). The areas under the ROC curve of the nomogram in the training and validation queues were higher than those of sequential organ failure assessment (SOFA) score and simplified acute physiology score II (SAPS II). In addition, integrated discrimination improvement (IDI) and net reclassification improvement (NRI) reflected the intuitive improvement in the nomogram. Compared with those of the SOFA score, the NRI and IDI values of the nomogram in the training cohort were 0.272 (95% CI = 0.190–0.355) and 0.177 (95% CI = 0.148–0.206), respectively, whereas those in the validation cohort were 0.250 (95% CI = 0.129–0.371) and 0.129 (95% CI = 0.087–0.171), respectively. Compared with SAPS II, the NRI and IDI values of the nomogram in the training cohort were 0.282 (95% CI = 0.201–0.362) and 0.137 (95% CI = 0.107–0.166), respectively; in the validation cohort, they were 0.168 (95% CI = 0.061–0.276) and 0.078 (95% CI = 0.039–0.117), respectively.
Clinical application of the nomogram
As shown in Fig. 4, regardless of the cohort (training or validation), a threshold probability between 0.1 and 0.75 indicated that our constructed nomogram model showed more net benefits than the SOFA score and SAPS II. For example, according to Fig. 4a, if the risk threshold is set to 0.4 when we individualize and intensify care for patients with a greater than 40% risk of in-hospital mortality, for every 100 patients who use the nomogram model, 14 gain benefits without incurring losses to others. In contrast, only eight and ten patients using the SOFA score and SAPS II achieved a net benefit, respectively.
Discussion
Patients with thrombocytopenia are at an increased risk of bleeding, and even a mild or moderate decrease in platelet count in critically ill patients cannot be ignored11. Severe thrombocytopenia can no longer be regarded as a comorbidity of other diseases, as it severely affects patient management and restricts doctors from providing invasive intervention. Therefore, it was necessary to develop a specific model to predict patient prognosis.
To the best our knowledge, this is the first study to develop and validate a predictive model for in-hospital mortality in patients with severe thrombocytopenia. We revealed the following as independent risk factors for in-hospital mortality in patients with severe thrombocytopenia: age, presence of cerebrovascular disease, malignant cancer, oxygen saturation, heart rate, respiration rate, mean arterial pressure, mechanical ventilation, vasopressor use, CRRT; PT, PTT, and BUN. These risk factors were used to construct a nomogram model, which was verified and evaluated using ROC curve, calibration curve, IDI, NRI, and decision curve analysis. We believe that the nomogram model has good predictive performance and clinical application value.
In the prognostic models of different diseases, age, as a non-interventional factor, has been reported as an independent risk factor for most diseases12,13. Generally, the decline in the body's immunity with age is inevitable14. Additionally, the existence of non-interventional factors affects the net benefit of clinical intervention based on this nomogram.
Vital signs beyond the normal range indicate that the body is making compensatory adjustments. However, once out of control, the patients’ condition becomes serious, and clinical interventions, such as mechanical ventilation and vasopressor agents, are necessary. Comorbidities affect patients in many ways, and this may be due to the absence of platelet homeostasis. Cardiovascular diseases often require antiplatelet therapy, which contradicts the treatment of patients with severe thrombocytopenia15. The immune system of patients with malignant tumors is severely damaged, and thrombocytopenia is the main side effect of cancer treatment16.
From the nomogram model, it is clear that PT, PTT, and BUN are laboratory parameters worth paying attention to. PT and PTT reflect the function of the coagulation system. Patients with severe thrombocytopenia have microvascular failure, organ dysfunction, and blood coagulation disorders which increase the risk of bleeding17. BUN is an indicator of renal function; studies have found that it is an independent risk factor for the prognosis of critically ill patients, especially those with cardiogenic diseases18,19. Our study found that BUN is independently related to the prognosis of patients with severe thrombocytopenia, possibly because patients with renal failure also have complex hemostatic disorders20,21.
A nomogram is a common visual presentation for predictive models. Compared with the traditional critically ill patient scoring systems (SOFA and SAPS II), risk stratification based on our nomogram model showed a higher clinical benefit.
However, our findings had some limitations. First, because the data were extracted from the MIMIC-IV database, though the nomogram model passed verification in the validation cohort, its universality is limited, and verification using multi-center data is required. Second, because of the retrospective study design, potential selection bias is unavoidable, and the results should be interpreted with caution. Third, it is undeniable that there may be variables that were not included in the model, which have significant effects on in-hospital mortality in patients with severe thrombocytopenia. Fourth, the nomogram model comprises multiple variables and, in practice, it is not suitable for patients with missing variables. Therefore, we recommend deciding whether to use this model to assess patient outcomes either before or at the time of patient admission to the ICU, as opposed to waiting for more than 24 h following admission. Although the nomogram model could provide an important reference for clinical diagnosis and treatment, it could not accurately predict prognosis.
The nomogram model we developed can help quantitatively assess the prognostic risk factors in patients with severe thrombocytopenia. This model has superior predictive performance and can provide a good reference for evaluating the in-hospital mortality rate in patients with severe thrombocytopenia. However, multi-center prospective studies are required for further verification.
Methods
Data source
The MIMIC-IV database contains all data from intensive care patients admitted to the ICU or emergency department of Beth Israel Deaconess Medical Center (Boston, MA) from 2008 to 201922. The collection of raw data, as well as the establishment of the database, was approved by the Institutional Review Board of Beth Israel Deaconess Medical Center and the Massachusetts Institute of Technology (Cambridge, MA). Because all medical data were deidentified, the requirement for individual patient consent was waived. In accordance with the data usage agreement, Lu passed the training for protecting human research participants (certificate number: 35953547) and was responsible for the acquisition and analysis of research data. All methods were performed in accordance with the relevant guidelines and regulations.
Study population
Severe thrombocytopenia was defined as the lowest platelet value < 50 × 109/L within 24 h of ICU admission. Data on 2434 patients with severe thrombocytopenia were extracted from all patients admitted to the ICU. Some data were excluded based on the following criteria: (1) If the same patient was admitted multiple times, only the information of the patient's first admission was retained; (2) Patients who were younger than 18 years old; (3) Patients who were hospitalized in the ICU for < 24 h; (4) Patients who received platelet transfusion before ICU admission; and (5) Patients with missing clinical data > 20%. (Supplementary Fig. 1).
Data extraction
We used the structured query language in PostgreSQL 10 software to extract clinical data from the final study population. The following data were collected (results of multiple measurements were included as the initial value or the mean value as required): (1) demographics including age, sex, and weight measured for the first time after ICU admission; (2) comorbidities; (3) the mean value of vital sign measurements within 24 h of ICU admission; (4) severity scores on the first day of ICU admission; (5) medical treatment; and (6) the initial value of laboratory measurements obtained within 24 h of ICU admission. When the proportion of missing values for a variable was less than 20% (Supplementary Table 1), the missing part of the variable was filled in the training cohort and the validation cohort using multiple imputations, respectively. Otherwise, the variables were excluded. To reduce the influence of extreme values on the conclusions of the study, continuous variables were winsorized by 1% on both sides23.
Statistical analyses
Patients with severe thrombocytopenia included in the study were randomly divided into training (70%) and validation (30%) cohorts. After analyzing the distribution of continuous variables using the Shapiro–Wilk test, the normally distributed variables are presented as the mean ± standard deviation. Non-normally distributed variables are represented by the median and interquartile range. Categorical variables are expressed as quantities (percentages). The differences between groups of continuous variables were compared using unpaired Student's t-test and Wilcox test. The chi-square test was used for categorical variables.
IBM Statistical Package for the Social Sciences for Windows (version 22.0. Armonk, NY: IBM Corp) and R (version 4.1.0) software were used for data analysis and drawing graphs. In the training cohort, univariate logistic regression analysis was initially used to screen for candidate variables. Then, according to the value minimization principle of Akaike information criteria24, multivariate logistic regression analysis with positive stepwise selection was performed on the statistically significant variables (p < 0.05). The VIF tested the collinearity between variables, whose acceptable range is < 1025. The "rms" package of R software was used to convert the results into nomograms.
To test the clinical application performance of the model, both the training and validation cohorts were drawn with ROC curves. The performance of the SOFA score and SAPS II were compared with the performance of the new model. We used the NRI and IDI to more objectively evaluate the improvement of the new model26. The calibration curve used the Hosmer–Lemeshow goodness-of-fit test to reflect the consistency between the actual and the predicted probabilities27. Decision curve analysis was performed to assess the net clinical benefits of the new model under different thresholds28.
The outcome variable was all-cause in-hospital mortality in patients with severe thrombocytopenia. This study was based on the transparent reporting of individual prognosis or diagnosis (TRIPOD) of multivariate predictive models guidelines for analysis and reporting29.
Ethics approval and consent to participate
The collection of raw data, as well as the establishment of the database, was approved by the Institutional Review Board of Beth Israel Deaconess Medical Center and the Massachusetts Institute of Technology (Cambridge, MA). Since all medical data were deidentified, the requirement for individual patient consent was waived. In accordance with the data usage agreement, Lu passed the training for protecting human research participants.
Data availability
All available data were obtained from MIMIC-IV database. The original contributions presented in the study are included in the article/supplementary material; further inquiries can be directed to the corresponding author/s.
Abbreviations
- BUN:
-
Blood urea nitrogen
- CRRT:
-
Continuous renal replacement therapy
- ICU:
-
Intensive care units
- IDI:
-
Integrated Discrimination Improvement
- MIMIC-IV:
-
Intensive Care Medical Information Market IV
- NRI:
-
Net reclassification improvement
- PTT:
-
Partial thromboplastin time
- PT:
-
Prothrombin time
- ROC:
-
Receiver operating characteristics
- RDW:
-
Red blood cell distribution width
- SAPS II:
-
Simplified acute physiology score II
- SOFA:
-
Sequential organ failure assessment
- VIF:
-
Variance inflation factor
References
Lee, E. J. & Lee, A. I. Thrombocytopenia. Prim. Care 43, 543–557. https://doi.org/10.1016/j.pop.2016.07.008 (2016).
Rice, T. W. & Wheeler, A. P. Coagulopathy in critically ill patients: Part 1: Platelet disorders. Chest 136, 1622–1630. https://doi.org/10.1378/chest.08-2534 (2009).
Williamson, D. R. et al. Thrombocytopenia in critically ill patients receiving thromboprophylaxis: frequency, risk factors, and outcomes. Chest 144, 1207–1215. https://doi.org/10.1378/chest.13-0121 (2013).
Knöbl, P. Thrombocytopenia in the intensive care unit : Diagnosis, differential diagnosis, and treatment. Medizinische Klinik, Intensivmedizin und Notfallmedizin 111, 425–433. https://doi.org/10.1007/s00063-016-0174-8 (2016).
Greinacher, A. & Selleng, K. Thrombocytopenia in the intensive care unit patient. Hematology 135–143, 2010. https://doi.org/10.1182/asheducation-2010.1.135 (2010).
Ostadi, Z., Shadvar, K., Sanaie, S., Mahmoodpoor, A. & Saghaleini, S. H. Thrombocytopenia in the intensive care unit. Pak. J. Med. Sci. 35, 282–287. https://doi.org/10.12669/pjms.35.1.19 (2019).
Zhu, Y. et al. Association between thrombocytopenia and 180-day prognosis of COVID-19 patients in intensive care units: A two-center observational study. PLoS ONE 16, e0248671. https://doi.org/10.1371/journal.pone.0248671 (2021).
Zhong, Z., Yuan, X., Liu, S., Yang, Y. & Liu, F. Machine learning prediction models for prognosis of critically ill patients after open-heart surgery. Sci. Rep. 11, 3384. https://doi.org/10.1038/s41598-021-83020-7 (2021).
Yan, J., He, Y., Wang, M. & Wu, Y. Prognostic nomogram for overall survival of patients aged 50 years or older with cervical cancer. Int. J. Gen. Med. 14, 7741–7754. https://doi.org/10.2147/ijgm.s335409 (2021).
Guo, Q. et al. Development and validation of a prognostic nomogram for myocardial infarction patients in intensive care units: a retrospective cohort study. BMJ Open 10, e040291. https://doi.org/10.1136/bmjopen-2020-040291 (2020).
Thachil, J. & Warkentin, T. E. How do we approach thrombocytopenia in critically ill patients?. Br. J. Haematol. 177, 27–38. https://doi.org/10.1111/bjh.14482 (2017).
Tan, L., Xu, Q. & Shi, R. A nomogram for predicting hospital mortality in intensive care unit patients with acute myocardial infarction. Int. J. Gen. Med. 14, 5863–5877. https://doi.org/10.2147/ijgm.s326898 (2021).
Ho, K. M., Knuiman, M., Finn, J. & Webb, S. A. Estimating long-term survival of critically ill patients: The PREDICT model. PLoS ONE 3, e3226. https://doi.org/10.1371/journal.pone.0003226 (2008).
Pinti, M. et al. Aging of the immune system: Focus on inflammation and vaccination. Eur. J. Immunol. 46, 2286–2301. https://doi.org/10.1002/eji.201546178 (2016).
Zhu, B. C. et al. Combination of Xuesaitong and Aspirin based on the antiplatelet effect and gastrointestinal injury: Study protocol for a randomized controlled noninferiority trial. Evid. Based Complem. Alternat. Med. 2021, 5552506. https://doi.org/10.1155/2021/5552506 (2021).
Castaman, G. & Pieri, L. Management of thrombocytopenia in cancer. Thromb. Res. 164(Suppl 1), S89-s93. https://doi.org/10.1016/j.thromres.2018.02.001 (2018).
Nguyen, T. C. Thrombocytopenia-associated multiple organ failure. Crit. Care Clin. 36, 379–390. https://doi.org/10.1016/j.ccc.2019.12.010 (2020).
Angraal, S. et al. Machine learning prediction of mortality and hospitalization in heart failure with preserved ejection fraction. JACC. Heart Fail. 8, 12–21. https://doi.org/10.1016/j.jchf.2019.06.013 (2020).
Ren, X. et al. Role of blood urea nitrogen in predicting the post-discharge prognosis in elderly patients with acute decompensated heart failure. Sci. Rep. 8, 13507. https://doi.org/10.1038/s41598-018-31059-4 (2018).
Nguyen, T. C., Cruz, M. A. & Carcillo, J. A. Thrombocytopenia-associated multiple organ failure and acute kidney injury. Crit. Care Clin. 31, 661–674. https://doi.org/10.1016/j.ccc.2015.06.004 (2015).
Boccardo, P., Remuzzi, G. & Galbusera, M. Platelet dysfunction in renal failure. Semin. Thromb. Hemost. 30, 579–589. https://doi.org/10.1055/s-2004-835678 (2004).
Johnson, A. et al. MIMIC-IV (version 1.0), https://doi.org/10.13026/s6n6-xd98 (2021).
Ventura-León, J. Pearson Winsorized: A robust coefficient for correlations with small samples. Rev. Chilena Pediatr. 91, 642–643. https://doi.org/10.32641/rchped.vi91i4.2300 (2020).
Portet, S. A primer on model selection using the Akaike Information Criterion. Infect. Dis. Model. 5, 111–128. https://doi.org/10.1016/j.idm.2019.12.010 (2020).
Kim, J. H. Multicollinearity and misleading statistical results. Korean J. Anesthesiol. 72, 558–569. https://doi.org/10.4097/kja.19087 (2019).
Steyerberg, E. W. et al. Assessing the performance of prediction models: A framework for traditional and novel measures. Epidemiology 21, 128–138. https://doi.org/10.1097/EDE.0b013e3181c30fb2 (2010).
Kramer, A. A. & Zimmerman, J. E. Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited. Crit. Care Med. 35, 2052–2056. https://doi.org/10.1097/01.ccm.0000275267.64078.b0 (2007).
Vickers, A. J., van Calster, B. & Steyerberg, E. W. A simple, step-by-step guide to interpreting decision curve analysis. Diagn. Progn. Res. 3, 18. https://doi.org/10.1186/s41512-019-0064-7 (2019).
Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. BMJ 350, g7594. https://doi.org/10.1136/bmj.g7594 (2015).
Funding
This study did not receive any grant from funding agencies.
Author information
Authors and Affiliations
Contributions
Y.L. conceived the study and was responsible for the acquisition and analysis of research data and drafting of the manuscript. Q.Z. contributed to the literature search, drawing of diagrams, and drafting of the manuscript. J.J. contributed to data analysis and software support.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lu, Y., Zhang, Q. & Jiang, J. Development and validation of a prediction model for in-hospital mortality of patients with severe thrombocytopenia. Sci Rep 12, 6316 (2022). https://doi.org/10.1038/s41598-022-10438-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-10438-y
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.