Ability of IMPROVE and IMPROVE-DD scores to predict outcomes in patients with severe COVID-19: a prospective observational study

In this study we aimed to evaluate the ability of IMPROVE and IMPROVE-DD scores in predicting in-hospital mortality in patients with severe COVID-19. This prospective observational study included adult patients with severe COVID-19 within 12 h from admission. We recorded patients' demographic and laboratory data, Charlson comorbidity index (CCI), SpO2 at room air, acute physiology and chronic health evaluation II (APACHE II), IMPROVE score and IMPROVE-DD score. In-hospital mortality and incidence of clinical worsening (the need for invasive mechanical ventilation, vasopressors, renal replacement therapy) were recorded. Our outcomes included the ability of the IMPROVE and IMPROVE-DD to predict in-hospital mortality and clinical worsening using the area under receiver operating characteristic curve (AUC) analysis. Multivariate analysis was used to detect independent risk factors for the study outcomes. Eighty-nine patients were available for the final analysis. The IMPROVE and IMPROVE-DD score showed the highest ability for predicting in-hospital mortality (AUC [95% confidence intervals {CI}] 0.96 [0.90–0.99] and 0.96 [0.90–0.99], respectively) in comparison to other risk stratification tools (APACHE II, CCI, SpO2). The AUC (95% CI) for IMPROVE and IMPROVE-DD to predict clinical worsening were 0.80 (0.70–0.88) and 0.79 (0.69–0.87), respectively. Using multivariate analysis, IMPROVE-DD and SpO2 were the only predictors for in-hospital mortality and clinical worsening. In patients with severe COVID-19, high IMPROVE and IMOROVE-DD scores showed excellent ability to predict in-hospital mortality and clinical worsening. Independent risk factors for in-hospital mortality and clinical worsening were IMPROVE-DD and SpO2.

www.nature.com/scientificreports/ knowledge, there is no reports of prospectively evaluating the ability of IMPROVE and IMPROVE-DD score to predict outcomes in patients with severe COVID-19. This study aims to evaluate the ability of IMPROVE and IMPROVE-DD scoring systems in predicting inhospital mortality in patients with severe COVID-19.

Methods
This prospective observational study was conducted in three separate intensive care units (ICUs) in Cairo University Hospital, after institutional Research Ethics Committee approval (N-104-2021) from November to December 2021. Written informed consent was obtained from the patient's next-in-kin before the enrolment. We confirm that the research was performed in accordance with the Declaration of Helsinki. We included adult patients (> 18 years) with severe COVID-19 (confirmed to be positive for SARS-CoV-2 by the reverse-transcriptase polymerase chain reaction, peripheral oxygen saturation [SpO 2 ] < 94% at room air, a respiratory rate > 30 breaths/min, arterial oxygen tension/fraction of inspired oxygen ratio [PaO 2 /FiO 2 ] < 300 mm Hg, or lung infiltrates > 50% as detected by computed tomography [CT] of the chest). Patients who are expected to die or be discharged within 48 h after admission and pregnant women were excluded.
Within 12 h from the admission to the emergency department, patient's demographic data (age, weight, height, sex, co-morbidities by calculating Charlson comorbidity index), clinical data (mean arterial pressure, heart rate, temperature, respiratory rate, SpO 2 at room air, acute physiology and chronic health evaluation II [APACHE II] score), laboratory data (Hemoglobin, white blood cell count, platelet count, d-dimer, C-reactive protein), level of respiratory support (simple oxygen therapy, high-flow nasal oxygen, non-invasive ventilation, or invasive mechanical ventilation) were recorded. The risk scores for VTE including IMPROVE score (calculated as; prior VTE: 3 points, thrombophilia: 2 points, paralysis of the lower extremity during the hospitalization: 2 points, current malignancy: 2 points, immobilization for at least 7 days: 1 point, ICU admission: 1 point, age > 60 years: 1 point) and IMPROVE-DD score (as IMPROVE score in addition to giving 2 points if the D-dimer ≥ 2-time upper limit of normal) were calculated.
The patients were managed during the ICU stay according to our standardized protocol for respiratory and hemodynamic support 9-11 and the treating physician was blinded to the purpose of the study. All patients were examined by venous color-Doppler ultrasound of the limbs to assess the presence of DVT upon ICU admission, by Samsung HS60 ultrasound machine with a high frequency linear probe. Subsequent investigation for VTE during the ICU stay was done upon suspicion in the form of venous color-Doppler ultrasound and multisliced CT angiography.
Patients with no documented VTE received prophylactic dose of low molecular weight heparin. If VTE was confirmed, the patient received therapeutic dose of low molecular weight heparin, the anticoagulant dose was adjusted if creatinine clearance < 30 mL/min. Only two patients did not receive any anticoagulation due to high bleeding risk and those patients did not develop VTE during their ICU course. All patients were followed up until discharge from the ICU or death.
Patient's outcome data were recorded such as length of ICU stay, patient outcome (survival or death), incidence of VTE, Incidence of major bleeding, incidence of other complications, and incidence of clinical worsening (the need for conversion to more intense treatment: invasive mechanical ventilation, vasopressors, the need to renal replacement therapy).
The primary outcome was the accuracy of the IMPROVE and IMPROVE-DD scores to predict in-hospital mortality. Secondary outcomes included the accuracy of the IMPROVE, D-dimer, APACHE II, Charlson comorbidity index and SpO 2 to predict in-hospital mortality. Accuracy of IMPROVE-DD, IMPROVE, D-dimer, APACHE II, Charlson comorbidity index and SpO 2 to predict clinical worsening. Other outcomes included patient's demographic data, clinical and laboratory data at admission. Sample size calculation. Sample size was calculated using MedCalc Software version 14 (MedCalc Software bvba, Ostend, Belgium) to detect area under receiver operating characteristic curve (AUC) of 0.75 with null hypothesis AUC of 0.5. Taking in consideration that the in-hospital mortality of severe COVID-19 is ⁓ 20%, we calculated a minimum number of 85 patients (with at least 17 deaths) for study power of 90% and alpha error of 0.05. Statistical analysis. The patients were categorized according to the survival (survived/dead) and clinical worsening (yes/no). Data were reported as mean and standard deviation or median and quartiles as appropriate and were analyzed using the unpaired student t-test or the Mann-Whitney test as appropriate. Categorical variables were summarized as frequency (percentages) and analyzed using the Chi-squared or Fisher's exact test as appropriate. The AUC was calculated for IMPROVE and IMPROVE-DD scores as well as for the D-dimer, APACHE II, Charlson comorbidity index, and SpO 2 , to predict mortality and clinical worsening. The best cutoff values were calculated using the Youden's index. The AUCs were compared using the Henley-MacNeil test. Logistic regression was performed to obtain adjusted odds ratio (OR) and 95% confidence intervals (CI) for mortality and clinical worsening. Statistical analysis was conducted using the MedCalc Software version 14 and Statistical package for social science (SPSS) software, version 26 for Microsoft Windows (Armonk, NY: IBM Corp).

Results
Ninety-six patients were screened for eligibility, seven patients were excluded for not fulfilling the inclusions criteria, and 89 patients were included and were available for the final analysis. Clinical worsening occurred in 56 (63%) patients and 38 (43%) died (Fig. 1 Fig. 2).
For the ability to predict clinical worsening, the IMPROVE score had the highest AUC (0.80 [0.70-0.88]) but was only significant when compared to the Charlson comorbidity index, P value: 0.049 (Table 2, Fig. 2). Furthermore, the IMPROVE score showed the highest specificity (94%) for predicting clinical worsening ( Table 2, Fig. 2).
In the univariate analysis, risk factors for in-hospital mortality were the age, SpO 2 , APACHE II score, Charlson comorbidity index, IMPROVE score, IMPROVE-DD score, D-dimer, and C-reactive protein. The risk factors for clinical worsening were the respiratory rate, SpO 2 , APACHE II score, Charlson comorbidity index, IMPROVE score, IMPROVE-DD score, D-dimer, and C-reactive protein (Table 3).
In the multivariate analysis we only included the APACHE II (instead of the age in the in-hospital mortality model or the respiratory rate in the clinical worsening model), IMPROVE-DD (instead of the IMPROVE and D-dimer in both model) to avoid collinearity; in addition to the Charlson comorbidity index, and C-reactive protein. Only the SpO 2 and IMPROVE-DD were found to be the independent risk factors for in-hospital mortality (

Discussion
In our cohort of patients with severe COVID-19, IMPROVE-DD score and SpO 2 , measured on hospital admission, were the two independent risk factors for clinical worsening and in-hospital mortality. IMPROVE-DD score showed excellent ability to predict in-hospital mortality which was the highest among all other tools for risk stratification. Furthermore, IMPROVE-DD score showed very good ability to predict clinical worsening especially in the positive predictive value. The IMPROVE and IMPROVE-DD scores showed an important and unique feature among all risk stratification tools which is combination of excellent positive and negative predictive values which was > 90% in the two scores.
The evidence for the association of COVID-19 with pro-coagulant state is well established despite the lack of definitive explanation 2 . IMPROVE-DD score had been originally introduced for estimation of the risk of VTE and to guide the prescription of anticoagulant drugs among hospitalized patients 4 . Furthermore, high VTE risk (using another VTE risk score: the Padua prediction score) was associated with increased risk of mortality in non-COVID acutely ill medical patients 12,13 . Therefore, we hypothesized that this score might show good performance in risk stratification of COVID-19. We found that IMPROVE-DD score was independently associated with risk of mortality even when clinical VTE was included in the analysis; this finding denotes that COVID-19 is associated with thrombotic complications which are not always clinically detected and are sometimes www.nature.com/scientificreports/ microvascular. This explains the relation between IMPROVE-DD score and patient outcomes despite the low incidence of VTE (8%) in our patients. The APACHE II and Charlson comorbidity index are known risk stratification tools and were able to predict mortality in patients with COVID-19 14,15 . In this study, the predictive values of IMPROVE-DD score were higher than the APACHE II score and Charlson comorbidity index. Furthermore, when these scores were included in the multivariate analysis, the IMPROVE-DD score was found to be an independent predictor for poor outcome. The SpO 2 was the other independent risk factor for poor outcomes in this study, this finding agreed with our previous reports 16,17 . Furthermore, the cutoff value for SpO 2 (78%) for in-hospital mortality was, interestingly, close to our previous report (79%) 16 . We evaluated the IMPROVE-DD score to find whether incorporation of the D-dimer results would increase the validity of the score; however, the predictive value did not differ in the two scores.
One previous report by Greco et al. 8 , showed that the IMPROVE score was not an independent predictor of the need for intensification of treatment; however, it was a risk factor for mortality. The unexplained contradiction in the results of Greco et al., might be due to the retrospective design, the small sample (51 patients), and the lack of evaluation of the severity of illness in the included patients. Our study had the advantage of the larger sample size, the prospective design, the strict inclusion of severe cases, and the follow-up of patients until death or discharge. Another advantage is including Charlson comorbidity index in the multivariate analysis as an indicator of general status and chronic illness and this provide more accurate estimation for the validity of risk factors.
Currently, the ideal anticoagulation regimen for non-critically ill patients with COVID-19 is controversial 1 . The guidelines for prescription of anticoagulant drugs changed many times since the beginning of this pandemic. The latest evidence suggests that the benefit of therapeutic anticoagulation is clearer in the early stages of the disease, namely in non-critically ill, while prophylactic anticoagulation is more suitable in critically ill patients 18,19 . However, higher levels of anticoagulation increase the risk of bleeding which is sometimes serious. Hence, it is essential to select the level of anticoagulation meticulously and to find more tools which can guide this critical decision. Our findings suggest that patients with severe COVID-19 and IMPROVE score > 2 or IMPROVE-DD Table 1. Demographic data, clinical data, and ICU course. APACHE II acute physiology and chronic health evaluation II, BMI body mass index, CI confidence interval, CRP C-reactive protein, DD D-dimer, ICU intensive care unit, IMPROVE international medical prevention registry on venous thromboembolism, INR international normalized ratio, MAP mean arterial pressure, RR respiratory rate, SD standard deviation, SpO 2 peripheral oxygen saturation, Q quartiles. www.nature.com/scientificreports/ score > 3 have high risk of clinical worsening with positive predictive values of 94% and 87%, respectively. An IMPROVE score > 2 and IMPROVE-DD score > 4 have positive predictive value for in-hospital mortality of 94%. Our findings would improve the process of triaging and early detection of critical patients; furthermore, our findings might guide the decision regarding the level of anticoagulation in non-critically ill patients with COVID-19 such as providing more liberal anti-coagulation in high-risk patients and being more conservative in low-risk patients especially if they have high bleeding risk. Future studies are needed to evaluate the usefulness of incorporating those scores in clinical decision regarding the reduction of risk of clinical worsening and mortality. Our study has a limitation for being conducted in one university, however, it has the advantage of being conducted in three separate ICUs which are completely different in their location (in different hospitals) and staff

Conclusion
In patients with severe COVID-19, IMPROVE and IMPROVE-DD scores showed excellent ability to predict in-hospital mortality and clinical worsening. The two scores predicted in-hospital mortality with a PPV of 94% and a NPV 93% and 91%, respectively. The IMPROVE-DD score and SpO 2 were independent risk factors for clinical worsening and in-hospital mortality.

Data availability
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.