# Establishment and Validation of a Prediction Equation to Estimate Risk of Intraoperative Hypothermia in Patients Receiving General Anesthesia

## Abstract

Inadvertent intraoperative hypothermia (core temperature <36 °C) is a frequent but preventable complication of general anesthesia. Accurate risk assessment of individual patients may help physicians identify patients at risk for hypothermia and apply preventive approaches, which include active intraoperative warming. This study aimed to develop and validate a risk-prediction model for intraoperative hypothermia. Two independent observational studies in China, the Beijing Regional Survey and the China National Survey, were conducted in 2013 and 2014, respectively, to determine the incidence of hypothermia and its underlying risk factors. In this study, using data from these two studies, we first derived a risk calculation equation, estimating the predictive risk of hypothermia using National Survey data (3132 patients), then validated the equation using the Beijing Regional Survey data (830 patients). Measures of accuracy, discrimination and calibration were calculated in the validation data set. Through validation, this model, named Predictors Score, had sound overall accuracy (Brier Score = 0.211), good discrimination (C-Statistic = 0.759) and excellent calibration (Hosmer-Lemeshow, P = 0.5611). We conclude that the Predictors Score is a valid predictor of the risk of operative hypothermia and can be used in deciding whether intraoperative warming is a cost-effective measure in preventing the hypothermia.

## Introduction

Mild inadvertent intraoperative hypothermia (core temperature<36 °C) is common among patients undergoing major operations under general anesthesia1. Hypothermia has been reported in 4% to 72% of cases1, and up to 90% in some studies2,3. The hypothermia is associated with several major adverse events that increase patients’ operative risks: cardiac complications4,5; hemorrhage6,7,8; and infection9,10,11,12,13, especially in patients with high-risk factors (American Society of Anesthesiologists grade III, IV). The decrease in body temperature may also lead to altered drug metabolism14,15, prolonged time in a post-anesthetic care unit or intensive care unit16, and uncomfortable cold for patients. These consequences can affect patients’ satisfaction with the procedure and increase the cost17,18.

From the standpoint of patient safety, body temperature is one of the vital signs and must be monitored carefully during the perioperative period. A final core temperature of ≥ 36 °C is widely considered “normothermic,” and it has been incorporated into various clinical guidelines19. For example, the Surgical Care Improvement Project suggested a final intraoperative temperature above 36 °C and use of active over-body warming for body temperature below 36 °C20. In the United States, according to guidelines22, all surgical patients are actively warmed. And active warming is suggested but is uncommon in many other developed Western countries21. In developing countries, though, few surgical patients are actively warmed.

In this study, we aimed to develop a readily accessible method for quantifying individual patient’s absolute risk of intraoperative hypothermia. Using two independent data sets from two recent observational studies in China22,23, we strove to derive and externally validate a prediction equation to determine the hypothermia risk. We believe this information could help patients be aware of the risk and help physicians identify high-risk patients, make informed treatment decisions, and more closely manage modifiable risk factors.

## Results

### Incidence of Hypothermia

In the Beijing Regional Survey, the incidence of intraoperative hypothermia among the 830 patients was 39.9%. As is standard of care in China, all patients were warmed passively by covering with surgical drapes or cotton blanket; 10.7% of patients also received active warming with space heater, electric blanket, or other devices. Pre-warmed intravenous fluid was infused in 16.9% of patients, and 34.6% were rinsed with pre-warmed fluid.

In the China National Survey, the incidence of intraoperative hypothermia was as high as 44.3%, and the average rates of hypothermia were 17.8%, 36.2%, 42.5% and 44.1% within 1 h, 2 h, 3 h and 4 h, respectively, after induction of anesthesia. As in the Beijing Survey, all patients were warmed passively; a low percentage (14.2%) were also given active warming. Baseline characteristics of derivation and validation cohorts are summarized in Table 1.

### Predictor Variables

Several predictor variables were selected based on published literature1,2,24 of significant contributors to intraoperative hypothermia, then examined in the two studies separately. Analysis showed that higher BMI (>=25), higher patient baseline core temperature prior to anesthesia, and higher ambient temperature prevented hypothermia. In contrast, major operations, longer duration of anesthesia (>2 h), more intravenous un-warmed fluid infusion (>1000 ml), and open surgery increased the risk of hypothermia. Intraoperative active warming, although not with recommended forced-air warming, reduced the chance of hypothermia (Table 2).

The final regression model was expressed as:

$$\begin{array}{c}{\rm{Predictors}}\,{\rm{Score}}={\rm{Probability}}(P)\,{\rm{of}}\,{\rm{Hypothermia}}\,\times \,100 \% =100 \% \\ \qquad \quad \qquad \quad \quad \,\,\times 1/\{1+\mathrm{EXP}[-(119\,+\,0.201\,\times \,{\rm{Magnitude}}\_{\rm{Surgery}}\,-\,0.1847\\ \qquad \quad \qquad \quad \quad \,\,\times {\rm{Intravenous}}\_{\rm{Fluid}}\,+\,0.5299\times {\rm{Duration}}\_{\rm{Anesthesia}}-0.2269\\ \qquad \quad \qquad \quad \quad \,\,\times {\rm{Mode}}\_{\rm{of}}\_{\rm{Patient}}\_{\rm{Warming}}\,-\,0.306\,\times \,{\rm{BMI}}\,-\,0.1912\\ \qquad \quad \qquad \quad \quad \,\,\times {\rm{OR}}\_{\rm{Ambient}}\_{\rm{Temperature}}-3.1057\,\times \,{\rm{Baseline}}\_{\rm{Core}}\_{\rm{Temperature}})]\},\end{array}$$

where R-squared = 0.15. The Predictors Score is not applicable to patients under 18 and cardiovascular surgeries with extracorporeal circulation as we did not include these patients and types of surgeries in both Beijing Regional and National Hypothermia Survey22,23.

### Performance of Regression Model

Based on receiver operation curve analysis, C-statistics of derivation and validation sets were 0.789 and 0.771, respectively, indicating good discrimination (Fig. 1). The Hosmer-Lemeshow goodness-of-fit statistic was used to test model reliability in the validation cohort, and P = 0.5611 indicated a good match of predicted risk over observed risk. Brier Score is a measure of calibration defined as the means squared difference between predicted hypothermia and actual hypothermia; Brier Score = 0.21 represents a good accuracy.

### Risk Calculator

The risk calculator that implements the risk equation from the final model was created with Excel Spreadsheet (the presenting spreadsheet is shown in Fig. 2). We named the calculated probability of hypothermia “Predictors Score,” which implies the quantitative risk of hypothermia. The Predictors Score, which is simply equal to the Probability (P) of Hypothermia × 100% (see also above), represents the predicted risk for each patient of developing intraoperative hypothermia given the baseline information and hypothesized variables before and during the operation.

## Discussion

Intraoperative hypothermia and its adverse consequences are known by medical practitioners throughout the world, but limited data of hypothermia had been available in China. This is one of the reasons that we initiated regional and national studies on intraoperative hypothermia since 2013. It has also been difficult to develop policies regarding hypothermia in a big country such as China, with its geographic, socioeconomic, and cultural diversity and variations in healthcare resources. Thus, we aimed in this study to develop a readily accessible method for quantifying an individual patient’s absolute risk of intraoperative hypothermia.

Towards this end, we developed and then externally validated a hypothermia risk prediction calculator for patients undergoing general anesthesia. The equations are well performed and demonstrated good discrimination with, C statistic values of 0.759 in the validation cohort, a sound overall accuracy (Brier Score) and goodness of fit (Hosmer-Lemeshow). To our knowledge, this is the first such tool to quantify the risk of hypothermia for individual patients.

Perioperative core temperature is affected by multiple factors, including patients’ health and illnesses, the operation, and the anesthesia. These variables are differently weighted as they contribute to hypothermia. In this study, we first screened literature and reviewed our clinical experience, then selected a group of risk factors associated with hypothermia from one data set (national data) and validated it with another data set (Beijing data). Initially, we included all known risk factors associated with hypothermia: age, gender, American Society of Anesthesiologists physical status, magnitude of surgery, BMI, mode of anesthesia, volume of intravenous fluid used, volume of irrigation fluid used, duration of anesthesia, endoscopic/open surgery, patient-warming mode, baseline core temperature, and operating room ambient temperature. However, as with the risk- assessment model generated from the Framingham Heart Study25 and in other studies26, we revised this full model to a simplified one with fewer but highly weighted risk factors. The final model includes only magnitude of surgery, duration of anesthesia, BMI, baseline core temperature, operating room ambient temperature, volume of intravenous fluid infused, and the mode of patient warming. This list, we believe, is more practicable for health care providers to use. By entering a risk-factor profile, a patient’s risk of hypothermia, which we named Predictors Score, can be generated. Use of the Score should help physicians identify high-risk patients; assess the risk vs benefit, including cost of active perioperative active warming; and help in management of modifiable risk factors. The scores may also help patients beware of the risk of hypothermia.

Although perioperative warming is routine practice in the United States and many other developed countries, it is not often used in most developing countries or in China; amounts and allocation of healthcare resources likely is a determinant in this difference. To follow United States’ guidelines, reliable warming of patients to 37 °C or higher usually requires 30 minutes of pre-warming, two intraoperative forced-air warming covers, and a fluid warmer, all of which add cost to the operation24. This expense may not be necessary for many operations, such as small operations performed in a warm operating room. The need for scrutiny in the use of perioperative warming is one of the reasons we initiated regional and national studies on hypothermia in intraoperative patients in China.

There are some limitations in our study. First, both Beijing and National studies did not include patients under 18 years old, so the risk assessment applies only to adult patients. Second, although the risk assessment calculator was generated from the national survey, then validated by the Beijing regional survey, repressiveness may still be an issue; due to lack of technical capability, patients were not selected in a randomized manner in the national survey.

In summary, we developed and validated a regression equation, “Predictors Scores,” for predicting personalized risk of hypothermia in patients undergoing general anesthesia. The potential usefulness of the Score is to help physicians identify patients at risk for hypothermia before commencement of anesthesia, and in deciding whether active perioperative warming is needed. This assessment of risk should aid in making sound clinical decisions and in the rational use of healthcare resources.

## Methods

### Patients and Data Source

Data were derived from two independent observational studies: the Beijing Regional Survey23 and the China National Survey for Intraoperative Hypothermia22. The studies are parts of the China National Anesthesiology Healthcare Quality Improvement Program. The Beijing Regional Survey is a regional cross-sectional study in the city of Beijing, conducted from June 2013 through December 2013. Eight hundred and thirty eligible patients who underwent various operations under general anesthesia were randomly selected from 24 hospitals in Beijing through a multistage probability sampling23.

The China National Survey for Hypothermia and Patient Warming, another observational study, was conducted from November 2014 through August 2015. It is a prospective study with 30-day postoperative follow-up to identify the incidence and clinical outcome of hypothermia. A total of 3132 eligible patients who underwent general anesthesia in 28 hospitals nationwide were enrolled. Data access is available (see data availability statement below).

This is a retrospective observational study based on the data obtained from two previous studies, the Beijing Survey and the National Survey, which were led by Peking Union Medical College Hospital (PUMCH). This study was carried out in accordance with Good Clinical Practice guidelines and regulations. The study protocol was fully approved by Institutional Review Board (IRB) of PUMCH and then informed consent form (ICF) was waived.

### Model Derivation and Validation

Because the Beijing Regional Survey and the China National Survey are independent observational studies for intraoperative hypothermia, we first used the China National Survey cohort to derive a multivariate logistic regression model and identify predictors associated with intraoperative hypothermia and their relative predictive weights (coefficients). We selected and examined these predictor variables based on published literature1,2,24. The variables were: age, gender, intraoperative active warming, body mass index (BMI), baseline core temperature prior to anesthesia, ambient temperature of the operation room, magnitude of operation, duration of anesthesia, volume of intravenous un-warmed fluid used, volume of intraoperative irrigation used, and open/endoscopic surgery. The model was then validated with another data set from the Beijing Regional Survey.

### Model Performance

Model performance was evaluated with C statistic, Brier Score and Hosmer-Lemeshow Goodness-of-Fit statistics27,28,29. C statistic, or area under the curve (AUC) of receiver operating characteristics, is a measure of discrimination, with 0.5 corresponding to discrimination that is no better than chance, and 1.0 corresponding to perfect prediction. The Brier Score is a measure of calibration defined as the means squared difference between predicted outcome and actual outcome (occurrence of hypothermia in this study), with the score = 0.0 representing a perfect model performance. Additionally, Hosmer-Lemeshow Goodness-of-Fit Statistics was calculated to evaluate model reliability; a large P value (>0.05) indicates a good match of predicted risk over observed risk. After model validation, a risk calculator based on the model using the National Survey cohort was established. All data manipulation and statistical analysis were performed using SAS 9.4 (SAS Institute, Inc.).

### Data Availability

Our data are available from PUMCH Institutional Data Access/Ethics Committee for researchers only who meet the criteria for access to confidential data. Please submit an application form, obtainable at http://www.pumch.cn to Prof. Jie Chen, Chair of PUMCH Institutional Review Board. Researchers requesting data access may also contact corresponding author Dr. Yuguang Huang. Upon agreement, researchers should sign a data usage contract with PUMCH specifying terms and conditions.

## References

1. 1.

Burns, S. M., Piotrowski, K., Caraffa, G. & Wojnakowski, M. Incidence of postoperative hypothermia and the relationship to clinical variables. J Perianesth Nurs 25, 286–289, https://doi.org/10.1016/j.jopan.2010.07.001 (2010).

2. 2.

Burger, L. & Fitzpatrick, J. Prevention of inadvertent perioperative hypothermia. Br J Nurs 18(1114), 1116–1119, https://doi.org/10.12968/bjon.2009.18.18.44553 (2009).

3. 3.

Tappen, R. M. & Andre, S. P. Inadvertent hypothermia in elderly surgical patients. AORN J 63, 639–644 (1996).

4. 4.

Frank, S. M. et al. Unintentional hypothermia is associated with postoperative myocardial ischemia. The Perioperative Ischemia Randomized Anesthesia Trial Study Group. Anesthesiology 78, 468–476 (1993).

5. 5.

Frank, S. M. et al. Perioperative maintenance of normothermia reduces the incidence of morbid cardiac events. A randomized clinical trial. JAMA 277, 1127–1134 (1997).

6. 6.

Schmied, H., Kurz, A., Sessler, D. I., Kozek, S. & Reiter, A. Mild hypothermia increases blood loss and transfusion requirements during total hip arthroplasty. Lancet 347, 289–292 (1996).

7. 7.

Rajagopalan, S., Mascha, E., Na, J. & Sessler, D. I. The effects of mild perioperative hypothermia on blood loss and transfusion requirement. Anesthesiology 108, 71–77, https://doi.org/10.1097/01.anes.0000296719.73450.52 (2008).

8. 8.

Winkler, M. et al. Aggressive warming reduces blood loss during hip arthroplasty. Anesth Analg 91, 978–984 (2000).

9. 9.

Aasen, A. O. et al. Panel discussion: current issues in the prevention and management of surgical site infection–part 1. Surg Infect (Larchmt) 3(Suppl 1), S1-7, https://doi.org/10.1089/10962960260496299 (2002).

10. 10.

Aasen, A. O. et al. Panel discussion: current issues in the prevention and management of surgical site infection–part 2. Surg Infect (Larchmt) 3(Suppl 1), S99-102, https://doi.org/10.1089/10962960260496389 (2002).

11. 11.

Barie, P. S. Surgical site infections: epidemiology and prevention. Surg Infect (Larchmt) 3(Suppl 1), S9-21, https://doi.org/10.1089/sur.2002.3.s1-9 (2002).

12. 12.

Bock, M. et al. Effects of preinduction and intraoperative warming during major laparotomy. Br J Anaesth 80, 159–163 (1998).

13. 13.

Kurz, A., Sessler, D. I. & Lenhardt, R. Perioperative normothermia to reduce the incidence of surgical-wound infection and shorten hospitalization. Study of Wound Infection and Temperature Group. N Engl J Med 334, 1209–1215, https://doi.org/10.1056/NEJM199605093341901 (1996).

14. 14.

Leslie, K., Sessler, D. I., Bjorksten, A. R. & Moayeri, A. Mild hypothermia alters propofol pharmacokinetics and increases the duration of action of atracurium. Anesth Analg 80, 1007–1014 (1995).

15. 15.

Heier, T., Caldwell, J. E., Sessler, D. I. & Miller, R. D. Mild intraoperative hypothermia increases duration of action and spontaneous recovery of vecuronium blockade during nitrous oxide-isoflurane anesthesia in humans. Anesthesiology 74, 815–819 (1991).

16. 16.

Lenhardt, R. et al. Mild intraoperative hypothermia prolongs postanesthetic recovery. Anesthesiology 87, 1318–1323 (1997).

17. 17.

Mahoney, C. B. & Odom, J. Maintaining intraoperative normothermia: a meta-analysis of outcomes with costs. AANA J 67, 155–163 (1999).

18. 18.

Wong, P. F., Kumar, S., Bohra, A., Whetter, D. & Leaper, D. J. Randomized clinical trial of perioperative systemic warming in major elective abdominal surgery. Br J Surg 94, 421–426, https://doi.org/10.1002/bjs.5631 (2007).

19. 19.

Jeran, L. Patient temperature: an introduction to the clinical guideline for the prevention of unplanned perioperative hypothermia. J Perianesth Nurs 16, 303–304, https://doi.org/10.1053/jpan.2001.28452 (2001).

20. 20.

Scott, A. V. et al. Compliance with Surgical Care Improvement Project for Body Temperature Management (SCIP Inf-10) Is Associated with Improved Clinical Outcomes. Anesthesiology 123, 116–125, https://doi.org/10.1097/ALN.0000000000000681 (2015).

21. 21.

NICE. Preoperative Tests: The use of preoperative tests for elective surgery–Evidence, Methods and Guidance. National Institute for Health and Clinical Excellence London, www.nice.nhs.uk (2003).

22. 22.

Yi, J. et al. Intraoperative hypothermia and its clinical outcomes in patients undergoing general anesthesia: National study in China. PloS one 12, e0177221, https://doi.org/10.1371/journal.pone.0177221 (2017).

23. 23.

Yi, J. et al. Incidence of Inadvertent Intraoperative Hypothermia and Its Risk Factors in Patients Undergoing General Anesthesia in Beijing: A Prospective Regional Survey. PloS one 10, e0136136, https://doi.org/10.1371/journal.pone.0136136 (2015).

24. 24.

Forbes, S. S. et al. Evidence-based guidelines for prevention of perioperative hypothermia. J Am Coll Surg 209, 492–503 e491, doi:10.1016/j.jamcollsurg.2009.07.002 (2009).

25. 25.

Sullivan, L. M., Massaro, J. M. & D’Agostino, R. B. Sr. Presentation of multivariate data for clinical use: The Framingham Study risk score functions. Stat Med 23, 1631–1660, https://doi.org/10.1002/sim.1742 (2004).

26. 26.

Hippisley-Cox, J. & Coupland, C. Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study. BMJ 351, h5441, https://doi.org/10.1136/bmj.h5441 (2015).

27. 27.

Rufibach, K. Use of Brier score to assess binary predictions. J Clin Epidemiol 63, 938–939; author reply 939, doi:10.1016/j.jclinepi.2009.11.009 (2010).

28. 28.

Paul, P., Pennell, M. L. & Lemeshow, S. Standardizing the power of the Hosmer-Lemeshow goodness of fit test in large data sets. Stat Med 32, 67–80, https://doi.org/10.1002/sim.5525 (2013).

29. 29.

Mohanty, S. et al. Risk of discharge to postacute care: a patient-centered outcome for the american college of surgeons national surgical quality improvement program surgical risk calculator. JAMA Surg 150, 480–484, https://doi.org/10.1001/jamasurg.2014.3176 (2015).

## Acknowledgements

This study was funded by the China National Health and Planned Parenthood Committee Health Quality Improvement Award (ID# 201402017, principal investigator Yuguang Huang, MD); the China National Nature Science Foundation (Grant# 31070930, principal investigator Yuguang Huang, MD), and an unrestricted research grant (MDI0091, principal investigator Yuguang Huang, MD) from 3 M China R&D Center. Drs. Lujing Zhan and Min Yao are current or former employees of 3 M.

## Author information

Authors

### Contributions

Study Administration: Jie Yi and Yuguang Huang Study Design: Jie Yi and Yuguang Huang Conduct of Study: Jie Yi, Yuguang Huang, Yongjing Lei, Shiyuan Xu, Yongyu Si, Shiyang Li, Zhongyuan Xia, Yisa Shi, Xiaoping Gu, Jianshe Yu, Guohai Xu, Erwei Gu, Yonghao Yu, Yanqing Chen, Hequn Jia, Yinglin Wang, Xiuli Wang, Xiaoqing Chai, Xiaoju Jin, Junping Chen, Meiying Xu, Junyu Xiong, Guonian Wang, Kaizhi Lu, Wenli Yu, Weifu Lei, Zaisheng Qin, Jingguo Xiang, Longyuan Li, and Min Yao Data Analysis and Interpretation: Jie Yi, Lujing Zhan, Min Yao, and Yuguang Huang Manuscript Drafting: Jie Yi Manuscript Review, Revision, Finalization and Approval: Yuguang Huang

### Corresponding author

Correspondence to Yuguang Huang.

## Ethics declarations

### Competing Interests

The authors declare that they have no competing interests.

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

Yi, J., Zhan, L., Lei, Y. et al. Establishment and Validation of a Prediction Equation to Estimate Risk of Intraoperative Hypothermia in Patients Receiving General Anesthesia. Sci Rep 7, 13927 (2017). https://doi.org/10.1038/s41598-017-12997-x