Introduction

Patient handovers, the process of transferring primary authority for clinical care from one caregiver (or group of caregivers) to another [1], are ubiquitous in medicine, and an essential feature of the management of surgical patients in the neonatal intensive care unit (NICU). While common, handovers present both a threat to patient safety and an opportunity to develop processes to foster communication and teamwork, thereby improving safety risk.

Different handover structures exist with potentially different effects on patient safety. Interdisciplinary, team-based handovers consist of all personnel on the current care team (e.g., physicians, nurses, respiratory therapists, etc.) providing care transition to an interdisciplinary group of team members receiving the infant for a new phase of care. These interdisciplinary, team-based handovers have been shown to improve the safety, efficiency, and quality of care transitions between intensive care units and operating rooms (ORs) primarily in adults [2,3,4,5]. Despite their benefits, the safety risks that persist for team-based handovers have not been adequately defined, especially in pre-operative neonatal settings. Alternatively, nursing-based handovers, consisting of nurse-to-nurse handover only, remain the most prevalent form of handover in many NICUs and perioperative environments due in part to their ease of implementation [1, 6, 7]. No studies have systematically evaluated the effect of handover type (team-based versus nursing-based) on patient safety risk in critically ill neonates.

Hospitalized neonates, especially those with surgical pathologies, are one of the highest risk groups for iatrogenic events due to their size, fragility, unique developmental physiology, inability to communicate verbally, and sensitivity to environmental stressors [8]. Rates of adverse events, such as medication errors and adverse drug events, are as much as 8 times higher for NICU patients compared with hospitalized adults [9]. Safety risks may be greatest during and surrounding surgery, yet there is very little published data on the perioperative safety of surgical neonates. An analysis of 2012 National Surgical Quality Improvement Program Pediatric (NSQIP-P) data found that neonates represented only 6% of all patients, yet accounted for 60 and 16% of the total observed 30-day post-operative morbidity and mortality, respectively [10]. Unadjusted mortality (2–3%) and composite morbidity (16–21%) rates are as much as two-fold higher for neonatal versus pediatric surgery patients in all specialties except orthopedics [11, 12]. The relative contribution of medical errors, such as those that occur in association with handovers, to these outcomes remains largely unknown.

The primary objective of this study was to evaluate the impact of handover structure on patient safety risk during the perioperative period in a cohort of surgical neonates, arguably the most vulnerable population of hospitalized patients. To do this, we used the non-routine events (NREs) methodology, a novel method of capturing risk that has been used in high-reliability industries such aviation and nuclear power [13,14,15]. An NRE is any event that is perceived by care providers or skilled observers as a deviation from optimal care based on the clinical situation [13].

Methods

Design and setting

We conducted a 17-month prospective mixed-methods observational study at an urban academic children’s hospital to assess the incidence and etiology of NREs during neonatal perioperative care and to define factors (e.g., handovers) that were associated with NRE incidence and severity.

The primary unit of analysis was a ‘case’, which consisted of four phases: (1) the pre-operative phase, defined as the period (up to one hour) before the patient (i.e., neonate) left the NICU and the departing transfer from the NICU to the OR; (2) the OR phase, defined as the period starting with the patient’s entry into the OR and ending with their exit from the OR, including the operative procedure(s); (3) the early post-operative phase, which included the patient’s transport from the OR to the post-anesthesia care unit (PACU) or NICU, any post-operative handovers, and the first hour of post-operative NICU care; and (4) the late post-operative phase, defined as the 24 h that followed the early post-operative phase. Trained research assistants (RAs) surveyed NICU and OR providers after each perioperative phase, using a previously validated instrument to collect information on the incidence, severity, and preventability of NREs and their contributory factors [13]. NSQIP-P occurrences were identified through structured chart review.

A one-time 30-item cross-sectional survey of providers’ perceptions and attitudes about the study hospital’s current handover practices was administered at month 15 of the 17-month study period.

Participants

The study protocol was approved by the Vanderbilt University Institutional Review Board. Eligible neonates had to be admitted to the NICU, receive pre-operative care in the NICU, were scheduled to undergo non-cardiac surgery (in either the OR or NICU), and were expected to receive post-operative NICU care. Convenience sampling was used to identify eligible patient who had scheduled or emergency operations during weekday hours (i.e., 7 am to 6 pm). The study was powered to determine the association between NREs and NSQIP-occurrences in surgical neonates using an estimate of the neonatal perioperative NRE incidence rate collected in pilot studies along with the hospital’s historical NSQIP-P occurrence rates. Eligible patients were excluded if study personnel were unable to obtain written informed consent from the parent/legal guardian, from at least one clinician in each perioperative phase, or if the infant’s surgical procedure was not eligible for NSQIP-P review.

All perioperative providers, (n = 634) including attending physicians, fellows, residents, nurses, nurse practitioners, therapists (respiratory, occupational, etc.), technicians, and clinical staff who deliver care to neonates, were eligible to participate in the observational study and the cross-sectional survey. Providers were required to provide written informed consent quarterly during the study period and verbal consent prior to each enrolled case. There was a separate written informed consent associated with the web-based survey.

Patient transfer and handover processes

The study hospital used different perioperative transfer processes, as dictated primarily by patient acuity. Critically ill neonates (mechanically ventilated, high levels of non-invasive respiratory support) were transferred from the NICU directly to the OR (direct) while less acute patients were transferred from the NICU to the preoperative holding area (indirect) before going into the OR. Similarly, post-operative neonates were either transferred directly back to the NICU (direct) or first to the PACU before later being transferred to the NICU (indirect). The hospital developed specific patient handover practices for each perioperative transfer processes (Fig. 1Direct transfers were almost exclusively associated with a structured, interdisciplinary, team-based, face-to-face handover (i.e., direct handover) between the responsible teams transferring care. At a minimum, direct handovers required the presence and participation of the anesthesia provider and the NICU nurse but much broader participation from neonatology, anesthesia, pediatric surgery, perioperative services, and parents/legal guardians was encouraged. Their content and structure was developed as a part of prior intensive quality improvement (QI) initiative between Anesthesiology, Neonatology, and Pediatric Surgery. During this initiative, perioperative clinicians received formal training on the handover process and their performance was evaluated by trained observers. Upon the completion of the QI initiative, the direct handover process was adopted as the standard approach for critically ill neonates and remains so today.

In contrast, handovers for indirect transfers (i.e., indirect handovers) were conducted between NICU and OR nurses, were not standardized, and often occurred via phone.

Providers received no formal training for indirect patient handovers.

Perioperative teams used a mixed handover process for neonates who required low respiratory support pre-operatively (i.e., indirect transfer) and high respiratory support post-operatively (i.e., direct transfer).

The discussion of pre-operative and post-operative events was a standard component of handover practices at the study hospital prior to and during the study period. These events were typically serious near misses or events that resulted in patient harm or significant changes in the perioperative care plans. However, the term “non-routine event”, which incorporates a broader range of events than serious near misses and adverse events, had not been formally incorporated into the language of the direct handover script or recommended as a topic of discussion in indirect or mixed handovers prior to the initiation of the study. Since the study’s primary objective was to characterize neonatal risk in the context of current perioperative patient handover practices, NRE reporting and discussions were not specifically addressed in any way during observed handovers.

Fig. 1
figure 1

Direct and indirect perioperative handovers

Measurement of handover effectiveness

The Handover Evaluation Instrument’s Global Rating of Handover Effectiveness, a validated handover evaluation instrument [16], was used by RAs to score the completeness of information exchange, the quality of interpersonal communications, and the overall effectiveness of direct handovers. This tool (Range: 1 (minimum) to 5 (maximum)) was originally developed and validated during a study to improve OR-to-PACU handovers for adult and pediatric patients. As in that study, a value of three or greater was considered an effective handover [16]. The effectiveness of unstructured indirect handovers was not scored by RAs. In the case of mixed handovers, RAs only scored the effectiveness of the direct handover component.

NRE measurement

Non-routine events (including incidence rates and severity) were the primary outcome measure in this study. Research assistants collected NRE reports from perioperative clinicians after each perioperative phase using the Comprehensive Open-Ended Non-Routine Event Survey (CONES), which has been described previously [13]. Using the CONES, clinicians rated the severity of NREs on a 5-point Likert-like scale (1 (negligible), 3 (moderate severity), 5 (catastrophic)) and identified contributory factors for each reported NRE. Clinicians’ severity ratings were subjective and based on clinical judgment. When administering the CONES RAs provided examples of severe and non-severe NREs to help clinicians anchor and calibrate their ratings. Contributory factors were classified using the following 7 categories: clinical care processes, equipment or supplies, individual factors, environment of care, logistical and system factors, teamwork, and patient factors. Non-routine event counts and the maximum reported NRE severity were computed at the case and perioperative phase level.

Trained RAs used the same CONES to describe reported NREs and to provide their assessment of each NRE’s preventability (preventable vs. non-preventable). RA’s ratings of preventability were subjective and based on pre-study training that included extensive observations in the NICU and OR, shadowing perioperative providers (e.g., surgeons, CRNAs, NICU nurses, etc.), and case studies of audio and video-recorded episodes of perioperative care that included NREs of variable severity and contributory factors.

Perioperative patient outcomes

We also collected data on the occurrence of 30-day post-operative major morbidities using the NSQIP-P methodology [17, 18]. NSQIP-P review was performed by a single surgical resident with training in the NSQIP-P methodology. Thirty-four occurrence types were included in the review—4 intraoperative measures (e.g., cardiac arrest, death, and unplanned extubations) and 30 post-operative measures (e.g., surgical site infections, pneumonia, unplanned intubation, seizure, central line-associated blood stream infection, transfusion, and intraventricular hemorrhage, readmission, and unplanned reoperation among others).

Patient handover perceptions survey

A 30-item, cross-sectional, web-based survey was developed and administered in the Research Electronic Data Capture (REDCap) program [19] to measure perioperative providers’ perceptions and attitudes about current handover practices for surgical neonates (See Table 3). The survey was administered during the 15th month of the 17-month observational study. The survey queries providers about their handover training, handover-related human and system factors, experience with adverse outcomes, handover quality ratings, logistical preferences, and recommendations related to all patient handovers types between the NICU and OR. The survey used the following response formats: Yes/No, multiple choice, 7-point Likert-type scale, and free text.

Statistical analysis

Descriptive statistics, including percentages for categorical variables and mean and 95% confidence intervals for continuous variables, were computed for independent and dependent variables. Median and interquartile ranges were computed for NRE count and severity per case, which were both non-normally distributed. We used the Kruskal-Wallis H test and Dunn’s test for post hoc pairwise comparisons to compare patient demographics, clinical, procedural factors, and patient safety metrics (e.g., NREs and 30-day NSQIP-P occurrences) by handover type. An alpha level of 0.05 was used as the cut-off for statistical significance in all analyses. All statistical analyses were conducted in IBM SPSS 25.0 (IBM Corp. Released 2017. IBM SPSS Statistics for Windows, Version 25.0. Armonk, NY: IBM Corp.)

Results

A total of 312 eligible cases occurred during the study period. One hundred forty-five eligible cases (46%) could not be observed due to logistical constraints (e.g., late night or weekend cases, concurrent cases, insufficient notice, etc.). In 31 eligible cases (10%), parents or guardians were unavailable to provide consent. Pediatric surgeons declined to consent in 6 (2%) of eligible cases. No parents or legal guardians declined consent. Thus, we report on 130 cases involving 109 eligible neonates.

A total of 232 providers associated with eligible cases consented to participate in the observational study. Ninety-four providers (60 from the NICU and 34 from the OR) completed the REDCap survey.

Patient demographics, clinical, and procedural factors by handover type

Table 1 presents patient demographics and clinical and procedural characteristics stratified by handover type. Patients receiving direct handovers were sicker and more medically complex than patients transferred by indirect and mixed handovers. Patients receiving direct handovers were more likely to require pre-procedural ventilation (p < 0.001), received higher American Society of Anesthesiologist (ASA) physical status classification scores (p < 0.001) from anesthesia providers, and have emergency surgeries (p = 0.016) than infants transferred by other handover methods.

Table 1 Patient demographics, clinical, and procedural factors by handover type

Handover effectiveness

Using the Global Rating of Handover Effectiveness tool, 82% (n = 39) of observed direct NICU-to-OR handovers and 89% (n = 28) of observed direct OR-to-NICU handovers achieved an effectiveness rating ≥ 3 (5: most effective) indicating that all critical content related to the infant’s health status and operative plan was presented and discussed by the perioperative team during the structured handover.

Non-routine events by handover type

Table 2 presents the incidence and severity of clinician-reported NREs, NRE preventability ratings assessed by trained RAs, and NSQIP-P occurrence rates for surgical neonates stratified by case handover type. Non-routine events were reported by clinicians in 101/130 (78%) cases but did not differ significantly by handover practices (p = 0.790). The incidence of preventable and preventable, severe NREs did not differ significantly by handover (p = 0.375). Maximum NRE severity (per case) was significantly higher (p = 0.009) in cases with direct handovers and mixed handovers compared to cases with indirect handovers.

Table 2 Patient safety outcomes by handover type

At the NRE level, clinicians rated 28% of all NREs as severe and trained RAs rated 47% of reported NREs as preventable. Eleven percent of severe NREs were preventable. NRE severity and preventability did not vary significantly by handover type.

Table 3 shows the distribution of the primary factors that contributed to clinician-reported NREs. Patient factors were the most frequently reported contributors to NREs. Clinical care processes and equipment issues were the most frequently cited preventable contributory factors. Teamwork was more frequently a factor in team-based handovers (direct and mixed) than indirect handovers.

Table 3 Distribution of primary NRE contributory factors by handover type

Table 4 provides examples of clinician-reported NREs along with their primary contributory factor and severity score, and RA-assessed preventability determination for direct, indirect, and mixed handovers, respectively.

Table 4 Examples of NREs reported during direct patient handovers

NSQIP-P occurrences by handover type

The incidence of major morbidities (28% overall), as defined by NSQIP-P, was significantly higher (p < 0.001) in cases with direct team handovers than those with indirect or mixed handovers (Table 2). Cases with direct handovers also accounted for a significantly higher mean count of NSQIP-P occurrences per NRE case. Transfusions (n = 12, 32%), reintubations (n = 11, 30%, post-operative deaths (n = 4, 11%, and post-operative cardiac arrests (n = 2, 5%) accounted for nearly 80% of the observed NSQIP-P occurrences in the study sample.

Patient handover perceptions survey

The Handover Perceptions Survey (Table 5) was completed by 96 neonatal perioperative providers (15% of all total providers and approximately 40% of observed providers). For the purpose of this initial analysis anesthesia providers were classified as OR providers. Of the respondents 80% had received prior handover training. A significantly higher proportion of OR providers had received handover training than NICU providers. NICU and OR teams had significantly different perspectives on the type of providers who should be present at standardized, face-to-face patient handovers. Thirty-seven percent of NICU providers and 18% of OR providers reported that a poor handover had resulted in a serious adverse outcome in a prior patient. NICU and OR providers rated direct handovers as critical to patient safety and indicated low confidence that patient safety could be maximized without them. All perioperative providers preferred face-to-face interdisciplinary handovers over one-on-one and electronic handovers, and they preferred to be present in handovers involving their patients. However, a significantly higher proportion of OR providers than NICU providers responded that they routinely attend direct pre-operative and post-operative handovers. However, these behaviors were not routinely observed in practice during observed cases. A significantly higher proportion of NICU providers stated that direct handovers interfere with other clinical tasks and expressed dissatisfaction with the communication related to the timing of handovers. OR providers were significantly more satisfied with the quality of direct handovers to and from the OR than NICU providers. NICU and OR providers both agreed that there was a moderate to critical need for structured handovers between the NICU and holding room and the PACU and the NICU. Finally, NICU and OR providers demonstrated agreement that the most important information they seek and provide during handovers are patient medications, OR events, and respiratory and airway support.

Table 5 Handover of surgical neonates: providers’ perspectives survey (Percentages correspond to bolded response options)

Discussion

The incidence of clinician-reported NREs was high in our observational study of neonatal perioperative care, with 78% of observed cases having an NRE and 30% having a severe NRE. Trained RAs determined that nearly half of NREs resulted from preventable factors and preventable- severe NREs occurred in 1 of 9 surgical cases. Interestingly, unadjusted NRE rates did not differ significantly by handover type despite direct handovers being used in the most critically ill patients. Cases that included team-based handovers (i.e., direct or mixed handovers) were associated with higher NRE severity and higher rates of NSQIP-P occurrences, the only outcomes associated with handover types in unadjusted analyses. These findings are not surprising given that patients who receive structured team-based handovers in our hospital are the most acutely ill, clinically complex, and, from a surgical perspective, often the most technically complicated.

We were unable to quantify the safety benefit team-based handovers provided to high-acuity cases because pre-intervention NRE rates and NSQIP-P occurrence rates were not know prior to the adoption of interdisciplinary face-to-face handoffs. However, the homogeny of NRE rates across handover types provides evidence that structured, team-based handovers provide a protective benefit to iatrogenic patient safety events, such as NREs in the 24-h post-operative period. Additional research is needed to determine the relative contributions of mutable human and system factors versus underlying health status to neonatal perioperative risk and to quantify the short-term (i.e., up to 24 h post-operative) and quasi-long-term (i.e., 30-day post-operative) impact of handover structure on safety outcomes. Pre-post (handover intervention) study designs are needed to accomplish these goals. The study brings to light important findings about the effectiveness, opportunities, and remaining challenges of patient handovers practices to improve patient safety, especially in vulnerable populations.

Our stratified analysis of NRE rates by handover type and our supplementary survey of providers’ perceptions highlighted both the advances healthcare organizations have made in standardizing handover processes and barriers remaining in current practice. The results showed that although 82% of observed structured, face-to-face handovers were rated as either effective or highly effective by trained RAs they did not prevent the occurrence of safety events in clinically high-risk cases. NSQIP-P occurrences were highest in direct handovers. Almost 20% of contributory factors attributed to NREs in direct and mixed patient handovers (i.e., including structured team handovers) were related to teamwork which highlights the ongoing challenges to align interdisciplinary handover work in the context of the unsynchronized work patterns of the neonatology, anesthesia, and pediatric surgery.

The direct handover process observed during this study is the product of years of rigorous patient safety research and numerous QI initiatives. This work started with the development, training, and evaluation of a multimodal intervention to improve PACU handovers in adult and pediatric units [16], which has recently been adapted to improve preoperative pediatric and neonatal handovers [20, 21]. The handover work completed at the study hospital is a microcosm of broader international research and QI efforts aimed at eliminating preventable communication errors in healthcare. Communications errors are estimated to account for 70% of preventable medical errors; half of which occur during patient handovers [22, 23]. Significant strides have been made to address this problem, most notably in post-operative handovers, where standardization and customization (i.e., to the unit and needs of the specific patient population) has resulted in increased provider satisfaction, improved teamwork and work efficiency, higher quality clinical communications, error reduction, and better patient outcomes [4, 24]. Preoperative handovers have been much less studied and published intervention studies with patient-specific outcomes are nearly non-existent [24]. Published research suggests that preoperative handovers share the same shortcomings as their post-operative counterparts and should also benefit from standardized customizable protocols. For example, research conducted in our NICU before the modification and adoption of the direct pre-operative handover protocol found “lack of a standardized report, patients not prepared for transfer, unclear transition of care between team members, unclear provider roles, provider traffic, and distractions” [20, 24]. In consideration of the NRE statistics reported in the results, incorporating NRE reporting and NRE discussions into handover processes represents promising opportunities to improve the detection and clinical response to safety events through handover design. The direct handovers observed in the study included discussions of serious pre-operative and intraoperative events but they did not formally or routinely address low severity NREs. The direct handover protocol was not modified to address NREs for the observational study because its objective was to identify and define the spectrum of neonatal safety risks in the context of existing, unmodified care processes rather than to intervene on suspected risks. Adding a discussion of NREs to all handover processes is highly recommended as a means to promote the generation of a shared mental model of the risks and threats to patient safety between giving and receiving care teams. Raising clinicians’ awareness to the occurrence and/or risk of NREs, regardless of their severity or preventability, may circumvent subsequent related NREs and mitigate the impact of NREs on patient outcomes.

Unstructured nursing handovers between the NICU and holding room or PACU “get the job done” for lower risk infants in that they do not elevate safety risk in clinically lower risk cases relative to other handover types, but for the reasons described above, are far from optimal. Our observational data and our moderate sample of perioperative providers’ survey responses painted a picture of the complex state of neonatal handovers at the study hospital. Because the hospital uses a mixture of handover structures and processes, the results, while not representative of global handover practices, are effective in highlighting the competing cultures of the clinical specialties (e.g., neonatology, anesthesia, and surgery) and the many challenges hospitals face in coordinating neonatal care transitions.

In the study hospital, direct pre-operative handovers that are intended to invite the presence and participation of nurses, surgeons, neonatologists, anesthesia providers, and therapists are primarily used by NICU nurses and the anesthesia providers. Workflow constraints often prevent surgeons from participating in the handover so pre-operative communications between the surgeon, family or guardian, neonatologist, and/or NICU nurse must take place before the structured handover. In contrast to their survey responses indicating the high value of all direct (team) handovers and the criticality of their own participation, neonatologists participate most in post-operative handovers to the NICU. It is at this time when they learn how the infant’s clinical status has changed from his or her pre-operative baseline. One explanation for this contradiction is that neonatologist may feel they have little into gain, in terms of information collection, from participating in pre-operative handovers since they know the infants under their care so well, especially in those infants who have had extended lengths-of-stay in the NICU. The challenge here is to emphasize the importance of the neonatologist’s role in pre-operative handovers as an information provider to the OR team.

NICU nurses are dissatisfied with the timing (or lack) of communications about an imminent handover from the OR or PACU. The timing of handovers are driven by the OR schedule and thus fit with the anesthesia provider’s workflow however they create a disruption to the workflow of all other providers. This is a classic example of what Deming [25, 26] called sub-optimization where optimizing one part of the system creates unintended consequences in another part of the system. NICU providers frequently are paged from the bedside of a critically ill infant to attend a handover of a child considered significantly less ill. Further, providers, as demonstrated above in the contrast between the attitudes and behaviors of neonatologists, are more interested in receiving information critical to their work and are less interested in providing information to others. Thus, NICU providers perceive handovers for patients arriving in the NICU from the OR as much more valuable. These findings suggest that a structured daily meeting of anesthesia providers and NICU staff for all handovers of patients scheduled to go to the OR that day might provide less interruption and yield better results.

All clinicians were emphatic in stressing the value of structured handovers in preserving patient safety and the need for the development and implementation of structured handovers for indirect cases. In addition to these findings, it is important to note that the NICU and OR at the study hospital are separated by one floor and almost all operations are performed in the OR. In fact, all of the observed operations were performed in the OR. While NICU-centric surgeries would likely improve the participation in and quality of current handover processes, they would also create new risks to neonatal safety [25, 26], again through the process of sub-optimization, by pulling critical resources from other NICU patients, creating distractions for other NICU providers, and creating ergonomic stressors for surgeons, to name a few. The challenge moving forward for handover design in the neonatal perioperative environment is finding solutions that maximize patient safety while remaining flexible to the distinct workflows of neonatology, anesthesia, and surgery.

Limitations

This study had several limitations. First, NRE reports were undoubtedly influenced by inherent reporter biases because they were submitted by NICU and OR clinicians involved in the care of observed surgical neonates. Second, NRE severity and preventability were subjectively rated and based purely on clinician and RA experience, respectively. For future analyses we will use subject matter experts (i.e., trained clinicians not involved in the care of the observed infants) to perform a secondary, final review to validate these initial ratings. Third, the study had no historical control data to compare NRE incidence and NSQIP-P occurrence rates before the adoption of direct handovers. Finally, due to sample size constraints, we were unable to statistically model the relationship between NRE count or severity and 30-day NSQIP-P occurrences. To address this limitation, we are adding a second children’s hospital as a study site to increase our sample size.

Conclusion

The results reported here represent the practices, behaviors, and attitudes of clinicians at one children’s hospital and cannot be used to draw broad conclusions on the state of patient handovers in the neonatal perioperative environments. Instead, the study highlights the pressing need in neonatal systems safety research to quantify and qualify the existing variability in patient handover practices across hospitals. Undoubtedly, there are wide distributions in the structures, processes, content, timing, and effectiveness of nursing handovers and interdisciplinary team handovers in use in this domain. Because hospitals, NICUs, and ORs vary in terms of size, patient volume, resources, and acuity level, it is likely to be neither feasible nor practical to design and implement a single solution for handover structure (i.e., interdisciplinary team handover) given these constraints. However, designing and implementing a universal handover process (i.e., content, order, timing, etc.) is feasible and is worthy of pursuit to improve neonatal safety. Therefore, future research is needed to identify an existing or design a new a unifying handover process, identify or design resource-matched structures (i.e., participants and their roles), and to guide their dissemination through the use of implementation science methodologies.