Key Points
-
Presents an international perspective about 'never events' in dentistry.
-
Outlines a list of events that can support quality assessment and governance activities.
-
Provides a starting point for further patient safety research opportunities to build the evidence base that can be translated into action.
Abstract
Introduction
Never events (NEs) are a subset of serious patient safety incidents that should not occur if appropriate preventive measures are implemented. Although there is a consensus in medicine, there is no agreement on NEs in dentistry.
Aim
To identify NEs in primary care dentistry.
Method
We undertook an electronic Delphi exercise to develop an international agreement on NEs for primary care dentistry.
Results
We initially identified candidate NEs through a scoping review of the literature and then analysed dentistry-related reports in a national incident reporting system. Next, we invited an international panel of 41 experts to complete two rounds of questionnaires; 32 agreed to participate (78%) and completed the first round and 29/41 (71%) members completed the second round. We provided anonymised controlled feedback between rounds and used a cut-off of 80% agreement to define consensus. Consensus was achieved for 23 out of 42 candidate NEs. These related to routine assessment, and pre-operative, intra-operative and post-operative stages of dental procedures.
Discussion and conclusion
To our knowledge, this is the first international expert consensus-based approach that has identified NEs for primary care dentistry. We suggest that dental regulators consider these to support quality assessment and governance activities.
Introduction
Patient safety incidents occur in all healthcare settings worldwide.1,2,3,4 One in ten patients acutely admitted to hospital experience a patient safety incident,2,5,6,7,8 whilst two to three percent of primary care encounters put patients at risk of unsafe care.9 Seminal publications such as the Harvard Malpractice Study10 and the Institute of Medicine's (now the National Academy of Medicine) 'To Err is Human'11 encouraged healthcare organisations, researchers and policymakers around the world to pay attention to patient safety. Since 2002, as issued in Resolution 55.18, the World Health Assembly recognised patient safety incidents in healthcare as a significant public health concern.12
Over the past 20 years, standard definitions relating to patient safety13,14 have become available (Table 1), and the accumulated evidence about the extent of harm and underlying causes has been translated into interventions designed to reduce harm.15 An example of this is the implementation of policies in countries like the United States (US),16 the United Kingdom (UK),17,18 Canada19 and Australia20 for the reduction of 'never events' (NEs). In the UK, NEs are a subtype of 'serious incidents'21 within the Revised Serious Incident Framework21 and are defined 'as serious, largely preventable patient safety incidents that should not occur if the available preventive measures are implemented'.13 A list of NEs for hospital settings was developed in England by the National Patient Safety Agency (NPSA) in 2009 and was later revised by the Department of Health in 2015 (Table 2).13 Due to their clear potential for severe harm,17,18 national guidance and national safety recommendations encourage reporting of NEs.17,18 In England, such policies enable clinical commissioning groups (CCGs) to recover healthcare costs when a procedure or treatment results in an NE.22 NEs are collected and monitored in patient safety incident reporting systems overseen by the NHS Improvement's Patient Safety Domain.23
The World Health Organisation's (WHO) emerging agenda for 'safer primary care'3 has advocated for a better understanding of patient safety in primary care as this field remains largely unexplored.24,25 This includes the epidemiology of patient safety incidents in primary care dentistry.26,27,28,29 A recent scoping review of the literature showed patient safety research in dentistry over the past 20 years is poorly conceptualised and described with important methodological limitations.30 As a result, an estimate of the burden of patient safety incidents remains unknown. One of the largest cross-sectional studies was conducted by Thusu et al.31 They analysed 22012 patient safety incidents reports from which they described injuries, medical emergencies, inhalation and ingestion of foreign objects, adverse reactions and wrong-tooth extractions as main areas of concern. They also suggested wrong-tooth extractions as a potential NE. This incident is currently the only clearly defined NE related to dentistry that has been included in the NE list used in the English NHS13 and accounts for around 120 reported cases per year.23,32
Although wrong-tooth extractions are clearly defined NEs, little is known about other potential NEs for dentistry. Established surgical NEs such as wrong-site surgery, wrong implant and retained foreign objects may be applicable to dentistry. However, these surgical NEs also overlap with other NEs from other disciplines in secondary care. Examples include a wrong kidney biopsy, wrong knee implant and retained part of an umbilical venous catheter. As a result, no formal list has been developed for primary care dentistry, and no systematic attempts have been made to identify and propose NEs for international use. Black and Bowie took an initial step in proposing a list of NEs for primary care dentistry.33 However, the authors also recommended a more systematic approach to review the literature and identify other potential NEs existing within primary care dentistry. The authors also suggested the need to address a more diverse composition of participants to be more representative of primary dental care settings. Therefore, we aimed to develop and achieve consensus on a list of NEs with experts from around the world, and identify NEs with the greatest need and opportunity for future intervention strategies to improve patient safety in primary care dentistry.
Methods
We undertook an electronic Delphi exercise based on the method developed by the US Research and Development Corporation (RAND).34,35 This involved a formal, structured process for generating consensus among a group of experts based on feedback obtained from their anonymous responses.36,37,38 This approach is favoured in cases where little to no empirical or historical data exist.37,39,40 There were three stages to the study (see Figure 1): (i) the identification of candidate NEs and questionnaire development; (ii) the selection of experts; and, (iii) the iterative completion of a sequence of questionnaires by this panel of experts. The use of electronic questionnaires instead of paper-based questionnaires represented a modification to the originally described Delphi process. This electronic approach has been previously used in other studies.41,42
Ethical approval was obtained from The University of Edinburgh's Centre for Population Health Sciences Research Ethics Committee (Ethics Application number 1624).
Stage 1: Identification of candidate never events and questionnaire development
As the Delphi method aims to make effective use of informed expert judgement,40 the experts needed a baseline of available empirical evidence.34 Therefore, in accordance with the definition provided by the former NPSA (see Table 1),13 we used three approaches to identify the candidate NEs that we included in our initial questionnaire.
First, we conducted a scoping review of the primary care dentistry literature from January 1994 to January 2015.30 Then, additional candidate NEs were identified through the examination of 12,000 patient safety incident reports related to dentistry submitted to the National Reporting and Learning System (NRLS) from 2005 to 2013. These were manually cleaned and we identified 4,249 relevant reports. Each incident was reviewed by the study team to make a judgment about whether they could meet the NE criteria according to the original NPSA definition (see Table 1). Finally, the third approach constituted the revision of existing lists of NEs in hospital care developed by the NPSA13 and NEs for general practice.43 Table 2 shows the NEs we believed, based on our clinical experience, were transferable to dentistry.
Based on these approaches, we developed an initial list of candidate NEs. As shown in Table 4, these were grouped into four stages, which were conceptualised as the period that comprises any routine assessment or check-up, the period before clinical treatments were carried out (pre-operative stage), the period of clinical treatment (intra-operative stage), and the period after the clinical treatment (post-operative stage).
Stage 2: selection of experts
We identified participants from different countries, levels of experience, academic backgrounds and specialties disciplines (for example, general dentistry, paediatric dentistry, endodontics, oral surgery and public health) within primary dental care. Table 3 shows the criteria used for the identification and selection of experts. All eligible experts received an invitation to participate by email that included an information sheet and a consent form. Participants were asked to read these documents and provide their voluntary signed consent before their participation.
Stage 3: iterative completion of a sequence of questionnaires
In the first round, we distributed emails containing the questionnaire including the definition of NEs and the instructions for answering each item. Each item corresponded to a candidate NE and included three criteria which participants were asked to score. These were based on the criteria of 'preventability', 'severity' and the criterion 'should be classified as never event' outlined by the Never Events Policy and Framework of the NHS (Box 1).13 We removed the criterion surrounding 'the past and future risk' as our scoping review identified evidence of 14 of our initial list of candidate NEs being reported over a period of 20 years.30
Participants were asked to assign a number between one to five as a relative score44 in which the number five represented the closest proximity of each candidate NE to meet the NE criteria displayed in Box 1. Also, they were asked to provide reasons for their assigned scores and recommendations for any modification, addition or elimination of NEs on the list. The responses were collected, anonymised and summarised. Moreover, participants were asked to suggest any potential NE not included. A period of three weeks was given to complete and return the questionnaire. We started the study on 11 September 2016. To maintain high response rates, three reminders were sent on the seventh, twelfth and nineteenth day. Non-responders were given an additional reminder on the twenty-first day.
For the second round, NEs were rephrased or discarded in line with the scores, comments and suggestions received in the first round. Participants were provided with the group's median score for each item along with their responses (expressed in medians) and an anonymous summary of the comments received. Then, they were asked to read this feedback and decide if their original scores should be changed. If they decided to modify them, they were asked to score the items on the same scale (Box 2) and provide a reason for changing their original score. Again, they were asked to provide reasons for their assigned scores and recommendations for modification of items, additions or elimination of NEs on the list.
Analysis
After each round, all the responses were collected and anonymised. Then, all scores and comments were transcribed into a data collection tool in Microsoft Excel software.45 According to the Delphi method, after each round, median scores were estimated per item.35,44 To summarise the overall score for each NE, overall median scores of the three criteria for every candidate NE were calculated. The median of these final responses represented the group response.44 Any unanswered field was considered as 'no opinion.' The retrieved comments were also summarised and were envisaged for the refinement of the list of NEs, and that was included in the second round. Contrasting comments were grouped and compared to assess the possible inclusion of additional items.
Percentages of agreement were assessed by grouping the overall median proportions of 'agree' and 'totally agree'. Proportions greater or equal to 80% were interpreted as a satisfactory agreement. This procedure was repeated after each round until consensus greater or equal to 80% was achieved. Participants also received feedback from the final stage.
Data availability
All raw data generated during questionnaire completion during the first and second rounds are not made publicly available to assure the anonymity of the participants. Summary data are available from the corresponding author on reasonable request and after anonymising the requested data.
Results
A total of 41 experts were invited to participate in the study. Out of these, 32 (78%) agreed to participate, provided their informed consent and completed the first round questionnaire. No potential participant explicitly refused to take part in the study. Of these, 29/41 (71%) went on to finish the second round. Reasons for not completing the second questionnaire included no replies after the third reminder was sent (N = 2) and no response after further clarification was asked about the answers provided. The detailed demographics and professional features of the expert panel are shown in the supplementary section (Supplementary online only Table 1).
In brief, out of the 32 the participants, the majority were from the UK (N = 7), followed by Mexico and Sudan (N = 5 each). Then, two participants each from Cambodia, Colombia and Spain, and one participant each from the following countries: Argentina, Australia, Brazil, Chile, China, Indonesia, Kenya, South Africa and the US. Public health and community dentistry were the main disciplines (N = 9) represented, followed by general dentistry (N = 6), paediatric dentistry (N = 4) periodontics (N = 3), sedation and special care dentistry (N = 3), and orthodontics (N = 2). See supplementary online only Table 1 for a full breakdown of disciplines represented. Concerning the professional roles, 16 participants had both academic and clinical roles whereas eight had professional roles in academia and public health. Only three participants had academic, clinical and public health roles.
First and second rounds
We formulated 24 candidate NEs, which were incorporated into the first questionnaire. No agreement was reached for any of the first 24 candidate NEs in the first round. The scores, comments and feedback we received provided the basis for refining and expanding the initial list into 43 candidate NEs. After the second round, consensus was achieved in 23 out of the 43 candidates NEs (See Table 4). These related to routine assessment (N = 3), pre-operative (N = 3), intra-operative (N = 13) and post-operative (N = 4) stages of dental procedures. Examples of these include for example, 'failure to register patient's history of allergies to medication' (routine assessment), 'failure to sterilise re-usable instruments' (pre-operative), 'wrong-tooth extractions' (intra-operative) and 'prescription of teratogenic drug to patients known to be pregnant'.
Discussion
In our study, we achieved international expert consensus in 23 out of 43 candidate NEs (See Table 4). Our list compares well with ten of the 27 NEs proposed by Black and Bowie (published after the completion of our study).33 Although not identical, we identified similar domains for NEs (for example, drug prescription, wrong-tooth extractions, infection control practices, aspiration of foreign objects and treating the wrong patient). However, we also identified additional priorities as 13 of our proposed NEs did not match those proposed by Black and Bowie.33 Of the 17 remaining NEs, five of these were similar to candidate NEs used during the first and second rounds of our study. These were mistaken patient identity, wrong-tooth treated (excluding extraction), tooth extraction in patients treated with bisphosphonates, use of outdated material and ingestion of foreign objects. However, these were not included in our list as we did not achieve consensus equal or greater than 80%. Probable reasons for discrepancies (for the rest of the 12 NEs that did not match our list) are the process for identification of candidate NEs and the composition of experts. Black and Bowie33 initially conducted a rapid literature review and then held workshops with dental practitioners. Our list, however, was developed and structured in accordance to the conceptualised stages in our scoping review.30 On the other hand, Black and Bowie33 identified a sample of experts in Scotland whereas our sample of experts had a more heterogeneous and international composition. Moreover, the feedback we received from our experts during the first and second round highlighted that recommendations, guidelines and availability of clinical/environmental resources were likely to be different between countries.
Implications for policy and practice
Our list of NEs can inform further interventions and policies.46,47 National and international patient-safety-focused agendas should now be developed for primary care dentistry considering the variability of regulatory frameworks between countries. Berger et al.48 enlisted three recommendations to reduce the incidence of NEs.
First, their inclusion into incidents reporting systems is needed48 to ensure clinical governance to monitor and learn from NEs. Although dentistry-focused national incident reporting systems have been already recommended,49 such systems have not been introduced yet. We believe our proposed list of NEs should inform efforts to interrogate patient safety data, like incident reports, as well as electronic medical records and repositories of malpractice claims. Policies like the Framework for the Identification and Management of Never Events17,18 from the NHS should be either developed or adapted for dentistry and supported by education and training efforts, as well as clear policies for 'just culture'50 reporting or disciplinary actions.51
The concept of 'never event' was first introduced by Kizer in 2001 to describe the 'most egregious health care errors' that should never occur.52 However, this concept is not globally used and, when available, definitions for NEs vary between countries,53 making comparisons between countries challenging.54 Even when regulatory frameworks are available, the presence of multiple regulations by, for example, the General Dental Council (GDC),55 the Care Quality Commission56 and NHS England18,21 towards incident reporting by dentists in the UK, create complexity and unclear processes for dentists to follow.57 The consequences of this complexity have been discussed by Renton et al.32 after they reviewed serious events and NE reports relevant to dentistry in the NRLS and Strategic Executive Information System databases. Analysed reports were incorrectly coded, missing information and, in some cases, were duplicated within the same database.32 The need to integrate existing incident reporting systems has been already highlighted58 followed by the development of the Patient Safety Incident Management System, as the successor of the existing NRLS.59 This integrated approach for reporting incidents should also include those occurring in dentistry.57 Within an international context, countries need to collaborate and share information about common patient safety issues.(4) If needed, guidance towards the introduction of incident reporting systems can be provided and this is currently being developed by WHO. In doing so, patient safety organisations, policymakers and dentistry should establish standards for the accuracy of NEs derived from administrative data and agree on a standard definition of a NE.53
Secondly, communication between healthcare personnel needs improvement and standardisation of procedures are necessary.48 Failures in communication and teamwork are one of the main issues in primary care delivery.60 From a systems-based perspective, policies should be developed to create an infrastructure at a national level to build and maintain professional networks and services to enable professionals to communicate and learn from each other.61 On the other hand, many treatments or procedures in dentistry do not follow established evidence-based guidelines.62 The guidelines should now be developed with a robust evidence base for further implementation and evaluation by national regulatory bodies supported by the law and agreed on standards of performance.63 Examples within the UK include the Professionals Standards Authority64 which oversees independent regulatory bodies such as the General Medical Council65 and the GDC.66 These regulatory agencies, in their areas of interest, set the standards of competence and conduct that healthcare professionals must meet to obtain and maintain their registration and fitness to practice. Additional functions include reviewing the content and quality of education and training courses. Pre-service and in-service education on patient safety needs to be discipline-oriented in accordance with a system-based perspective to facilitate its sustainable improvement.61 Other measures to tackle patient safety include the investigations undertaken by the Care Quality Commission67 and the National Clinical Assessment Service for poorly performing healthcare professionals.68 Another strategy learned from the human factors research undertaken in hospital-based studies is to reduce the reliance on memory, attention or perception.69 Examples of this include patient safety checklists for oral surgery,70 endodontic procedures,71 wrong-tooth extractions72 and dental implant placement.73 However, their effectiveness has not been adequately tested.27 Although the analysis of patient safety incidents, including NEs, bring a valuable opportunity for learning and to implement strategies for quality improvement, a possible difficulty exists around how to most effectively foster an environment receptive to change.74 Facilitators for a patient safety culture include the recognition of the risks of dental care delivery through all health sectors and dental associations, including the support of dental schools by integrating patient safety into their curricula and the organisational structure of dentistry.75 The WHO's patient safety curriculum guides have outlined the core learning requirements for healthcare professionals.76,77 Patient safety guidance to maximise opportunities to learn from incidents in general practice are available,78 and these should also be developed for dentistry.
Finally, the third recommendation concerns the implementation of more effective systems to help minimise elements of human fallibility.48 As we reported in our scoping review,30 patient safety incidents are not limited to human error. Therefore, we should also understand the conditions, environment and the influence of policies in which primary dental care is delivered. These factors can be identified through the analysis of incident reports which include all types of patient safety incidents, including 'near misses', 'no harm incidents' and NEs. Incidents which did not reach the patient are referred to as 'near misses', whereas a 'no harm incident' is one in which an event reached a patient, but resulted in no discernible harm.14 Both incidents are considered during the initial steps for patient safety management since high detection rates are needed for the identification of unintended risk and hazards.79 Moreover, for NEs, serious harm and/or death are not required to have happened for a NE to be reported.18 Therefore, as the concept of NEs can overlap with 'near misses' and 'no harm incidents', these should also be identified and analysed as the root causes of these incidents might be similar.80 In doing so, learning points can be identified which can then be implemented for both quality and safety improvement. Effective primary care teams, health information technology, effective transitions of care, effective diagnostic services and patient engagement are also opportunities for patient safety improvement in primary care81 which should be disseminated across the profession. Existing patient safety frameworks should be used. Examples of this include the framework for risk and safety by Vincent et al.82 (1998), Reason´s Swiss cheese model of system accidents (2000)83 and the Primary Care Patient Safety (PISA) Classification System.84
Strengths and limitations
Our study has addressed the methodological concerns highlighted in the study by Black and Bowie.33 Firstly by developing an initial NE list supported by a comprehensive scoping review,30 complemented by a mixed methods review of patient safety reports from primary dental care in a national patient safety incident reporting system, and the review of established NEs in general practice43 and secondary care.13 Secondly, we followed a structured and rigorous approach appropriately modified from processes developed by the RAND Corporation.34,35 Finally, we recruited an international sample of professionals with clinical and academic backgrounds, as well as experience in public health who provided different insights of NEs. As a result, we obtained a consensus from a diverse composition of participants with adequate response rates to both rounds (ie, 78% and 71%, respectively).
Patient safety research is poorly organised in primary dental care; it is mostly descriptive, with a variety of approaches to the terminology, the study designs and different patient populations with little evidence to identify priorities which can be translated into action.30 Therefore, as the experts' feedback is a reflection of their current knowledge, experience and/or perceptions around incidents that matched our criteria for NEs, patient-safety expertise across participants was likely to be variable but overall low. In our study, although we were able to include from a diverse range of relevant backgrounds, the field of patient safety in dentistry is still in development. As more evidence accumulates and training and education in patient safety training increases, the number of patient-safety focused experts are likely to increase. Therefore, we believe our proposed list should be further developed based on the consensus of future patient-safety-experts' opinions and the evidence emerging from primary care dentistry. As each country has different regulatory frameworks, our list or any future update should also consider international regulatory frameworks.
Recommendations for further research
Research priorities must now be set so NEs can be translated into action,74 particularly into possible preventive measures, policy-making and resource allocation for interventions. We believe a systematic approach to research priority setting based on the method proposed by the Child Health and Nutrition Research Initiative (CHNRI) with the Global Forum for Health Research85 can be used.
Conclusions
We have achieved an international expert consensus-based list of NEs for primary care dentistry. This list can be considered to support quality assessment and governance activities. It should be further improved as more evidence on patient safety incidents accumulates in primary dental care. We believe a future step should be to use the list for setting global research priorities on NEs that can be translated into prevention strategies based on a robust evidence base. We encourage dental regulators, professionals and academic communities in dentistry to foster patient safety through evidence-based initiatives that can be translated into action.
Author contributions statement
All authors reviewed and/or reviewed the manuscript before submission. E. E. C conducted the study and wrote the article. E. E. C. and K. C. developed the protocol and submitted it for ethical approval. R. B. provided the professional networks for the identification and participation of the experts. A. C. S., K. C., R. B. and A. S. provided a substantial contribution to the discussion of content.
References
Jha A . Summary of the evidence on patient safety: implications for research Spain. World Health Organiszation, 2008. Available at http://www.who.int/patientsafety/information_centre/20080523_Summary_of_the_evidence_on_patient_safety.pdf (accessed April 2018).
Jha A K, Prasopa-Plaizier N, Larizgoitia I, Bates D W, Research Priority Setting Working Group of the WHOWAfPS. Patient safety research: an overview of the global evidence. Qual Saf Health Care 2010; 19: 42–47.
The Safer Primary Care Expert Working Group. Safer Primary Care: A Global Challenge. Switzerland. World Health Organisation, 2012.
Carson-Stevens A, Edwards A, Panesar S et al. Reducing the burden of iatrogenic harm in children. Lancet 2015; 385: 1593–1594.
World Health Organisation. IBEAS: a pioneer study on patient safety in Latin America. Towards safer hospital care. Geneva, Switzerland: World Health Organisation, 2011.
de Vries E N, Ramrattan M A, Smorenburg S M et al. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care 2008; 17: 216–223.
Bartlett G, Blais R, Tamblyn R, Clermont R J, MacGibbon B . Impact of patient communication problems on the risk of preventable adverse events in acute care settings. CMAJ 2008; 178: 1555–1562.
World Health Organisation. Global Priorities for Patient Safety Research Better knowledge for safer care. 2008.
Panesar S S, Carson-Stevens A, Cresswell K M et al. How safe is primary care? A systematic review. BMJ Qual Saf 2015; 25: 544–553.
Brennan T A, Leape L L, Laird N M et al. Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med 1991; 324: 370–376.
Kohn L T, Corrigan J M, Donaldson M S . To Err Is Human: Building a Safer Health System. National Academies Press, 2000.
World Health Organisation. World Health Assembly Resolution WHA 55.18 2012. Available at http://apps.who.int/gb/archive/pdf_files/WHA55/ewha5518.pdf?ua=1&ua=1 (accessed April 2018).
National Patient Safety Agency. Patient Safety – Never Events. NHS, 2015 Available at http://www.nrls.npsa.nhs.uk/neverevents/ (accessed April 2018).
World Alliance For Patient Safety Drafting G, Sherman H, Castro G et al. Towards an International Classification for Patient Safety: the conceptual framework. Int J Qual Helath Care 2009; 21: 2–8.
Wilson T, Sheikh A . Enhancing public safety in primary care. BMJ 2002; 324: 584–587.
Centers for Medicare & Medicaid Services. The Deficit Reduction Act. 2005. Available at https://www.cms.gov/Regulations-and-Guidance/Legislation/DeficitReductionAct/index.html (accessed April 2018).
Department of Health. The never events policy framework: An update to the never events policy. London: National Health Service, 2012.
Department of Health. Revised Never Events Policy and Framework. London: National Health Service, 2015.
The Canadian Patient Safety Institute. Never Events for Hospital Care in Canada. Canada, 2015.
The Australian Commission on Safety and Quality in Health Care. Australian Safety and Quality Framework for Health Care. Australia, 2010 Available at https://www.safetyandquality.gov.au/national-priorities/australian-safety-and-quality-framework-for-health-care/ (accessed April 2018).
Department of Health. Revised Serious Incident Framework. NHS Improvement, 2015.
Harrop-Griffiths W . Never events. Anaesthesia 2011; 66: 158–162.
Department of Health. Provisional publication of Never Events reported as occurring between 1 April 2014 and 31 March 2015. NHS Improvement, 2015.
Sheikh A, Panesar S S, Larizgoitia I et al. Safer primary care for all: a global imperative. Lancet Global Health 2013; 1: E182–E183.
Sheikh A, Bates D W . Iatrogenic harm in primary care. Harvard Health Policy Review 2014; 4: 4–8.
Bailey E, Tickle M, Campbell S . Patient safety in primary care dentistry: where are we now? Br Dent J 2014; 217: 339–344.
Bailey E, Tickle M, Campbell S et al. Systematic review of patient safety interventions in dentistry. BMC Oral Health 2015; 15: 152.
Yamalik N, Van Dijk W . Analysis of the attitudes and needs/demands of dental practitioners in the field of patient safety and risk management. Int Dent J 2013; 63: 291–297.
Yamalik N, Perea Perez B . Patient safety and dentistry: what do we need to know? Fundamentals of patient safety, the safety culture and implementation of patient safety measures in dental practice. Int Dent J 2012; 62: 189–196.
Ensaldo-Carrasco E, Suarez-Ortegon M F, Carson-Stevens A, Cresswell K, Bedi R, Sheikh A . Patient Safety Incidents and Adverse Events in Ambulatory Dental Care: A Systematic Scoping Review. J Patient Saf 2016; Published online ahead of print.
Thusu S, Panesar S, Bedi R . Patient safety in dentistry – state of play as revealed by a national database of errors. Br Dent J 2012; 213: E3.
Renton T, Sabbah W . Review of never and serious events related to dentistry 2005–2014. Br Dent J 2016; 221: 71–79.
Black I, Bowie P . Patient Safety in primary care dentistry: Development of candidate 'never event' list to support team learning and system improvement. Br Dent J 2017; 222: 782–788
Fink A, Kosecoff J, Chassin M et al. Consensus Methods – Characteristics and Guidelines for Use. Am J Public Health 1984; 74: 979–983.
Sackman H . Delphi assessment: Expert opinion, forecasting, and group process. DTIC Document. 1974.
Rowe G, Wright G, Bolger F . Delphi – a Reevaluation of Research and Theory. Technolog Forecast Soc Change 1991; 39: 235–251.
Okoli C, Pawlowski S D . The Delphi method as a research tool: an example, design considerations and applications. Inform Manag 2004; 42: 15–29.
Steurer J . The Delphi method: an efficient procedure to generate knowledge. Skeletal Radiol 2011; 40: 959–961.
de Meyrick J . The Delphi method and health research. Health Educ 2003; 103: 7–16.
Helmer O . Analysis of the future: The Delphi method. DTIC Document. 1967.
Avery A, Savelyich B, Sheikh A et al. Identifying and establishing consensus on the most important safety features of GP computer systems: e-Delphi study. Inform Prim Care 2005; 13: 3–11.
Worth A, Nurmatov U, Sheikh A . Key components of anaphylaxis management plans: consensus findings from a national electronic Delphi study. JRSM Short Rep 2010; 1: 42.
de Wet C, O'Donnell C, Bowie P . Developing a preliminary 'never event' list for general practice using consensus-building methods. Br J Gen Pract 2014; 64: e159–e167.
Brown BB . Delphi process: A methodology used for the elicitation of opinions of experts. DTIC Document. 1968.
Microsoft. Excel. Redmond, WA: Microsoft Corporations, 2011.
Williams H, Edwards A, Hibbert P et al. Harms from discharge to primary care: mixed methods analysis of incident reports. Br J Gen Pract 2015; 65: e829–e837.
Rees P, Edwards A, Powell C et al. Pediatric immunization-related safety incidents in primary care: A mixed methods analysis of a national database. Vaccine 2015; 33: 3873–3880.
Berger E R, Greenberg C C, Bilimoria K Y . Challenges in Reducing Surgical 'Never Events'. J Am Med Assoc 2015; 314: 1386–1387.
Council of European Dentists. Resolution on Patient Safety. 2008.
Boysen P G . Just culture: a foundation for balanced accountability and patient safety. Ochsner J 2013; 13: 400–406.
Ovretveit J . Understanding and improving patient safety: the psychological, social and cultural dimensions. J Health Org Manag 2009; 23: 581–596.
Agency for Healthcare Research & Quality. Never events. 2016. Available at https://psnet.ahrq.gov/primers/primer/3/never-events (accessed April 2018).
Austin J M, Pronovost PJ . 'Never events' and the quest to reduce preventable harm. Jt Comm J Qual Patient Saf 2015; 41: 279–288.
Makar A, Kodera A, Bhayani S B . Never Events in Surgery. Elsevier, 2015.
General Dental Council. Standards for the dental team. GDC, London. 2013.
CQC. Reporting IRMER incidents. Care Quality Commission, 2017.
Renton T, Master S . The complexity of patient safety reporting systems in UK dentistry. Br Dent J 2016; 221: 517–524.
Mayer E FK, Callahan R, Darzi A . National Reporting and Learning System Research and Development. England: NHIT Imperial Patient Safety Translational Research Centre, 2016.
Department of Health. The future of the patient safety incident reporting: upgrading the NRLS. UK: National Health Service, 2017. Available at https://improvement.nhs.uk/news-alerts/development-patient-safety-incident-management-system-dpsims/ (accessed April 2018).
Cresswell K M, Panesar S S, Salvilla S A et al. Global research priorities to better understand the burden of iatrogenic harm in primary care: an international Delphi exercise. PLoS Med 2013; 10: e1001554.
World Health Organisation. Education and Training: Technical Series on Safer Primary Care. Geneva: World Health Organisation; 2016.
Bader J D . Challenges in quality assessment of dental care. J Am Med Assoc 2009; 140: 1456–1464.
Pronovost P J R, A D. Stoll R A . Kennedy S B . Transforming Patient Safety: A Sector-Wide Systems Approach. World Innovation Summit for Health (WISH), 2015.
Professionals Standards Authority. Homepage. Available at http://www.professionalstandards.org.uk/ (accessed April 2018).
General Medical Council. Homepage. Available at http://www.gmc-uk.org/ (accessed April 2018).
General Dental Council. Homepage. Available at https://www.gdc-uk.org/Pages/default.aspx (accessed April 2018).
Care Quality Commission. Homepage. Available at http://www.cqc.org.uk/ (accessed April 2018).
National Clinical Assessment Service. Homepage. Available at http://www.ncas.nhs.uk/ (accessed April 2018).
Porto G G . Safety by design: ten lessons from human factors research. J Healthc Risk Manag 2001; 21: 43–50.
Perea-Perez B, Santiago-Saez A, Garcia-Marin F et al. Proposal for a 'surgical checklist' for ambulatory oral surgery. Int J Oral Maxillofac Surg 2011; 40: 949–954.
Diaz-Flores-Garcia V, Perea-Perez B, Labajo-Gonzalez E et al. Proposal of a 'Checklist' for endodontic treatment. J Clin Exp Dent 2014; 6: e104–e109.
Saksena A, Pemberton M N, Shaw A et al. Preventing wrong tooth extraction: experience in development and implementation of an outpatient safety checklist. Br Dent J 2014; 217: 357–362.
Christman A, Schrader S, John V et al. Designing a safety checklist for dental implant placement: a Delphi study. J Am Med Assoc 2014; 145: 131–140.
Lewis R Q, Fletcher M . Implementing a national strategy for patient safety: lessons from the National Health Service in England. Qual Saf Health Care 2005; 14: 135–139.
Pemberton MN . Developing patient safety in dentistry. Br Dent J 2014; 217: 335–337.
World Health Organisation. WHO patient safety curriculum guide: multi-professional edition. WHO Press, 2011.
World Health Organisation. WHO Patient Safety Curriculum Guide for Medical Schools: WHO Press, 2009.
Carson-Stevens A, Donaldson L . Reporting and learning from patient safety incidents in general practice: a practical guide. Royal College of General Practitioners, 2017.
Battles J B, Lilford R J . Organizing patient safety research to identify risks and hazards. Qual Saf Health Care. 2003; 12 (suppl 2): ii2–ii7.
Sheikhtaheri A . Near Misses and Their Importance for Improving Patient Safety. Iran J Public Health 2014; 43: 853–854.
World Health Organisation. Human Factors: Technical Series on Safer Primary Care. Geneva: World Health Organization, 2016.
Vincent C, Taylor-Adams S, Stanhope N . Framework for analysing risk and safety in clinical medicine. BMJ 1998; 316: 1154–1157.
Reason J . Human error: models and management. BMJ 2000; 320: 768–770.
Carson-Stevens A, Hibbert P, Avery A et al. A cross-sectional mixed methods study protocol to generate learning from patient safety incidents reported from general practice. BMJ Open 2015; 5: e009079.
Rudan I, Gibson J L, Ameratunga S et al. Setting priorities in global child health research investments: guidelines for implementation of CHNRI method. Croat Med J 2008; 49: 720–733.
Acknowledgements
We are grateful to the international panel of experts who so kindly gave of their time to support this work. The authors also express their gratitude to the Mexican National Council for Science and Technology (CONACYT) for the sponsorship of the first author within the PhD programme at the University of Edinburgh.
Author information
Authors and Affiliations
Corresponding author
Supplementary information
Supplementary information
Supplementary Tables (PDF 74 kb)
Rights and permissions
About this article
Cite this article
Ensaldo-Carrasco, E., Carson-Stevens, A., Cresswell, K. et al. Developing agreement on never events in primary care dentistry: an international eDelphi study. Br Dent J 224, 733–740 (2018). https://doi.org/10.1038/sj.bdj.2018.351
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/sj.bdj.2018.351
This article is cited by
-
Lessons learnt on patient safety in dentistry through a 5-year nationwide database study on iatrogenic harm
Scientific Reports (2024)
-
Hospital dental staff attitudes to guide education and training in patient safety: a study with a focus on qualitative data
British Dental Journal (2023)
-
Oral cancer – CPD and the GDC
British Dental Journal (2018)
-
Never events: Patient safety definitions
British Dental Journal (2018)
-
Never events: 'Significant' rather than 'never' events
British Dental Journal (2018)