Background

Contemporary healthcare provision requires an evidence-based approach and the engagement of patient opinions and desires in order to deliver non-paternalistic and individualised care plans. Two of the primary drivers of the need for change are: 1) the recognition that chronic diseases in an ageing population constitute the majority of the healthcare economic burden and that traditional 'repair' models of care are no longer fit-for purpose;1 and 2) that the major risk factors for chronic diseases are modifiable, but require active patient engagement and adherence to effect behaviour change.2 In medicine, a wellness model of healthcare delivery involves the identification of risk factors for key diseases in currently healthy patients followed by the provision of personalised preventive care plans aimed at delaying or preventing the onset of signs and symptoms of disease. Cardiovascular disease, for example, remains a major cause of premature mortality accounting for 31% and 23% of premature deaths in UK males and females respectively.3 The major risk factors are hypertension, hypercholesterolemia, smoking and diabetes, all of which are modifiable by patient driven behaviour change. The wellness approach to address these risk factors in non-diabetic men and women involves the use of age-driven risk scores. In the UK, individuals with a 20% 10-year risk are treated pharmacologically, whereas those in lower risk groups are supported in behaviour interventions aimed at reducing their blood pressure by reducing dietary salt intake, consuming more fruit and vegetables, increasing exercise, reducing weight and alcohol consumption.4 There is good evidence that a combination of simple and cost effective measures may result in 50% less vascular disease, morbidity and mortality,4

Dentistry has lagged behind medicine in respect of risk-based preventive care, largely due to historical models of remuneration within the NHS sector. 'Fee per item' or 'unit of dental activity' funding systems have driven a repair philosophy of surgical intervention rather than a wellness approach. However, in 2009 Steele and colleagues recognised this disconnect and recommended that urgent care should be followed by a formal oral health assessment to evaluate risks for major oral diseases. The latter should inform personalised prevention plans to stabilise the mouth, then advanced care pathways to restore and maintain quality of life should only be implemented when disease risks are managed.5

Private dentists and those engaged in capitation-style models are not restricted by the fee charging structure of the NHS which limits the time that they can spend on prevention. This has enabled many to move away from repair-based approaches to remuneration and implement pathways that better engage patients in their own wellness. For the last 12 years Denplan Ltd has operated a voluntary practice accreditation programme called Denplan Excel (http://www.denplan.co.uk). From its inception the Denplan Excel 'Oral Health Score' (OHS) has been an essential component of the programme, designed to motivate patients to actively engage in their own oral healthcare through personalised biofeedback. The OHS measures the oral health status of patients and has developed a significant evidence base over its 12-year history. Aspects included in the OHS derived from research conducted in this area,6,7 the weightings for the different components of the OHS were validated,8 patient satisfaction with the process was demonstrated9 and inter- and intra-examiner reproducibility was found to be strong.10 The Denplan Excel framework provided a setting in which the integration of risk and disease scoring algorithms into a system that also informed suggested capitation fee categories for patients, could be evaluated against an established paper-based system that did not include risk assessment.

Against this background, an online integrated patient assessment system was developed with three groups of output: output 1 – comprised risk categorisation for the major oral diseases (periodontal disease, caries, non-carious tooth surface loss and oral mucosal disease, including oral cancer); output 2 – a set of revised Oral Health Score (OHS) outputs; and output 3 – updated capitation fee guidance.

Development of the assessment tool for piloting

The online tool was developed in collaboration with Oral Health Innovations Ltd (OHI Ltd). OHI Ltd was established as a joint venture with the University of Birmingham in 2007 and profits of OHI are donated to the UK Oral and Dental Research Trust. OHI Ltd holds the UK and Ireland licence for PreViser technology (http://www.previser.co.uk) from PreViser Corporation of Washington, USA. PreViser have developed evidence-based online disease risk (caries, periodontal disease, non-carious tooth surface loss and oral cancer) and disease severity (periodontal health and tooth health) scoring and reporting systems for dental teams and their patients. The system uses validated risk factors incorporated into algorithms. The weighting of risk factors in the periodontal disease algorithm has a particularly robust evidence base,13–18 whereas the caries, oral cancer and tooth wear risk factors have been individually validated but their weighting within the algorithm has not. PreViser uses both numerical scores and a Red, Amber, Green (RAG) reporting system to aid presentation to patients.

During 2012, Denplan Ltd worked with OHI Ltd to develop the integrated risk and disease patient assessment tool, building on the strengths of PreViser and the OHS. This tool became known as the Denplan Excel/PreViser Patient Assessment (DEPPA). DEPPA is an online assessment which reports the following to dental teams and their patients:

  • Risk outputs (Fig. 1) – the PreViser risk scores (1–5, where 5 is highest risk). Shaded RAG (where red is 'very high risk') reporting was utilised for caries risk, periodontal disease risk, risk for non-carious tooth surface loss and oral cancer risk

    Figure 1
    figure 1

    Risk outputs

  • Oral health outputs (Fig. 2) – comprises a revised Denplan Excel OHS utilising the PreViser severity scores for periodontal health and tooth health but leaving the other six components and the weightings between all eight components unchanged.8,13 The OHS provides a red/amber/green (RAG) and numerical score for each of the eight components previously validated8,10,14 (Fig. 2) to support discussions between dental healthcare professionals and patients. It also provides an overall composite oral health score out of 100 where 100 represents maximum health as a patient motivation tool. The RAG element was added so that severe problems are highlighted in red, moderate problems in amber and health in green

    Figure 2
    figure 2

    Oral health outputs

  • Fee scale derivation – this module calculates the indicative Denplan fee category as A, B, C, D or E, giving a higher weighting than previously to periodontal disease severity (based on PreViser scoring) and introducing some weighting to oral disease risk (based on PreViser risk scores). Consequently, the significance of past restorative history was downgraded to some extent.

A set of inputs required for each patient assessment to deliver the above reports was developed under the following headings:

  1. 1

    Patient perceptions (three components of 'function', 'comfort', 'aesthetics'), previously reported under the OHS8,10

  2. 2

    Periodontal status – previously described under PreViser13,15,16

  3. 3

    Status of teeth – PreViser US Patent no. US8206154; Denplan fee category guidance

  4. 4

    Tooth wear – based on Bartlett et al., 201119

  5. 5

    Occlusion – previously reported under the OHS8,10

  6. 6

    Soft tissues including mouth cancer – previously described under PreViser.18

The inputs required were determined by the OHS protocols, the new protocols for Denplan fee category assessment and the data required to operate the PreViser algorithms for disease risks and severity. Approximately 20 of the inputs were based on questions which the patient needed to answer about their oral health perceptions, medical history and lifestyle (see point 1) above). A similar number of inputs were also required based on clinical observations and measurements (see points 2 to 6 above). These are summarised in Table 1. Once clinicians submitted their inputs online, the report was immediately generated. Copies of each patient report could be printed (for filing and/or handing to patients), saved to practice software or emailed to patients with their permission. A mock-up of the report produced is shown in Figures 1 and 2.

Table 1 Scoring method and descriptors for DEPPA 'Oral Health Scores'

Study aims

The aim of the pilot study was to seek practitioner feedback on the utility of DEPPA, its perceived value and the need for the system in contemporary preventive care practice.

Material and Methods

Twenty-five general dental practitioners were recruited to test this pilot version of DEPPA. Ten practice advisers (out of 30) volunteered to participate. An additional 15 participants were recruited from those attending Denplan course on practice enhancement. The final group comprised 25 Denplan dentists, 20 who were Denplan Excel accredited and 5 who were not. A condition of participation was that chair-side Internet access was required in each practice.

Each volunteer was sent a document explaining the development of the pilot version of DEPPA and the protocol for the study. Each pilot dentist was provided with a unique three digit code to access the online DEPPA tool and the web address for the site. Pilot dentists were asked to share the report with each patient and explain its content and implications. Dentists were instructed to either file a hard copy or save a digital copy of each report to patient records. Each study dentist was asked to submit 25 assessments each for patients over 19 years of age within four working weeks. Participants were asked only to assess recall patients and not to include new patients. They were given a further week to email their feedback to the primary author using a questionnaire incorporating a 10-point scale (Table 2). Each participant was also encouraged to make free comments to further clarify their scoring.

Table 2 Pilot dentist feedback questionnaire

Results

In total 640 patient assessments were completed during the four working weeks. Table 3 displays the mean (± SD) scores for oral health and disease risk. Only two dentists failed to submit 25 assessments and several performed more than 25.

Table 3 Mean (± SD) Oral Health Score (max. 100) and risk scores (highest risk = 5) – n = 640

The mean OHS was high in this maintenance population, while risk scores varied according to disease entity, with caries risk yielding the highest score. Table 4 sets out the percentage of patients in total classified as being at high risk or very high risk for each condition.

Table 4 Percentage of patient's classified as high or very high risk (scores 4 and 5) – n = 640

Table 5 shows the percentage of patients placed in each fee category by DEPPA compared with the current spread observed in the Denplan Care database.

Table 5 DEPPA recommended fee codes compared with current position (A = lowest fee, E = highest fee)

Figure 3 shows the average feedback scores received from the 25 pilots, Twenty-four participants submitted verbatim comments (see Table 1 for full questions).

Figure 3
figure 3

Mean (± SEM) feedback scores from 25 pilot dentists

The most common verbatim comments were either:

  • Positive and supportive of the tool, eg 'This is an excellent assessment of caries and periodontal disease. It would assist us in developing individual preventive treatments plans and gaining patient compliance (the most difficult part of preventive therapy). I would like to start using it straight away'

  • Critical about the ease of use of the on screen inputs, 'Time is a factor as I am sure you appreciate. I did get quicker but it still added 5-10 mins to exam appt'

  • Noted a perceived tendency for DEPPA to overestimate caries risk, 'I found that when caries risk assessing the fact that if a patient had one carious episode in the previous 12 months it often put them in a high risk category which appears to be harsh. They may not have had any decay for some time before and probably won't have decay again for some time to come. The rest of the risk assessment I thought reflected my clinical observations, especially perio.'

Discussion

This paper reports the feedback of 25 pilot practices to a novel online, integrated risk and disease scoring system, based upon 640 patient assessments performed during November 2012. It also compares future disease risk data with current prevalence data from the ONS adult dental health survey (2009) and compares derived fee bandings for capitation, which are based upon validated risk and disease scores, with the established bandings within the Denplan Excel practice system. Overall the response of the participating dentists was very favourable towards the pilot version of DEPPA. The average feedback score across all 10 questions from the 25 participants was 8.5/10 and the group were almost unanimously in support of several aspects. Practitioners clearly believed that comprehensive patient assessment, such as DEPPA, is becoming an essential aspect of contemporary high quality dental care. There was wide acceptance that DEPPA constituted a comprehensive process, served as a valuable patient communication aid, providing personalised biofeedback, which was reported to be well received by patients.

The updating of the original OHS was generally well received and the revised scoring was perceived by the group as appropriate. However, two pilot dentists commented that Oral Health Scores were typically lower that the original paper-based OHS version, implying a more critical assessment. Anecdotally, and from audit data, the authors report that the average scores for the original OHS were around 85 – about six points higher than with DEPPA. The DEPPA version employs tooth health scores derived from PreViser algorithms in such a manner that six points are lost from tooth health once any restoration is in situ (that is, tooth substance has been lost). This is consistent with PreViser periodontal health scores which can never reach the maximum once bone loss has occurred, since predictable and complete bone regeneration remains an elusive goal. Moreover, while a restored tooth may be 'healthy' it remains structurally compromised relative to its pre-disease/restored form and should thus be deemed 'less healthy'.

The feedback scoring and free comments suggested that there was significant support from the pilot group for the changes made to the indicative Denplan fee scoring with 80% of the pilot dentists scoring this at eight and above. Several participants commented that most patients' fee categories were unchanged, which was reassuring, as the designers wished to avoid large scale disruption to the status quo, unless justified by the severity of periodontal disease or future oral disease risk. Further, the data in Table 5 does not suggest that this more contemporary method of allocating fee categories results in large scale changes for patients. It must be remembered that this scoring is pragmatic, based largely on scientific evidence, but only provides guidance and Denplan dentists ultimately set their own fees and are the final arbiters on which fee category a patient is placed in. The rational here is to retain flexibility of decision-making with the dentist as the final arbiter, allowing them to use their experience and judgement to individualise patient care plans, rather than adopting a restrictive, inflexible and didactic system based upon computer algorithms, which currently cannot replicate human judgement.

Both the feedback scoring and the free comments indicated that several members of the pilot group had concerns about the sensitivity of the caries risk scoring in this pilot version of DEPPA. Forty percent of the pilots scored the question on risk validity (question 5) below 8/10. The data in Table 4 shows that 30% of these recall patients were classified by this pilot version of DEPPA to be at high risk or very high risk of future caries. This compares to 9% at high or very high risk of future periodontal disease, 9% for tooth wear and 2% for oral cancer. Reviewing the data objectively demonstrates that the data in Table 4 reported from the 640 patients is broadly matched to current disease rates in the UK. Approximately 10% of UK adults have severe periodontitis and 31% are reported to have active caries,11 while tooth wear prevalence increases from 3% at 20 years of age to 27% at 70 years.12 Therefore while risk and disease are distinct, but linked parameters, it is reasonable to assume that in the absence of intervention risk broadly translates into disease prevalence and that the DEPPA risk scores very closely reflect current UK disease levels. In response to the concerns over caries risk, the algorithm was modified to discriminate between primary and secondary caries and the system re-piloted by the four practitioners who had expressed concern. The feedback from the re-pilot was unanimous in its support for this modification.

The authors readily accept that, although the evidence base for periodontal disease risk scoring is strong,13–16 that for caries risk scoring is less so. There is scope for future work on the validity of caries risk scoring which will be facilitated by the data generated by DEPPA.

Finally, the pilot group were keen to see the 'user-friendliness' of DEPPA evolve from this pilot version. Question 1, concerning this aspect, received the lowest feedback score at 7.6/10. Many useful suggestions were made, on how this could be achieved. Prior to the launch of DEPPA on 26 April 2013 at the BDA conference, two changes were made in this area: 1) reorganising the inputs so that those questions requiring patients' answers appear together at the start of the data input screen before those inputs requiring data from clinical examination, and 2) creating an optional facility for patients to self-enter these inputs using a tablet system, with the answers being subsequently accessible to the dentist to check and modify. These changes save valuable chair-side time.

One limitation of the current study was that the pilot group were not randomly selected from all Excel general dental practitioners and were a mix of advisors, Excel and non-Excel GDPs in order to provide broad representation, but this does limit the generalisability of the opinions expressed.

Conclusions

Having addressed and re-piloted the caries risk score and user friendliness issues raised in the initial pilot, the integrated online oral health and risk assessment tool reported here as DEPPA appears fit for purpose as a pragmatic analytical and biofeedback tool. DEPPA will allow dental teams to measure oral health status, future disease risk and receive ongoing guidance on capitation fee setting. The indications are that DEPPA could be a valuable audit, care planning and patient communication tool, since the centralised data collection format will allow analysis of many thousands of patient inputs in a longitudinal manner, facilitating algorithm modification according to recorded outcomes.