Introduction

Evidence-based healthcare incorporates the 'conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients'.1 This approach to healthcare encourages clinicians to interpret evidence on an individual patient basis and to include assessment of patient outcome preference in decision making. Patients' preferences in healthcare settings reflect many factors. It is increasingly apparent that these are both medical and non-medical, and include social, cultural and economic factors. Whilst traditional utility assessment methods fail to integrate non-medical factors,2 multi-attribute utility (MAU) methodology, allows assessment of both medical and non-medical factors.3

With regard to the prophylactic removal of mandibular third molars, published research has focused on general dental practitioners' and oral surgeons' opinions about risks and benefits4,5 and patients' preferences concerning mandibular third molar removal and retention.6,7,8 In one of these studies,8 on Swedish patients' preferences, complications following removal were considered to have greater negative effects on their lives than complications of retention. It is not known whether this holds true across national boundaries.

The aim of this study was therefore to elucidate patients' preferences for outcomes of mandibular third molar removal and retention on an international basis. The study was done in Sweden and Wales, because comparisons of third molar treatment there had previously been carried out. There are, however, differences in the two countries in terms of costs and delivery: two major issues in national healthcare. In Sweden, all patients pay for third molar examination and surgical treatment while in the UK, National Health Service treatment is, apart from standard adult patient co-payments in the general dental service, free at the point of delivery. Furthermore, the number of oral surgeons per million inhabitants is lower in the UK compared with Sweden.9 There is also a difference in practice pattern: large numbers of mandibular third molar removals are still done under general anaesthesia in the UK whereas in Sweden these numbers are very low.

It is possible that these differences affect patient treatment preferences, for example for removal or retention of third molars. It is also possible that preferences are shared across healthcare systems. Thus, the hypothesis that guided the research reported here was that patients' third molar outcome preferences relating to removal and retention of mandibular third molars in Sweden and Wales are similar when ranked using MAU methodology.

Subjects and method

Subjects

The subjects comprised patients referred for removal of one or both mandibular third molars. In Sweden, patients were referred in 1997/8 to three oral and maxillofacial surgery clinics of the National Health Service in south Sweden. In Wales, patients were referred in 1997/8 to the department of oral and maxillofacial surgery, Dental Hospital, Cardiff. Patients who were scheduled for third molar surgical removal were recruited to the study. At the initial consultation, patients were fully informed about the nature, effects and probability of complications. No patient had previous experience of third molar removal. The sex and age distribution of the patients participating in the three stages of the study are presented in Table 1. The difference between the mean age of the Swedish and Welsh participants was calculated by the t-test (P=0.05).

Table 1 Sex and age (years) distribution of patients participating in the different stages of multi-attribute utility (MAU) study performed in Sweden and Wales. Within Stage 2 and Stage 3 there were differences (P<0.05) in mean age between the Swedish and Welsh participants.

The multi-attribute utility (MAU) method

Multi-attribute utility assessment was in three stages:

Stage 1 Elicitation of domains (attributes), ie main areas of concern that patients considered important generally in their lives, which could be affected by mandibular third molar removal and retention.

Stage 2 Inter- and intradomain weighting. Interdomain weighting was done by relative weighting of the domains elicited in Stage 1. In the intradomain weighting, patients designated values for different health states. The health states were described as a decomposed function of each attribute.

Stage 3 Rating of outcomes. The patients were asked to imagine experiencing a series of representative outcomes of mandibular third molar removal and retention, which were described in a number of short descriptions (vignettes).

Stage 1. Elicitation of domains

The interview

The domains were elicited by means of an interview technique based on recommendations set out by Babbie.10 Interviews were performed by the four authors in Sweden and by a research assistant in Wales who had been trained to use this technique. The interviews were conducted separately by one interviewer, took place in the clinic immediately after the consultation and were tape-recorded. Thirty patients participated in Sweden and 77 took part in Wales.

The interviews were non-structured and included questions regarding medical, psychological, social, cultural and economic dimensions, to identify main areas of concern (domains) the patients thought could have an impact on their lives.

The interviewer started the interview with the question 'what do you expect to experience after having your wisdom tooth out?' After taking cues from this response, further open-ended questions were asked if considered necessary. Examples of such questions were:

How do you feel about coming into hospital?

How do you feel about having time off from work/school?

What arrangements might you have to make before coming into hospital?

Is there anything specific that concerns you about the operation?

What do you feel about the complications which have been explained to you?

How do you think having the operation will affect your normal routine?

Which of the effects you have mentioned do you feel might affect you most?

How do you imagine having your tooth out may affect other areas of your life?

Content analysis

The tape recordings were then transcribed to preserve textual data. Then, the interviewer processed the textual data by searching for patients' statements which described 'areas of importance' that could influence their health state. Examples of statements that emerged were: 'I feel good about getting rid of the tooth. It is very difficult to keep it clean', and 'the effects of post-operative complications worry me. I do not worry about the operation'. Each statement was 'indexed' to identify categories of 'areas of importance'. Examples of such 'areas of importance' were 'to feel safe' or 'the operation/procedure'.

Then the 'areas of importance' were categorised into domains. Domains were defined as areas of common concern, interest or importance to the patients. Domains that were considered irrelevant and inconsistent with an MAU model concerning mandibular third molars were excluded. Such excluded domains were 'physical integrity' and 'economic situation'.

In Wales the interviews were subjected to content analyses by the two UK authors (MB, JS). In Sweden the same procedure was performed by the four Swedish authors (RL, KK, LL, MR). The six authors in collaboration did the final categorisation into domains.

Stage 2. Domain weighting

Interdomain weighting

Samples of 78 further third molar patients in Sweden and 100 further patients in Wales were asked to weight the relative importance of the domains which emerged in Stage 1. They were asked to distribute 100 'resource points' to the domains, assigning a greater or lesser number of points (from 0 to 100) to the domains that they felt were more or less important to them. They were also allowed to reject any domain which they perceived would not be affected by the outcomes being considered.

Intradomain weighting

To each of the individual domains, four health states (see Table 3), representing a range of descriptions applicable to these domains, were constructed as described by Brickley et al.11 Values were then assigned to these health states by the 78 patients who took part in the interdomain weighting exercise. By placing the health states on a one hundred centimetre visual analogue scale (VAS) with numerical anchor points of 0 and 100, it was possible to obtain quantitative values for the health states. Thus, the patients were asked to mark their choices for 0 (worst) and 100 (best) on the VAS. Then, the patients were asked to place the remaining two health states on the scale between 0 and 100. These two points were measured to the nearest 0.5 cm. The difference between the mean weightings of the Swedish and the Welsh patients was calculated by the t-test (P=0.05).

Table 3 Intradomain weighting. Mean and standard deviation (s) expressed in cm VAS (0 represents 'worst' health state and 100 'best' health state on the VAS) as assigned by patients from Sweden (n=78) and Wales (n=100) referred for mandibular third molar removal

Stage 3. Rating of outcomes

Eighteen vignettes describing outcomes of mandibular third molar removal and retention were constructed using evidence from the literature.12,13,14,15,16,17,18,19,20 A new sample of 55 patients in Sweden and 100 patients in Wales was asked to imagine experiencing the outcomes described in each vignette. Then, the patients were asked to select the health state within each of the five domains that matched how they imagined experiencing the outcomes described in each vignette. This was repeated for all 18 vignettes.

Calculation of patients' preferences

The results of patients' intra- and interdomain weightings were recorded as numerical data and were entered into a spreadsheet. The mean value of the domain weightings were then calculated using SPSS (Statistical Package for the Social Sciences).

The result derived for each vignette was expressed as 'preference'. The preference for each vignette and each patient was calculated using the following formula:

Ptotal = (Σ Pd Wd):100

where

Ptotal = The overall preference

Pd = The value given to the intradomain health state that has been derived from the intradomain weightings

Wd = The interdomain weighting of a specific domain.

The mean preference was then calculated for each of the 18 vignettes. This was done separately for the patients in Sweden and Wales. A worked example is shown in the Appendix.

Ranking of mean values of the preferences was done for each country separately. Rank order in the two countries was compared using Spearman's rank correlation (P= 0.05).

Patient-reliability and understanding of the method

Patient-reliability and understanding of the method for interdomain and intradomain weighting were tested in Sweden and have previously been reported.8 The results justified the application of MAU methodology to mandibular third molar removal and retention.

Results

Elicitation of domains

Based on the non-structured interviews of patients in Sweden and Wales five domains were identified, ie 'home and social life', 'general health and well-being', 'job and studies', 'health and comfort of mouth, teeth and gums' and 'your appearance'.

Domain weighting

The patients' interdomain weightings are presented in Table 2. The mean weighting of the relative importance was highest in Sweden for 'home and social life', while 'general health and well-being' was highest in Wales. 'Job and studies' was rated as the third most important weighting in Sweden and 'health and comfort of mouth, teeth and gums' in Wales. 'Your appearance' received the lowest mean weighting in Sweden and 'job and studies', the lowest mean weighting in Wales.

Table 2 Interdomain weighting. Mean and standard deviation(s) of the relative importance of the elicited domains as assigned by patients from Sweden (n=78) and Wales (n=100) referred for mandibular third molar removal

The patients' intradomain weightings are presented in Table 3. The mean weightings of the second 'best' health state differed from the mean weightings of the second 'worst' health state for all domains. Weighting was different (P<0.05) for only three health states, which were weighted lower by patients in Wales compared with patients in Sweden. In particular, patients in Wales considered that their job and studies, and their appearance would be affected to a greater extent than patients in Sweden.

Patients' preferences for the vignettes

Table 4 presents the mean patients' preferences and the ranking of the outcomes described in the vignettes. There was a high degree of correlation in patients' ranking of the different outcomes between the two countries (rs=0.93, P<0.001).

Table 4 Patients' preferences. Mean and ranking (R) of 18 vignettes within each country separately. The preferences were based on Swedish (n=55) and Welsh (n=100) patients' ratings when asked to imagine experiencing the outcomes of the vignettes. Ranking 1 represents the least annoying and ranking 18 the most annoying outcome. There was a high degree of correlation between he two countries (rs= 0.93, P<0.001)

Generally, vignettes describing the outcomes of retention attracted higher ranking, ie had least impact, than vignettes describing the outcomes of surgical removal. Vignette 18, which described the presence of a fluid-filled sac which suggested that this tooth must be removed, received the highest ranking, i.e had the least impact in Sweden. In Wales vignette 17, which described the lower front teeth as 'more squashed together' received the highest ranking*. Symptoms of mild transient pericoronitis (vignette 13) received the second highest ranking by patients in both countries. 'After the extraction, the surgeon tells you that your jaw is broken and...' (vignette 12) received the lowest ranking by patients, in both countries. The second lowest ranking was achieved by vignettes that described severe pain (vignette 2) and permanent numbness of the lip and tongue (vignette 11), but in reverse order in the two countries.

Discussion

The principal finding of this study, and the most important for practitioners and healthcare managers, is that patient-orientated decisions were very consistent across national boundaries. This underlines the importance of taking fully into account, in a systematic and organised manner, the beliefs of patients in decisions about their care. Standard gamble, time trade-off, MAU, rating-scales, magnitude estimation, equivalence and willingness to pay methods and most scaling methods are all considered credible for this purpose.21 The MAU technique allows quantification and incorporation of social, psychological and physical components of health states into utility measurement and allows clinicians and patients alike to focus on the critical issues in reaching a treatment decision. The vignettes were constructed to illustrate a wide variety of outcomes of removal and retention of third molars and both temporary and chronic outcomes, to reflect a range of outcomes which might be expected to affect patients' quality of life over a lifetime. Long term outcomes could be expected to affect patients to a greater degree than transient outcomes.

The selection of patients in Sweden and Wales was somewhat different. In both countries, general dental practitioners referred the patients and some patients in Wales were referred from the hospital examination and emergency department. The population of patients was randomly selected and is representative of the population referred for third molar removal. Not all of them had problems with their third molars. Of those referred for removal, in both Sweden and Wales, about one fifth were without any symptoms and pathology. Patient distribution according to age was about equal between the two countries, even though statistically significant differences in age existed in Stage 2 and Stage 3. However, these mean differences were about three years: the Swedish participants were a few years older compared with the Welsh patients. The impact of this limited age difference on the overall result must be considered to be minor. However, the distribution of females and males differed. In Sweden, gender distribution was equal in Stages 1 and 2. In Stage 3 more females participated. In Wales, however, females outnumbered males by about 2:1 in all three stages, reflecting treatment demand. Even though there were differences in gender distribution between the countries, this did not appear to influence the domains which were elicited. Main areas of concern identified were the same in both countries. However, in Stage 2, in which patients assessed the relative importance of the domains, interdomain weighting, some differences emerged, which may, in part reflect differing proportions of females/ males participating together with cultural differences. For example, the domain 'home and social life' was assigned the highest value in Sweden while 'general health and well-being' was assigned the highest value in Wales.

Most importantly, this study demonstrated consistent patient values with regard to the outcome of third molar treatment decisions in two contrasting European cultures. Patients in Sweden and Wales believed that the impact of third molar removal would have a more negative effect on their lives than the impact of retention: patients generally preferred a more restrictive approach to intervention. In contrast, dentists are known to have different attitudes towards potential outcomes of different treatment alternatives.22,23 A recent study compared general dental practitioners' third molar removal rates in Sweden and Wales,5 and found no significant difference between mean number of third molars scheduled for removal in the two countries. However, Swedish oral surgeons scheduled significantly more third molars for removal than oral surgeons in Wales.5 Although differences in socio-economic contexts from the perspective of family dentists and oral surgeons in Sweden as compared with Wales might contribute to this difference, a more likely explanation is a lively public debate about reasons for removal in the UK, starting in the early 1990s. Differences in access to oral surgeons (these are almost double the number in Sweden compared with UK despite a much lower population), and anesthetic provision may also play a part. However, even though these differences exist from the professional perspective they have not, according to the results in this study, affected patients' preferences on this issue either in Sweden or in Wales. Again, this strengthens the case for adopting a much more patient-orientated, less clinician-orientated approach to decision making.

In conclusion, these results are in accordance with our hypothesis: despite differences in healthcare delivery in the two countries, the main areas of importance in patients' lives that could be influenced by retention or removal of mandibular third molars were similar. Furthermore, preferences for the various outcomes of these two treatment alternatives were also consistent.

Appendix

Example of the calculations for one patient and vignette 1: 'After the extraction you experience moderate pain and your face and mouth are very swollen'. The patient selected the following health states within each domain that matched how she imagined experiencing the outcomes described in vignette 1. Table 5

The preference (P) for this patient and vignette 1 would be:

Table 5 Appendix