Main

Patients treated for cutaneous melanoma are at a high risk of recurrence and require careful follow-up (McCarthy et al, 1988; Martini et al, 1994; Roberts et al, 2002; SIGN, 2003). Several guidelines that give recommendations about the timing and schedule of formal follow-up exist, based on current limited evidence and expert opinion (Poo-Hwu et al, 1999; Roberts et al, 2002; SIGN, 2003). Despite this, there are no universally accepted guidelines for follow-up, and none is specific about where it should take place, or which health-care professional should deliver it (Poo-Hwu et al, 1999; Roberts et al, 2002; SIGN, 2003). Furthermore, there have been no randomised trials of different follow-up methods, for example, comparing follow-up by different professionals or in different locations (Martinez and Otley, 2001; SIGN, 2003; Francken et al, 2005).

There are several reasons to believe that a GP-led follow-up programme for melanoma could be feasible and attractive, but it could also have several potential problems. Individual practices are likely to have small numbers of patients requiring melanoma follow-up, which has the advantage that the programme may be incorporated into the primary care workload with minimal disruption and few resource issues, but the disadvantage that skills might be practised infrequently. However, as melanoma follow-up is based on elements of clinical examination practised routinely in primary care, patient self-examination and patient education, GPs might be able to provide a service that is equivalent in clinical outcome to specialist follow-up. Support for this view comes from three randomised controlled trials, two in women with breast cancer and one in individuals with colorectal cancer, wherein a follow-up programme based on GP examination, patient self-examination and education, demonstrated equivalent outcomes to those achieved in secondary care (Grunfeld et al, 1999, 2006; Wattchow et al, 2006). Although hospitals may offer more focused specialist consultations, primary care may offer more holistic consultations; this notion has been suggested by earlier studies and was confirmed in a parallel qualitative study to this randomised trial (Grunfeld et al, 1999; Murchie et al, 2010). A key aim of follow-up is to detect recurrences and new primaries early, but most of these events have been found to occur during the intervals between follow-up appointments; therefore, patient education may be more important than review examinations (Meyers et al, 2009). It is not clear whether specialists or primary care are best at enabling patients to understand self-examination, but primary care may have more time, more opportunities for reinforcement and greater continuity. On the other hand, individuals with melanoma may value regular review by specialists and be less reassured by GP review.

We developed a GP-led follow-up programme for cutaneous melanoma according to the principles of the MRC framework for the design and evaluation of complex health-care interventions to improve health (Murchie et al, 2007). In a 1-year exploratory randomised controlled trial in North-east Scotland, we evaluated its effect on patient satisfaction, follow-up guideline compliance, anxiety and depression, as well as health status.

Methods

Setting and participants

This study was conducted in North-east Scotland (population 500 000) between April 2005 and April 2006. A total of 35 general practices from across the region agreed to participate. Each participating practice was presented with a list of their patients currently attending the joint hospital melanoma clinic at the Aberdeen Royal Infirmary (ARI) and asked to supplement this with a search of their own practice computer records for patients with melanoma. They were then asked to ensure that all identified patients met the inclusion criteria (Box 1).

Sample size calculation

This was an open cluster randomised trial designed to avoid the risk of contamination and minimise bias. As most participants would normally be attending the joint melanoma clinic at the ARI, the size of the intra-cluster correlation coefficient (ICC) between participants at different general practices in baseline satisfaction with existing hospital-based follow-up was unlikely to be large; therefore, a conservative ICC of 0.01 was estimated. With 40 practices and 150 participants, and assuming baseline levels of satisfaction of 60% for service delivery, 65% for the consultation and 40% for continuity of care (Grunfeld et al, 1999), the resultant trial would have 80% power to detect differences of at least 20% in each of the three domains of patient satisfaction, at the two-sided 5% significance level.

Randomisation

Randomisation was conducted by the principal investigator PM. Practices were stratified according to the number of eligible patients likely to be available in each practice on the basis of a list provided by the joint melanoma clinic at the ARI. Three strata were formed: practices with >5 eligible patients, 4–5 eligible patients and 3 eligible participants. Strata were checked to ensure an equal balance of rural (15 miles from the Aberdeen City centre) and urban (<15 miles from the Aberdeen City centre) practices. Practices were then randomised within each stratum to intervention or control using the randomisation function of the computer software package SPSS version 15.0 (SPSS Inc., Chicago, IL, USA). Participants were not blinded as to group allocation.

The intervention

Complete details of the intervention and its design have been published previously (Murchie et al, 2007). Briefly, a lead GP from each of the intervention practices attended a 4-h training session and received a comprehensive information manual detailing how to deliver the study protocol for a 12-month period. This session focused on the presentation of new and recurrent melanomas and how best to examine to identify these. Participating GPs received travel and locum expenses to attend training. In three cases (in which the lead GP was unable to attend the training session), the principal investigator (PM) visited the practices and delivered a modified training session to the GP. All patients in the intervention group received a detailed information booklet about melanoma, which included information on conducting self-examination. A computerised recall register of the intervention group patients was constructed in Microsoft Excel (Microsoft, Redmond, WA, USA) and maintained by the principal investigator. The intervention group patients were invited to attend scheduled protocol-based melanoma follow-up appointments with the lead GP at their practice, at 3 or 6-monthly intervals depending on the thickness of melanoma and time since diagnosis. This schedule of visits is identical to that followed by the specialists running the Joint Melanoma Clinic at the ARI, and is informed by the frequency of visits recommended in national guidelines (Roberts et al, 2002; SIGN, 2003). At each appointment, the GP took a focused history, and conducted a structured examination of the melanoma primary site and regional lymph nodes. Imaging, blood tests or dermoscopy were not performed as these are not recommended in the current UK Guidelines (Roberts et al, 2002; SIGN, 2003). At the first GP follow-up appointment only, the GP conducted a complete skin survey. Moreover, at the first visit, the GP instructed the patient on how to conduct a self-examination, an issue revisited at each subsequent follow-up visit. Whenever concern arose regarding possible recurrence during or between scheduled follow-up appointments, patients could be referred through a rapid referral pathway to the plastic surgery outpatient clinic at the ARI. Participating practices received £30 per follow-up visit towards practice participation costs. The GPs at control practices received no training in melanoma follow-up and had no scheduled consultations with their patients as part of the study. Patients at practices randomised to the control group continued to attend the hospital-based joint melanoma clinic for their melanoma follow-up, at 3 or 6-monthly intervals depending on the thickness of melanoma and time since diagnosis. The joint melanoma clinic is run by specialists from plastic surgery, oncology and dermatology, and attending patients have primary tumour site, nodal basins, abdomen and other abnormal moles examined by one of these specialists or a trainee.

Data collection

Data were collected at baseline and after 12 months from the following two sources: (i) a self-completed postal patient questionnaire (comprising questions on demographic and socioeconomic status, a questionnaire to ascertain patient satisfaction (Grunfeld et al, 1999), the Short Form-36 (SF-36) questionnaire (Ware, 1993) and the Hospital Anxiety and Depression Scale (HADS) (Zigmond and Snaith, 1983)) and (ii) patients’ general practice-held medical records for information about the initial melanoma diagnosis as well as treatment and use of primary and secondary care services in the previous 12 months.

Outcome measures

Primary outcome

The primary outcome of the trial was patient satisfaction. Patients were asked to rate, on a four-point Likert scale, their agreement with statements about 15 aspects of follow-up covering service delivery, the consultation and continuity of care (Table 2). Owing to small numbers, the answers were combined to create a binary variable for analysis. For each item, ‘agree’ was combined with ‘agree sometimes’ and ‘disagree’ was combined with ‘can’t say’. This was because the satisfaction instrument is attitudinal and based on a Rasch model, in which combing adjacent categories is permitted, provided they signify related levels of the variable being measured. (Wright and Linacre, 1992). The satisfaction questionnaire had been developed for use in a randomised trial of GP-led breast cancer follow-up (Grunfeld et al, 1999), and Cronbach's α-values of 0.70, 0.67 and 0.70 at baseline, 6 weeks and 3 months have been reported. Answers to the 15 individual questions were then combined into a total satisfaction summary score of between 15 (total satisfaction) and 60 (total dissatisfaction).

Secondary outcomes

Adherence to local guidelines was determined in relation to the current locally recommended schedule from the hospital joint melanoma clinic (Box 2). Guideline adherence was a binary variable, with the care of patients considered adherent if the general practice-held medical records indicated that they had had, in the preceding 12 months, the correct number of joint melanoma clinic or GP melanoma follow-up visits as deemed appropriate for the Breslow thickness and time since initial diagnosis. Health status was assessed using the SF-36 (Ware, 1993; Lyons et al, 1995) and the HADS (Zigmond and Snaith, 1983; Bjelland et al, 2002).

Statistical analysis

The questionnaires were coded and all data entered manually using Microsoft Office Access 2003 (Microsoft). The data were analysed using SPSS for Windows version 15.0 and STATA 10 (StataCorp, College Station, TX, USA).

Satisfaction, adherence to guidelines and HADS status between intervention and control groups at baseline and follow-up were compared using the cluster-adjusted χ2 test based on the generalised estimating equations (GEEs) approach, on the assumption that there was working exchangeable correlation among patients within the same cluster (Donner and Klar, 1994). It is now recognised that changes in SF-36 scores between two points in time for six domains (namely physical functioning, social functioning, mental health, energy and vitality, bodily pain and general health), as well as for the physical and mental component summary scores have a normal distribution (Fayers and Machin, 2000). For this reason, the cluster-adjusted t-test was used to compare the mean summary satisfaction score and SF-36 scores between intervention and control groups at the two time points (Donner and Klar, 2000). The cluster-adjusted McNemar's χ2 test was used to compare change in each aspect of satisfaction, adherence to guidelines and HADS group between baseline and follow-up within the intervention and control groups separately (Durkalski et al, 2003). Unadjusted odds ratios (ORs) and their 95% confidence interval (95% CI) were estimated through GEEs using robust (heteroskedasticity-corrected) s.e. to increase the efficiency of estimation (Donner and Klar, 1994). The ORs were then adjusted for variables selected a priori as potential confounders (gender, age, practice size, distance of home from ARI, educational status, level of satisfaction at baseline and practice). Owing to the number of statistical tests performed, and the increased chance of a type 1 error, a P-value of 0.01 was used to denote statistical significance throughout the univariate analyses.

Results

Recruitment

Overall, 35 of the 83 practices approached (42.2%) agreed to participate, and a total of 207 potentially eligible patients were identified (Figure 1). Of these, 142 (68.6%) patients agreed to participate in the study, resulting in 17 practices with 53 patients in the intervention group and 18 practices with 89 patients in the control group. The imbalance in numbers was a result of lower recruitment than anticipated in several larger practices.

Figure 1
figure 1

Consort diagram illustrating participant flow.

The intervention and control groups were comparable for age, sex, socioeconomic factors and features of their melanoma, but those in the intervention group tended to live further away from the ARI (Table 1).

Table 1 Baseline characteristics of each group

Patient satisfaction

At baseline, there was no significant difference between groups in any of the 15 aspects of the patient satisfaction measured (Table 2). At follow-up, more participants in the intervention group agreed with different aspects of satisfaction than did those in the control group. There were statistically significant differences between groups on 6 of the 15 aspects assessed. Members of the intervention group were significantly more likely than those in the control group to believe that ‘it's easy to get through by phone if you need to’; that ‘if I feel I need to I can usually see a doctor on the same day’; that ‘you are usually seen within 20 minutes of your appointment time’; that ‘the doctor examines you thoroughly when necessary’; that ‘the doctor always prescribes medicine if you need it’; and that ‘you see a doctor who know you well.’

Table 2 Proportion of people indicating satisfaction with different aspects of care at baseline and follow-up, by group

At baseline, there was no significant difference between groups in the cluster-adjusted mean summary satisfaction score (P=0.912). At follow-up, the cluster-adjusted mean score was significantly lower in the intervention group 26.4 (95% CI: 24.9–27.9) vs 33.5 (95% CI: 32.5–34.4), indicating significantly higher satisfaction than in controls (P<0.001).

Within the intervention group, there was a statistically significant change over time in the level of agreement in satisfaction with 5 of 15 aspects of care (Table 3). In contrast, within the control group, there were no significant changes over time. Change (from baseline to follow-up) in the mean summary score was found to be significantly lower (−5.96, 95% CI: −8.09 to −3.89) in the intervention group than in the control group (0.29, 95% CI: −1.49 to 2.08) (P=0.001), indicating higher overall satisfaction.

Table 3 Number of people indicating satisfaction with different aspects of care before and after the intervention

Of the 13 aspects of satisfaction wherein ORs could be computed, there was statistically significant higher satisfaction in the intervention group for 7 aspects after adjustment for clustering and potential confounders (Table 4).

Table 4 Chances of agreeing at follow-up with various statements of satisfaction with aspects of care of follow-up in the intervention group, compared with the control group (expressed as odds ratio (95% confidence interval (CI)

Adherence to guidelines

In the year before the study, 84.9% of the individuals in the intervention group and 85.4% of the control group had been seen in accordance with the local guidelines (P=0.86). At follow-up, 98.1% of the individuals in the intervention group were seen according to local guidelines, compared with 80.9% of the control group (P=0.020).

Health status and psychological well-being

There was no statistically significant difference between groups in terms of distribution of SF-36 scores at either baseline or follow-up (Table 5). There was no statistically significant difference in the proportion of intervention and control group participants with a HADS score, suggesting anxiety or depression (8) either at baseline or follow-up (Table 6). Similarly, there was no statistically significant within-group difference between baseline and follow-up in the proportion of patients exhibiting a likelihood of caseness for anxiety or depression (HADS score 8) (Table 7) (Bjelland et al, 2002).

Table 5 Median and interquartile range (IQR) SF-36 scores
Table 6 Baseline and outcome hospital anxiety and depression scale scores
Table 7 Comparison of hospital anxiety and depression scale scores within groups between baseline and outcome

Referrals and adverse events

A total of 146 GP follow-up appointments took place during the study year. No problems were detected during 136 (93.2%) of these appointments. In all, 10 (6.8%) scheduled follow-up appointments resulted in urgent referrals through the rapid access pathway.

Nine adverse events occurred during the trial, of which four were related to melanoma. There were two diagnoses of recurrent melanoma, one in each group, with one patient dying before the study was completed. Two new primaries, one in each group, were detected during the trial year. Unrelated to melanoma, three patients died (all belonging to the control group) and two, one in either group, were diagnosed with another cancer.

Discussion

Main findings

We found that GP-led melanoma follow-up improved patient satisfaction and was more guideline compliant than hospital-based follow-up. Health status and psychological well-being of those participants receiving the new intervention seemed to be relatively unaffected.

Strengths and limitations

The GP-led follow-up programme was developed over a period of 12 months using the MRC framework for the development and evaluation of complex interventions to improve health (Murchie et al, 2007), resulting in a robust intervention that functioned with few practical difficulties. A total of 42% of practices in the Grampian region agreed to participate in the study. This is a relatively high recruitment rate for an interventional trial in primary care and increases the chances that the results are applicable to the whole of this large geographical area (Foy et al, 2003). We randomised by practice to avoid contamination, but lower than expected recruitment in some practices resulted in eight clusters with fewer than three participants each after follow-up. This complicated our analysis, but the use of the GEE approach enabled us to account for the effect of clustering throughout all analyses.

We were unable to investigate the effect of the intervention on clinical end points, such as recurrence and mortality. Post hoc power calculations indicate that, to obtain definitive data on mortality and recurrence, a study of at least 2000 patients would be required, and this is unlikely ever to be funded. Our study, therefore, provides a firm basis if such a major undertaking were ever to be contemplated. On the other hand, it seems likely that research in this important clinical area will have to depend in future on softer outcomes, and our data contribute considerably to sparse current literature. Furthermore, although we detected no significant difference in health status or anxiety and depression, our trial had limited power to detect small or moderate-sized changes.

The trial was not blinded. Patients were aware that they were in the control group, not receiving the novel GP-led follow-up programme. Our results would have been affected if patients in the control group became, or remained, more dissatisfied than those in the intervention group, because they knew that they remained under hospital follow-up.

Our recruitment rate of 67% is high, but 38 of those patients invited to participate did not respond and 28 declined to take part. We have no information on the reasons for refusal or non-response, but it may be that GP-led melanoma follow-up is attractive and acceptable to many, but not all, patients.

Owing to limitations of funding, the study ran for only 1 year. According to the protocol, 22 members of the intervention group required a 3-monthly follow-up and 31 required a 6-monthly follow-up. As a result, the median number of GP-led melanoma follow-up appointments experienced by the intervention group was two. This may have limited their ability to make comparisons with their hospital follow-up. At the conclusion of the trial, melanoma follow-up by GPs ended and patients were discharged back to the melanoma clinic. Although the intervention seemed to have been successful over the course of the year, it is not known whether the benefits would have been sustained over a longer period.

Comparison with other research

Several questionnaire and qualitative studies have explored the views of patients about the possibility of receiving cancer follow-up from their GPs (Adewuyi-Dalton et al, 1998; Howells et al, 1999; Rozmovits et al, 2004; Dancey et al, 2005). Most suggest that a significant proportion of patients would consider primary care-led cancer follow-up to be acceptable, including 60% of 217 individuals attending follow-up after melanoma at a plastic surgical outpatient clinic in an English hospital in 2003 (Dancey et al, 2005). Three randomised trials, two for breast and one for colorectal cancer, have examined follow-up based in primary care, with the GP responsible for delivering the intervention (Grunfeld et al, 1996, 1999, 2006; Wattchow et al, 2006). In each case, the GP-led programme performed at least as well as traditional hospital-based follow-up, although the outcome measures varied from trial to trial. Several small surveys provide evidence about the willingness of UK GPs to become involved in the follow-up of patients with cancer, including melanoma (Grunfeld et al, 1995; Papagrigoriadis and Heyman, 2001; Moses et al, 2004; Dancey et al, 2005).

Taken together, the evidence suggests that a sizeable proportion of individuals with cancer are willing to consider alternatives to traditional hospital follow-up. In addition, it is clear that groups of health professionals, including GPs and specialist nurses, are willing, with certain caveats, to assume greater responsibility for the routine follow-up of patients with cancer (Grunfeld et al, 1995; Papagrigoriadis and Heyman, 2001; Moses et al, 2004; Cox et al, 2006). Our results seem to strengthen these findings, as they support the notion that GP-led follow-up would be attractive to a large proportion of individuals with melanoma, and their GPs. It is important to be aware, however, that this is just one alternative model for the delivery of cancer follow-up care.

Meaning and implications

Our results show that an integrated programme of routine GP-led follow-up for patients with cutaneous melanoma is feasible, at least in North-east Scotland. Receipt of follow-up in general practice, instead of at the hospital outpatient clinic, did not significantly increase anxiety or depression among participants, or impair their health status, although, as these were secondary outcomes, we had limited power to state this definitively. These, although limited, data are consistent with earlier work suggesting that most recurrent cancers are detected in the interval between routine follow-up appointments. Overall, the data support an emerging literature which suggests that GP-led follow-up confers important benefits in patient satisfaction, without adverse effects on the psychological and physical well-being of patients, at least in the short term. This finding needs to be confirmed in large-scale randomised trials powered on hard clinical outcomes, such as recurrence and mortality.