Main

The Oncotype DX 21-gene assay is validated to predict benefit from chemotherapy in women with early breast cancer (Paik et al, 2006; Albain et al, 2010). It is included in the American Society of Clinical Oncology (Harris et al, 2007) and National Comprehensive Cancer Network (NCCN Clinical Practice Guidelines in Oncology Breast Cancer, 2011), ESMO (Aebi et al, 2010) and St Gallen guidelines (Goldhirsch et al, 2011) as an adjunct to decision making for oncologists when considering the appropriateness of chemotherapy.

This study looks at the impact if this test were to be adopted for all node negative or micrometastatic, oestrogen receptor (ER)-positive women fit for chemotherapy in the setting of the UK National Health Service. We looked at the effect on chemotherapy prescribing (decision impact), the acceptability to patients of applying this test (decision conflict analysis) and assessed the cost-effectiveness in terms of cost per quality-adjusted life year (QALY).

Materials and Methods

A total of 150 tests were available to five oncologists working in one cancer centre in West Wales. Women with excised ER-positive (Allred score 3/8 by immunohistochemistry IHC) and node-negative (pN0, pN0i+) invasive breast cancer or with minimal node involvement (pN1mi) were identified at the multidisciplinary team meetings as being suitable for testing and oncologists were encouraged to include them even if initial assessment suggested they were at very low risk of recurrence, so as to best reflect testing of this whole cohort. At their initial consultation with their oncologist, patients were assessed for fitness to receive chemotherapy, if recommended. Women under 18 years, pregnant, unable to comprehend the details of the trial, unable to complete the documentation in English or who had a previous history of breast cancer treatment were excluded. Participants were asked to provide signed informed consent before inclusion in the trial. The Hywel Dda Health Board Research and Development Committee and Dyfed Powys Ethics Committee approved the study.

Decision impact study method

Once the full post surgical histopathology results were available, each patient was seen by her oncologist to discuss adjuvant therapy. With this information (size, grade, type, ER, progesterone receptor (PR), HER2 and node status) and with added information from Adjuvant! online, the oncologist discussed chemotherapy with the patient. A written recommendation for or against chemotherapy was made at the conclusion of the consultation taking into account both the patient’s and the oncologist’s views. The Oncotype DX test was requested and a second meeting between the patient and her oncologist was scheduled once the result was available. The Recurrence Score result was reviewed and this information was added to the clinical data already available and a final decision for or against chemotherapy recorded.

Decision conflict study methods

During the latter half of the study, patients seen at one institution were asked to complete a 16-item decision conflict questionnaire immediately following their pre- and post-Oncotype DX consultation. The Decision Conflict Scale (DCS) was based on a 16-item questionnaire. Each item was scored as: 1=‘strongly agree’, 2=‘agree’, 3=‘neither agree nor disagree’, 4=‘disagree’ and 5=‘strongly disagree’. The total score was based on all 16 items. There were five subscores (informed, values clarity, support, uncertainty and effective decision). The User Manual for the DCS specifies that each subscore and the total score should be calculated by averaging the responses to the relevant items, and scaling each score 0–100. Smaller scores reflect less decisional conflict. The following method was used for this analysis:

  • A subscore was calculated only if there were responses to at least two items.

  • If any subscore was missing, then no total score was calculated.

From the total and the five subscores, the means and the mean changes were calculated for each questionnaire. A paired t-test was used to assess the significance of any change between pre- and post-testing scores.

Cost-effectiveness method

The analysis was performed using a Markov model (based on a previously published model by Hornberger et al, 2005) consisting of three states with a cycle length of 1 year (incorporating half-cycle correction). All patients begin the model in the recurrence-free state, and may transition to recurrence (following a distant recurrence event) or death (following a mortality event).

The analysis compared two approaches to inform treatment recommendations for adjuvant therapy: (1) Conventional diagnostic procedures (including Adjuvant! Online and the Nottingham Prognostic Index) and (2) the Oncotype DX assay. In the Oncotype DX arm, treatment recommendations were then reviewed following availability of the Recurrence Score result (Holt et al, 2011).

In each cycle of the simulation, patients were exposed to the competing risks of mortality and recurrence. Clinical input data were derived from landmark Oncotype DX studies for the risk of recurrence, and mortality rates were taken from UK-specific life tables.

In each cycle of the model, recurrence risk for each simulated patient is evaluated based on the Recurrence Score category (low, intermediate or high, as reported by Paik et al, 2006; Figure 1). Risk was then adjusted based on whether patients were receiving chemotherapy as per initial recommendations (in the usual care arm) and based on the Recurrence Score result (in the Oncotype DX arm). A summary of clinical variables used in the model is shown in Table 1.

Figure 1
figure 1

Structure of the cost-effectiveness model.

Table 1 Summary of clinical variables used in the cost-effectiveness model

Costs, utilities, discounting and time horizon

All patients were asked to complete a diary of medical interactions over the 6 months following inclusion in the study. Hospital notes and electronic chemotherapy prescription records were also used to estimate the total cost of chemotherapy for the cost-effectiveness analyses. All other treatment costs used in the model were derived from UK-specific sources and were inflated, where necessary, to 2010 GBP using the Hospital and Community Health Services pay and price inflation index. Unit costs used in the model are summarised in Table 2. The utility scores used in the model were derived from published literature. Mean (s.e.) utility scores used in the model for the recurrence-free state, recurrence state and chemotherapy treatment (6 cycles) were 0.78 (0.03), 0.60 (0.03) and −0.07 (0.01), respectively (Conner-Spady et al, 2005; Milne et al, 2006; Peasgood et al, 2010).

Table 2 Summary of treatment/management costs for patients receiving chemotherapy and those not receiving chemotherapy

Adverse event rates for the first 5 years of endocrine therapy were also accounted in the model based on published data (Hind et al, 2007). In relation to adverse events, the following assumptions were made:

  • 40% patients with vaginal bleeding received an ultrasound scan, 40% received a hysterectomy and 20% received both

  • Patients with endometrial cancer received the same diagnostics and treatment costs as for vaginal bleeding, plus all patients received a hysterectomy and 50% received radiotherapy

  • 0.4% patients with deep vein thrombosis developed pulmonary embolism

  • 80% of ischemic cerebrovascular events were assumed to be strokes, the remaining 20% were assumed to be transient ischemic attacks and only first year costs were included for both stroke and transient ischemic attack

The analysis was performed over a time horizon of 30 years and future costs and clinical outcomes were discounted at a rate of 3.5% per annum in line with current UK recommendations.

Sensitivity analyses

A series of one-way sensitivity analyses were performed to establish key drivers of outcomes. Most clinical and cost parameter inputs in the model were varied by ±25% (with the exception of discount rate and time horizon). Sensitivity analyses were performed using a discount rate of 0 and 6% per annum for both future costs and clinical outcomes. Other one-way sensitivity analyses performed included changing the time horizon to 10, 20 and 40 years (in comparison with 30 years in the base case), assuming that the cost of chemotherapy was based on five cycles per regimen (versus six cycles in the base case), varying the disutility of chemotherapy to 0.037 (Conner-Spady et al, 2005) and 0.5 (Simes and Coates, 2001), and changing the utility value for the recurrence state to 0.51 (Milne et al, 2006). Other one-way sensitivity analyses were performed around the proportion of patients on chemotherapy receiving growth colony-stimulating factor prophylaxis, post-recurrence survival rates and 10-year recurrence risks.

To test the robustness of the model and assess measures of likely variance around outcomes reported in the base case, probabilistic sensitivity analysis (PSA) was performed. Here, sampling of recurrence risks and relative risk reductions was performed from normal distributions, with variance defined based on published data (Table 1); for the PSA, a total of 1000 iterations were run.

Results

Of the 146 patients enrolled, 4 were excluded: 1 patient withdrew from the trial before the result was available and the tissue samples for 3 patients did not meet pathology review criteria for the assay. Of the 142 patients who were evaluable for the final analysis, 2 failed the first assay but yielded a reportable result on a second block, and 1 patient had bilateral breast cancer with both tumours giving the same score. The patient characteristics are summarised in Table 3. The median age was 55 years (range 34–72). The tumour was removed in 112 of the women by wide excision and 30 by mastectomy, 5 with immediate reconstruction.

Table 3 Patient characteristics

Patients receiving chemotherapy had significantly higher total mean (s.d.) treatment and management costs in comparison with those not receiving chemotherapy (GBP 20418 (13 053) versus GBP 9987 (7577); P<0.00; Table 2). This was primarily driven by the costs of chemotherapy drugs, although patients receiving chemotherapy also incurred significantly higher costs attributable to district nurse visits and hospital stays.

Decision impact results

Initially, 57 (40.14%) of the 142 patients were recommended chemotherapy and hormone therapy. In 26 of these 57 patients (45.61%), treatment was revised to hormone therapy alone after the RS was made available. The remaining 85 (59.86%) patients were initially advised that hormone therapy alone would be sufficient, but, after review of the RS, 12 (14.12%) of these were advised chemotherapy as well. Overall, the chemotherapy decision was changed after Oncotype DX testing in 38 (26.76%) of patients representing an overall reduction in chemotherapy recommendation in 14 of 142 patients (9.9%). In the low RS group, 26 of 79 patients were initially recommended for chemotherapy, of which 23 were then recommended against (−88.4%). In the intermediate RS group, 16 of 39 patients were initially advised chemotherapy, which was increased to 19 on receipt of the results (+18.6%). In the high RS group, 15 of 24 patients were initially recommended chemotherapy, which was increased to 21 (+40%). The final chemotherapy recommendations were 3 of 79 (3.7%) in the low RS group, 19 of 39 (48.7%) in the intermediate RS group and 21 of 24 (87.5%) in the high RS group. The results are summarised in Table 4.

Table 4 Summary of decision impact results

Decision conflict results

Of the 45 patients who completed initial DCS questionnaire, 44 completed all 16 items and 1 patient missed 9 items. This left 44 patients in whom a total score could be calculated. In all, 41 patients completed the subsequent DCS questionnaire, of whom 40 completed all 16 items and 1 missed 9 items, leaving 40 patients with fully completed questionnaires. There were 39 patients with DCS total scores from both initial and subsequent questionnaires all of which had all 16 items completed for both. The results are summarised in Table 5. Statistically significant decreases from initial to subsequent DCS scores were noted in the total score, informed and uncertainty subscores and non-significant changes in the values clarity, support and effective decision subscores.

Table 5 Summary of decision conflict results

Cost-effectiveness results

The use of Oncotype DX testing was projected to increase mean life expectancy by 0.16 years and quality-adjusted life expectancy by 0.14 QALYs compared with current clinical practice in N0 and pN1mi early-stage breast cancer. The benefits in terms of improved quality-adjusted life expectancy were driven by optimised allocation of adjuvant chemotherapy in terms of chemotherapy sparing in patients unlikely to derive clinical benefit and ensuring patients likely to benefit received chemotherapy. In terms of cost, the mean total direct cost in the Oncotype DX group was GBP 12 735 compared with GBP 11 847 in the current clinical practice group (difference GBP 888). Assessment of cost-effectiveness showed that the use of Oncotype DX was associated with an incremental cost-effectiveness ratio (ICER) of GBP 6232 per QALY gained and GBP 5633 per life year gained in comparison with current clinical practice (Table 6).

Table 6 Summary of cost-effectiveness results

The results of one-way sensitivity analyses identified the key drivers of outcomes as patient age, the cost of Oncotype DX testing and changes in chemotherapy recommendations for patients deemed to be at low risk of distant recurrence. The benefit of chemotherapy in the intermediate risk group is unknown, but, even if it is assumed to be zero, univariate analysis around this parameter shows a change in ICER from base case of +£551 per QALY to £6783 (Figure 2).

Figure 2
figure 2

Tornado diagram showing results of one-way sensitivity analyses.

The single biggest driver of outcomes was patient age; decreasing the mean age to 45 years (versus 60.55 years in the base case) led to an ICER of GBP 4628 per QALY gained, whereas increasing patient age to 75 years led to an ICER of GBP 16 537 per QALY gained. The results were largely robust to changes in input assumptions regarding changes in chemotherapy use in patients with high RS score, the cost of managing adverse events and the disutility associated with chemotherapy. The results of PSA showed that there was a 99.6% probability that the Oncotype DX assay would be considered cost-effective in comparison with current clinical practice in the UK setting, assuming a willingness to pay threshold of GBP 20 000 per QALY gained.

A comparison of costs and cost differences between patients receiving and not receiving chemotherapy as calculated using the patients’ diary of events, notes and prescriptions and the results summarised in Table 7 showed that the total economic cost to the NHS of testing this cohort of 142 patients was £220 326.

Table 7 Estimated total economic impact to the National Health Service of testing this cohort of patients

Discussion

The use of adjuvant chemotherapy following complete surgical excision has proven survival advantages particularly for patients with a poor prognosis where the potential advantage is greatest. However, identifying individual patients who can derive benefit from chemotherapy is challenging but assuming greater importance not only for economic reasons but also because of the increasing concern about overtreatment of women in the national screening programme. Quantitative analysis of gene expression in tumours has the potential to identify those responsive to chemotherapy and as such provides an excellent example of personalised medicine. The Oncotype DX assay looks at the expression of a panel of 16 tumour-related genes (and 5 reference genes) and can predict chemotherapy benefit rather than simply prognosis.

The trial was intended to include all eligible women sequentially, although at review after the first third of the cases were recruited, some case selection was evident. After clarification with the oncologists subsequent recruitment followed the protocol much more closely. We interpret the results as broadly reflecting the effect of unselected testing in this group.

This decision impact study performed in 142 patients with early-stage ER+ node-negative breast cancer shows that use of the Oncotype DX assay has a notable impact on chemotherapy prescribing, resulting in changes in treatment recommendations in 26.8% (n=38). In particular, 45.6% of patients initially recommended both chemotherapy and endocrine therapy had their treatment recommendation changed to endocrine therapy alone when their tumour returned a low or low-intermediate RS. This group of patients was not only spared the considerable inconvenience, risk and personal economic impact of chemotherapy but also the unknown long-term effects.

Of the 85 patients initially recommended hormone therapy alone, 12 (14.1%) were advised to receive chemotherapy in addition following Oncotype DX testing, which returned a high intermediate or high recurrence score. Although these patients were fewer in number, they are, arguably, the most important group to identify because they are most likely to benefit from testing. Although we thought these patients might be the most difficult to manage, they were, in the event, the most grateful, realising that they would otherwise have been deprived of treatment which would reduce their risk of relapse.

The UK figure of 27% change in treatment recommendations in node-negative ER+ women compares with similar impact studies carried out in Europe with Germany showing a 33% change (Eiermann et al, 2012), Spain 32% (Albanell et al, 2012a), France 34% (Gligorov et al, 2012) and the European meta-analysis of those studies 31.9% (Albanell et al, 2012b). Oncotype DX testing in one centralised laboratory is likely to contribute to this consistency.

Although only about one-third of the patients were asked to complete questionnaires, decision conflict was also assessed in the present analysis, the results of which suggest that the use of Oncotype DX gives patients increased confidence in their treatment decision. These results represent a 28% reduction in the DCS total score, which concurs with the analysis of Lo et al (2010), in which a 30% reduction was observed.

A number of cost-effectiveness analyses of the Oncotype DX assay for other settings, including the Unites States, Canada, Japan, Israel and Germany, have been published (Hornberger et al, 2005; Lyman et al, 2007; Klang et al, 2010; Kondo et al, 2011; Blohmer et al, 2012; Lamond et al, 2012). These previous analyses have shown that use of the Oncotype DX assay is cost-effective (or cost-saving in the United States and Germany) from the perspective of a third-party payer, with clinical benefits being primarily driven by the sparing of chemotherapy. The results of the current analysis concur and suggest that the Oncotype DX assay can be considered to be cost-effective in the UK setting in comparison with current clinical practice.

The greatest change in the ICER value occurred when mean patient age was increased to 75 years. This led to an ICER of GBP 16 537 per QALY gained for Oncotype DX versus current clinical practice. However, even in this scenario, it is likely that Oncotype DX could be considered cost-effective in comparison with current clinical practice. The substantial increase in ICER with increasing baseline patient age is attributable to competing mortality.

The budget impact calculation is expected to be an over estimate of the actual impact of the introduction of Oncotype DX testing owing to a number of factors. First, the present study enrolled near consecutive patients, a number of whom would not be expected to receive the test were it introduced in the NHS. Indeed, in the United States where the test is broadly reimbursed since 2005, a recent review of patterns of care reports that in real-life clinical practice, physicians tend to select patients to whom they offer the test and not all potentially eligible patients receive it (Winer and Sparano, 2011). Second, HER2-positive patients (four cases, 2.8%) were included in this study, but experience shows that testing this group is unnecessary as HER2 positivity is a reliable predictor of high recurrence score and, in any case, few oncologists would deprive these patients of the benefit of chemotherapy. Therefore, the total acquisition costs of the test would be reduced, lessening the impact on health-care spending.

Reviewing the patient characteristics in this cohort shows that women with low grade, ER and PR strongly positive tumours, or high grade, ER or PR less than 7/8 positive, are least likely to have their adjuvant therapy decisions changed by the Oncotype DX assay (Table 3). If testing in this series had been restricted, first, to women scheduled for chemotherapy and, second, to those not recommended chemotherapy with grade 2 or 3 tumours and PR by IHC 6/8 or less, then 92% or the changes would have been captured and 41% of the cost of testing spared. Furthermore, the budget impact analysis only captures short-term costs, such as the costs of chemotherapy and the acquisition cost of the test, whereas the cost-effectiveness analysis examines the long-term impact of the test. Consequently, budget impact is driven by chemotherapy cost savings when patients change adjuvant chemotherapy recommendation, whereas the cost-effectiveness results also incorporate recurrences avoided, the costs of which are not captured in the budget impact analysis. As the Oncotype DX assay identifies patients who would be undertreated through not receiving chemotherapy under current practice, the costs of recurrence would be expected to be lower in the analysis where the test was used. For these several reasons, we conclude that the presented impact on health-care spending is an over estimate.

The current analysis was performed from a third-party payer perspective, and as such only takes into account the direct economic costs to the NHS. It does not take into account the impact of indirect costs associated with travel, lost work time and treatment costs associated with long-term side-effects. The current analysis does not capture long-term productivity; one of the strongest predictors for not returning to work after treatment for breast cancer is receipt of chemotherapy (Johnsson et al, 2009). Breast cancer and breast cancer treatment also have a notable impact on personal life, family life and a wider impact in terms of loss to employers and prolonged sickness benefits from the state. These have not been taken into account in this study.

In conclusion, decision impact analysis has shown that the use of the Oncotype DX assay has a considerable influence on chemotherapy treatment recommendations in patients with ER+ early-stage breast cancer. It is associated with substantial chemotherapy sparing in patients likely to derive little or no benefit from treatment and assists in the identification of patients currently considered at low risk who will in fact benefit from chemotherapy. Cost-effectiveness evaluation shows that the use of the Oncotype DX assay is associated with improved life expectancy and quality-adjusted life expectancy in comparison with current clinical practice and is likely to be cost-effective in the UK using current thresholds.