Introduction

Women with breast cancer and a family history that includes multiple cases of breast and/or ovarian cancer may be referred to familial cancer clinics (FCCs) for genetic assessment and consideration of testing for germ-line mutations in cancer predisposition genes, including BRCA1 and BRCA2 (BRCA1/2). Genetic information provides the context for advice regarding women’s personal future cancer risk and its management, helps to inform treatment decisions regarding their current cancer diagnosis, and provides risk estimations for unaffected blood relatives.1

Historically there has been little urgency for a genetic assessment at initial cancer diagnosis because the outcomes have generally not influenced cancer management in an individual patient.1 However, there is growing evidence that genetic knowledge may influence specific treatment recommendations.1 Hence, women newly diagnosed with breast cancer with high-risk clinical features are increasingly being offered genetic counseling and testing at diagnosis to allow appropriately timed treatment decisions (hereafter “treatment-focused genetic testing” (TFGT)).1 Apart from family history, these features include younger age (≤50 years at diagnosis), triple-negative tumor, bilateral breast cancer, and/or Ashkenazi ethnicity.2

Currently the major contribution of identifying a mutation in a breast cancer predisposition gene is to facilitate the decision between breast conservation or mastectomy, with or without a contralateral mastectomy. The latter two options are associated with large reductions in the risk of ipsilateral and contralateral breast cancer.3,4,5 Two recent studies showed that mutation carriers who underwent bilateral mastectomy (BM) at the time of their first breast cancer diagnosis were less likely to die from breast cancer than women treated with unilateral mastectomy.3,4 BM as a primary surgical treatment also circumvents the morbidity, cost, and recovery time of additional surgeries following delayed genetic testing and may bypass the morbidity, cost, and potentially negative impact of radiation treatment that is in most cases rendered unnecessary after BM. Breast conservation is also a reasonable approach for women, provided appropriate breast screening is available. Finally, carriers should consider risk-reducing bilateral salpingo-oophorectomy (RRBSO), which reduces the risk of ovarian cancer by up to 95%6 and may halve the risk of breast cancer in premenopausal carriers,7 although this has recently been challenged.8

Several studies have shown that knowledge of BRCA1/2 mutation status increases uptake of BM.9,10,11,12 More recently observed survival benefits associated with BM in carriers support the use of genetic testing early in the treatment trajectory.5,9 Furthermore, evidence for targeted therapies, such as poly(ADP-ribose) polymerase inhibitors13 and platinum agents,14 in BRCA1/2-associated breast cancer is accumulating, and the use of TFGT can direct such therapies. The increasing utility of TFGT will translate into additional pressures on genetics services and patient burden,15 driving a need to develop alternative strategies to conventional models of genetic counseling that are both cost-effective and responsive to the time frames demanded in acute cancer management, without compromising informed consent.

This study compared the efficacy of providing brief written education (a pamphlet) about TFGT (intervention group (IG)) in preparing women for decision making about TFGT with conventional pretest, face-to-face genetic counseling (usual-care group (UCG)). Through a noninferiority trial,16 the primary hypothesis tested was that decisional conflict regarding testing choices would not be inferior in the IG compared with the UCG. Secondary aims were instead analyzed using superiority testing to assess the efficacy of brief education on knowledge of TFGT, breast cancer–specific worry, anxiety, depression, family involvement in decision making about TFGT, uptake of BM and RRBSO, and to compare the resource-based costs of the two methods of education about TFGT. Superiority testing was undertaken for secondary outcomes since any difference could be theoretically expected to occur in either direction; for example, removing the extra counseling session could lead to either negative experiences if women feel unprepared or, conversely, positive experiences if the burden or stress associated with another medical appointment is alleviated.

Materials and Methods

Patients

Women were recruited through the breast clinics associated with eight participating FCCs in three Australian states. The methodology of this institutional review board–approved noninferiority randomized controlled trial is described in more detail elsewhere.17 In brief, women aged 18–49 years and diagnosed with breast cancer (early invasive or ductal carcinoma in situ) were eligible if they were proficient in English and had either (i) a strong family history of breast and/or ovarian cancer (FH+) or (ii) no or minimal family history of breast and/or ovarian cancer (FH−) but a personal diagnosis of bilateral breast cancer and/or Ashkenazi Jewish ancestry and/or triple-negative breast cancer. Women were excluded if they had previously undergone genetic testing, a mastectomy, or breast radiotherapy, or if they were diagnosed with distant metastases or lobular in situ carcinoma. The relevant institutional review board at each participating site provided ethics approval.

Procedure

Eligible women were invited to participate by their treating breast surgeon. Participants were offered a choice of completing online or paper questionnaires. Following completion of the baseline questionnaire at time 1 (Supplementary Materials S1 online), participants were randomized to the IG or UCG. Women randomized to the IG were mailed a double-sided A4 trifold educational pamphlet (Supplementary Materials S2 online) developed on the basis of qualitative interviews with younger patients with breast cancer and pilot-tested before commencement of the trial with the target group.18 Participants in both groups chose whether to have TFGT after receiving education about TFGT. TFGT results were available 8 working days from blood draw and was free of charge to the patient.

Approximately 1 week before their appointment to disclose results, women in the IG who elected to have TFGT participated in a telephone “intake” interview with a genetic counselor to ascertain a brief cancer family history. Participants allocated to the UCG also received an equivalent telephone “intake” interview with a genetic counselor before a full pretest, face-to-face genetic counseling appointment.

Participants in both groups completed the questionnaire at time 2 (Supplementary Materials S3 online), within 1 week of receiving education about TFGT. All participants then received their test results in face-to-face appointments at their local FCC. The typical content of the results disclosure appointment has been described previously.17 Participants completed a questionnaire at time 3 (Supplementary Materials S4 online), 2 weeks following disclosure of TFGT results, and another questionnaire at time 4 (Supplementary Materials S5 online) 12 months after study enrollment ( Figure 1 ).

Figure 1
figure 1

Flow of participants through the study.

Measures

Clinical information. Clinical information was collected directly from surgeons and/or pathology reports. Mutation carrier probability was calculated using the Breast and Ovarian Analysis of Disease Incidence and Carrier Estimation Algorithm.19

Health economic data. Surgeons and FCC staff recorded time spent (in minutes) during each patient consultation on pretest genetic counseling (UCG only) and results disclosure, including any necessary preparation time. Salary costs were collected for the different health professionals typically involved in each consultation type (averaged across different Australian states). Costs of developing the educational materials were also collected.

The following measures were included in patient questionnaires: time 1, sociodemographic data and measures (1) to (4); time 2, measures (1) to (4); time 3, measures (3) to (6); time 4, measures (3) to (5), (7), and (8).

  • 1. Decisional conflict scale (DCS): Ten, three-point Likert scale items measured decisional conflict in relation to TFGT choice (scores range from 0 to 100, with higher scores indicating more decisional conflict).20

  • 2. Knowledge of TFGT: Ten true/false items were purposely designed and pilot-tested. Knowledge items are shown in Supplementary Figure S6 online. The total score was the number of correct responses.

  • 3. Impact of Event Scale (IES): Fifteen items measured the frequency and severity of breast cancer–specific worry (range 0–75, with higher scores indicating more worry).21

  • 4. Hospital Anxiety and Depression Scale (HADS): The 14-item HADS has two subscales measuring anxiety and depression.22 Scores range from 0 to 21 for each subscale, with higher scores indicating more anxiety or depression.

  • 5. Test-Related Distress and Positive Experiences: Six items assessed distress (range 0–30) and four items positive experiences of genetic testing (range 0–30),23 with higher scores indicating more distress and positive experiences.

  • 6. Family involvement in decision making about TFGT: One item asked women to indicate which family members were involved in the decision-making process about TFGT, if any.

  • 7. Decision Regret Scale (DRS)—Genetic Testing Choice: The five-item DRS was adapted to measure decision regret in relation to the decision to undergo TFGT.24 Higher scores indicate more regret (range 0–100).

  • 8. DRS—Surgery Choice: Women completed two different versions of the DRS to measure decision regret relating to BM and RRBSO.

Statistical power

Decisional conflict was selected as the primary outcome and subject of noninferiority testing because of its demonstrated impact on actual decisions; for example, several studies that evaluated educational interventions show that lower levels of decisional conflict are associated with follow-through with decisions, and conversely, higher levels are associated with delays.17,20 Our protocol paper specified the noninferiority margin for the primary outcome variable, decisional conflict, as −10 units.17 That is, the IG was considered no worse than (noninferior to) the UCG if the 95% confidence interval (CI) of the mean difference in DCS between the two groups lied wholly above −10 units.17 This trial aimed to obtain recruit 64 patients in each group (128 in total). This would provide 80% power to claim that the intervention is no worse than usual care (i.e., noninferior) with respect to Decisional Conflict Scale scores, assuming the true difference between groups was 0 and a standard deviation of 20 units. The power calculation was based on a t-test for a noninferiority margin of 10 units.

Data analysis

All analyses were conducted in IBM SPSS Statistics 21.0, and results were considered statistically significant when P < 0.05. Variances were similar between the groups that were statistically compared. The primary outcome of decisional conflict and secondary outcome knowledge scores were assessed using linear regressions on scores after education, with scores before education added to the model as a covariate. This approach was prespecified in our published trial protocol and was selected over one using change scores because it has been argued that analyzing only change scores does not correct for any baseline differences due to the potential that those with low scores experienced more regression to the mean, and vice versa for those with initially high scores.25 Linear mixed effects models were used to assess secondary outcome variables, with multiple time points to allow for correlated and missing data. The goodness of fit for each model was compared using a first-order autoregressive covariance structure and an unstructured covariance structure. In all models the former was selected because it provided a better fit. Decision regret regarding TFGT, BM, and RRBSO were analyzed using linear regression, and two categorical outcomes (decision to undergo BM or RRBSO) were analyzed using binary logistic regression.

Results

Participant recruitment

Recruitment took place from July 2010 to October 2012. Sociodemographic, medical history, and family history characteristics of the sample are detailed in Table 1 . Of the 136 women enrolled, all were randomized and all opted to have TFGT. One woman was excluded from analyses subsequent to randomization because her pathology revealed benign proliferative disease; she was not found to have breast cancer.

Table 1 Sociodemographic, medical, and family history characteristics of the usual-care and intervention groups (N = 135)

Of the 135 analyzed, 77 (57.0%) were categorized FH+, with the remainder having other risk factors for BRCA1/2 mutations (FH−). Twenty (14.8%) were identified as BRCA1/2 mutation carriers, 97 (71.9%) had no mutation identified, and 18 (13.3%) received a variant of unknown significance result. Of the 20 mutation carriers, 9 (45.0%) were recruited as FH+ and 7 (35.0%), 3 (15.0%), and 1 (5.0%) on the basis of triple-negative histology, bilateral breast cancer, and Ashkenazi Jewish ancestry, respectively. The IG and UCG included 6 and 14 identified carriers, respectively.

Decisional conflict regarding TFGT (primary outcome)

The unadjusted mean, depicted in Supplementary Figure S6 online, for decisional conflict post education for the IG was 12.34 (95% CI: 9.06–16.33) and for the UCG was 11.52 (95% CI: 7.95–15.61), and when adjusting for baseline decisional conflict, this was 13.17 (95% CI: 9.40–16.93) for the IG group and 10.719 (95% CI: 7.01–14.42) for the UCG group. When controlling for baseline decisional conflict scores, study arm did not predict a statistically significant portion of variance in decisional conflict after education, indicating no difference between the IG and UCG (β = 0.08; 95% CI: −2.87 to 7.76; P = 0.36); a forest plot is shown in Figure 2 . The lower limit of the 95% CI, equivalent to a one-tailed 97.5% for the purposes of noninferiority, for the coefficient of the study arm variable (mean difference score) is greater than the noninferiority margin of −10, suggesting noninferiority of the intervention. Table 2 depicts the mean differences and CIs for decisional conflict and all other psychological outcomes.

Figure 2
figure 2

A forest plot depicting the prespecified noninferiority margin and the confidence interval around the difference between the intervention and usual-care groups.

Table 2 Mean difference (95% confidence interval) for the primary and secondary outcomes at baseline, after education, and 2 weeks and 1 year after receipt of results

Secondary psychological outcomes

Supplementary Figures S8 to S14 online show the means for secondary outcomes. Study arm did not predict a significant proportion of variance in knowledge after education when controlling for baseline knowledge (β = −0.06; 95% CI: (−2.87 to 7.76; P = 0.49). There was no significant difference in breast cancer–specific worry scores between study arms (d = 0.19; P = 0.27), and there was no significant study arm × time point interaction (P = 0.42).

There was no significant difference in HADS-Anxiety scores between study arms (d = 0.15; P = 0.37), and there was no significant study arm × time point interaction (P = 0.21). There was no significant difference in HADS-Depression scores between study arms (d = 0.03; P = 0.86), and there was no significant study arm × time point interaction (P = 0.52).

There was no significant difference in test-related distress between study arms (d = 0.16; P = 0.38), and there was no significant study arm × time point interaction (P = 0.50). There was no significant difference in test-related positive experiences between study arms (d = 0.11; P = 0.55), and there was no significant study arm × time point interaction (P = 0.65).

There were no significant group differences in terms of family involvement in decision making about TFGT, with 40.3 and 32.3% in the IG and UCG reporting family involvement, respectively (χ2 = 0.87; P = 0.35). Participants named their spouse or partner, followed by their mother and then sister, most often as the family member who contributed to their decision-making process.

Uptake of, and decision regret regarding, BM and RRBSO at 12 months

At 12 months after enrollment, no differences were found between the IG and UCG in decision regret about having TFGT (β = −0.04; P = 0.69), BM (β = 0.02; P = 0.87), or RRBSO (β = −0.02; P = 0.88). There were no significant differences between the two groups for uptake of BM: IG, n = 22 (34.4%) and UCG, n = 25 (36.4%) (odds ratio = 1.16; 95% CI: 0.57–2.38; P = 0.68; Supplementary Table S15 online). The numerically higher uptake of RRBSO in the UCG (n = 11, 17.2%) compared with the IG (n = 6, 9.4%) must be considered in the context of the uneven distribution of carriers in the UCG (n = 12) and IG (n = 6); however, there were no significant differences in uptake of RRBSO between the UCG and IG (odds ratio = 2.04; 95% CI: 0.71–5.90; P = 0.19). A sensitivity analysis determined that controlling for mutation status did not affect either surgical logistic regression.

Health economic comparison

Table 3 compares the resource costs associated with each mode of education. The total cost per woman counseled in the IG was significantly lower (AUD$90) compared with the UCG (AUD$173) (t(114) = 5.93; P < 0.001). Development costs and pilot-testing of the education pamphlet (62 h of research staff time) amounted to AUD$3,165 (AUD$49/patient). If the developmental cost is included in the comparison, the cost per woman counseled in the IG is AUD$137, which remains significantly lower than for the UCG (t(114) = 2.48; P = 0.014).

Table 3 Comparison of costs associated with each mode of information delivery

Of the 135 participants included in the analyses, 109 also returned the 12-month questionnaire (follow-up rate of 80.7%). No significant differences were found between participants who completed all questionnaires and those who did not in terms of baseline psychological characteristics, age, and educational level.

Discussion

Given the climate of increasing cost constraints in health care in conjunction with the rapidly increasing demand for timely genetic testing in general, and TFGT in particular,26 the development of alternative cost-effective clinical service models is critical. Several alternatives to conventional face-to-face genetic counseling have been shown to be feasible, including videoconferencing,27 telephone genetic counseling,28 computer/Internet-delivered education,29 and/or a combination of delivery methods.30 However, a dearth of data is currently available on the cost-effectiveness of these strategies.28

In this trial we tested an alternative streamlined model of service provision that incorporates brief written education about TFGT in place of conventional pretest genetic counseling. As hypothesized, we found that this was not inferior when compared with usual care in terms of the primary outcome of decisional conflict about testing choice. Also, as predicted, we found a significantly lower cost of providing brief education compared to face-to-face pretest genetic counseling. Thus this streamlined model of educating women about TFGT seems to be a cost-effective way of informing women newly diagnosed with breast cancer about TFGT while ensuring that women feel informed and supported in their decision making about genetic testing.

To our knowledge, this study is the first to include a substantial proportion of women offered TFGT based on features other than a family history of cancer. Women with no or minimal family history of cancer are unlikely to be aware that they are at risk of carrying a mutation and may experience higher levels of distress if identified as mutation carriers, compared with those with a strong family history. Women receiving a variant of unknown significance result may also be more vulnerable to adverse psychological sequelae arising from TFGT, given that they continue to live with uncertainty.31

Before discussing the clinical implications of this study, its limitations should be mentioned. It was not possible to blind patients and clinicians at participating FCCs to randomization status, which may have introduced bias. All participants in this trial opted to receive their TFGT results, and it is therefore likely that participants are self-selected for interest in genetic testing and may not be fully representative of the larger group of younger women newly diagnosed with breast cancer. However, the study was not designed to measure uptake of TFGT among this larger group, and other studies have documented uptake rates, for example, among consecutively recruited samples.32 Nevertheless, study findings are generalizable to those women most likely to take up TFGT when offered. The majority of women (94.5%) reported speaking mostly English at home, and thus generalizability to cultural and linguistic minorities is limited. Similarly, women were younger than 50 years of age, and might have greater genetic literacy; hence findings need to be replicated with older women. Moreover, multigene panel testing has been introduced in the nonacute setting in some countries,33 and the results reported may also need replicating in the multigene panel setting. In addition, the generalizability of findings to countries without national health services may be limited.

Finally, this study compared a particular model of genetic testing (no pretest genetic counseling followed by posttest face-to-face genetic counseling for all women) with traditional face-to-face pre- and posttest counseling. The clinical context is changing rapidly, and other models that involve a combination of face-to-face, telephone, and/or telehealth pre- and posttest counseling are being increasingly used alongside traditional face-to-face pre- and posttest genetic counseling34; even an invitation for women with ovarian cancer to have TFGT by mail has been implemented.8 However, the efficacy of these new models has not been rigorously evaluated, with the exception of pre- and posttesting telephone genetic counseling.28

In the US environment, much treatment-focused genetic testing already occurs outside of specialist genetics services, with access to and the extent of genetic counseling likely to vary between individual oncology units; outside of the United States, however, most genetic testing still occurs within the specialist genetics setting; this study provides support for a more targeted approach to this group of patients with a treatment decision influenced by a genetic test result. The number of carriers included in the study was small, and the study was not powered to detect differences by mutation status in important outcomes, such as regret after receipt of results. Finally, two trials were published after our protocol using a more conservative decisional criterion of four units, suggesting support for this more conservative margin.28,35 However, it is important to note that even using this criterion, our results would still be considered noninferior.

Our study also has important strengths, including a high follow-up rate at 12 months (83.5%) and a lack of differences between those lost to follow-up and those retained; surgical outcome data were still available from file review for most of those lost to follow-up. Women were recruited from multiple FCCs across several states, each with different state-based health-care delivery; such heterogeneity of ascertainment indicates a high generalizability of the findings.

Clinical implications

The current model of pretest genetic counseling and testing provided by FCCs uses an approach derived from genetic testing for nonmalignant diseases, where knowledge of mutation status typically does not influence immediate treatment. By contrast, clinical contexts where genetic testing results can have direct implications for treatment and clinical management require streamlined service models if the results of germ-line genetic testing are to become fully integrated into cancer care. Recent surveys show that non–genetics health professionals, including surgeons, radiation oncologists, and medical oncologists, have positive attitudes and experiences with TFGT,36,37 indicating that involvement in the delivery of education should be acceptable to such health professionals. Findings from this study indicate that brief education, delivered in the context of a surgical/oncological consultation, could be a safe and effective way of informing women newly diagnosed with breast cancer about TFGT. This service model could serve as a basis for developing similarly cost-effective models in other acute cancer settings, such as in the context of reflex tumor screening for mismatch repair deficiency associated with Lynch syndrome.38

Disclosure

The authors declare no conflict of interest.