Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Development and pilot of an online, personalized risk assessment tool for a breast cancer precision medicine trial

Abstract

Breast cancer risk reduction has been validated by large-scale clinical trials, but uptake remains low. A risk communication tool could provide personalized risk-reduction information for high-risk women. A low-literacy-friendly, visual, and personalized tool was designed as part of the Women Informed to Screen Depending On Measures of risk (WISDOM) study. The tool integrates genetic, polygenic, and lifestyle factors, and quantifies the risk-reduction from undertaking medication and lifestyle interventions. The development and design process utilized feedback from clinicians, decision-making scientists, software engineers, and patient advocates. We piloted the tool with 17 study participants, collecting quantitative and qualitative feedback. Overall, participants felt they better understood their personalized breast cancer risk, were motivated to reduce their risk, and considered lifestyle interventions. The tool will be used to evaluate whether risk-based screening leads to more informed decisions and higher uptake of risk-reduction interventions among those most likely to benefit.

Introduction

The development of risk models has not led to the uptake of risk-reducing interventions, such as endocrine risk-reduction1. Large-scale clinical trials of selective estrogen receptor modulators and aromatase inhibitors show benefit in high-risk women for reducing both invasive and non-invasive breast cancer incidence2,3,4,5,6,7,8,9. However, initial studies of quality of life have significantly underrepresented the significant side-effects of medications, which impact a patient’s willingness to consider risk-reduction3,5,6,10. These side-effects include menopausal symptoms, thromboembolism, and endometrial cancer risk; recent literature suggests these possibly correlate with dosage11,12,13. In addition to risk-reducing medications, several studies have demonstrated that lifestyle interventions also may reduce the risk of breast cancer14,15,16,17,18,19.

Risk-reduction strategies are only useful if women are aware that they are estimated to have high risk and benefits outweigh the risk of side-effects20,21. The US Preventive Services Task Force (USPSTF) guidelines recommend the use of clinical risk models to assess women of high risk22. Early models were first created by Gail and used in the Breast Cancer Risk Assessment Tool23,24. Since then, models such as the Tyrer-Cuzick, Breast and Ovarian Analysis of Disease Incidence and Carrier Estimation Algorithm (BOADICEA), and the Breast Cancer Surveillance Consortium (BCSC) have enhanced prior models by incorporating mammographic density for their 5- and 10-year risk projections19,25,26. Model modifications integrating genetic risk have been put into practice27,28,29. The BCSC model has been validated in a diverse population of over 1 million women across the United States.

In a review of available breast cancer risk assessment tools, we found the following barriers to informed adoption of endocrine risk reduction:

First, it is difficult to understand personal risk and whether the risk of side-effects outweigh the benefits. Prior risk assessment tools have attempted to make breast cancer risk information more readily accessible for primary care physicians to use online30,31. The development of these frameworks has been beneficial, but these tools are often provider facing, and do not improve the ability of patients to understand the information.

Second, most online, patient-facing tools do not incorporate an individual’s genetic testing information that would be needed to personalize risk information32,33. As advances in next-generation sequencing (NGS) became cheaper in the precision medicine era, they accelerated the access to and use of broader germline gene panels to assess individual risk. Tailoring risk-reduction based solely on standardized factors included in the Gail, Tyrer-Cuzick, and BCSC models was not as comprehensive. However, as the use of NGS increases, so does the need for risk assessment tools to explain and interpret personal genetic and polygenic risk in a meaningful way for patients.

Third, risk assessment tools need to make risk and risk-reduction information readily understandable. A study identified that 63% of patient educational materials randomly sampled from MedlinePlus/National Library of Medicine were above the reading level of an average United States resident (eighth-grade equivalent or below, based on the Flesch-Kincaid scale)34,35,36,37. This suggests that risk information would not be easily understood by those with lower health literacy. Decision scientists suggest the use of natural frequencies and absolute risk help patients understand medical risk38,39.

Members of our research team (E.O., L.J.E.) had previously developed a risk assessment tool to guide and inform high-risk consultations in breast cancer30,40. The risk assessment tool described in this paper aims to improve upon this previous tool30. We will test the efficacy of the tool in the Women Informed to Screen Depending On Measures of risk (WISDOM) study, a precision medicine trial administered by the Athena Breast Health Network28.

Results

Finalized risk assessment tool

The prior version of the computer-based risk assessment tool inspired the development of five primary pages30. Each page allowed the participant to build an increasingly nuanced understanding of their risk and ways of mitigating their risk. Following iterative initial user testing with the multidisciplinary advisory board and visual/software changes to incorporate their feedback, the five primary pages developed were:

  1. 1.

    My risk snapshot: Reviews risk calculation inputs, as provided by participants in a WISDOM Study Breast Health Questionnaire, that are used to calculate both the Gail and BCSC scores. For each input, the page provides the user-submitted information for age, race, family history, breast biopsy history, and breast density. The page also explains the WISDOM Study’s personalized screening recommendation, risk calculations, and polygenic risk score.

  2. 2.

    My risk report: Uses both natural frequencies and icon array diagrams to provide the risk of developing breast cancer versus an average woman of the same age and race/ethnicity. The participant can toggle between 5-year, 10-year, and lifetime risks, or compare all of them simultaneously (Fig. 1).

    Fig. 1: My risk report.
    figure1

    This primary page compares a participant’s five-year, ten-year, and lifetime (estimated to age 90) risk of developing breast cancer in comparison to an average woman of the same age and race/ethnicity.

  3. 3.

    Putting risk in perspective: Uses natural frequencies and diagrams to contrast a woman’s risk of developing breast cancer over 10 years in the context of other common morbidities such as heart attack and stroke (using SEER program data estimates).

  4. 4.

    Risk-reducing strategies: Provides both medication, lifestyle, and surgical options for women to reduce their risk of breast cancer. If rigorous, peer-reviewed information is available, we also provide the estimated absolute risk-reduction from performing that intervention. Each medication and lifestyle intervention link to secondary pages (Fig. 2) that include information on side-effects or benefits. Each strategy is personalized based on a woman’s menopausal status, age, or Breast Health Questionnaire inputs.

    Fig. 2: Detailed page on medication.
    figure2

    This is an example of a secondary page that includes detailed information on side-effects and benefits. Each strategy is personalized based on a participant’s menopausal status, age, or questionnaire inputs. Participants can toggle through different aromatase inhibitors and selective estrogen receptor modulators (SERMs) that might be appropriate for them.

  5. 5.

    Exploring what changes my risk: The tool summarizes in a graphical form the different risk-reducing strategies presented on the “Risk-reducing strategies” page. Each absolute risk score is modified based on the estimated change to breast cancer risk (Fig. 3).

    Fig. 3: Exploring what changes my risk.
    figure3

    This is an example of a primary page summarizing how different risk-reducing strategies impact a participant’s absolute breast cancer risk.

Participants were also given the option to view more information via hyperlinks given on primary pages. A PDF version of an individualized risk information/report was accessible on the final summary page of the tool. Peer-reviewed articles used to develop each primary page were also compiled. All references were linked and available on secondary landing pages.

Reading ease and grade level36 of the pages are shown in Table 1. The grade level was 8 and below for all pages. Reading ease varied from a low of 53.8% to a high of 90.2%.

Table 1 Page description and calculated readability.

Pilot study participants

A convenience sample of 20 elevated risk WISDOM Study participants was identified in the personalized arm without a breast cancer mutation (namely BRCA1, BCRA2, TP53, PTEN, STK11, CDH1, ATM, PALB2, CHEK2). These women were all classified as elevated risk, in the top 2.5% of BCSC score by age. A total of 17 women responded to the invitation to participate in the walk-through with a genetic counselor. Demographic data were obtained from self-reported responses in the WISDOM Breast Health Questionnaire administered at baseline enrollment and re-assessed in follow-up years (Table 2). Women who participated in the pilot study were mostly white, college-educated or higher, and between ages 40 and 74.

Table 2 Demographic distribution of pilot participants.

Quantitative pilot results

Of the 17 participants who were given the walk-through of the tool with a genetic counselor, 14 participants agreed to respond to the quantitative survey (Table 3). All 14 participants indicated that they had a better understanding of their breast cancer risk after using the personalized risk assessment tool. 13 of the 14 participants indicated that the tool helped facilitate their understanding of risk; 6 participants indicated that the tool was “Extremely helpful” while 7 participants indicated that it was “Very helpful” for them to understand their breast cancer risk.

Table 3 Quantitative feedback survey responses.

Of the 14 participants, 10 indicated that they were “Extremely motivated” or “Very motivated” to reduce their breast cancer risk. Of those, 6 were interested in taking risk-reducing medication. 10 women indicated they were considering lifestyle modifications to reduce their risk, such as exercising, decreasing alcohol intake, and reducing their body mass index. 1 participant indicated that she is considering surgical options.

Qualitative pilot results

From the pool of 14 participants who gave quantitative feedback, 10 participants agreed to provide qualitative feedback. Similar to the responses in the quantitative survey, most women report benefiting from the tool’s visual content.

Nine out of the 10 interviewed women had positive comments about the visuals. Five women specifically mentioned that they were visual learners with comments including:

“Just [talking] on the phone would not have had as big of an impact… I see the visuals in my mind, as I think back”.

“I’m a visual learner and for others who are, having a knowledgeable professional walk you through the infographics simplified the understanding process”.

Four women emphasized how the visuals accompanying the physician’s verbal explanations improved their knowledge retention, with one stating that she liked the process of the doctor guiding her through the tool while being able to visually see the tool being used. Two women stated that they could not “un-see” what was shown in the tool, so “seeing it [the visuals] was a motivating factor.”

Four women particularly liked the My Risk Report page (Fig. 1), which displayed the participant’s specific risk of developing breast cancer. One participant said in detail:

“[I] like the side-by-side comparison of me versus an average 40-year-old. That helped make a connection and gives you a scale visually. For people for whom numbers are abstract…that stark reminder is good. Seeing the picture makes it click.”

Five of the interviewed women learned more about their risk, with two realizing that their risk was higher than they previously thought. One of them stated:

“I never gave too much thought to my personal risk… no one in my family has breast cancer…presumed my risk was low. I had no idea that breast density was a risk factor and the consequences of that.”

Three participants were not aware of risk-reduction medications before their risk assessment consultation. One stated that:

“I was completely unaware about medication-related therapy. I had no idea that there were prescription medications to reduce your risk. I am not sure if I’m particularly interested in starting at this moment, but I would look into finding out more about the risks and side-effects for the benefits.”

Five participants plan to speak with their providers about risk-reduction medications. One participant discussed learning about them for the first time:

“[I] had no idea that there were medications one could take to reduce risk…Why do women not know more about these options? I am great about my health and this idea that there is this option out there…that doesn’t seem very hard to do…not as severe as you know, having a [prophylactic] mastectomy.”

Negative feedback was also collected, with a majority focusing on clarity of how risk models calculated, their inputs, and suggested risk-reduction interventions. Interviewees expressed frustration with understanding the tool’s use of various risk model inputs and risk score calculations:

“I thought it was weird that there was no good explanation for why having normal, benign breast biopsy puts you at higher risk. That wasn’t logical to me.”

“I am disappointed that I went through a great deal of trouble [to complete the surveys]. I sent a lot of information [to the WISDOM Study] to find that it wasn’t accurately applied to determine my risk.”

“It didn’t take into consideration that my mother developed breast cancer at age 80.”

One participant expressed disappointment with the risk-reduction options mentioned in the tool:

“[I was] disappointed that there weren’t any options other than mammograms and MRIs and some lifestyle changes and medications offered as prevention.”

Discussion

The development and pilot of the Women Informed to Screen Depending on Measures of risk (WISDOM) study risk assessment tool improves upon a previously developed risk assessment tool from 201440. The tool introduces a woman to her predicted risk of breast cancer and contextualizes among other women and common morbidities. The tool builds on and accommodates the evolving field of risk assessment and risk reduction, which includes risk modified by genetic/polygenic information. The tool is also interactive and patient-facing, allowing women to access as much detail as they wish with a facilitator. Finally, we designed the tool specifically to be low-literacy-friendly at an eighth-grade reading level or lower.

Our pilot study suggests that a review of risk using this tool with a genetic counselor could be used to inform and motivate women who either previously believed their risk was low or unaware of risk-reduction medications to seek further professional guidance. However, in response to pilot feedback from participants requesting more detail on factors contributing to their risk scores, we revised sections discussing why certain inputs are included. One participant identified one of the key problems with biopsy history as a risk factor, namely that the Gail model was developed before the screening era. Today, the Gail model overestimates risk due to the increased number of biopsies of non-palpable masses identified by a mammogram. We also explicitly mentioned how participant responses from the annual WISDOM Study health questionnaires are used as inputs in risk score calculations.

Overall, participants in the pilot study found that incorporating personalized genetic data and readability metrics in the tool’s content useful in understanding their breast cancer risk and risk-reduction options. Ten of fourteen participants indicated that they were “very motivated” and “extremely motivated” to reduce their risk. Participants also said that they would consider medication and lifestyle modifications, though more participants were motivated to pursue lifestyle modifications than risk-reducing medication. This could be due to the lower barrier in beginning lifestyle changes and consideration of side-effects, as discussed elsewhere11.

Follow-up will be necessary to determine participant statements translate into action. As part of our follow-up, we will find out whether they discuss these preventive options with their primary care physicians. The pilot suggests that the tool can improve a woman’s knowledge of risk-reducing strategies and thereby lead to informed breast health choices. It is clear that even those who consider themselves well-informed, even self-proclaimed health enthusiasts, are not aware of risk-reducing medications and their potential benefits, especially for high-risk women. The research milieu of breast cancer decision-making tools has been focused on informed choice, and the contribution of literacy requirements and graphics seem to be in line with building on prior efforts41.

Our study has several limitations, which could be addressed in further studies. First, our pilot used a small sample size of mostly white, well-educated participants, which is not representative of the general breast cancer screening population. Furthermore, convenience sampling is prone to selection bias, because we contacted participants who had completed their annual questionnaire when the tool was completed. To make the study findings more representative of the general population, a larger study sample with diversity across education, age, and race is essential42. Second, the tool was designed and analyzed for low reading grade level, but we have not analyzed the tool for health literacy in terms of numeracy. Efforts are currently underway as part of a validation survey to include a more diverse study population and learn more about the numeracy requirements to using the tool. Third, the pilot study required a walk-through of the tool with a genetic counselor. Therefore, navigation and comprehension could have been improved by the genetic counselor clarifying information. Finally, since data are populated with a patient’s specific risk information as collected through the WISDOM Study, the risk assessment tool is only accessible for study participants at this time.

Based on encouraging feedback from the pilot study, we are collecting additional follow-up data on a larger cohort of elevated risk study participants43. We are motivated to recruit women of greater diversity in education, race, and ethnicity, to further evaluate the tool’s role in risk knowledge and risk-reduction strategies. The tool is being actively used with participants in the top 2.5% of risk by age as part of a consult with WISDOM Study Breast Health Specialists or genetic counselors, as this group was identified as a population where we would be most likely to improve the uptake of risk-reduction strategies44. Extending upon the current pilot data collected, we will evaluate the participant’s concrete actions after exposure to the risk assessment tool as part of the consultation.

However, it will also be important to assess if the tool is effective for participants navigating the tool independently, as the tool will be released to a wider WISDOM Study sample. Throughout this process, additional modifications are likely necessary to improve the tool’s usability and conveyance of risk information. The study team is also identifying methods of sharing these resources with participants’ primary care physicians. We hope to automate the communication from WISDOM Study risk assessment tool to the participant’s primary care provider.

As the tool standardizes the presentation of risk information, it will be used to test the fourth aim of the WISDOM Study, if (1) Personalized risk-based screening promotes endocrine risk-reduction uptake. (2) Use of the risk assessment tool results in more active participation in risk reduction in the personalized screening arm compared to the annual screening arm. After validation in the WISDOM study, we hope to generalize the tool and enable it to be integrated into healthcare consultations as part of primary care.

Methods

Development process

The WISDOM Study was approved by the University of California, San Francisco (UCSF) Institutional Review Board, which included the development and pilot of our risk assessment tool. Informed consent was obtained from all human participants. The Women Informed to Screen Depending on Measures of risk (WISDOM) study is registered on ClinicalTrials.gov as NCT02620852.

The primary focus was three-fold: to incorporate personalized risk assessments; to create a patient-facing web-based software application; to make the risk assessment tool accessible to a low-literacy audience. Figure 4 illustrates the development process for the risk assessment tool.

Fig. 4: Development and pilot process for the WISDOM study risk assessment tool.
figure4

Schematic describing the development and pilot process, which began with a review of the literature and the 2014 version of the tool. The content was developed with a multidisciplinary advisory board. Interface and design were iterated with a software engineer, following feedback from the advisory board and study participants.

First, authors HK and YSH reviewed the 2014 version of the tool and assessed the breast cancer risk-reduction literature to identify the highest level of evidence regarding modifiable and non-modifiable risk factors for breast cancer30. The technology and design phase involved close work with a software engineer and authors HK and YH designing a prototype for the digital Salesforce platform. The requirements of the prototype included the ability to interface with the existing study platform used by the WISDOM Study. This is because the WISDOM Study participant risk assessment, risk calculation, and survey entries are all housed on the Salesforce-based WISDOM Study authenticated portal to protect patient privacy. Another requirement was to design the tool to be accessible by computer, tablet, and smartphone web browsers.

Multidisciplinary advisory group

To review its design, the authors convened an advisory group was composed of 3 physicians, 4 breast cancer researchers, 4 patient advocates, 2 genetic counselors, 3 behavioral and decision scientists, 1 user interface and user experience developer, 1 software engineer, and 1 programmer. The group met eight times during the calendar years 2017–18, partially in-person and otherwise virtually. Authors H.K. and Y.H. elicited and summarized the group’s input on the content and presentation of risk communication. Per their recommendations, the tool incorporated evidence-based principles for risk communication described in the literature.

Assessing tool readability

We used the Readability Test Tool from WebFX to determine the Flesch-Kincaid Reading Ease and Grade Level36. Our goal was to ensure the instructions and curated content of primary pages were at an eighth-grade reading level or below.

Participant risk estimates

We used participant survey data and mammographic density data from the WISDOM Study intake questionnaire to determine a woman’s 5- and 10-year risk of developing breast cancer. 5- and 10-year risk calculations used the Breast Cancer Surveillance Consortium (BCSC) score. We additionally used a patient’s genetic testing results (including intermediate-high penetrance genes and single nucleotide polymorphisms) to estimate participant’s risk of developing breast cancer via a polygenic risk score. This model has been published previously45.

Pilot study process

We designed a pilot study intended to obtain feedback on the tool from participants evaluated to be high-risk, non-gene mutation carriers. The purpose of the pilot study was to improve upon the tool before roll-out to a larger study sample, and assess the conveyance of personal risk knowledge and motivating preventative actions immediately after consultation with a genetic counselor.

The participants were identified by the following procedure. First, 20 high-risk participants were identified to be at elevated risk for developing breast cancer and without a known mutation associated with breast cancer. These participants had completed their annual WISDOM Study Breast Health Questionnaire in January 2019, before the tool was to be piloted. Then, participants were contacted by the study team by email and offered the opportunity to participate in a walk-through of their risk assessment with the tool by a genetic counselor.

Those who accepted the invitation were guided systematically through each of the pages by a genetic counselor (DG) using a virtual screen sharing function in the Zoom platform. The genetic counselor was able to refer to the secondary pages and also respond to participant questions during the session. After the guided consultation, members of the study team asked the participant if they were willing to provide quantitative and qualitative feedback. The purpose of the four-question quantitative survey (see Supplementary Note 1) was to assess the utility of the tool in informing women about their breast cancer risk along with their motivation to undertake any of the risk-reducing strategies after learning about their risk. If participants were willing, follow-up phone interviews for qualitative feedback were also conducted by authors Y.S.H., T.W., and M.C. until thematic saturation using a semi-structured interview guide (see Supplementary Note 2).

Reporting summary

Further information on research design is available in the Nature Research Reporting Summary linked to this article.

Data availability

The data generated and analyzed during this study are described in the following data record: https://doi.org/10.6084/m9.figshare.1454605846. The personalized risk assessment tool and the data supporting the validity of this tool are available on request from the corresponding author, Laura J. Esserman (Laura.Esserman@ucsf.edu). The tool is available for non-commercial use only and the data are not publicly available since the WISDOM Study portal requires participant authentication and registration.

Code availability

Readability Test Tool from WebFX was used to determine the Flesch-Kincaid Reading Ease and Grade Level. This tool is publicly available online36.

References

  1. 1.

    Narod, S. A. Personalised medicine and population health: breast and ovarian cancer. Hum. Genet. 137, 769–778 (2018).

    CAS  Article  Google Scholar 

  2. 2.

    Cuzick, J. et al. Use of anastrozole for breast cancer prevention (IBIS-II): long-term results of a randomised controlled trial. Lancet 395, 117–122 (2020).

    CAS  Article  Google Scholar 

  3. 3.

    Land, S. R. et al. Patient-reported symptoms and quality of life during treatment with tamoxifen or raloxifene for breast cancer prevention: the NSABP Study of Tamoxifen and Raloxifene (STAR) P-2 trial. JAMA 295, 2742–2751 (2006).

    CAS  Article  Google Scholar 

  4. 4.

    Cuzick, J. et al. Tamoxifen for prevention of breast cancer: extended long-term follow-up of the IBIS-I breast cancer prevention trial. Lancet Oncol. 16, 67–75 (2015).

    CAS  Article  Google Scholar 

  5. 5.

    Goss, P. E. et al. Exemestane for breast-cancer prevention in postmenopausal women. N. Engl. J. Med. 364, 2381–2391 (2011).

    CAS  Article  Google Scholar 

  6. 6.

    Fisher, B. et al. Tamoxifen for the prevention of breast cancer: current status of the National Surgical Adjuvant Breast and Bowel Project P-1 study. J. Natl. Cancer Inst. 97, 1652–1662 (2005).

    CAS  Article  Google Scholar 

  7. 7.

    Powles, T. J., Ashley, S., Tidy, A., Smith, I. E. & Dowsett, M. Twenty-year follow-up of the Royal Marsden randomized, double-blinded tamoxifen breast cancer prevention trial. J. Natl. Cancer Inst. 99, 283–290 (2007).

    CAS  Article  Google Scholar 

  8. 8.

    Waters, E. A., McNeel, T. S., McCaskill Stevens, W. & Freedman, A. N. Use of Tamoxifen and Raloxifene for Breast Cancer Chemoprevention in 2010. Breast Cancer Res. Treat. 134, 875–880 (2012).

    CAS  Article  Google Scholar 

  9. 9.

    Visvanathan, K. et al. Use of pharmacologic interventions for breast cancer risk reduction: American Society of Clinical Oncology clinical practice guideline. J. Clin. Oncol. 31, 2942–2962 (2013).

    Article  Google Scholar 

  10. 10.

    Ganz, P. A., Day, R., Ware, J. E., Redmond, C. & Fisher, B. Base-line quality-of-life assessment in the National Surgical Adjuvant Breast and Bowel Project Breast Cancer Prevention Trial. J. Natl. Cancer Inst. 87, 1372–1382 (1995).

    CAS  Article  Google Scholar 

  11. 11.

    Port, E. R., Montgomery, L. L., Heerdt, A. S. & Borgen, P. I. Patient reluctance toward tamoxifen use for breast cancer primary prevention. Ann. Surg. Oncol. 8, 580–585 (2001).

    CAS  Article  Google Scholar 

  12. 12.

    Pruthi, S., Heisey, R. E. & Bevers, T. B. Chemoprevention for breast cancer. Ann. Surg. Oncol. 22, 3230–3235 (2015).

    Article  Google Scholar 

  13. 13.

    DeCensi, A. et al. Randomized Placebo Controlled Trial of Low-Dose Tamoxifen to Prevent Local and Contralateral Recurrence in Breast Intraepithelial Neoplasia. J. Clin. Oncol. 37, 1629–1637 (2019).

    CAS  Article  Google Scholar 

  14. 14.

    Parkin, D. M., Boyd, L. & Walker, L. C. 16. The fraction of cancer attributable to lifestyle and environmental factors in the UK in 2010. Br. J. Cancer 105, S77–S81 (2011).

    Article  Google Scholar 

  15. 15.

    Bagnardi, V., Blangiardo, M., La Vecchia, C. & Corrao, G. A meta-analysis of alcohol drinking and cancer risk. Br. J. Cancer 85, 1700–1705 (2001).

    CAS  Article  Google Scholar 

  16. 16.

    Renehan, A. G., Tyson, M., Egger, M., Heller, R. F. & Zwahlen, M. Body-mass index and incidence of cancer: a systematic review and meta-analysis of prospective observational studies. Lancet Lond. Engl. 371, 569–578 (2008).

    Article  Google Scholar 

  17. 17.

    Wu, Y., Zhang, D. & Kang, S. Physical activity and risk of breast cancer: a meta-analysis of prospective studies. Breast Cancer Res. Treat. 137, 869–882 (2013).

    Article  Google Scholar 

  18. 18.

    Pizot, C. et al. Physical activity, hormone replacement therapy and breast cancer risk: a meta-analysis of prospective studies. Eur. J. Cancer 52, 138–154 (2016).

    Article  Google Scholar 

  19. 19.

    Cummings, S. R. et al. Prevention of breast cancer in postmenopausal women: approaches to estimating and reducing risk. J. Natl. Cancer Inst. 101, 384–398 (2009).

    Article  Google Scholar 

  20. 20.

    Donnelly, L. S. et al. Uptake of tamoxifen in consecutive premenopausal women under surveillance in a high-risk breast cancer clinic. Br. J. Cancer 110, 1681–1687 (2014).

    CAS  Article  Google Scholar 

  21. 21.

    Evans, D. G., Harvie, M., Bundred, N. & Howell, A. Uptake of breast cancer prevention and screening trials. J. Med. Genet. 47, 853–855 (2010).

    Article  Google Scholar 

  22. 22.

    Nelson, H. D., Smith, M. E. B., Griffin, J. C. & Fu, R. Use of medications to reduce risk for primary breast cancer: a systematic review for the U.S. Preventive Services Task Force. Ann. Intern. Med. 158, 604–614 (2013).

    Article  Google Scholar 

  23. 23.

    Gail, M. H. et al. Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J. Natl. Cancer Inst. 81, 1879–1886 (1989).

    CAS  Article  Google Scholar 

  24. 24.

    Rockhill, B., Spiegelman, D., Byrne, C., Hunter, D. J. & Colditz, G. A. Validation of the Gail et al. model of breast cancer risk prediction and implications for chemoprevention. J. Natl. Cancer Inst. 93, 358–366 (2001).

    CAS  Article  Google Scholar 

  25. 25.

    Brentnall, A. R., Cuzick, J., Buist, D. S. M. & Bowles, E. J. A. Long-term accuracy of breast cancer risk assessment combining classic risk factors and breast density. JAMA Oncol. 4, e180174 (2018).

    Article  Google Scholar 

  26. 26.

    Lee, A. et al. BOADICEA: a comprehensive breast cancer risk prediction model incorporating genetic and nongenetic risk factors. Genet. Med. 21, 1708–1718 (2019).

    Article  Google Scholar 

  27. 27.

    Shieh, Y. et al. Breast cancer risk prediction using a clinical risk model and polygenic risk score. Breast Cancer Res. Treat. 159, 513–525 (2016).

    Article  Google Scholar 

  28. 28.

    Esserman, L. J. et al. The WISDOM Study: breaking the deadlock in the breast cancer screening debate. Npj Breast Cancer 3, 34 (2017).

    Article  Google Scholar 

  29. 29.

    Vachon, C. M. et al. The contributions of breast density and common genetic variation to breast cancer risk. J. Natl. Cancer Inst. 107, dju397 (2015).

  30. 30.

    Ozanne, E. M., Howe, R., Omer, Z. & Esserman, L. J. Development of a personalized decision aid for breast cancer risk reduction and management. BMC Med. Inform. Decis. Mak. 14, 4 (2014).

    Article  Google Scholar 

  31. 31.

    Stacey, D. et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst. Rev. CD001431, https://doi.org/10.1002/14651858.CD001431.pub4 (2014).

  32. 32.

    Start Here - Bright pink ovarian cancer risk level. Bright Pink. https://www.brightpink.org/know-and-manage-your-risk/start-here/ (2020).

  33. 33.

    Assess Your Risk. Bright pink. https://www.assessyourrisk.org/ (2020).

  34. 34.

    Stossel, L. M., Segar, N., Gliatto, P., Fallar, R. & Karani, R. Readability of patient education materials available at the point of care. J. Gen. Intern. Med. 27, 1165–1170 (2012).

    Article  Google Scholar 

  35. 35.

    Meade, C. D. & Smith, C. F. Readability formulas: cautions and criteria. Patient Educ. Couns. 17, 153–158 (1991).

    Article  Google Scholar 

  36. 36.

    Readable | Free Readability Test Tool. WebFX. https://www.webfx.com/tools/read-able/check.php (2021).

  37. 37.

    Paasche-Orlow, M. K., Taylor, H. A. & Brancati, F. L. Readability standards for informed-consent forms as compared with actual readability. N. Engl. J. Med. 348, 721–726 (2003).

    Article  Google Scholar 

  38. 38.

    Gigerenzer, G. & Edwards, A. Simple tools for understanding risks: from innumeracy to insight. BMJ 327, 741–744 (2003).

    Article  Google Scholar 

  39. 39.

    Gigerenzer, G. What are natural frequencies? BMJ 343, 1–2 (2011).

  40. 40.

    Ozanne, E. M., Klemp, J. R. & Esserman, L. J. Breast cancer risk assessment and prevention: a framework for shared decision-making consultations. Breast J. 12, 103–113 (2006).

    Article  Google Scholar 

  41. 41.

    Martínez-Alonso, M. et al. Assessment of the effects of decision aids about breast cancer screening: a systematic review and meta-analysis. BMJ Open 7, e016894 (2017).

    Article  Google Scholar 

  42. 42.

    Kukafka, R. et al. Why breast cancer risk by the numbers is not enough: evaluation of a decision aid in multi-ethnic, low-numerate women. J. Med. Internet Res. 17, e165 (2015).

    Article  Google Scholar 

  43. 43.

    Wang, T. et al. Abstract PS7-43: validation study results for a personalized prevention education aid in breast cancer risk reduction. Cancer Res. 81, PS7–PS43 (2021).

    Google Scholar 

  44. 44.

    Huilgol, Y. S. et al. Abstract P5-08-01: Breast cancer risk thresholds as a predictor of chemoprevention uptake in the Athena Breast Health Network. Cancer Res. 80, P5-08–P5-001 (2020).

    Google Scholar 

  45. 45.

    Shieh, Y. et al. Breast cancer screening in the precision medicine era: risk-based screening in a population-based trial. J. Natl. Cancer Inst. 109, 1–8 (2017).

  46. 46.

    Keane, H. et al. Metadata record for the article: development and pilot of an online, personalized risk assessment tool for a breast cancer precision medicine trial. figshare (2021).

  47. 47.

    Keane, H. et al. Abstract P5-08-23: Personalized, prevention decision aid developed for breast cancer risk-reducing discussions and interventions in the WISDOM study. Cancer Res. 80, P5-08–P5-023 (2020).

    Google Scholar 

Download references

Acknowledgements

We acknowledge Adam Asare, Susie Brain, Diane Heditsian, Jessie Hong, Celia Kaplan, Vivian Lee, Michael Resendez, and Alex Koorkoff. The authors are also grateful to the central Athena Program Management Office staff, WISDOM Study member institution-based program managers, data staff, and Breast Health Specialists for their assistance with data collection and design. The WISDOM Study is supported by the Patient-Centered Outcomes Research Institute (PCORI; PCS-1402-10749 to L.J.E.), National Cancer Institute (K08 CA237829 to Y.S. and R01 CA237533 to L.J.E.), Safeway Foundation (to L.J.E.), Breast Cancer Research Foundation (SPEC-18-006 to L.J.E.), Mt. Zion Health Fund (to L.J.E.), and Robert Wood Johnson Foundation (Grant 71864 to L.J.E.). The Athena Breast Health Network is supported by the University of California Office of the President (P0043830 to L.J.E.). Data collection and sharing for WISDOM Study are supported by the NCI-funded Breast Cancer Surveillance Consortium (HHSN261201100031C). This publication was also supported by the National Center for Advancing Translational Sciences, National Institutes of Health, through UCSF-CTSI Grant Number UL1 TR001872. The statements presented in this publication are solely the responsibility of the authors and do not necessarily represent the official views of PCORI, its Board of Governors, or Methodology Committee, or the NIH. Part of this work has been presented at the annual San Antonio Breast Cancer Symposium in December 2019 (Keane et al.47, abstract P5-08-23).

Author information

Affiliations

Authors

Contributions

H.K. and Y.S.H. are co-first authors and contributed equally. Conceptualization (all authors); resources (L.J.E.); data acquisition (H.K., Y.S.H., W.P.S., T.W., M.C.); formal analysis (Y.S.H., H.K.); supervision (L.J.E.); funding acquisition (Y.S., L.J.E.); methodology (Y.S.H., L.J.E.); writing—original draft (H.K., Y.S.H., L.J.E.); project administration (A.S.F.); writing—review and editing (all authors).

Corresponding author

Correspondence to Laura J. Esserman.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Keane, H., Huilgol, Y.S., Shieh, Y. et al. Development and pilot of an online, personalized risk assessment tool for a breast cancer precision medicine trial. npj Breast Cancer 7, 78 (2021). https://doi.org/10.1038/s41523-021-00288-8

Download citation

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing