Despite rapid advancements in genetics and genomics, referral practices remain suboptimal. This systematic review assesses the extent to which approaches from implementation science have been applied to address suboptimal genetic referral practices.
A search of MEDLINE, EMBASE, and PsycINFO generated 7,794 articles, of which 28 were included. Lay barriers were mapped to the Theoretical Domains Framework (TDF) and interventions mapped to behavior change techniques. Use of implementation and behavior change frameworks was assessed, and the Theory and Techniques Tool used to determine theoretical alignment.
Knowledge was the most frequent retrospectively TDF-coded barrier, followed by environmental context and resources, and skills. Significant referral improvements occurred in 56% of studies. Among these, the most frequent interventions were clinical data review systems, family history collection and referral tools, and embedding genetics staff into nongenetic specialties. Few studies used implementation frameworks or reported implementation outcomes, though some deployed intuitive strategies that aligned with theory.
Genetic referral interventions are rarely informed by implementation and/or behavior change theories, limiting opportunities for learning across contexts. Retrospective coding has provided a suite of theoretically linked strategies, which may be useful for informing future efforts. Incorporating these strategies into clinical guidelines may facilitate operationalization within the system.
Rapid advances in genetic and genomic research have promised to transform future approaches to disease prevention, detection, and treatment . The development of high-throughput technologies for genetic sequencing and analysis has generated new opportunities for improved diagnosis of genetic disorders, personalized targeted treatments (particularly for cancer patients), prenatal screening and diagnosis, and pharmacogenomics . For this research to be clinically translated, health-care professionals must first be able to identify patients who would most benefit from genetic assessment, then facilitate the necessary referral pathways to ensure equitable access and uptake.
However, a wealth of evidence highlights suboptimal genetic referral rates across a range of clinical settings. In the cancer setting for example, studies have demonstrated referral rates of less than 30% among patients at high risk of Lynch syndrome (e.g ). Similar findings are demonstrated in hereditary breast and ovarian cancer, with referral rates among eligible patients of less than 50% (e.g., ). Given the well documented health benefits of risk management protocols for those affected by hereditary cancer syndromes, these studies signify missed opportunities for cancer prevention, treatment and early detection. For example, preventable (and often incurable) BRCA1/2-related cancers have been reported in families where relatives with previous breast and/or ovarian cancer were never referred for variant testing, despite meeting clinical criteria . Beyond the cancer setting, suboptimal referral practices have also been demonstrated across other genetic specialties (e.g., prenatal risk assessment , hereditary cardiac conditions ). A recent scoping review identified that up to 58% of nongenetics health-care professionals (across various specialties) had never referred a patient for clinical genetics assessment .
A number of studies have explored barriers to genetic referral practices, both at the patient and health-care provider levels . At the patient level, barriers include lack of awareness about personal risk and/or family history, and lack of knowledge of genetic services [10, 11]. At the health-care provider level, barriers include lack of knowledge about genetic conditions and patient risk factors, inadequate family history documentation, lack of awareness of genetic services, inadequate referral coordination, and genetic workforce issues [9, 12, 13]. Developing an in-depth understanding of barriers is necessary for the design of targeted strategies to overcome them. The Theoretical Domains Framework (TDF)  synthesizes a range of behavior change theories to facilitate the identification of behavior change determinants (e.g., barriers and/or facilitators). Use of a theoretical framework can facilitate the identification of more complex, individual-level barriers (e.g., emotion, social influences) that are less likely to be articulated through standard (non–theory informed) approaches, thereby enabling more comprehensive barrier assessment . However, the extent to which genetic referral barriers have been assessed or classified using theoretical approaches is unknown.
Implementation interventions involve strategies designed to change behaviors at the organizational, provider, or patient level to enhance the adoption of a given clinical intervention or practice . In the context of genetic referral practices, multiple behaviors are involved in the processes through which health-care professionals identify patients who warrant genetic assessment and/or testing (e.g., eliciting family history, interpreting risk, applying referral guidelines) and initiate the referral (e.g., discussion with patient, identifying the appropriate genetic service, writing the referral letter). In this setting, behavior change interventions, underpinned by existing psychological theories, may be effective in achieving clinical practice change . Behavior change techniques (BCTs) are the “active ingredients” of an intervention with the potential to change behavior, while mechanisms of action refer to the processes through which BCTs produce their effects . The TDF can facilitate the identification of behavior change determinants, which can then inform the design of intervention strategies that employ BCTs with known mechanistic links.
Despite the potential benefits, these frameworks are currently underutilized in health-care improvement efforts . While health-care providers are ideally placed to apply their tacit and contextual knowledge to intuitively develop strategies to address the clinical problem they are attempting to solve (“informal theory”), explicitly stating the underlying theoretical causal assumptions can enhance opportunities for learning, replication and generalizability across other settings. Although the ideal is to use theory prospectively, retrospectively determining the extent to which intuitive strategies are represented by BCTs with established mechanistic links (i.e., theoretical alignment) may help to optimize the design of prospective intervention strategies, while developing an understanding of the processes through which these strategies produce their effects . This also improves standardization and generalizability, enabling adaptation of interventions to other contexts while keeping active ingredients constant.
Even when interventions are carefully designed, success is dependent on how well those interventions are implemented in practice . Process evaluations are exploratory studies that seek to complement outcome evaluations by understanding how an intervention works in practice, and are crucial in distinguishing between interventions that are inherently faulty in concept or design, versus those that are poorly implemented. The UK Medical Research Council (MRC) highlights the need for process evaluations alongside complex interventions to assess implementation outcomes (e.g., the quality and quantity of what is delivered), clarify causal mechanisms, and identify contextual factors—all of which can be associated with variation in clinical and/or service level outcomes .
The extent to which these approaches from the field of implementation science have been applied in the genetics setting to address suboptimal referral practices is unknown. To address these gaps, the aims of this review were to:
Describe health-care provider interventions aimed at improving genetic referral practices, and assess their impact
Retrospectively code barriers and intervention strategies against a theoretical framework of behavior change, and assess evidence of potential mechanistic links
Assess the extent to which implementation science theories and frameworks have been applied in the design of interventions
Determine the extent to which process evaluation and implementation outcome data has been collected to explain clinical intervention outcomes
MATERIALS AND METHODS
The protocol for this systematic review was prospectively registered through PROSPERO (CRD42020166632) and findings have been reported in line with Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement .
Using database-specific subject headings, MEDLINE (including Medline Epub Ahead of Print, In-Process & Other Non-Indexed Citations), EMBASE, and PsycINFO were searched. Search terms for genetic counseling and testing were combined with referral terms (see Supplementary File 1). The search was limited to articles published in English after 1 January 2000 (as older studies are unlikely to be relevant to current practice). Monthly auto-alerts were generated and continued until completion of data extraction. Search results were exported into Endnote X9 (Thomas Reuters) for screening against inclusion and exclusion criteria. For included studies, reference lists were screened for additional relevant studies. The final database search was performed on 1 May 2021.
Inclusion and exclusion criteria
Inclusion and exclusion criteria were developed and refined using the PICOS framework (see Supplementary File 2). Articles were included if they:
Described an implementation intervention aimed at improving genetic referral practices by targeting a health professional group or health service/system;
Reported clinical outcome data relevant to genetic referral practices (e.g., genetic referral rates and/or surrogate outcomes, such as genetic counseling attendance or genetic testing uptake) with a relevant comparator (e.g., preintervention baseline, standard care, other implementation intervention);
Were based in Australia, New Zealand, Europe, Canada, the United States (given similarities in health service settings and genetic testing and referral guidelines); and
Were published in English in a peer-reviewed journal between 2000 and 2021.
Articles were excluded if they:
Described a technical intervention (e.g., introduction of new clinical processes without any accompanying implementation components) or mainstreaming intervention (e.g., provision of genetic counseling or testing by nongenetics health-care professionals);
Described an implementation intervention targeted specifically to nonclinical, sociodemographic subgroups (due to limited generalizability); or
Were conference proceedings, protocols, case studies, commentaries, letters, editorials, or scoping/narrative reviews.
Screening and data extraction
Titles and abstracts were screened against inclusion/exclusion criteria by a single reviewer (A.M.—reviewer 1; see Fig. 1.). Articles that were potentially relevant (or of unclear relevance) were selected for full-text review. A prespecified inclusion/exclusion form was independently piloted by reviewer 1 (A.M.) and reviewer 2 (P.C.) using the first ten articles. Following review and refinement of the form, all full-text articles were independently assessed by reviewer 1 and reviewer 2. Discrepancies were resolved via discussion, with adjudication by a third reviewer (N.T.) where consensus could not be reached. For articles with missing or unclear information, authors were contacted for clarification. For all excluded articles, reasons for exclusion were documented.
An initial data extraction form was developed to address the research aims, and to include key items from published intervention reporting guidelines—the Standards for Reporting Implementation Studies (StaRI) statement  and Template for Intervention Description and Replication (TIDieR) checklist . These guidelines have been developed to ensure adequate description of implementation studies and intervention strategies to enhance replicability. The extraction form was piloted by two reviewers (A.M. & P.C.), with discussion and refinement among the research team. Reviewer 1 extracted data from all studies selected for inclusion, and reviewer 2 independently extracted data for 20% of randomly selected studies to ensure accuracy.
Where possible, reported barriers to genetics referral were mapped to the TDF . The TDF is a validated framework that can be used to classify barriers according to theoretically underpinned psychosocial domains of behavior change, and has been extensively used across a range of clinical settings . Implementation strategies were coded to a refined taxonomy of 73 discrete strategies identified through the Expert Recommendations for Implementing Change (ERIC) project in response to the need for a consistent nomenclature for implementation terms and definitions .
Intervention content descriptions were further mapped to the BCT Taxonomy version 1 , which consolidates a large number of published intervention components designed to alter causal processes influencing behavior (e.g., the “active ingredients” of an intervention). Studies were further categorized according to the extent to which theory and/or implementation frameworks were applied in intervention design, using the theoretical coding scheme developed by Michie and colleagues .
Where barriers were described in sufficient detail to allow mapping to TDF domains and BCTs were identified in subsequent intervention components, the Theory and Techniques Tool  was used to determine evidence of theoretical alignment (i.e., mechanistic links) between the BCTs used to target TDF-mapped barriers. The Theory and Techniques Tool is an interactive online resource consolidating links between BCTs and their mechanisms of action based on a synthesis of published intervention studies and expert consensus study . Process evaluation and implementation outcomes were coded against the framework by Proctor et al.  that consists of eight implementation outcomes (acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability), which are conceptually distinct from clinical and service system outcomes. All coding was performed by one author (A.M.), with 40% independently coded by a second author (N.T.) to ensure agreement. Coding for all remaining articles was reviewed by N.T. Both A.M. and N.T. have prior experience coding intervention content using these frameworks.
Extracted and coded data were synthesized using a narrative framework (incorporating theoretical perspectives), with findings tabulated, grouped, and structured into key themes by one author (A.M.), with discussion and refinement among the wider team (P.C., N.T., K.M.T.).
The quality of all articles were assessed using QualSyst, which accommodates assessment of both qualitative and quantitative study designs simultaneously . The quality appraisal was conducted by a single reviewer (A.M.) and checked by an additional reviewer (P.C.). Studies were not excluded on the basis of quality; however, quality was considered in the interpretation of findings. Missing data were factored into the quality scores. A Grading of Recommendations Assessment, Development and Evaluation (GRADE) assessment was performed to assess quality across studies and certainty of the evidence .
Thirty-two studies were included in the review, the characteristics of which are summarized in Supplementary File 3. Most studies took place in the hospital setting (n = 26; 81%), and in the context of hereditary cancer (n = 29; 91%). Most described cohort studies (n = 26; 81%), while the remaining were cluster randomized controlled trials (n = 5; 16%) or stepped-wedge trials (n = 1; 3%). Over half took place in the United States (n = 20; 63%).
Twenty-four articles (75%) explicitly stated barriers to genetic referral, which were mapped to eight TDF domains . Knowledge was the most frequently cited referral barrier (n = 16 studies; 67%), followed by environmental context and resources (n = 10, 42%), skills (n = 8, 33%), and memory, attention and decision processes (n = 8, 33%). Table 1 provides details of the barriers cited within each domain. In the majority of articles (n = 21; 88%) barriers were identified from published literature or anecdotal reports, whereas three studies (13%) conducted formal assessment of local barriers (see “Implementation strategies” below). One study  explicitly classified barriers according to a theoretical framework (the TDF), identifying 11 different barriers spanning four TDF domains: environmental context and resources (four barriers); knowledge and skills (four barriers); memory, attention, and decision processes (two barriers); and beliefs about capabilities (one barrier).
The majority of articles described multicomponent interventions (n = 26; 81%), with 108 active intervention components identified across all included articles. More than half the intervention studies included provider education components (n = 17, 53%), most of which were delivered via face-to-face training (n = 10; 59%). Fifteen studies (47%) included family history and/or referral tools; of which ten (67%) also provided clinical decision-making support. Fifteen studies (47%) used clinical data review systems (e.g., review of pathology results for genetic referral indicators, discussion of clinical risk indicators at multidisciplinary team meetings). Remaining intervention components included (but were not limited to) clinician reminder systems (n = 10; 31%), embedding genetics staff within other clinical teams (n = 10; 31%), automated electronic referral systems (n = 6; 19%), development of clinical protocols and flowcharts (n = 5; 16%), and audit and feedback (n = 3; 9%). Intervention components are described in full in Supplementary File 4. While this review focused on interventions targeted at the health system or provider level, nine articles (28%) also incorporated patient-level intervention components, the majority of which were educational materials (n = 8; 89%) or involved patient completion of family history tools (n = 3; 33%).
Less than half the articles (n = 15; 47%) explicitly described implementation strategies used to promote uptake of active intervention components. Thirty strategies (coded to the ERIC taxonomy) were identified, the majority of which (n = 25; 83%) took place at the preimplementation stage. Three studies [3, 33, 34] conducted formal assessment of local barriers and facilitators to tailor the design of intervention strategies, using methods such as stakeholder working groups [3, 34], environmental scans , and validated barrier questionnaires . Eight studies [3, 35,36,37,38,39,40,41] conducted preimplementation meetings among stakeholder workgroups to plan the improvement effort and allow intervention refinement. Other preimplementation strategies included identifying and preparing local champions [39, 41, 42], conducting educational meetings about the intervention [40, 43,44,45], involving executive boards [3, 41], developing a formal implementation blueprint , and forming partnerships with implementation experts . Interventions were designed by end users in five studies [33, 34, 37,38,39], while five studies used a co-design approach with collaboration between researchers and end users [3, 36, 40, 46, 47]. The remaining 22 studies did not specify the approach to intervention design.
Mid-implementation strategies included the provision of ongoing researcher support to promote intervention uptake [40, 44], tailoring of strategies based on clinician experiences [36, 43], and provision of auditing feedback on intervention adherence . No postimplementation strategies were identified. Full descriptions of the implementation strategies are provided in Supplementary File 5.
Application of theory and frameworks
Few studies (n = 4; 13%) explicitly made use of implementation science or behavior change theory frameworks in the design and/or implementation of intervention strategies. Applying the coding scheme developed by Michie et al. , only one article  applied behavior change theory to the full extent (e.g., describing how theoretical constructs were used to inform the design of each intervention strategy). In this article, the Theoretical Domains Framework Implementation (TDFI) provided a structured process through which local barriers (mapped to TDF domains) were identified, with the design of a suite of targeted intervention strategies informed by corresponding BCTs . Of the remaining three studies [33, 34, 37], theoretical frameworks were only partially applied (e.g., broad description of how theory was used in intervention design).
Analysis of the 108 active intervention components across all studies identified 16 categories of BCTs, which were used on 214 occasions (intervention components often contained multiple BCTs). The most frequently occurring BCTs were social support—practical (examples included assisted interpretation of molecular screening tests, genetic counselor attendance at multidisciplinary meetings), which was used on 43 occasions across 22 studies; prompts and cues (e.g., referral reminder systems, electronic alerts) used on 38 occasions across 23 studies; conserving mental resources (e.g., clinical decision support tools) used on 29 occasions across 20 studies; and information about health consequences (e.g., educational workshops and resources about Lynch syndrome) used on 28 occasions across 14 studies. Only one study explicitly stated the BCTs used in intervention strategies , with the majority of studies requiring retrospective coding of BCTs based on intervention descriptions. Supplementary file 4 provides the full BCT mapping exercise.
After applying the Theory and Techniques Tool , nine BCTs were used to address a corresponding barrier that has previously demonstrated statistically significant mechanistic links (i.e., theoretical alignment agreed upon by expert consensus AND associations in the intervention literature synthesis). These were used on 83 occasions, identified within 59 intervention components (each intervention component can contain multiple BCTs) across 23 studies. The most frequently cited BCTs with evidence of mechanistic links were information about health consequences (TDF domain = knowledge), used on 20 occasions; social support (practical) (TDF domain = environmental context and resources). used on 19 occasions; prompts and cues (TDF domains = environmental context and resources and memory, attention, and decision processes), used on 17 occasions; and instruction on how to perform the behavior (TDF domains = knowledge and beliefs about capabilities), used on 12 occasions. Theoretical alignment was unable to be assessed for 37 of the 108 strategies (34%), due to insufficient descriptions of barriers and/or corresponding intervention strategies.
The BCT social support—practical was the most frequently observed BCT among studies that successfully led to improvements in referral (used on 32 occasions across 16 studies), while the BCT information about health consequences was the most frequently observed among studies that did not lead to improvements (used on 14 occasions across 5 studies). Among successful studies, 41% (41/99) of the examinable BCTs had evidence of mechanistic links according to the Theory and Techniques Tool , compared to 25% (11/44) in the nonsuccessful studies. Table 2 provides a compilation of example strategies with proven mechanistic links from successful studies, stating their proposed causal pathway.
Service level outcomes
Eighteen studies (56%) resulted in significant improvements in genetic referral practices. Among these studies, clinical data review systems [33, 41, 48,49,50,51,52,53], referral and family history tools [36, 37, 40, 43, 48, 51, 54], and efforts to embed genetic staff into nongenetics services [33, 52,53,54,55,56,57] were the most frequently cited intervention components. An additional five studies (17%) also showed improvements, though were not powered for significance [34, 39, 42, 47, 58]. Two studies had mixed results (e.g., improvements in some referral outcomes but not others) [3, 40, 59], while changes in referral rates could not be established in one study due to lack of historical comparator . Five studies (16%) showed no significant improvement in referral [35, 38, 44, 46, 61]. Individual quality appraisal scores are provided in Supplementary File 3. Using the GRADE assessment tool , there were some concerns about the certainty of the evidence across studies given the potential for publication bias, and since most studies used observational cohort design with historical controls (many of which did not report controlling for potential confounders, e.g., changes in genetic testing and referral guidelines over time).
Twelve studies (38%) incorporated implementation outcomes in their reporting, though none formally applied the Proctor framework. These included adoption (n = 8; 25%), acceptability (n = 6; 19%), appropriateness (n = 4; 13%), feasibility (n = 3; 9%), and cost (n = 2; 6%). The extent to which health-care professionals adopted the planned intervention strategies ranged from 15%  to 67% . For example, in a study implementing a software program to facilitate assessment of familial cancer risk in general practice, only 14% of the practitioners surveyed had used the program at least once in the one-year study period (potentially explaining the lack of improvement in genetic referral rates) . Clinicians varied in their beliefs about the appropriateness, acceptability and feasibility of interventions, for example clinicians in three studies [3, 48, 60] found the interventions too time-consuming for day-to-day use. Of the two studies reporting economic outcomes [38, 62], these were expressed as marginal costs (e.g., unit costs associated with active intervention components, without reporting of costs to implement). Three studies [3, 40, 43] were accompanied by process evaluations (reported separately) providing in-depth insights on implementation outcomes and contextual factors potentially impacting implementation success.
The speed at which genetic research is evolving requires ongoing evidence-based interventions to ensure meaningful translation into clinical practice. However, this systematic review has highlighted the variable success of intervention efforts to improve genetic referral, and the limited extent to which implementation science theories and frameworks have been applied to date. To advance the science of implementation in genetics and genomics, this review has comprehensively consolidated existing interventions according to standardized terminology, demonstrating patterns of successful and less successful approaches.
Despite calls for the explicit use of theory to better understand behavior change determinants, identify mechanisms of impact, and inform intervention strategies , this review has highlighted the underutilization of theory to address genetic referral practice gaps. This is comparable to findings from two systematic reviews of genomics intervention studies, in which both authors noted an absence of studies incorporating behavior change frameworks [63, 64]. Outside the genetics setting, studies have also demonstrated limited use of theory to address implementation challenges or guide intervention design . Health-care professionals may not be aware that such frameworks exist, or require additional training and support to apply them in a meaningful and practical way [17, 20]. Efforts are currently underway to upskill clinicians and researchers to be able to apply these frameworks in the design of evidence-based intervention strategies [65, 66].
While recognizing the potential value of theory and implementation science frameworks in the genetics setting, a number of intuitively designed interventions (i.e., those designed by clinicians without explicit use of theory) in this review were successful in achieving significant improvements in genetic referral practices. While the use of this “informal theory” can be effective in producing positive practice change, explicit application of theory serves to promote learning across a range of studies, contexts, and clinical problems so as to avoid reinventing the wheel . Furthermore, while intuitive and common-sense approaches can often be used to solve basic problems in ways that retrospectively align with theory (e.g., training opportunities to address knowledge and skill barriers), formal and prospective application of theory may also serve to better understand and address more complex barriers (e.g., emotion, social influences) that require more sophisticated approaches for tailored intervention design. A co-design model—harnessing the strengths of health-care professionals and behavior change experts—may support the development of intervention strategies that are both theoretically informed and fit for context .
Although the ideal is to apply theory prospectively in the design of intervention strategies, retrospectively coding intuitive interventions may help to understand the processes by which these strategies produce their effects, while also optimizing the design of future intervention efforts to address genetic referral practices. Through this review, we have consolidated a large number of intervention strategies matched to key psychosocial barriers, and demonstrated the extent to which these barriers and corresponding intervention strategies align with TDF domains and corresponding BCTs. We have also compiled a list of example strategies with proven mechanistic links (across a range of barrier domains) that have been successfully used in studies that resulted in improvements in genetic referral practices. In addition to demonstrating how BCTs can be operationalized and theoretical links made explicit, these provide a resource for clinicians embarking on future efforts to improve genetic referral practices, allowing potential selection of strategies with existing mechanistic links to address similar psychosocial barriers. This is a relatively novel strategy, which, to our knowledge, has been previously applied only once in the context of intuitive genetic counseling interventions aimed at improving family communication of genetic cancer risk information . The process was found by clinicians to be highly valuable in developing a practical understanding of the application of behavior change theory .
In this systematic review, knowledge was the most frequently cited barrier to genetic referral practices. This is consistent with other systematic reviews that have used the TDF to categorize behavioral determinants surrounding various aspects of genetic practice—one in the context of nongenetic specialist decision-making about offering genetic and genomic testing , and another related to mainstreaming of genetics and genomics for nurses and physicians . While it is useful to gain a collective understanding of the commonly experienced barriers to genetic referral practices, barriers are highly context-specific and can vary widely across different settings. It is therefore crucial to gain an in-depth understanding of local barriers to ensure the design of intervention strategies targeted to the local context. Despite the availability of multiple systematic approaches to identify context-specific determinants and match appropriate intervention strategies , only three studies in this review conducted local barrier assessments at the preimplementation stage [3, 33, 34]. Assumption of barriers, even when guided by literature reports, may lead to selection of strategies that are not contextually relevant, and hence less likely to be effective. For example, two studies in this review focusing on educational strategies (based on the assumption of clinician knowledge barriers) demonstrated no improvements in referral practices despite increases in knowledge [35, 61], suggesting involvement of other determinants not targeted for change. Such findings may also suggest that increasing knowledge alone is insufficient for achieving behavior change. To address these issues, theory-guided approaches can elicit a more meaningful and accurate representation of barriers to better inform intervention design .
Relatively few studies in this review were accompanied by formal process evaluations, or reported on implementation outcomes. While previous systematic reviews of health system interventions have rarely included formal measurement and reporting of these outcomes, similar findings have been demonstrated in the cardiovascular intervention setting . Consequently, when studies fail to achieve the desired clinical outcome (in this case, improvements in genetic referral practices) researchers and clinicians are unable to distinguish between interventions that are inherently faulty in their design, versus those poorly implemented . To address this issue, the UK MRC has provided a comprehensive statement to guide researchers in the design of process evaluations to maximize the interpretation of complex intervention trials .
Among studies that reported on implementation outcomes, a number cited suboptimal adoption as a potential explanation for lack of improvement in genetic referral [35, 38, 44]. In such instances, real-time process evaluation data can shed light on the factors underlying suboptimal implementation, allowing interventions to be tailored and adapted to the needs and preferences of end users . In this review, only two studies provided opportunities during the implementation phase to adapt strategies to ensure a better fit for the local context [36, 43]. While intervention adaptations were once broadly perceived as a threat to fidelity (and therefore study quality and effectiveness), there is growing recognition that adaptations may in fact have a positive impact on study outcomes—provided that the intended underlying causal mechanisms (i.e., core functions) are maintained . Such approaches can also facilitate scale-up efforts, though require an in-depth understanding of the underlying theory and causal processes through which the intervention is intended to produce effects.
Finally, very few studies in this review incorporated measures to assess the economic impact of intervention implementation [38, 62]. For policymakers and health managers to justify the allocation of resources for implementation efforts, there is a need not only to establish the clinical effectiveness (i.e., improvements in referral rates), but also cost-effectiveness . To ensure efficient use of health system resources, formal economic evaluations are needed (incorporating costs of both intervention and implementation strategies) to determine the most cost-effective implementation approaches .
To assess intervention effectiveness, papers were included only if they reported at least one clinical or service level outcome representing genetic referral practices (e.g., genetic referral rates, genetic counseling attendance, uptake of genetic tests). Papers reporting only on nonclinical outcomes (e.g., clinician knowledge, confidence, self-reported referral practices) were excluded. Therefore, insights gained from this review may not be representative of the broader body of intervention research in this area. Furthermore, the majority of interventions took place in the cancer setting, and therefore may not be generalizable to other genetic subspecialties.
Although full texts were independently assessed by two reviewers, extraction was predominantly performed by a single reviewer. Although a second reviewer independently extracted data for 20% of randomly selected studies, there remains some potential for error in the extraction process. As noted in the results, there were also potential biases both within and across studies, and findings from this systematic review should therefore be interpreted with caution. Coding of barriers, implementation approaches, and intervention strategies were limited by the extent to which these were adequately described within studies, with many providing insufficient detail to enable coding. Results of the coding exercise should also be interpreted with caution. This highlights the need for better reporting of interventions, particularly given that no included studies explicitly made use of available intervention reporting guidelines (acknowledging that some studies were published before the guidelines were introduced) [24, 25]. Standardized reporting would also enable opportunities for meta-analyses, with the potential to quantify the significance of theoretical contributions to referral interventions for producing better outcomes.
Given the speed at which genetics and genomics is evolving, the application of implementation science and/or behavior change methods is crucial for ensuring smoother translation, while advancing current understanding about what strategies work, and why. However, this review has demonstrated that the use of such methods in the context of interventions aimed at improving genetic referral practices is lacking. Further efforts to upskill genetic health-care professionals to apply these methods in practice, and/or to build collaborative partnerships with implementation science and behavior change experts are needed. In light of findings from this review, we propose the following recommendations for consideration when designing, implementing, and reporting future intervention efforts in the genetics setting:
A thorough, theory-guided assessment of local barriers conducted at the preimplementation stage to inform the design of targeted, context-specific intervention strategies
Utilization of theories, models, and frameworks to optimize the design of genetic intervention strategies and opportunities for successful implementation, and support a standardized understanding of effective ingredients for eliciting change
Formal assessment of implementation outcomes to enhance interpretation of clinical outcomes, providing an understanding of the factors impacting success
Carefully designed process evaluations conducted alongside intervention studies can provide an in-depth understanding of what works (or does not) and why, while economic evaluations can guide decisions about resource allocation for future implementation and/or scale-up efforts
Process evaluations can also provide opportunities to adapt interventions to ensure better fit for context, provided that the proposed causal pathways are maintained
When reporting intervention studies, reporting guidelines (such as StaRI and TIDieR) should be utilized to enhance intervention replicability, with underlying theory made explicit
In addition to maximizing opportunities for successful implementation, applying the above recommendations will serve to promote learning across interventions to address clinical problems within and beyond genetics to ensure smoother translation of new (and existing) evidence into practice.
Availability of data and materials
Data and materials (e.g., template data collection forms) are available upon written request.
Horton RH, Lucassen AM. Recent developments in genetic/genomic medicine. Clin Sci. 2019;133:697–708.
Naidoo N, Pawitan Y, Soong R, Cooper DN, Ku C-S. Human genetics and genomics a decade after the release of the draft sequence of the human genome. Hum Genomics. 2011;5:577.
Long JC, Debono D, Williams R, Salisbury E, O’Neill S, Eykman E, et al. Using behaviour change and implementation science to address low referral rates in oncology. BMC Health Serv Res. 2018;18:904.
Backman J, Chang Z, Carroll S, Einstein MH. Referrals to genetic counseling in patients with ovarian, fallopian tube, or primary peritoneal cancer, an institutional review. Gynecol Oncol. 2015;139:586.
Samimi G, Bernardini MQ, Brody LC, Caga-Anan CF, Campbell IG, Chenevix-Trench G, et al. Traceback: a proposed framework to increase identification and genetic counseling of BRCA1 and BRCA2 mutation carriers through family-based outreach. J Clin Oncol. 2017;35:2329.
McClatchey T, Lay E, Strassberg M, Van den Veyver IB. Missed opportunities: unidentified genetic risk factors in prenatal care. Prenat Diagn. 2018;38:75–79.
Ruiter JS, Berkenbosch-Nieuwhof K, Van Den Berg MP, Van Dijk R, Middel B, Van, Tintelen JP. The importance of the family history in caring for families with long QT syndrome and dilated cardiomyopathy. Am J Med Genet A. 2010;152:607–612.
Dragojlovic N, Borle K, Kopac N, Ellis U, Birch P, Adam S, et al. The composition and capacity of the clinical genetics workforce in high-income countries: a scoping review. Genet Med. 2020;22:1437–1449.
Delikurt T, Williamson GR, Anastasiadou V, Skirton H. A systematic review of factors that act as barriers to patient referral to genetic services. Eur J Hum Genet. 2015;23:739–745.
Collins V, Halliday J, Williamson R. What predicts the use of genetic counseling services after the birth of a child with Down syndrome? J Genet Couns. 2003;12:43–60.
Beene-Harris RY, Wang C, Bach JV. Barriers to access: results from focus groups to identify genetic service needs in the community. Public Health Genomics. 2007;10:10–18.
Aalfs CM, Smets EM, de Haes HC, Leschot NJ. Referral for genetic counselling during pregnancy: limited alertness and awareness about genetic risk factors among GPs. Fam Pract. 2003;20:135–141.
Koil CE, Everett JN, Hoechstetter L, Ricer RE, Huelsman KM. Differences in physician referral practices and attitudes regarding hereditary breast cancer by clinical practice location. Genet Med. 2003;5:364–369.
Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.
Dyson J, Lawton R, Jackson C, Cheater F. Does the use of a theoretical approach tell us more about hand hygiene behaviour? The barriers and levers to hand hygiene. J Infect Prev. 2011;12:17–24.
Eldh AC, Almost J, DeCorby-Watson K, Gifford W, Harvey G, Hasson H, et al. Clinical interventions, implementation interventions, and the potential greyness in between-a discussion paper. BMC Health Serv Res. 2017;17:1–10.
Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf. 2015;24:228–238.
Michie S, Carey RN, Johnston M, Rothman AJ, De Bruin M, Kelly MP, et al. From theory-inspired to theory-based interventions: A protocol for developing and testing a methodology for linking behaviour change techniques to theoretical mechanisms of action. Ann Behav Med. 2018;52:501–512.
Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:14.
Taylor N, Healey E, Morrow A, Greening S, Wakefield CE, Warwick L, et al. Aligning intuition and theory: enhancing the replicability of behaviour change interventions in cancer genetics. Implement Sci Commun. 2020;1:1–10.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38:65–76.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.
Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for Reporting Implementation Studies (StaRI) statement. BMJ. 2017;356:i6795.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
Phillips CJ, Marshall AP, Chaves NJ, Jankelowitz SK, Lin IB, Loy CT, et al. Experiences of using the Theoretical Domains Framework across diverse clinical environments: a qualitative study. J Multidiscip Healthc. 2015;8:139.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46:81–95.
Michie S, Prestwich A. Are interventions theory-based? Development of a theory coding scheme. Health Psychol. 2010;29:1.
Johnston M, Carey RN, Connell Bohlen LE, Johnston DW, Rothman AJ, de Bruin M, et al. Development of an online tool for linking behavior change techniques and mechanisms of action based on triangulation of findings from literature synthesis and expert consensus. Transl Behav Med. 2021;11:1049–1065.
Kmet LM, Lee RC, Cook LS. Standard quality assessment criteria for evaluating primary research papers from a variety of fields. Alberta Heritage Foundation for Medical Research. Retreived from http://www.ihe.ca/documents/HTA-FR13.pdf. 2004.
Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64:401–406.
Bednar EM, Sun CC, Camacho B, Terrell J, Rieber AG, Ramondetta LM, et al. Disseminating universal genetic testing to a diverse, indigent patient population at a county hospital gynecologic oncology clinic. Gynecol Oncol. 2019;152:328–333.
Bednar EM, Oakley HD, Sun CC, Burke CC, Munsell MF, Westin SN, et al. A universal genetic testing initiative for patients with high-grade, non-mucinous epithelial ovarian cancer and the implications for cancer treatment. Gynecol Oncol. 2017;146:399–404.
Dekker N, Hermens RP, de Wilt JH, van Zelst-Stams WA, Hoogerbrugge N, RISCO study group. Improving recognition and referral of patients with an increased familial risk of colorectal cancer: results from a randomized controlled trial. Colorectal Dis. 2015;17:499–510.
Scheuner MT, Hamilton AB, Peredo J, Sale TJ, Austin C, Gilman SC, et al. A cancer genetics toolkit improves access to genetic services through documentation and use of the family history by primary-care clinicians. Genet Med. 2014;16:60–69.
Swanson CL, Kumar A, Maharaj JM, Kemppainen JL, Thomas BC, Weinhold MR, et al. Increasing genetic counseling referral rates through bundled interventions after ovarian cancer diagnosis. Gynecol Oncol. 2018;149:121–126.
Wilson BJ, Torrance N, Mollison J, Watson MS, Douglas A, Miedzybrodzka Z, et al. Cluster randomized trial of a multifaceted primary care decision-support intervention for inherited breast cancer risk. Fam Pract. 2006;23:537–544.
Cohen SA, Laurino M, Bowen DJ, Upton MP, Pritchard C, Hisama F, et al. Initiation of universal tumor screening for Lynch syndrome in colorectal cancer patients as a model for the implementation of genetic information into clinical oncology practice. Cancer. 2016;122:393–401.
Edelman EA, Lin BK, Doksum T, Drohan B, Edelson V, Dolan SM, et al. Implementation of an electronic genomic and family health history tool in primary prenatal care. Am J Med Genet C Semin Med Genet. 2014;166:34–44.
Eichmeyer JN, Burnham C, Sproat P, Tivis R, Beck TM. The value of a genetic counselor: improving identification of cancer genetic counseling patients with chart review. J Genet Couns. 2014;23:323–329.
Cohen SA, McIlvried DE. Improving access with a collaborative approach to cancer genetic counseling services: a pilot study. Community Oncol. 2013;10:227–234.
Emery J, Morris H, Goodchild R, Fanshawe T, Prevost AT, Bobrow M, et al. The GRAIDS trial: A cluster randomised controlled trial of computer decision support for the management of familial cancer risk in primary care. Br J Cancer. 2007;97:486–493.
Kallenberg FGJ, Aalfs CM, The FO, Wientjes CA, Depla AC, Mundt MW, et al. Evaluation of an online family history tool for identifying hereditary and familial colorectal cancer. Fam Cancer. 2018;17:371–380.
Graff SL, Holder JM, Sears LE, Kurbegov D. Increase in genetic counseling and testing referrals after breast cancer pathway implementation. JCO Oncol Pract. 2020;16:e1481–e8.
Westwood G, Pickering R, Latter S, Little P, Gerard K, Lucassen A, et al. A primary care specialist genetics service: a cluster-randomised factorial trial. Br J Gen Pract. 2012;62:e191–e7.
Spinosa D, Acosta T, Wong J, Kurtovic K, Mewshaw J, Collins S, et al. Universal screening for Lynch syndrome in uterine cancer patients: a quality improvement initiative. Gynecol Oncol. 2021;160:169–174.
Koeneman MM, Kruse AJ, Sep SJS, Gubbels CS, Slangen BFM, Van Gorp T, et al. A family history questionnaire improves detection of women at risk for hereditary gynecologic cancer: a pilot study. Fam Cancer. 2014;13:469–475.
Miesfeldt S, Feero WG, Lucas FL, Rasmussen K. Association of patient navigation with care coordination in an Lynch syndrome screening program. Transl Behav Med. 2018;8:450–455.
Brown J, Athens A, Tait DL, Crane EK, Higgins RV, Naumann RW, et al. A comprehensive program enabling effective delivery of regional genetic counseling. Int J Gynecological Cancer. 2018;28:996–1002.
Kessels K, Eisinger JD, Letteboer TG, Offerhaus GJA, Siersema PD, Moons LMG. Sending family history questionnaires to patients before a colonoscopy improves genetic counseling for hereditary colorectal cancer. J Digest Dis. 2017;18:343–348.
Cohen PA, Nichols CB, Schofield L, Van Der Werf S, Pachter N. Impact of clinical genetics attendance at a gynecological oncology tumor board on referrals for genetic counseling and BRCA mutation testing. Int J Gynecol Cancer. 2016;26:892–897.
Heald B, Plesec T, Liu X, Burke CA, Kalady MF, Church J, et al. Implementation of institutional MSI and IHC testing for diagnosis of Lynch syndrome: the Cleveland Clinic experience. Fam Cancer. 2013;12:784–785.
Kishan AU, Gomez CL, Dawson NA, Dvorak R, Foster NM, Hoyt A, et al. Increasing appropriate BRCA1/2 mutation testing: the role of family history documentation and genetic counseling in a multidisciplinary clinic. Ann Surg Oncol. 2016;23 Suppl 5:634–641.
Pederson HJ, Hussain N, Noss R, Yanda C, O’Rourke C, Eng C, et al. Impact of an embedded genetic counselor on breast cancer treatment. Breast Cancer Res Treat. 2018;169:43–46.
Rana HQ, Kipnis L, Hehir K, Cronin A, Jaung T, Stokes SM, et al. Embedding a genetic counselor into oncology clinics improves testing rates and timeliness for women with ovarian cancer. Gynecol Oncol. 2021;160:457–463.
Senter L, O’Malley DM, Backes FJ, Copeland LJ, Fowler JM, Salani R, et al. Genetic consultation embedded in a gynecologic oncology clinic improves compliance with guideline-based care. Gynecol Oncol. 2017;147:110–114.
Moss CA, Cojocaru E, Hanwell J, Ward S, Xu W, van Zyl M, et al. Multidisciplinary interventions in a specialist Drug Development Unit to improve family history documentation and onward referral of patients with advanced cancer to cancer genetics services. Eur J Cancer. 2019;114:97–106.
Doe S, Petersen S, Swain M. Utilization of genetic testing in breast cancer treatment after implementation of comprehensive multi‐disciplinary care. Breast J. 2020;26:911–916.
Helsper CW, Van Vliet LM, Velthuizen ME, De Wit NJ, Beijaert RPH, Butter E, et al. Identifying patients with a history of ovarian cancer for referral for genetic counselling: non-randomised comparison of two case-finding strategies in primary care. Br J Gen Pract. 2018;68:e750–e6.
Clyman JC, Nazir F, Tarolli S, Black E, Lombardi RQ, Higgins JJ. The impact of a genetics education program on physicians’ knowledge and genetic counseling referral patterns. Med Teach. 2007;29:e143–e50.
Overbeek L, Hermens R, Van Krieken J, Adang E, Casparie M, Nagengast F, et al. Electronic reminders for pathologists promote recognition of patients at risk for Lynch syndrome: cluster-randomised controlled trial. Virchows Arch. 2010;456:653–659.
Paul JL, Leslie H, Trainer AH, Gaff C. A theory-informed systematic review of clinicians’ genetic testing practices. Eur J Hum Genet. 2018;26:1401–1416.
Roberts MC, Kennedy AE, Chambers DA, Khoury MJ. The current state of implementation science in genomic medicine: opportunities for improvement. Genet Med. 2017;19:858–863.
Meissner HI, Glasgow RE, Vinson CA, Chambers D, Brownson RC, Green LW, et al. The US training institute for dissemination and implementation research in health. Implement Sci. 2013;8:1–9.
Morrow A, Chan P, Tiernan G, Steinberg J, Debono D, Wolfenden L, et al. Building capacity from within: qualitative evaluation of a training program aimed at upskilling healthcare workers in delivering an evidence-based implementation approach. Transl Behav Med. 2021.
Morrow A, Hogden E, Kang Y-J, Steinberg J, Canfell K, Solomon MJ, et al. Comparing theory and non-theory based implementation approaches to improving referral practices in cancer genetics: a cluster randomised trial protocol. Trials. 2019;20:1–12.
White S, Jacobs C, Phillips J. Mainstreaming genetics and genomics: a systematic review of the barriers and facilitators for nurses and physicians in secondary and tertiary care. Genet Med. 2020:22:1149–1155.
Albano MG, Jourdain P, De Andrade V, Domenke A, Desnos M, d’Ivernois J-F. Therapeutic patient education in heart failure: do studies provide sufficient information about the educational programme? Arch Cardiovasc Dis. 2014;107:328–339.
Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332:413–416.
Kirk MA, Moore JE, Stirman SW, Birken SA. Towards a comprehensive model for understanding adaptations’ impact: the model for adaptation design and impact (MADI). Implement Sci. 2020;15:1–15.
Morrow A, Parkinson B, Kang Y-J, Hogden E, Canfell K, Taylor N. The health and economic impact of implementation strategies for improving detection of hereditary cancer patients—protocol for an in-depth cost-effectiveness evaluation with microsimulation modelling. Implement Sci Commun. 2020;1:1–12.
Petzel SV, Vogel RI, McNiel J, Leininger A, Argenta PA, Geller MA. Improving referral for genetic risk assessment in ovarian cancer using an electronic medical record system. Int J Gynecol Cancer. 2014;24:1003–1009.
The authors sincerely thank Suzanne Hughes from Cancer Council NSW for her guidance and input into the search strategy for this systematic review. A.M. is a recipient of an Australian Government Research Training Program Scholarship and a Translational Cancer Research Network Clinical PhD Scholarship Top-up award, supported by the Cancer Institute NSW. Funding support has also been provided by Cancer Council NSW.
The authors declare no competing interests.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Morrow, A., Chan, P., Tucker, K.M. et al. The design, implementation, and effectiveness of intervention strategies aimed at improving genetic referral practices: a systematic review of the literature. Genet Med 23, 2239–2249 (2021). https://doi.org/10.1038/s41436-021-01272-0
This article is cited by
Implementing organized colorectal cancer screening programs in Europe—protocol for a systematic review of determinants and strategies
Systematic Reviews (2023)
Aligning intuition and theory: a novel approach to identifying the determinants of behaviours necessary to support implementation of evidence into practice
Implementation Science (2023)
Pathogenic variants among females with breast cancer and a non-breast cancer reveal opportunities for cancer interception
Breast Cancer Research and Treatment (2023)