Abstract
Biomedical HIV-prevention strategies (BmPS) among men who have sex with men (MSM), such as pre-exposure prophylaxis (PrEP) and viral load sorting (VLS), are essential but relatively new and their uptake gradual. Using an extension of the causal attitude network approach, we investigated which beliefs are related to uptake of PrEP and VLS at each time-point. We included 632 HIV-negative MSM from the Amsterdam Cohort Studies from four data-waves between 2017 and 2019. We estimated weighted, undirected networks for each time-point, where we included pairwise interactions of PrEP and VLS uptake and related beliefs. PrEP use increased from 10 to 31% (p < 0.001), while VLS was reported by 7–10% at each time-point. Uptake of both BmPS was directly related to the perceived positive impact of the strategy on one’s quality of sex life and perceived supportive social norms. Overall network structure differed between time points, specifically in regard to PrEP. At earlier time points, perceptions of efficacy and affordability played an important role for PrEP uptake, while more recently social and health-related concerns became increasingly important.The network structure differed across data-waves, suggesting specific time changes in uptake motives. These findings may be used in communication to increase prevention uptake.
Similar content being viewed by others
Introduction
In most high-income countries, men who have sex with men (MSM) continue to be disproportionally affected by HIV1. In 2020, 63% of new HIV diagnoses in the Netherlands were among MSM2. In the early stages of the HIV epidemic, HIV prevention choices were limited to condom use, serosorting, or sexual abstinence. In the past decade, the HIV prevention toolbox has expanded with biomedical prevention strategies (BmPS), which make use of antiretroviral medication to prevent HIV infections. Two BmPS that effectively prevent HIV are pre-exposure prophylaxis (PrEP) and increased testing and treating of HIV-positive individuals (i.e., “treatment as prevention” [TasP]). PrEP is a pill containing antiretrovirals that can be taken either daily or intermittently (i.e., before and after sex) by HIV-negative individuals. If PrEP is taken correctly, it is highly effective in preventing HIV infection among MSM3,4,5,6. TasP enables HIV-negative MSM to decide to have safe sex with HIV-positive MSM based on information about their viral load, which we refer to as viral load sorting (VLS). VLS is based on the assumption of “Undetectable = Untransmittable” (U = U), which holds that HIV-positive individuals who have a sustained undetectable viral load—usually achieved by consistently adhering to antiretroviral therapy—cannot sexually transmit HIV7,8.
Mathematical modeling studies show that BmPS have the potential to eliminate new HIV infections among MSM, although this is highly dependent on BmPS uptake and adherence 9,10,11. Literature illustrates that BmPS uptake is often far from optimal12,13,14,15 with several psychosocial factors curtailing uptake16,17,18,19,20,21,22,23. An estimate of PrEP uptake suggests that only 7% of MSM in Amsterdam, the capital of the Netherlands, used PrEP in 201712. At that time, PrEP was only available free-of-charge through research programs for a small number of MSM24,25. Outside research settings, PrEP was also used, but difficult to obtain and expensive, limiting its uptake26,27. In recent years, PrEP became more affordable and accessible due to the availability of generic PrEP in 201828 and the implementation of a national PrEP program in August 201929. PrEP uptake is currently estimated at 7542 individuals in the Netherlands15,30, which still falls behind the optimal uptake of 10,000 individuals who are eligible for PrEP31. As for VLS, no data is currently available on the number and proportion of HIV-negative MSM in the Netherlands that apply VLS as an active prevention strategy, despite the recent conclusive evidence for the effectiveness of U = U in the context of anal sex among MSM8,32. To optimize uptake of BmPS among those with unmet prevention needs, it is essential to get insight into actual uptake among MSM, to identify individual motives and barriers for BmPS usage and to explore how these change over time due to increased availability and acceptability within the MSM community. The present research aims to provide such insight.
To understand and explain the uptake of health behaviors, several psychosocial theories, which include the health belief model (HBM)33 and the theory of planned behavior (TPB)34, have successfully been used in the past. In the HBM, behavior is explained by the perceived threat of a health risk and individual motivation based on the perceived costs and benefits of a health behavior, self-efficacy and cues to action. In the TPB, behavior is explained through behavioral intention, which is the product of attitude, perceived behavioral control and social norms. In the context of PrEP, previous studies have shown barriers of PrEP uptake that were in line with such models, such as perceived lack of self-efficacy, low HIV risk perception, and problematic beliefs regarding PrEP’s efficacy, costs, expected stigma, and knowledge regarding the potential physical health and sexual effects17,19,20,21,22. The little that is known on the psychosocial factors related to application of VLS among HIV-negative MSM suggests that lack of knowledge and disbelief in the U = U principle are predominant factors of perceived low efficacy of VLS35. However, the fact that these models offer a simplified and causal explanation of behavior has been criticized as it assumes unidirectional effects of the predictors on behavior, which may mask important interrelationships between variables36,37,38. Furthermore, not all aspects of these models may be equally important, but instead there may be more central and less central components determining BmPS uptake. In addition, the adaptation of new preventive measures based on new scientific insights can be expected to change rapidly over time after which initial acceptability barriers give place to more structural ones. Such temporal changes have not received sufficient attention in previous studies on BmPS uptake.
Given the complexity of the psychological factors underlying BmPS uptake, we aim to examine more comprehensive interactions of factors that contribute to the uptake of BmPS over time and employ an approach that is agnostic about the causal relationships between factors. Using the causal attitude network (CAN) approach39, we applied a complex system network approach to provide insight into the relative importance of each specific factor that may be useful to target in behavior change interventions to improve the uptake of BmPS among MSM.
Psychological network approach
In this study, we build on the work of Dalege and colleagues38 who introduced the Causal Attitude Network (CAN) model. Within this model, attitudes are conceptualized as a network of evaluative reactions (nodes) that interact with each other (edges) and are corrected for all other nodes in the network. The CAN model provides a novel approach to the study of attitudes and behaviors. This approach is inherently flexible and can encompass a wide range of factors that can include or exclude the target behavior. Including the target behavior in the network allows the exploration of direct and indirect relationships between specific beliefs and the target behavior40. An example of a hypothetical simple, weighted, undirected network in which the outcome of interest is included is presented in Fig. 1 below, in which three nodes are included: the behavioral HIV prevention strategy condom use and two evaluative reactions (fear of HIV and sexual pleasure). The connections between them are represented by edges that represent positive or negative relations between nodes and that can differ in magnitude (i.e., weighted network). The edges are undirected as they present bidirectional associations. Because of interrelatedness of nodes in the CAN model, influencing one node (e.g., sexual pleasure) may have consequences for other nodes within the network and result in change in the target behavior (i.e., condom use), or vice versa.
Other key properties of an empirical attitude network model include the overall connectivity of a network41, centrality of nodes within the network, and closely connected nodes that form communities. Connectivity is the extent to which the nodes in the network are related to one another. It has been shown that the higher the connectivity of the network, the more closely its components are related to behaviour and the more stable and resistant to change or persuasion the network is38,42. The centrality of a node reflects the extent to which it is connected to other nodes in the network. Centrality thus provides information about the structural importance of a given node in the network and may inform which nodes are therefore most closely related to decision-making39,42. Beliefs clustering with the target behaviour (i.e., community) indicate they are more closely connected to each other than to other nodes. In sum, all network properties provide some information on which nodes are most important within the network, but also provide information on their mutual dependencies with other nodes.
The present study
So far, the CAN model has only been applied to cross-sectional attitude data towards a single attitude object. Temporal network approaches to date have been theoretical and predominantly focused on the connectivity property of network models41,43. This is one of the first study in which the interplay of factors is investigated through empirical data. We explore which factors relate to two co-existing BmPS and how changes in these factors may help explain how the uptake of PrEP and VLS change across time points. We extend the CAN model in two important ways. First, we extend the model with factors that transcend latent constructs of individual attitudes. We investigate a broader psychological system that also includes factors related to perceived structural and practical barriers of BmPS uptake, knowledge and demographics. Second, we focus on several properties of the CAN model at different time points which helps us to evaluate whether the structure of the network and thus the relative importance of factors is different at different time points. In doing so, our study is not only the first to apply such a complex attitude network approach to two recently introduced BmPS, but also one of the first to examine the temporal dynamics of attitude networks.
Results
In total, we included 632 HIV-negative MSM (Fig. 2) with a median of 3 [interquartile range (IQR)]: 2–4) visits (see Table 1 for their baseline socio-demographic characteristics). Use of any HIV prevention strategy in the past 6 months increased from 78% at T1 to 84% at T4 (test for linear trend: odds ratio (OR) = 1.10, 95% confidence interval (95% CI) = 1.03–1.17; p = 0.003, Table 2). PrEP use increased from 10% at T1 to 31% at T4 (test for linear trend: OR = 1.40, 95% CI 1.31–1.49; p < 0.001), condom use decreased from 64 to 57% (test for linear trend: OR = 0.92, 95% CI 0.88–0.97; p = 0.002), and uptake of VLS remained similar and was overall reported in 7–10% of participants (test for linear trend: 1.06, 95% CI 0.95–1.18; p = 0.278).
The means and standard deviations of all included PrEP and VLS beliefs at the four time points are shown in Table 3.
Network analyses
The estimated networks, including use of PrEP and VLS as BmPS and related factors, are shown in Fig. 3 per time point. The edge weights, accuracy and difference tests of the estimated edges, and community detection analyses at each time point can be found in the Supplementary materials S1, S2, S3 and S4.
Direct correlates of PrEP and VLS uptake
From T1 to T4, PrEP use was consistently and directly connected at each time point to a positive descriptive norm of gay friends using PrEP [prep13; edge weights at T1: 0.34 (0.01–0.71), T2: 0.18 (0.02–0.39), T3: 0.30 (0.22–0.60); T4: 0.27 (0.00–0.39)] and expecting lower burden of expected side-effects [prep9; T1: 0.48 (0.33–0.72), T2: 0.20 (0.00–0.37), T3: 0.12 (0.00–0.29), T4: 0.34 (0.00–0.51)], and at three time points to the perceived positive impact of PrEP on one’s sex life [prep1; T1:0.14 (0.00–0.41), T2:0.32 (0.18–0.57), T3:0.21 (0.02–0.39); and prep11; T1: 0.26 (0.01–0.45), T3: 0.27, T4: 0.07 (0.00–0.26)], older age [age; T1: 0.26 (0.02–0.78), T2: 0.14 (0.00–0.38), T3: 0.20 (0.10–0.47)] and VLS uptake [VLS; T1:0.09 (0.00–0.78), T2:0.09 (0.00–0.57), T3: 0.38 (0.00–0.76)]. Correlates directly related to PrEP uptake at T4 but not at earlier time points were not expecting PrEP to cause HIV drug resistance [prep8; T4: 0.12 (0.00–0.32)) or burdensome PrEP procedures (prep10; T4: 0.34 (0.00–0.38)], and not having a steady partner [sp; T4: − 0.18 (− 0.22–0.00)]. In contrast, beliefs such as PrEP’s perceived affordability [prep7; T2: 0.11 (0.00–0.37)] and efficacy [prep4, T1: 0.08 (0.00–0.12), T2: 0.16 (0.00–0.36)] were directly related to PrEP uptake at earlier time points (T1 and/or T2), but not at more recent time points (T3 and/or T4).
VLS uptake was directly related at most time points to PrEP uptake [PrEP, T1: 0.09 (0.00–0.78), T2: 0.09 (0.00–0.57), T4: 0.38 (0.00–0.55)], the perceived beneficial impact of VLS on quality of sex life [vls5; T3: 0.11 (0.00–0.31), T4: 0.24 (0.00–0.28)] and to gay friends approving of VLS as an HIV prevention method [vls8; T1: 0.25 (0.00–0.71), T2: 0.23 (0.00–0.51)]. Additionally, the strongest direct correlates of VLS uptake uniquely for T4 were expecting PrEP to cause HIV drug resistance [prep8; T4: − 0.11 (− 0.36–0.00)], viewing PrEP users as individuals engaging in high-risk behaviors [prep15; T4: 0.21 (0.00–0.32)], a negative injunctive norm of others not approving of PrEP use [prep14; T4: − 0.13 (− 0.19–0.00)], the perceived good efficacy of VLS [vls3; T4: 0.14 (0.00–0.16] and older age [age; T4: 0.14 (0.00–0.37)].
Community detection
The colored groups in Fig. 3 represent clusters with higher interconnectedness (i.e., communities). Community detection analysis revealed that PrEP uptake at T4 clustered with practical aspects, such as perceived burden of side-effects, burden of PrEP procedures, self-efficacy and affordability, while at T1 clustering was suggestive of more social concerns or need for social approval, indicating differential interconnectedness of nodes between time points. Community detection of VLS uptake was less distinctive and suggests a role for socio-demographics, such as increasing age, and relationship status being related to VLS uptake.
Node centrality
The node centrality results are displayed in Fig. 4 and represent which nodes are most influential in the networks. Outcomes of the accuracy and differences tests in strength per time point can be found in the supplementary material S5 and S6. The average correlation of the strength of our original samples with the strength of subsets of that sample suggest that the strength measure was highly stable and accurate at all time points (all above 0.7). Across time points, the strength of our outcomes of interest, PrEP and VLS uptake, increased and became the nodes with highest strength at T4 (prep T4: 1.9; vls T4: 1.4) strength did not differ). Regarding PrEP beliefs, largest change in strength was found in PrEP’s perceived impact on one’s sex life and quality of sex life and perceived efficacy of PrEP. These nodes were most influential at T1 for the network (prep1 and prep11 T1 both 1.7; prep4 T1: 1.6), but their relative importance decreased towards T4 (prep1 T4: 0.9; prep11 T4: 1.2; prep4 T4: 0.8), showing a similar pattern to the direct correlates of PrEP use. In contrast, nodes with increasing strength from T1 to T4 were not expecting PrEP to cause HIV drug resistance (prep8 T1: 0.5; T4: 0.9) and others approving of PrEP use (prep14 T1: 1.0; T4: 1.3), which were also direct correlates of PrEP use at T4. Other PrEP beliefs showed relatively stable but lower strength, suggesting that influencing these nodes are less likely to change the network at T4. The strength of VLS beliefs were fairly similar for all VLS nodes and remained relatively similar across time points, although some VLS-related social norm nodes lost strength, suggesting a more important role in the network at T1 compared to T4. At T4, VLS nodes with the highest and similar strength were perceived self-efficacy of VLS use (vls9 T4: 1.5) and the perceived preventive effectiveness of VLS (vls3 T4: 1.0), and others using VLS (vls7 T4: 1.1) and approving of VLS as HIV prevention strategy (vls6 T4: 0.9).
Temporal network differences
The results of the network comparison test indicate that the global strength (i.e., a measure of the connectivity of the network) did not change across time points (global strength for T1: 10.75, T2: 9.92, T3: 11.83, T4: 10.69; p > 0.05 for all, Table 4). However, the network structure differed significantly between T1 and T4 (p = 0.020) and T1 and T2 (p = 0.002), suggesting that the overall difference between T1 and T4 is most likely due to changes in network structure occurring from T1 to T2. Figure 5 displays the significant differences in edge weights between nodes between each of the time points.
Sensitivity analyses
The sensitivity analyses in which we restricted our analyses to those reporting condomless anal sex (CAS) showed similar results with regards to baseline characteristics (Supplement S9), associations with PrEP and VLS uptake (Supplement S7 and S8), and the network structure (network invariance: p = 0.594) (Supplement S10 and edges directly relating to PrEP and VLS at T4 (Supplement S1). In addition, PrEP use but not VLS, also increased among both participants reporting and not reporting CAS with a casual partner (p < 0.001 for both, data not shown).
Discussion
Since uptake of BmPS is one of the key factors to achieve HIV elimination, we describe the interplay of factors that were related to the uptake of these strategies among HIV-negative MSM and their related temporal dynamics. To do so, we took a complex systems approach by applying the CAN model, in which variables are presented as networks, to the case of BmPS uptake. We found that, between July 2017 and December 2019, PrEP use significantly increased, while the uptake of VLS remained relatively stable and was reported by approximately one tenth of participants. We showed that at almost all time points, both strategies were interrelated: the uptake of each strategy was directly related to the use of the other strategy. Other consistent relations of BmPS uptake were the perceived positive impact of each strategy on one’s quality of sex life and significant others approving or using of the strategy as an HIV prevention method. In addition, we found that the network structure significantly differed between the first and last time point, suggesting changes in uptake motives between time points, specifically regarding PrEP uptake.
Regarding these temporal changes, our study showed that perceptions of efficacy and affordability played a more important role in PrEP uptake at earlier time points as compared to later time points. This may in part be explained by the concurrent developments in PrEP implementation in the Netherlands increasing its affordability and accessibility since 2018. As shown by the difference in network structure between T1 and T2, this shift already occurred early in our study, after which the network structure remained stable until T4. We interpret this as an indication that once such initial concerns are overcome, social (e.g., others approval of PrEP use) and health-related barriers (e.g., not expecting side-effects, HIV drug resistance and burden of PrEP procedures) become more important in the decision-making process. In contrast to PrEP, increase in usability-related factors such as efficacy were not related to increased uptake of VLS. A possible explanation is that the conclusive scientific evidence for U = U in MSM only became available in mid-201832 and therefore the trust in this strategy could have been low in the earlier data waves we used. Furthermore, as TasP is usually framed as an HIV-prevention strategy for HIV-positive individuals44,45,46 while our participants were all HIV-negative, they may not be aware of TasP as existing HIV prevention strategy in the form of VLS.
At the most recent time point, PrEP use and VLS became the most central nodes and showed the strongest direct positive relationships with each other. This is encouraging as it may imply that whenever one BmPS is used, the likelihood of using another BmPS is higher, suggesting that overall BmPS became more acceptable HIV prevention strategies to a subgroup of MSM. In addition, results of BmPS uptake and decision-making were comparable in sensitivity analyses restricted to participants reporting CAS. In line with this, previous studies have suggested that gaps between eligibility and uptake are more likely explained by psychological factors, such as those included in our study, than by behavioural factors13,47.
Network methodology and its practical value for BmPS implementation
The added value of the CAN approach is that it is a data-driven approach to attitudes that provides insight into the structure of attitudes that goes beyond traditional models. It sheds light onto how the components that form a complex attitude system interrelate and adds a level of complexity to other models that describe unidirectional associations between a limited number of determinants and the behavioural outcome. In doing so, networks provide insight into how the factors are interrelated and show that not all factors—despite also being associated with BmPS uptake—are equally important at all time points.
A first key insight drawn from the present study is that it points towards specific perceptions that remain important across different time points and are consistently related to BmPS uptake, which include the impact of BmPS on the quality of sex life and social norms. Previous studies also found intimacy and increased sexual pleasure due to reduced need for condoms as important facilitators of PrEP uptake49,50,51,52,53. Perceived negative social norms were identified as a barrier for PrEP initiation, adherence and retention20,54,55,56,57. Our findings suggest that social norms and perceived quality of sex life remain closely linked to PrEP use and VLS, irrespective of stage of their implementation.
Second, the temporal changes in factors relating to PrEP uptake suggest that uptake motives may differ according to the stage of BmPS implementation. Given that new BmPS for HIV such as vaccines are currently being developed58 and new PrEP modalities such as long-acting injectable PrEP already showed efficacious59, this knowledge is helpful to decide which beliefs are most directly linked to BmPS uptake at different stages of implementation. In the future, such knowledge can be applied not only to new BmPS for HIV prevention that are still in development, but also to other fields that rely on biomedical prevention strategies, such as new vaccines or direct-acting antiviral medication for hepatitis C among MSM.
Third, previous studies have used the CAN network methodology to choose intervention targets. For example, earlier work indicated that influencing a node directly related to the target behaviour was a successful means to generate behavioural change in the target behaviour48. Another study showed that an intervention aimed at a central node led to change in the intended outcome and affected connected nodes62. In line with this reasoning, our results may also offer potential avenues towards behavioural change regarding BmPS uptake that are specific to the present context by looking at the nodes that either have the highest strength—and are thus highly influential in the network—or have direct associations with one or both BmPS at T4. This points towards the importance to target several aspects of social norms in the MSM community regarding BmPS, including gay friends and significant others approving of BmPS use and gay friends also applying these strategies. However, these nodes are likely more difficult to change than less influential nodes (e.g., lower in strength), but an effect of a change on the rest of the network is expected to be more profound and may result in more endurable behaviour change. Therefore, it may be more feasible to target nodes that are connected to these highly central nodes. In this case, prep15 and prep16 were directly connected with a relatively high effect size and describe beliefs linking PrEP to promiscuity or rather sexual health. A strategy to improve PrEP uptake might thus be to generate more positive community norms include further fortifying the framing of PrEP as a health preservation opportunity rather than a sign of promiscuity20,63. In addition, considering the undirectional nature of the network, it is also possible that PrEP use itself leads to supportive norms. PrEP-users themselves have indeed been described as role models who can facilitate peer communication and normalization of PrEP use64,65. In any case, both avenues underscore the added value of a network analysis in which the interrelatedness of factors is taken into account over other analysis techniques that only focus on associations with the outcome. It should be noted, however, that our findings only provided insights into potential routes for behaviour change based on the networks we presented at each wave. Future studies should focus on whether targeting the described intervention targets indeed results in change in uptake. Unfortunately, our results provided us less apparent directives how to intervene with VLS uptake in the current time due high interrelatedness of VLS uptake with PrEP use and socio-demographic factors (i.e., age and having a steady partner). The latter requires further investigation to understand their impact in VLS uptake. The current low uptake of VLS may suggest that much work can still be done to improve awareness of VLS as an effective HIV prevention strategy. Considering the strong relationship between beliefs in PrEP efficacy and PrEP uptake, increasing the recognition of VLS as an effective prevention strategy among HIV-negative MSM could further contribute to increased uptake. In turn, increased uptake could also lead to increased trust in effectiveness.
Theoretical implications
Apart from the implications applied to HIV prevention, our study showed the viability of (1) broadening the scope of the CAN model beyond the focus on latent constructs of intra-attitudinal processes, and (2) studying network dynamics of health behaviour uptake at different points in time within the CAN model. First, the extension of the CAN model showed that by broadening the scope, we can increase the level of detail of the produced paths without hampering feasibility and make more specific recommendations regarding behaviour change as a result. In addition, we found that some constructs that are well-known for their predictive role in psychosocial models only played a moderate to minor role in determining our outcome behaviours, underscoring the added value of the broader scope. For example, perceived efficacy of PrEP played a moderate role in determining PrEP uptake, but only at earlier time points when PrEP use was probably less well integrated and knowledge in the community was limited. Likewise, in the network HIV risk perception was only peripherally connected to both of our target behaviours, suggesting that perceived exposure to risk was not central in BmPS decision-making.
Second, we demonstrated that the extended CAN model can be used to study changes in the structural importance of nodes. In the present study, structural importance of nodes rapidly changed across time points, while the connectivity of the networks remained stable. The latter is in contrast to previous theoretical work in which it is argued that connectivity increases over time once individuals become more familiar with (and think about) an attitude object43, thus increasing attitude strength. Accordingly, one could have expected a similar effect to occur here with the growing familiarity with BmPS. However, connectivity in our study was relatively low (with relatively high average shortest path lengths of 16.85–17.92) compared to other studies41,43 and did not increase. The reason that the connectivity remained relatively low could be that the attitudes are volatile as a result of changes in the availability and acceptability of strategies. This may provide inroads for behavioural change interventions since networks low in connectivity are easier to modify41. Studying temporal dynamics of networks may have the potential to provide insight into where interventions should be targeted at, at different stages of implementation, until a steady state of the network is reached, and the attitudes become more difficult to change.
Limitations of our approach relate predominantly to the inherent boundaries of the networks we presented. A network analysis like ours has as its goal to provide a comprehensive picture of the target behaviours, while at the same time, sufficient power is limited to networks of about 30 nodes per 500 participants66. Another limitation was the gap between T1 (July–December 2017) and T2 (July–December 2018) which limited us to specifically determine at which 6-monthly interval the significant change in network structure occurred. Finally, we acknowledge the temporal changes we found may be overestimated because of potential selection bias and low retest reliability and validity of the used measures. As for selection bias, we acknowledge the heterogeneity in our sample with only 41% of participants included at all time points Although we cannot rule this out, there were no significant differences in socio-demographics between time points, nor in socio-demographics or PrEP and VLS-related beliefs between those with (i.e., those included at all four time points) and without complete follow-up (data not shown), supporting the assumption of temporal changes rather than selection bias.
Conclusion
Using an extension of the CAN model, we successfully identified several specific beliefs that related to the uptake of BmPS at different time points. We suggest that uptake may improve by discussing the positive impact of BmPS use on one’s quality of sex life and by generating more BmPS supportive social norms in the community. In addition, we recommend adjusting interventions to the stage of their implementation as factors that are associated with the uptake of BmPS correspond with changes in the accessibility, affordability and acceptability over time. We recommend future research to examine the value of our current approach including temporal dynamics in understanding and enhancing other health behaviours.
Methods
Study design and participants
We included HIV-negative participants from the Amsterdam Cohort Study (ACS) on HIV, which is an open prospective cohort of HIV-positive and HIV-negative MSM. The ACS was initiated in 1984 to investigate the epidemiology, pathogenesis and (natural) course of HIV, sexually transmitted infections (STIs) and blood-borne infections, and to evaluate the effect of interventions16,67,68. More details on the procedures of the study have been described earlier67. In brief: men are eligible for enrolment in the ACS if they are at least 18 years old, live in the Amsterdam area or are involved in MSM-related activities taking place in Amsterdam, and had sex with other men in the past 6 months. Every 6 months, participants visit the Public Health Service Amsterdam, the Netherlands, for HIV and STI testing, and complete a self-administered questionnaire on, among others, sexual behavior, applied HIV prevention strategies, and related psychosocial factors. For the current analysis, we included all MSM who visited the ACS between July 2017 and December 2019 and included per wave those MSM who were HIV-negative, reported anal sex in the past 6 months and completed a questionnaire (Time point 1: July–December 2017, Time point 2: July–December 2018, Time point 3: January–June 2019, Time point 4: July–December 2019). We excluded the data wave January–June 2018 as the questionnaire on VLS- and PrEP-related beliefs was not administered during that wave. We defined baseline as the first visit since 1 July 2017.
Measures
Socio-demographic characteristics, sexual behavior, and use of HIV prevention strategies
We used data on socio-demographic characteristics (i.e., age, country of birth [Netherlands or other], education level [no college degree or at least college degree], residence area [in or outside Amsterdam]), sexual orientation (not exclusively homosexual or exclusively homosexual), having a steady partner (yes or no) and number of casual sex partners (0–5 or > 5 casual partners) in the past 6 months to describe the study population. At each of the time points, we measured condom use, PrEP use and VLS in the past 6 months.
Biomedical HIV prevention strategies and related variables included in the network
We included PrEP use and VLS in the past 6 months, socio-demographics, HIV risk perception, and a 21 PrEP-related and 9 VLS-related beliefs in the network analyses. Table 5 presents all the variables we included in the network and their short codes, the related items and their scale. The beliefs were informed by a previous study assessing PrEP use intention in the ACS16 relying on psychosocial theories such as TPB34 and the HBM33. The PrEP and VLS beliefs include injunctive and descriptive social norms, perceived self-efficacy, knowledge, perceived benefits and barriers of the use of BmPS (see Table 5).
Data analyses
First, all variables that measured the same belief and were measured with more than one item in the questionnaire (i.e., HIV risk perception and self-efficacy, see Table 5) were combined if their internal consistency exceeded 0.7 (Pearson’s correlation for 2 items or Cronbach’s alpha for > 2 items)69. The mean scores of the combined items were used in all further analyses.
Second, to examine the effect of time, we modelled the use of HIV prevention strategies (condoms, PrEP and VLS) and each PrEP and VLS related belief in logistic (for the HIV prevention strategies) and linear (for the beliefs) regression models using generalized estimating equations (GEE) to account for repeated measurements within individuals. In all models, we included the 6 monthly data waves as the time variable and the participant’s unique study id number to account for clustering.
Third, we estimated a weighted, undirected network for each time point, where we included pairwise interactions of PrEP and VLS use, age, having a steady partner, HIV risk perception, and 21 PrEP- and 9 VLS-related predictor variables (Table 5). To estimate the networks, we build on the work of Dalege et al.39. The networks were estimated using mixed graphical models, which allows inclusion of both binary and continuous data in contrast to other network estimation methods such as the eLasso procedure for binary66 or the Gaussian Graphical Model for continuous data70. The estimated networks resulted in sparse networks that represent each included variable as a node and display edges between the nodes that represent undirected, conditional dependent associations that are controlled for all other associations between nodes in the network. Edges between the continuous variables can be interpreted as partial correlations ranging from − 1 to 1, whereas for the binary nodes (PrEP, VLS and sp), a positive relation indicates that increasing the node results in a higher probability of outcome 1 of the factor (PrEP = 1: used PrEP in past 6 months, VLS = 1: VLS in past 6 months; sp = 1: reported a steady partner in the past 6 months). Using these estimated networks, we report on (1) direct correlates of PrEP and VLS use (using the edge weights between nodes and their bootstrapped 95% confidence intervals); (2) community detection to identify the clustering of beliefs closely related to each other (using the cluster walktrap algorithm [integrated in the igraph package] iterated 1000 times to select communities with nodes that belonged to the same community in over 90% of iterations); (3) node centrality to identify the nodes most influential in the networks (using node centrality measures); and (4) temporal differences between networks (using the Network Comparison Test). Popular indices of node centrality within a network are strength, betweenness and closeness71. In this paper, we only focused on strength as this indicator is most likely to produce stable parameter estimates72. Strength indicates the influence of a node on the network as it is based on the sum of the absolute edge values that are connected to a node. Influencing this node is most likely to impact the network as a whole39. We examined temporal differences with the network comparison test (NCT). This test assesses three things: first, whether the networks at each time point differ in network connectivity by testing differences in the global strength of a network (i.e., the sum of the absolute values of all edges in the network). Second, it determines whether the network structure is similar between time points by testing the maximum differences in edge weights between nodes of the networks, and, third, by testing which individual edge weights significantly differ across time points73. In addition, we have run two sensitivity analyses in which we estimated time trends in PrEP use and VLS use as outcomes and all other variables that were included in the network analyses in two logistic regression models using generalized estimating equations (GEE) to account for clustering within individuals. The results showed similar direct associations and effect sizes with PrEP and VLS as outcomes as the network analysis did (data not shown).
In our analyses we concentrated on choices of BmPS regardless of condom use because both condom users and non-condom users can choose to apply BmPS. We however conducted a range of sensitivity analyses to examine the change in the network structure if restricted to CAS, because behavioural factors such as absence of or inconsistent use of condoms could underlie the need to use BmPS, and, inconsistent condom use is a requirement to be enrolled in PrEP programs in the Netherlands. In these sensitivity analyses, we restricted the network analysis at the most recent time point to participants who reported CAS with casual partners in the past 6 months (N = 200 at T4) and tested for network invariance with the NCT. Additionally, we checked whether the baseline characteristics and associations of predictor variables with PrEP and VLS uptake were similar among this subgroup of the total sample (N = 258) compared to the total study population.
All network analyses were conducted in R version 3.6.374. We used the R-package mgm75 to estimate the networks, igraph76 for community detection, NetworkComparisonTest73 to compare the networks across time points, and qgraph77 to visualize all networks. In addition, to estimate the accuracy of our networks at each time point, we used bootnet to examine the accuracy of edge weights and the centrality measure strength and assessed whether the estimated edges and strength of each edge significantly differed from each other78. All other statistical analyses were conducted in Stata version 15.1 79. Results were considered significant at a p-value < 0.05.
Ethical considerations
The ACS was approved by the Medical Ethics Committee of the Amsterdam University Medical Center of the University of Amsterdam, the Netherlands (MEC 07/182). Participation is voluntary and without incentive. Written informed consent of each participant was obtained before enrollment. All research was carried out in accordance with the Declaration of Helsinki.
Data availability
The anonymized complete ACS dataset will soon be made publicly available at https://www.amsterdamcohortstudies.org/acsc/menu/publicdata.asp. In the meantime, the data used for the current study can be requested through datamanagersoz@ggd.amsterdam.nl.
References
European Centre for Disease Prevention and Control. HIV/AIDS surveillance in Europe 2018 – 2017 data, WHO Regional Office for Europe, Editor (WHO Regional Office for Europe, 2018).
van Sighem, A. I. et al. HIV Monitoring Report 2021 Human Immunodeficiency Virus (HIV) Infection in the Netherlands (Stichting HIV Monitoring, 2021).
Fonner, V. A. et al. Effectiveness and safety of oral HIV preexposure prophylaxis for all populations. AIDS 30(12), 1973–1983 (2016).
Grant, R. M. et al. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N. Engl. J. Med. 363(27), 2587–2599 (2010).
McCormack, S. et al. Pre-exposure prophylaxis to prevent the acquisition of HIV-1 infection (PROUD): effectiveness results from the pilot phase of a pragmatic open-label randomised trial. Lancet 387(10013), 53–60 (2016).
Molina, J. M. et al. On-demand preexposure prophylaxis in men at high risk for HIV-1 infection. N. Engl. J. Med. 373(23), 2237–2246 (2015).
Bavinton, B. R. et al. Viral suppression and HIV transmission in serodiscordant male couples: an international, prospective, observational, cohort study. Lancet HIV 5(8), e438–e447 (2018).
Rodger, A. J. et al. Risk of HIV transmission through condomless sex in serodifferent gay couples with the HIV-positive partner taking suppressive antiretroviral therapy (PARTNER): final results of a multicentre, prospective, observational study. Lancet 393(10189), 2428–2438 (2019).
Desai, K. et al. Modeling the impact of HIV chemoprophylaxis strategies among men who have sex with men in the United States: HIV infections prevented and cost-effectiveness. Aids 22(14), 1829-1839. https://doi.org/10.1097/QAD.0b013e32830e00f5 (2008).
Gomez, G. B. et al. The Cost and Impact of Scaling Up Pre-exposure Prophylaxis for HIV Prevention: A Systematic Review of Cost-Effectiveness Modelling Studies. PLoS. Med. 10(3), e1001401. https://doi.org/10.1371/journal.pmed.1001401 (2013).
Rozhnova, G. et al. Elimination prospects of the Dutch HIV epidemic among men who have sex with men in the era of preexposure prophylaxis. Aids 32(17), 2615. https://doi.org/10.1097/QAD.0000000000002050 (2018).
Coyer, L. et al. Pre-exposure prophylaxis among men who have sex with men in the Amsterdam Cohort Studies: use, eligibility, and intention to use. PLoS ONE 13(10), e0205663 (2018).
Parsons, J. T. et al. Uptake of HIV pre-exposure prophylaxis (PrEP) in a national cohort of gay and bisexual men in the united states. J. Acquir. Immune. Defic. Syndr. 74(3), 285–292 (2017).
Pyra, M. N. et al. Global implementation of PrEP for HIV prevention: setting expectations for impact. J. Int. AIDS Soc. 22(8), e25370 (2019).
AVAC. PrEPWatch. 2023 Accessed 9, March 2023 https://www.prepwatch.org/.
Bil, J. P. et al. What do Dutch MSM think of preexposure prophylaxis to prevent HIV-infection? A cross-sectional study. AIDS 29(8), 955–964 (2015).
Bil, J. P. et al. Motives of Dutch men who have sex with men for daily and intermittent HIV pre-exposure prophylaxis usage and preferences for implementation: A qualitative study. Medicine (Baltimore) 95(39), e4910 (2016).
Calabrese, S. K. & Underhill, K. How Stigma surrounding the use of HIV preexposure prophylaxis undermines prevention and pleasure: A call to destigmatize “Truvada Whores”. Am. J. Public Health 105(10), 1960–1964 (2015).
Dubov, A., Altice, F. L. & Fraenkel, L. An information-motivation-behavioral skills model of PrEP uptake. AIDS Behav. 22(11), 3603–3616 (2018).
GoluB, S. A. PrEP stigma: Implicit and explicit drivers of disparity. Curr. HIV/AIDS Rep. 15(2), 190–197 (2018).
Hannaford, A. et al. The Use of online posts to identify barriers to and facilitators of HIV pre-exposure prophylaxis (PrEP) among men who have sex with men: A comparison to a systematic review of the peer-reviewed literature. AIDS Behav. 22(4), 1080–1095 (2018).
Peng, P. et al. A global estimate of the acceptability of pre-exposure prophylaxis for HIV Among men who have sex with men: A systematic review and meta-analysis. AIDS Behav. 22(4), 1063–1074 (2018).
Pinto, R. M. et al. Improving PrEP implementation through multilevel interventions: A synthesis of the literature. AIDS Behav. 22(11), 3681–3691 (2018).
Hoornenborg, E. et al. Men who have sex with men more often chose daily than event-driven use of pre-exposure prophylaxis: Baseline analysis of a demonstration study in Amsterdam. J. Int. AIDS Soc. 21(3), e25105 (2018).
AVAC. DISCOVER. 2019 Accessed 9, March 2023 https://www.avac.org/trial/discover.
Hulstein, S. H. et al. Eligibility for HIV preexposure prophylaxis, intention to use preexposure prophylaxis, and informal use of preexposure prophylaxis among men who have sex with men in Amsterdam, the Netherlands. Sex Transm. Dis. 48(2), 86–93 (2021).
Coleman, R. & Prins, M. Options for affordable pre-exposure prophylaxis (PrEP) in national HIV prevention programmes in Europe. Euro. Surveill 22(42), 17 (2017).
Aidsfonds. PrEP nu voor 50 euro beschikbaar bij alle apotheken. Accessed 21 May 2021. 2018 [cited 2020 14–12–2020]: https://aidsfonds.nl/nieuws/prep-nu-voor-50-euro-beschikbaar-bij-alle-apotheken/#:~:text=Er%20is%20nu%20een%20generieke,een%20beperkt%20aantal%20apotheken%20aangeboden.
Bruins, B. Beleidsreactie preventief gebruik van hiv-remmers (PrEP) (Ministry of Health, Welfare and Sport, 2018).
van Ark, T. Kamerbrief Voortgang PrEP verstrekking (Ministerie van Volksgezondheid Welzijn en Sport, 2020).
Reitsema, M. et al. Preexposure prophylaxis for men who have sex with men in the Netherlands: impact on HIV and Neisseria gonorrhoeae transmission and cost-effectiveness. AIDS 34(4), 621–630 (2020).
Rodger, A., Risk of HIV transmission through condomless sex in gay couples with suppressive ART: the PARTNER2 study expanded results in gay men, in 22nd International AIDS Conference. 2018.
Rosenstock, I. M., Strecher, V. J. & Becker, M. H. Social learning theory and the health belief model. Health Educ. Q 15(2), 175–183 (1988).
Ajzen, I. The theory of planned behavior. Organ. Behav. Hum. Decis. Process. 50, 179–211 (1991).
Rendina, H. J. & Parsons, J. T. Factors associated with perceived accuracy of the Undetectable = Untransmittable slogan among men who have sex with men: Implications for messaging scale-up and implementation. J. Int. AIDS Soc. 21(1), e25055 (2018).
Gruijters, S. L. K. & Fleuren, B. P. I. Measuring the unmeasurable : The psychometrics of life history strategy. Hum. Nat. 29(1), 33–44 (2018).
Crutzen, R., Peters, G. Y. & Noijen, J. Using confidence interval-based estimation of relevance to select social-cognitive determinants for behavior change interventions. Front. Public Health 5, 165 (2017).
Dalege, J. et al. Toward a formalized account of attitudes: the causal attitude network (CAN) model. Psychol. Rev. 123(1), 2–22 (2016).
Dalege, J. et al. Network analysis on attitudes: A brief tutorial. Soc. Psychol. Personal Sci. 8(5), 528–537 (2017).
Mkhitaryan, S. et al. Network approach in health behaviour research; how can we explore new questions?. Health Psychol. Behav. Med. 7(1), 362–384 (2019).
Dalege, J. et al. A network perspective on attitude strength: Testing the connectivity hypothesis. Soc. Psychol. Personality Sci. 10(6), 746–756 (2019).
Dalege, J. et al. Network structure explains the impact of attitudes on voting decisions. Sci. Rep. 7(1), 4909 (2017).
Dalege, J. et al. The attitudinal entropy (AE) framework as a general theory of individual attitudes. Psychol. Inq. 29, 175–193 (2018).
Matacotta, J. J., Rosales-Perez, F. J. & Carrillo, C. M. HIV preexposure prophylaxis and treatment as prevention - beliefs and access barriers in men who have sex with men (MSM) and transgender women: A systematic review. J. Patient Cent. Res. Rev. 7(3), 265–274 (2020).
Young, I., Flowers, P. & McDaid, L. M. Key factors in the acceptability of treatment as prevention (TasP) in Scotland: A qualitative study with communities affected by HIV. Sex Transm. Infect 91(4), 269–274 (2015).
Grov, C. et al. Prevalence of and factors associated with the use of HIV serosorting and other biomedical prevention strategies among men who have sex with men in a US nationwide survey. AIDS Behav. 22(8), 2743–2755 (2018).
van Dijk, M. et al. Slow uptake of PrEP: Behavioral predictors and the influence of price on PrEP uptake among MSM with a high interest in PrEP. AIDS Behav. 25, 2382–2390 (2021).
Zwicker, M. V. et al. Applying an attitude network approach to consumer behaviour towards plastic. J. Environ. Psychol. 69, 101433 (2020).
Collins, S. P., McMahan, V. M. & Stekler, J. D. The impact of HIV pre-exposure prophylaxis (PrEP) use on the sexual health of men who have sex with men: a qualitative study in Seattle, WA. Int. J. Sex. Health 29(1), 55–68 (2016).
Gafos, M. et al. The context of sexual risk behaviour among men who have sex with men seeking PrEP, and the impact of PrEP on sexual behaviour. AIDS Behav. 23(7), 1708–1720 (2018).
Gamarel, K. E. & Golub, S. A. Intimacy motivations and pre-exposure prophylaxis (PrEP) adoption intentions among HIV-negative men who have sex with men (MSM) in romantic relationships. Ann Behav. Med. 49(2), 177–186 (2015).
Sun, C. J. et al. “Little tablets of gold”: An examination of the psychological and social dimensions of PrEP among LGBTQ communities. AIDS Educ. Prev. 31(1), 51–62 (2019).
Zimmermann, H. M. et al. The Impact of pre-exposure prophylaxis on sexual well-being among men who have sex with men. Arch. Sex. Behav. 50, 1829–1841 (2021).
Brooks, R. A. et al. Experiences of anticipated and enacted pre-exposure prophylaxis (PrEP) stigma among Latino MSM in Los Angeles. AIDS Behav 23(7), 1964–1973 (2019).
Grace, D. et al. The pre-exposure prophylaxis-stigma paradox: Learning from Canada’s first wave of PrEP users. AIDS Patient Care STDS 32(1), 24–30 (2018).
Tangmunkongvorakul, A. et al. Facilitators and barriers to medication adherence in an HIV prevention study among men who have sex with men in the iPrEx study in Chiang Mai, Thailand. AIDS Care 25(8), 961–967 (2013).
Golub, S. A. et al. Predictors of prep uptake among patients with equivalent access. AIDS Behav. 23(7), 1917–1924 (2019).
AVAC. The Future of ARV-Based Prevention and More. 2020 14, December 2020 https://www.avac.org/infographic/future-arv-based-prevention.
Landovitz, R.J., HPTN 083 interim results: pre-exposure prophylaxis containing long-acting injectable cabotegravir is safe and highly effective for cisgender men and transgender women who have sex with men, in 23rd International AIDS Conference (AIDS 2020: Virtual). 2020.
Grinsztejn, B., HPTN 083 interim results: efficacy of pre-exposure prophylaxis containing long-acting injectable cabotegravir is maintained across regions and key populations, in 23rd International AIDS Conference (AIDS 2020: Virtual). 2020.
Merck, Merck Advances Phase 3 Trial to Evaluate Investigational Islatravir as Once-Monthly Oral PrEP for Women at High Risk for Acquiring HIV-1, accessed 21 May 2021. https://www.merck.com/news/merck-advances-phase-3-trial-to-evaluate-investigational-islatravir-as-once-monthly-oral-prep-for-women-at-high-risk-for-acquiring-hiv-1/. 2020.
Chambon, M. et al. Tailored interventions into broad attitude networks towards the COVID-19 pandemic. PLoS ONE 17(10), e0276439 (2022).
Rojas Castro, D., Delabre, R. M. & Molina, J. M. Give PrEP a chance: Moving on from the “risk compensation” concept. J. Int. AIDS Soc. 22, e25351 (2019).
Gomez, W. et al. PrEP uptake as a social movement among gay and bisexual men. Cult. Health Sex. 24(2), 241–253 (2020).
Reyniers, T. et al. The social meanings of PrEP use—A mixed-method study of PrEP use disclosure in Antwerp and Amsterdam. Soc. Health Illn 43(6), 1311–1327 (2021).
van Borkulo, C. D. et al. A new method for constructing networks from binary data. Sci. Rep. 4, 5918 (2014).
van Bilsen, W. P. H. et al. Diverging trends in incidence of HIV versus other sexually transmitted infections in HIV-negative men who have sex with men (MSM) in Amsterdam. AIDS 34(2), 301–309 (2019).
van Griensven, G. J. et al. Changes in sexual behaviour and the fall in incidence of HIV infection among homosexual men. BMJ 298(6668), 218–221 (1989).
Cortina, J. M. What is coefficient alpha? An examination of theory and applications. J. Appl. Psychol. 78(1), 98–104 (1993).
Epskamp, S., Regularized Gaussian psychological networks: Brief report on the performance of extended BIC model selection. http://arxiv.org/abs/1606.05771. 2016.
Freeman, L. C. Centrality in social networks. Soc. Netw. 1, 215–239 (1978).
Santos, H. P. Jr. et al. Longitudinal network structure of depression symptoms and self-efficacy in low-income mothers. PLoS ONE 13(1), e0191675 (2018).
van Borkulo, C.D., et al. Comparing network structures on three aspects: A permutation test. 2017. https://doi.org/10.13140/RG.2.2.29455.38569.
R Core Team. R: A language and environment for statistical computing (R Foundation for Statistical Computing, 2020).
Haslbeck, J. M. B. & Waldorp, L. J. mgm: Estimating time-varying mixed graphical models in high-dimensional data. J. Stat. Softw. 93, 1–46 (2020).
Csardi, G. & Nepusz, T. The igraph software package for complex network research. InterJ Complex Syst. 1695(5), 1–9 (2006).
Epskamp, S. et al. qgraph: Network visualizations of relationships in psychometric data. J. Stat. Softw. 48(4), 1–18 (2012).
Epskamp, S., Borsboom, D. & Fried, E. I. Estimating psychological networks and their accuracy: A tutorial paper. Behav. Res. Methods 50(1), 195–212 (2018).
StataCorp. Stata Statistical Software: Release 15 (StataCorp LLC, 2017).
Acknowledgements
We gratefully acknowledge the Amsterdam Cohort Studies (ACS) on HIV infection, a collaboration between the Public Health Service of Amsterdam, the Amsterdam UMC, Sanquin Blood Supply Foundation, Medical Center Jan van Goyen, and the HIV Focus Center of the DC-Clinics. We furthermore thank their participants, study nurses (Leeann Storey and Samantha de Graaf) and data managers (Ertan Ersan, Dominique Loomans, Linda May, and Gerben Rienk Visser). We also acknowledge Monique Chambon for her contribution to the R-script and interpretation of the network analyses and Anders Boyd for his contribution to the remaining statistical analyses. The Amsterdam Cohort Study is part of the Netherlands HIV Monitoring Foundation and financially supported by the National Institute for Public Health and the Environment, Bilthoven, the Netherlands.
Author information
Authors and Affiliations
Contributions
H.Z. and U.D. contributed to study concept and design. H.Z. contributed to data management of the study and WvB and L.C. to data management of the ACS in general. H.Z., U.D. and F.vH. contributed to data analyses and/or interpretation of the data. H.Z. drafted the manuscript and all authors critically revised and approved the final version for publication. A.M. (coordination at Public Health Service of Amsterdam) and M.P. (overall coordination) are responsible for the ACS.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zimmermann, H.M.L., Davidovich, U., van Bilsen, W.P.H. et al. A psychosocial network approach studying biomedical HIV prevention uptake between 2017 and 2019. Sci Rep 13, 16168 (2023). https://doi.org/10.1038/s41598-023-42762-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-42762-2
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.