Several barriers complicate access to psychotherapy for depression, including time commitment, location of services, and stigma. Digital treatment has the potential to address these barriers, yet long term use of digital psychotherapy is poor. This paper presents data from a mixed-methods, online survey to document concerns patients with depression face when given the choice of in-person psychotherapy and digital psychotherapy. Participants were 164 adults living in the United States who had previously used or considered psychotherapy for depression. Rural-dwelling and racial/ethnic minority (Native American, African American, and Spanish-speaking) respondents were purposively sampled. Participants were asked their preferences for and opinions about four treatment modalities: self-guided digital, peer-supported digital, expert-guided digital, or in-person psychotherapy. Less than half (44.5%) of participants preferred in-person psychotherapy, 25.6% preferred self-guided digital treatment, 19.7% preferred expert-guided digital treatment, and 8.5% peer-supported digital treatment. Principal themes extracted from qualitative analysis centered on the efficacy of digital treatment, access to digital treatment, concerns about peer-supported care, confidentiality and privacy concerns, preference for in-person treatment, skepticism about self-guided therapy, and the impact of social anxiety on the use of video-chat based care. Future development of digital psychotherapy will need to address concerns regarding efficacy, privacy, data security, and methods to enhance motivation to use these treatments.
Depressive disorders are prevalent and are a leading cause of disability, lost productivity, and health care expenditure.1 Psychotherapies are effective in the treatment of mild to moderate depression,2,3 are first-line treatments for major depression,4 and are also the preferred treatment modality by most people with depression.5,6,7 Despite the effectiveness and preferences for these treatments, most people who seek psychotherapy for depression only attend one session,8,9,10 and in the US overall utilization by people with depression has declined from 15% in 1997 to 10% in 2007.11,12,13 At fault for poor utilization are transportation, time commitment (psychotherapy is typically delivered in weekly, hour-long appointments in a clinician’s office), and supply-side barriers, with too few professionals living in rural areas. The stigma that many cultural groups have related to seeking care also is noted as an important utilization barrier.14,15,16,17 A potential solution to overcome these barriers is providing treatment via digital means, such as on-line tools and mobile applications (apps). Currently, digital psychotherapy consists of self-guided digital treatment, in which consumers use web-based and app-based care to apply therapeutic principles without any additional support; peer-guided digital treatment, in which consumers use digital devices with access to trained peer support specialists who support and guide their use of the treatment program; and expert-guided digital treatment, in which consumers use digital devices with help from a professional. Studies find that digital interventions are efficacious,18 particularly for guided digital treatment,19 although effect sizes are smaller than those found for face-to-face treatment,20 and have negligible cost savings.21 Healthcare organizations around the globe offer digital tools to their depressed patients and a new healthcare industry based on fee-for-service, subscription based digital treatment has emerged in the US.22
While many digital interventions have not been rigorously tested, some digital interventions are evidence-based,23,24,25 and may address access barriers, a growing evidence base finds that utilization of digital treatment mirrors that of in-person psychotherapy and many patients with depression may prefer in-person, face-to-face treatment.26,27 For example, one study found that 86% of patients surveyed preferred face-to-face care to on-line treatment27 and another found that those who are reluctant to use in-person treatment are also reluctant to use on-line treatment.28 Although most people indicate a willingness to try digital interventions, there is some indication that concerns about effectiveness may mitigate use.29 Integration of digital treatment into health care systems is no small investment21 and more research is needed to ascertain why depressed patients maintain a preference for in-person psychotherapy, compared to digital treatment options.30 The purpose of this study is document concerns people face when offered a choice between self-guided digital programs, digital programs with coaching options, or traditional in-person psychotherapy.
See Table 1 for sample characteristics. Of the 238 individuals who responded to the survey, 56 (23.5%) were ineligible, and 18 (7.6%) did not complete the survey. The analytic sample was comprised of 164 eligible participants between 21–70 years of age (M = 32.88, SD = 8.29), 49.4% of whom identified as racial or ethnic minority, and 10.4% were Spanish speakers. Our respondents were equally distributed across urban (51.8%) and rural (48.2%) locales in the U.S. Approximately half (n = 81, 49.4%) of the respondents had previously received individual in-person psychotherapy from a licensed clinician, and 17.1% (n = 28) had used a mobile app for self-help or self-monitoring of depressive symptoms. Owing to a survey error, we were not able to accurately determine gender distribution; the survey program failed to populate this variable.
Participants were asked to select barriers they had previously encountered when considering in-person psychotherapy; the top three barriers endorsed by this sample were cost (48.2%), insurance limitations (26.8%), and stigma (26.2%). There were no demographic differences in the endorsement of barriers.
Preferences for in-person versus digital treatment
Seventy three percent of the sample would likely try individual in-person psychotherapy and 72% would try digital psychotherapy in the future. When forced to choose between modalities, the majority (44.5%) preferred individual in-person psychotherapy. Only a quarter (25.6%) of respondents preferred self-guided digital treatment. The options of self-guided digital psychotherapy enhanced with peer or expert support were least preferred (8.5% and 19.7% of the sample, respectively). Although 17.7% of respondents endorsed concerns with individual in-person psychotherapy, more than a quarter (27.4%) of the sample endorsed concerns about self-guided digital treatment, 36.8% of the sample endorsed concerns about digital treatment supplemented with peer support, and 36.8% expressed concerns regarding digital treatment supplemented with expert support. See Table 2.
Preference for digital versus in-person psychotherapy did not vary by rural/urban status, racial/ethnic minority status, or by age. However, 91.4% of those who had previously had in-person psychotherapy with a licensed clinician were more likely to re-consider this treatment in the future, compared to 64.4% of those without previous in-person psychotherapy experience (t(160) = −3.56, p ≤ 0.001).
Concerns regarding treatment selection
In the qualitative data, the following themes emerged from the open-ended responses: (1) concerns about relative effectiveness for digital treatment compared to in-person treatment; (2) access barriers; (3) skepticism specific to self-guided therapy; (4) social anxiety; (5) preference for in-person treatment (6) concerns about confidentiality or privacy; and (7) concerns specific to peer support. Table 3 illustrates themes and subthemes, along with the percentages of sample endorsing these codes. Subthemes were identified by at least three of the 164 respondents.
Theme 1: relative effectiveness
Sixty two percent of the participants raised questions or concerns regarding the relative efficacy or effectiveness of digital psychotherapy and in-person psychotherapy. Over half the sample (50.6%) raised questions about relative success rates between in-person psychotherapy versus digital psychotherapy (Box 1, data extracts 1–2). Twenty two percent of the respondents questioned the effectiveness of self-guided digital psychotherapy. A primary concern raised here was lack of accountability to a therapist (Box 1, data extract 3). Some respondents specifically indicated that having personal contact was important to address motivational issues related to depression (Box 1, data extracts 4–5). A subset of participants (4.3%) also shared unease about the perceived lack of professional monitoring in self-guided digital psychotherapy and its impact that has on treatment efficacy and effectiveness (Box 1, data extracts 6–7).
Theme 2: access barriers
Almost one-third of the sample (31.7%) remarked that access barriers would factor into their decision regarding choice of treatment. Most notable was the issue of cost (Box 2, extract 1). Participants reconfirmed that known in-person access barriers remained (e.g.: scheduling conflicts, and competing demands (e.g., family responsibilities (Box 2, extract 2). Practical concerns related to digital treatment were whether health insurance would cover this care, what equipment would be needed, frequency of sessions, and duration of treatment.
Theme 3: concerns with peer support
Sixteen percent of the sample had negative comments about peer support. Thirteen percent reported skepticism that peers are effective or well-trained, 4.3% reported discomfort related to trust, professionalism, and general discomfort (Box 7, extracts 2–5).
Theme 4: concerns about confidentiality and privacy
Privacy and confidentiality were notable concerns for 15.2% of respondents. These responses typically applied to concerns with digital psychotherapy (12.2%), although a subset of consumers (3.0%) commented on privacy or confidentiality concerns seeking in-person psychotherapy. Some of these issues were rooted in fear of stigma and a lack of privacy using shared technology at home (Box 6, data extract 1). Others specifically noted concerns about information security in the context of digital treatment, including fears of data breaches or unwanted recording or sharing of their sensitive information (Box 6, data extracts 3-4).
Theme 5: preference for in-person psychotherapy
Thirteen percent of participants articulated a preference for in-person psychotherapy, specifically their beliefs in this treatments’ superior outcomes and that it was more authentic and private (Box 5, extract 1). For others, a history of in-person psychotherapy informed their preference for that modality (Box 5, extract 3).
Theme 6: skepticism of self-guided digital psychotherapy
Nearly 13% of respondents were skeptical of self-guided digital treatment. Approximately 4% of respondents felt self-guided treatment was not personalized (Box 3, extracts 1–2). Six percent raised concerns over the safety of self-guided digital psychotherapy (Box 3, extracts 3–4). A small percent (2.4%) raised concerns about the trustworthiness of the intervention developer and questioned their motives (e.g., profit; Box 3, extract 5).
Theme 7: social anxiety
Nearly thirteen percent of respondents stated that their social anxiety would interfere with either the use of in-person therapy or a video chat element (such as that used to supplement digital treatment with peer or expert support; 7.3%). Those who expressed unease with video chat commented on the artificiality and discomfort associated with this technology (Box 4, extract 1). Four of these respondents specifically highlighted “social anxiety” as concerns with video-chat (Box 4, extracts 2-3). These participants shared they were uncomfortable or even ashamed about disclosing their “problems” or feelings, particularly to a stranger (Box 4, extracts 4-6). However, some might be willing to overcome this barrier if they perceived a need for treatment (Box 4, extract 7).
Several key findings were identified in this mixed methods survey of U.S. adults. First, much of the sample indicated a preference for in-person psychotherapy, even though they acknowledged that known access barriers such as transportation, cost, and stigma remain.11,16 The preference for in-person psychotherapy appears to be driven by concerns about the relative efficacy of digital psychotherapy compared to in-person psychotherapy, concerns regarding privacy and data security and whether digital psychotherapy is covered by insurance. These findings have been identified in other studies.27,28,29,31,32,33 Privacy and data security concerns are likely due to recent reports of digital breaches by large technology companies.34,35 Concerns about relative effciacy of digital psychotherapy compared to in-person psychotherapy could be addressed through broader dissemination of researching finding positive effects of digital psychotherapy, as well as the potential advantages of digital psychotherapy over in-person psychotherapy (e.g.: immediate access to a provider). Privacy concerns are harder to address, particularly given that some concerns regarding privacy had to do with limited access to private computers for care. Data security is also harder to address; as of yet there are no uniform standards for protection of information collected from digital therapeutics. The need to assure digital privacy is echoed by the guidelines for mental health apps developed by the American Psychiatric Association.36 They recommend that developers prioritize privacy and security. In sum, the concerns regarding digital psychotherapy (relative efficacy, patient protection, and personalization) are significant enough impact potential utilization of these treatments and will need to be addressed if there is to be routine use of digital psychotherapy.37
Other key findings from this survey were the concerns raised about specific types of digital psychotherapy. In conducting this survey, we were particularly interested in acceptability of a stepped care model of digital psychotherapy, where people could opt into different levels of care, namely, self-guided, peer-guided, and expert-guided digital psychotherapy. Strikingly, self-guided digital psychotherapy was the more preferred model of digital care, with a quarter of the sample saying they would opt for this treatment. However, many concerns were raised about the effectiveness of this model of care, in particular the lack of personalization, accountability, and potential safety risks of not having a provider monitor outcomes. These issues potentially explain why several studies have found poor uptake and continued use of self-guided care, particularly when it is compared to expert-guided care.38
It is possible that preference for self-guided care was influenced by the way we described this treatment to participants, that treatment would be delivered via video-chat and included an optional peer support component. Several participants had concerns regarding the qualifications of peer counselors, and many participants indicated that video-chat was not a technology they felt comfortable using. Although peer-supported care has been adopted in certain populations and settings, such as among veterans, those with serious mental illness, and individuals with chemical dependence, peer support is typically built into mental health treatment teams as an adjunct to traditional care.40 The reactions our participants had to peer support may be based on their experience with social media, in which individuals received unregulated advice from untrained peers in unregulated chat rooms or websites. Respondents may have confused our questions about “support from trained peers” with those encounters in this unregulated space. Our findings imply that providers or treatment developers who incorporate peer support services into care should make clear the qualifications and role of peer providers in providing support services, as well as any data on the effectiveness of peer-supported treatment.
To our knowledge, this is the first study to use a mixed-methods approach to ascertaining concerns faced by patients with depression. Further, using a bilingual online survey modality allowed us to overcome access barriers and oversample those most underrepresented in mental health services and research, including Spanish speakers, Native Americans, African Americans, and individuals residing in rural areas. However, a number of limitations are highlighted here. First, our survey was conducted using an on-line survey tool, and thus this is a sample of people who are familiarity with on-line technology. Preferences and concerns raised by this sample may not generalize to the broader population who are not regular users of technology. A second limitation is our inability to conduct analysis based on gender. A recent study found that women are more likely to engage in on-line treatment than men, suggesting that gender remains another barrier in the use of psychotherapy.28,41 Unfortunately, we are not able to discern if any of the concerns and questions raised here were specific to gender groups. Third, although half of the respondents reported past experience with in-person psychotherapy, very few had previously tried online therapy or mental health apps. Prior exposure to psychotherapy may have influenced these results.6 Finally, our wording of digital psychotherapy in the survey referred to this class of treatment as “on-line psychotherapy.” Although we had explained the intervention included internet and app-based care, we did not explicitly ask participants to compare preferences based on type of digital psychotherapy.
In sum, these data provide useful information regarding the use of digital psychotherapy. Concerns raised by respondents can be addressed through more rigorous research and dissemination of the efficacy of digital treatments and through better management of data security and privacy. We suggest transparency and proactive attempts to address potential concerns about treatment effectiveness, privacy and confidentiality concerns, and the specific training and professionalism of any peers used to supplement treatment. In clinical settings, this is best accomplished using shared decision making, a collaborative process whereby clinicians present patients with information regarding the medical condition and its treatment options, and patients inform clinicians about their values, goals, experiences, and preferences regarding treatment. This patient-centered approach can lead to treatment and delivery refinements and better harness the potential of digital psychotherapy to transform the delivery of care and close treatment gaps.
Participants were adults (age ≥18 years) living in the United States who had previously considered either psychotherapy or the use of self-guided treatment (e.g., a mobile app or online self-help platform) for depression. These participants were preregistered in the Amazon.com, Inc. Mechanical Turk (MTurk) participant pool, described below, and self-selected to complete our survey examining consumer opinions of online/app-based versus in-person psychotherapy. This study was approved by the IRB at University of Washington. Participants were provided written information about the study and were required to complete an informed consent to participate.
Recruitment for the cross-sectional survey, described below, was conducted over four separate days between November 2016 and April 2017. Recruitment occurred in two rounds; minor modifications were made to the first survey based on initial results, stakeholder guidance, and our intention to purposively sample underrepresented groups with poor access to psychotherapy, in particular, we purposively recruited individuals who self-identified as Spanish speakers, Native American, African American, and rural dwellers. The survey was administered through MTurk. MTurk is an online crowdsourcing marketplace owned by Amazon that allows users to take surveys and perform other computer-based tasks posted to the marketplace. Previous research has found that crowdsourcing platforms like MTurk allow for rapid and inexpensive capture of high-quality survey data from a large and potentially more diverse population than typically seen in standard convenience samples, allowing for speed of innovation.42 The surveys were open to each registered MTurk user, who volunteered to participate and qualified based on endorsement that the user had previously considered psychotherapy for depression. The surveys were offered in both English and Spanish. Participants were told that “researchers at the University of Washington were interested in consumer opinions about in-person and online psychotherapy/counseling.” Amazon worker identification numbers are collected for payment; these numbers are unique to each user and ensured there were no duplicate responses. Survey responses were collected using Research Electronic Data Capture (REDCap)43 hosted at the Institute of Translational Health Sciences. REDCap (Research Electronic Data Capture) is a secure, web-based application designed to support data capture for research studies, providing: (1) an intuitive interface for validated data entry; (2) audit trails for tracking data manipulation and export procedures; (3) automated export procedures for seamless data downloads to common statistical packages; and (4) procedures for importing data from external sources. No personal data were collected or stored. Participants were paid $5 for completion. Completion checks were built into RedCap and response completeness was also checked by the first author (B.N.R.) after questionnaire submission.
Survey questions were developed by the principal investigators and an advisory board consisting of representatives from U.S. national health plans (providers and administrators) and national patient advocacy groups. The survey was created to inform research questions for future comparative effectiveness research of digital treatment. The first survey focused specifically on preferences between in-person versus digital treatment (including on-line and app-based, self-guided and expert-guided, to include secure videoconferencing with a licensed clinician). The second survey had overlapping questions with the original survey and asked additional questions about the use of trained peer counselors to supplement digital treatment. The survey was comprised of structured questions and free text for qualitative analysis (see supplementary appendix). Participants were asked to rank their preferences for in-person versus different types of digital treatment and endorse any concerns with these treatment modalities. Qualitative analyses focused on the following open-ended questions:
What concerns would you have about the following treatment options (individual in-person therapy, self-guided online therapy, and online therapy supplemented with support and/or videoconferencing with a licensed clinician)?
If your doctor offered you the choice of getting therapy using an online-based program that offered self-guided therapy OR in-person therapy, what questions would you ask your doctor about the two types of treatment?
Do you wish to share any additional comments about in-person versus online therapy/counseling?
For a subset of respondents (n = 117), the response options to questions #1 and 3 above were expanded to include peer support supplements to online treatment.
Because of small sample sizes across minority groups, racial and ethnic identity were collapsed to create a binary variable of non-Hispanic White and racial/ethnic minority status (encompassing Hispanic White, as well as Hispanic and non-Hispanic individuals of African/African American, Asian/Asian American, Native American/Alaska Native, Native Hawaiian/Pacific Islander, and multiracial identities).
Data were analyzed using a complementarity mixed methods approach.44 Combined qualitative and quantitative methods have broad appeal in health research due to the ability of the two approaches to inform one another; in particular, inductive qualitative studies may provide the “why” to questions of intervention effectiveness and explore consumer perceptions of barriers and facilitators of treatment.
Quantitative data analysis
We calculated means and frequencies to report the sample demographics. Access barriers to in-person psychotherapy, preferences for treatment type, and concerns about treatment modalities were calculated as a percentage of the sample indicating such responses. Independent samples t-tests compared differences between demographic groups on stated preferences for psychotherapy modalities. All quantitative analyses were conducted in IBM SPSS Statistics, version 19.45
Qualitative data analysis
We imported participant responses to open-ended questions into Microsoft Excel. Two coders (P.A.A. and B.N.R.) sorted responses and developed themes using a grounded theory approach, whereby themes were derived inductively through open coding of the survey, rather than guided a priori by a theory or the literature.46 The themes were independently arrived at by the first two coders, and then verified by a third coder (H.S.L.), particularly in instances when the first two coders were not able to classify a response or when there was disagreement. Data were iteratively reviewed (open coded),47 and collapsed to mutually exclusive themes (axial coding). Once themes emerged in this way, the respondents’ comments were allocated to themes and the number of respondent comments that fell under a theme was tallied. On occasion, participant comments would reflect two themes. In those cases, (N = 5), the responses were counted in both categories. Given that there were no differences on preferences by demographic characteristics, qualitative themes are presented in the aggregate across participants.
The data generated during an/or analyzed in this study are available from email@example.com on reasonable request or may be accessed via Synapse, and open access data repository, https://www.synapse.org/#!Synapse:syn17114082/files/.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Murray, C. J. & Lopez, A. D. Measuring the global burden of disease. New Engl. J. Med. 369, 448–457 (2013).
Cuijpers, P. et al. Psychological treatment of depression in inpatients: a systematic review and meta-analysis. Clin. Psychol. Rev. 31, 353–360 (2011).
Cuijpers, P. et al. Psychotherapy for chronic major depression and dysthymia: a meta-analysis. Clin. Psychol. Rev. 30, 51–62 (2010).
Gelenberg, A. J. et al. Practice guideline for the treatment of patients with major depressive disorder 3rd edn, (American Psychiatric Association, New York, 2010).
Garcia, E. F. Y., Franks, P., Jerant, A., Bell, R. A. & Kravitz, R. L. Depression treatment preferences of hispanic individuals: exploring the influence of ethnicity, language, and explanatory models. J. Am. Board Fam. Med. 24, 39–50 (2011).
Raue, P. J., Weinberger, M. I., Sirey, J. A., Meyers, B. S. & Bruce, M. L. Preferences for depression treatment among elderly home health care patients. Psychiatr Serv. 62, 532–537 (2011).
Gum, A. M. et al. Depression treatment preferences in older primary care patients. Gerontologist 46, 14–22 (2006).
Kwan, B. M., Dimidjian, S. & Rizvi, S. L. Treatment preference, engagement, and clinical improvement in pharmacotherapy versus psychotherapy for depression. Behav. Res Ther. 48, 799–804 (2010).
Raue, P. J., Schulberg, H. C., Heo, M., Klimstra, S. & Bruce, M. L. Patients’ depression treatment preferences and initiation, adherence, and outcome: a randomized primary care study. Psychiatr. Serv. 60, 337–343 (2009).
Mott, J. M., Grubbs, K. M., Sansgiry, S., Fortney, J. C. & Cully, J. A. Psychotherapy utilization among rural and urban veterans from 2007 to 2010. J. Rural Health 31, 235–243 (2015).
Marcus, S. C. & Olfson, M. National trends in the treatment for depression from 1998 to 2007. Arch. Gen. Psychiatry 67, 1265–1273 (2010).
Olfson, M. et al. National trends in the outpatient treatment of depression. JAMA 287, 203–209 (2002).
Simon, G. E. & Ludman, E. J. Predictors of early dropout from psychotherapy for depression in community practice. Psychiatr. Serv. 61, 684–689 (2010).
Cruz, M., Pincus, H. A., Harman, J. S., Reynolds, C. F. & Post, E. P. Barriers to care-seeking for depressed African Americans. Int. J. Psychiatry Med. 38, 71–80 (2008).
Van Etten, D. Psychotherapy with older adults: benefits and barriers. J. Psychosoc. Nurs. Ment. Health Serv. 44, 28–33 (2006).
Pepin, R., Segal, D. L. & Coolidge, F. L. Intrinsic and extrinsic barriers to mental health care among community-dwelling younger and older adults. Aging Ment. Health 13, 769–777 (2009).
Fortney, J. C., Harman, J. S., Xu, S. & Dong, F. The association between rural residence and the use, type, and quality of depression care. J. Rural Health 26, 205–213 (2010).
Arjadi, R. et al. Internet-based behavioural activation with lay counsellor support versus online minimal psychoeducation without support for treatment of depression: a randomised controlled trial in Indonesia. Lancet Psychiatry 5, 707–716 (2018).
Karyotaki, E. et al. Do guided internet-based interventions result in clinically relevant changes for patients with depression? An individual participant data meta-analysis. Clin. Psychol. Rev. 63, 80–92 (2018).
Lancee, J., van Straten, A., Morina, N., Kaldo, V. & Kamphuis, J. H. Guided online or face-to-face cognitive behavioral treatment for insomnia: a randomized wait-list controlled trial. Sleep 39, 183–191 (2016).
Kolovos, S. et al. Cost effectiveness of guided Internet-based interventions for depression in comparison with control conditions: an individual-participant data meta-analysis. Depress Anxiety 35, 209–219 (2018).
Ecounseling.com. Top online psychotherapy services - May 2018, http://www.e-counseling.com/compare-online-therapy/?imt=1 (2018).
Kleiboer, A. et al. A randomized controlled trial on the role of support in Internet-based problem solving therapy for depression and anxiety. Behav. Res Ther. 72, 63–71 (2015).
Kenter, R. M., Cuijpers, P., Beekman, A. & van Straten, A. Effectiveness of a web-based guided self-help intervention for outpatients with a depressive disorder: short-term results from a randomized controlled trial. J. Med. Internet Res. 18, e80 (2016).
Andrews, G. et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J. Anxiety Disord. 55, 70–78 (2018).
Mohr, D. C. et al. A randomized controlled trial evaluating a manualized TeleCoaching protocol for improving adherence to a web-based intervention for the treatment of depression. PLoS One 8, e70086 (2013).
March, S. et al. Attitudes toward e-mental health services in a community sample of adults: online survey. J. Med. Internet Res. 20, e59 (2018).
Batterham, P. J. & Calear, A. L. Preferences for internet-based mental health interventions in an adult online sample: findings from an online community survey. JMIR Ment. Health 4, e26 (2017).
Clough, B. et al. Going global: do consumer preferences, attitudes, and barriers to using e-mental health services differ across countries? J. Ment. Health, 1–8 https://doi.org/10.1080/09638237.2017.1370639 (2017).
NIMH. Opportunities and Challenges of Developing Information Technologies on Behavioral and Social Science Clinical Research. https://www.nimh.nih.gov/about/advisory-boards-andgroups/namhc/reports/opportunities-and-challenges-of-developing-information-technologies-on-behavioraland-social-science-clinical-research.shtml (2015).
Berle, D. et al. Do patients prefer face-to-face or internet-based therapy? Psychother. Psychosom. 84, 61–62 (2015).
Mitchell, N. & Gordon, P. K. Attitudes towards computerized CBT for depression amongst a student population. Behav. Cogn. Psychother. 35, 421–430 (2007).
Wallin, E. E. K., Mattsson, S. & Olsson, E. M. G. The preference for internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment. Health 3, e25 (2016).
Gressin, S. The Equifax data breach: What do do https://www.consumer.ftc.gov/blog/2017/09/equifax-data-breach-what-do (2017).
Observer, T. Revealed: 50 million Facebook profiles harvested for Cambridge Analytica in major data breach https://www.theguardian.com/news/2018/mar/17/cambridge-analytica-facebook-influence-us-election (2018).
Association, A. P. App evaulation model https://www.psychiatry.org/psychiatrists/practice/mental-health-apps/app-evaluation-model (2018).
Bauer, A. M. et al. Acceptability of mHealth augmentation of Collaborative Care: a mixed methods pilot study. Gen. Hosp. Psychiatry 51, 22–29 (2018).
Kolovos, S. et al. Economic evaluation of Internet-based problem-solving guided self-help treatment in comparison with enhanced usual care for depressed outpatients waiting for face-to-face treatment: a randomized controlled trial. J. Affect Disord. 200, 284–292 (2016).
Washington State Department of Social and Health Services. Peer Support, https://www.dshs.wa.gov/bha/division-behavioral-health-and-recovery/peer-support (n.d.).
U.S. Department of Veterans Affairs. FAQ for peer support applicants, https://www.vacareers.va.gov/peer-to-peer/faqs.asp (n.d.).
Liddon, L., Kingerlee, R. & Barry, J. A. Gender differences in preferences for psychological treatment, coping strategies, and triggers to help-seeking. Br. J. Clin. Psychol. 57, 42–58 (2018).
Crequit, P., Mansouri, G., Benchoufi, M., Vivot, A. & Ravaud, P. Mapping of crowdsourcing in health: systematic review. J. Med. Internet Res. 20, e187 (2018).
Harris, P. A. et al. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J. Biomed. Inform. 42, 377–381 (2009).
Palinkas, L. A. et al. Mixed method designs in implementation research. Adm. Policy Ment. Health 38, 44–53 (2011).
IBM Corp. IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IBM Corp. https://www-01.ibm.com/support/docview.wss?uid=swg21476197 (2016).
Glaser, B. G. The Grounded Theory Perspective: Its Origins and Growth. Grounded Theory Review: An International Journal, 15 (2016).
Miller, W. L. & Crabtree, B. F. Qualitative analysis: how to begin making sense. Fam. Pract. Res. J. 14, 289–297 (1994).
We acknowledge the contribution of Lisa C. Goodale, ACSW, LSW of the Depression and Bipolar Support Alliance for her partnership and for her review of this manuscript for publication. This work was supported by the National Institute of Mental Health (T32MH073553). REDCap at ITHS is supported by the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number UL1 TR002319.