Abstract
The mobile health (mHealth) industry is an enormous global market; however, the dropout or continuance of mHealth is a major challenge that is affecting its positive outcomes. To date, the results of studies on the impact factors have been inconsistent. Consequently, research on the pooled effects of impact factors on the continuance intention of mHealth is limited. Therefore, this study aims to systematically analyze quantitative studies on the continuance intention of mHealth and explore the pooled effect of each direct and indirect impact factor. Until October 2021, eight literature databases were searched. Fifty-eight peer-reviewed studies on the impact factors and effects on continuance intention of mHealth were included. Out of the 19 direct impact factors of continuance intention, 15 are significant, with attitude (β = 0.450; 95% CI: 0.135, 0.683), satisfaction (β = 0.406; 95% CI: 0.292, 0.509), health empowerment (β = 0.359; 95% CI: 0.204, 0.497), perceived usefulness (β = 0.343; 95% CI: 0.280, 0.403), and perceived quality of health life (β = 0.315, 95% CI: 0.211, 0.412) having the largest pooled effect coefficients on continuance intention. There is high heterogeneity between the studies; thus, we conducted a subgroup analysis to explore the moderating effect of different characteristics on the impact effects. The geographic region, user type, mHealth type, user age, and publication year significantly moderate influential relationships, such as trust and continuance intention. Thus, mHealth developers should develop personalized continuous use promotion strategies based on user characteristics.
Similar content being viewed by others
Introduction
The mobile health (mHealth) industry is an enormous global market worth more than 50 billion USD, as the main means for health management is booming, with a wide range of products and a growing userbase; however, it also faces new challenges. Mobile health (mHealth) is defined as “the medical and public health practice supported by mobile devices, such as mobile phones, patient monitoring devices, personal digital assistants (PDAs), and other wireless devices” by the World Health Organization (WHO).1 It can improve the capacity and efficiency of medical services, monitor patients’ daily activities and physical indicators,2 improve personal health status by influencing personal health behaviors and avoiding health risks,3 and reduce rehospitalization and hospitalization costs by 63% and disease prevention costs by 33%.4 Considering these advantages, mHealth technologies and services represent the future of the health industry. The global mHealth market is valued at 51.635 billion USD in 2020 and is expected to grow at a compound annual rate of 25%, reaching 225.765 billion USD in 2026.5 Currently, more than 300,000 mHealth apps are available in the market, with approximately 40% of the smartphone users using mHealth apps.6 The coronavirus disease pandemic has resulted in the massive use of mHealth, with a survey showing that the downloads of mHealth apps were increased by 25% during the pandemic.7 Although mHealth has been developed rapidly and its use is widely accepted, this type of technology faces a major challenge, i.e., whether users will drop out or continue using it.8
Continuous use is of great significance to mobile health, as the initial short-term use of mHealth services is unlikely to lead to the achievement of long-term health management goals and improve the user health status. Moreover, short-term use is not conducive to the survival of mHealth services and technology in the market. In this context, Bhattacherjee pointed out that the long-term success of information technology or information systems does not depend on the initial adoption but on continuance.9 In a clinical trial setting, most health management services based on mHealth interventions should be used for more than 3 weeks to show effective results.10 However, a large real-world observational study found that only 2.58% of the 189,770 users who downloaded a mHealth app were active users for at least one week11; Similarly, other studies have reported that up to 80% of mHealth users logged in to the service less than twice after downloading.12 Therefore, although the positive outcomes of mHealth have been demonstrated in a clinical trial setting, there is limited evidence of its real-world benefits owing to poor continuance.
Continuance also has a major impact on mHealth companies. A previous study showed that 30% of mHealth apps are uninstalled within a month of download.6 Although the mHealth app market is huge, only 7% of mHealth apps have more than 50,000 active users monthly, and 62% of the apps reported fewer than 1000 active users monthly (active users were defined as those who use the app at least once a month).13 In 2020, app companies lost an average of $57,000 monthly because of uninstallation.14 Therefore, improving the continuance of mHealth services in the real world is a prerequisite for ensuring the effectiveness of health management and promoting the development of this type of technology.
Continuance intention is an important driving force for long-term use, which is defined as user’s willingness and tendency to continue using the mHealth.15 Therefore, relevant studies on the factors and mechanisms of continuance intention of mHealth services have gradually been increased. Studies on the various types of mHealth services, such as preventive health care or chronic disease management apps,16,17 wearable devices,18 and telemedicine, have been conducted.19 The amount of relevant literature is growing, with different results from different theories, models, and populations being reported.20,21,22,23 For example, Paré et al. aimed to explore the intention to continue using wearable devices for health management and found that the perceived ease of use had a significant positive impact on the continuance intention (β = 0.33, P < 0.01)20. In contrast, Cho and Lee found that its effect was not statistically significant (β = 0.10, P = 0.15).21 These contradictory findings make it difficult for researchers to deeply understand the mechanisms of mHealth continuance intention. Therefore, it is necessary to comprehensively determine the factors affecting the continuance of mHealth services.
Although, systematic reviews on the continuance of mHealth services or information systems have been published, there has been no quantitative and comprehensive meta-analysis study on the impact factors of the continuance intention to use mHealth. Khalil et al. conducted a systematic review on mHealth app continuance use intentions and comprehensively described the theoretical model used in the study and the distribution of impact factors. However, as it was only a descriptive review, the study could not explain the contradictory phenomena of the influence effects.6 A meta-analysis combines the quantitative results of multiple empirical studies to comprehensively assess the overall effect of impact factors and is more rigorous than descriptive systematic reviews and provides in-depth insights.24 Frank et al. conducted a meta-analysis of the impact factors of continuance intention of information systems; and identified five optimal influencing factors after integrating the influence effects.25 However, the use case scenarios for information systems in the study by Frank et al. are different from those for mHealth services. Similarly, user perceptions are also different. Therefore, the results of Frank et al. cannot fully explain the reasons for the continued use of mHealth services.
To address the above-mentioned limitations, this study focuses on mHealth users, including the general population and patients with diseases. We aim to integrate the effects of direct impact factors on users’ continuance intention, and then use the direct impact factors as intermediary variables to integrate the effects of indirect factors to explore the comprehensive effect of all impact factors. Moreover, we identify the main impact factors of continuance intention by conducting a meta-analysis. On this basis, subgroup analyses are performed to explore the moderating effects of the study design and population on the influence relationship, and to provide a reference for establishing a personalized strategy for the continuous use of mHealth.
Results
Literature search and study characteristics
The study selection process and the results of the literature search are depicted in Fig. 1. Using our search strategy, we identified 1,030 articles in eight databases. After removing duplicate articles, 470 articles remained. After applying further exclusion criteria, a total of 58 cross-sectional studies were included in our analysis, including 19 direct impact factors of continuance intention which have been explored more than three times.
The characteristics of these 58 studies are summarized in Table 1. The three countries which were the most highly active in research were China (25 studies), South Korea (7 studies) and the United States (6 studies). The most frequently used theories and models were the Expectation Confirmation Model of IS Continuance (ECM-ISC, 15 times), Technology Acceptance Model (TAM, 9 times) and the Unified Theory of Acceptance and Use of Technology (UTAUT, 6 times). All studies used self-reported continuance intention and use feeling, which was collected using questionnaires. The study quality scores ranged from 4 to 16, with a mean (standard deviation) score of 12.43 (2.50) (Supplementary Table 1). Kendall’s consistency coefficient was used to evaluate the consistency of researchers’ scores, which was 0.971 indicating a strong consistency.
Meta-analysis
(1) Direct impact factors of continuance intention. Figure 2 shows that out of the 19 direct impact factors of continuance intention, the pooled effects of four factors were not significant (social influence (0.098 [95% CI, −0.029, 0.222], P = 0.068, I2 = 81.14%); facilitating conditions (0.169 [95% CI, −0.144, 0.452], P = 0.086, I2 = 82.45%); perceived risk (−0.065 [95% CI, −0.302, 0.180], P = 0.259, I2 = 64.33%); engagement (0.536 [95% CI, −0.817, 0.982], P = 0.140, I2 = 99.13%)). The five factors that have been explored the most were satisfaction (26 times), perceived usefulness (24 times), perceived ease of use (12 times), trust (11 times), and social influence (8 times). According to the size of the pooled effect coefficients, the top five factors that have a direct impact on continuance intention were the attitude (0.450 [95% CI, 0.135, 0.683], P < 0.001, I2 = 92.34%), satisfaction (0.406 [95% CI, 0.292, 0.509], P < 0.001, I2 = 95.25%), health empowerment (0.359 [95% CI, 0.204, 0.497], P < 0.001, I2 = 15.90%), perceived usefulness (0.343 [95% CI, 0.280, 0.403], P < 0.001, I2 = 86.26%), and perceived quality of health life (0.315 [95% CI, 0.211, 0.412], P < 0.001, I2 = 0.00%), which were regarded as main impact factors on continuance intention.
(2) Impact factors of mediating factors. We also integrated and analyzed the impact factors of satisfaction, perceived usefulness, and perceived ease of use to explore the factors that indirectly affect the continuance intention. All four independent variables of satisfaction were significant; the most explored factor was perceived usefulness (14 times), and the pooled effect coefficient of service quality was the largest (0.623 [95% CI, 0.223, 0.843], P < 0.001, I2 = 98.20%). The pooled effects of the four independent variables of perceived usefulness were all significant, confirmation was the most explored impact factor (12 times), and the pooled effect coefficient of confirmation was the largest (0.660 [95% CI, 0.488, 0.783], P < 0.001, I2 = 98.23%). The pooled effect of confirmation on perceived ease of use was significant. The effect estimates and confidence intervals for both individual studies and the overall combined results were illustrated using a forest plot, which are shown in the Supplementary Figs. A1–A28 and Supplementary Table A1–A28. Figure 2 shows that most studies are highly heterogeneous. A path diagram was drawn for all the influence relationships with significant pooled effects in Fig. 3.
Subgroup analysis
The results of our subgroup analyses stratified by the study design and population are summarized in Tables 2–6. Table 2 revealed that the association between trust and continuance intention, social influence and continuance intention, confirmation and satisfaction, and perceived ease of use and perceived usefulness were substantially changed by geographic region. The impact effects were stronger in the developing countries or regions than in the developed countries or regions.
The association between satisfaction and continuance intention, trust and continuance intention, social influence and continuance intention, and confirmation and perceived usefulness substantially changed by the user type (Table 3). Compared with public users, the impact of satisfaction and trust on the continuance intention was not significant in the patients’ group. Compared with the patients’ group, the impact of social influence on the continuance intention was not significant in the public group. The impact effect of confirmation on perceived usefulness was stronger in the public users’ group than in the patient group.
The associations between perceived usefulness and continuance intention, social influence and continuance intention were substantially changed by the mHealth type (Table 4). Compared with mHealth dedicated to disease management and remote consultation, the impact of social influence on the continuance intention was not significant in mHealth dedicated to health promotion and prevention. The impact effect coefficient of perceived usefulness on continuance intention was largest in the group of mHealth apps dedicated to disease management and remote consultation.
The association between satisfaction and continuance intention was substantially changed by the age of the study population (Table 5). The impact effect coefficient of satisfaction on continuance intention was the largest among older individuals.
The association between trust and continuance intention was substantially changed by the publication year (Table 6). The impact of trust on continuance intention was only significant in recent years (2016–2021). However, the results were not substantially changed by the study quality (Supplementary Table 2).
Publication bias
Funnel plot and Egger linear regression tests revealed little evidence of publication bias (Supplementary Fig B1–B28).
Discussion
Ranked according to the size of pooled effect coefficients, the top five factors that affect the continuance intention of mHealth were attitude, satisfaction, health empowerment, perceived usefulness, and perceived quality of health life. Attitude towards mHealth refers to a user’s positive or negative sentiment towards a mHealth service or device.26 Individuals’ cognitive coordination between seeking perception and behavior leads to attitudes toward specific behaviors that affect continuance intention.27 However, users have different attitudes towards the same mHealth service, and exploring ways to improve user attitudes should be studied in the future. User satisfaction refers to the user’s overall evaluation of product performance.28 Users evaluate satisfaction by comparing the actual service or product with their expectations of the service or product before use.22 High satisfaction means that the product or service performance exceeds user expectations; thus, they are more likely to continue using them. Satisfaction is an important precursor variable of the continuance intention in many theories and models, such as ECM-ISC and TAM, and is also the most frequently explored factor in studies of continuance intention of mHealth. This indicates that the positive impact of satisfaction on continuance intention is widely recognized. Health empowerment is an effective strategy for promoting personal health, and self-management is an important aspect of health empowerment.29 Specifically, health empowerment is the realization of patients’ control of their health-related conditions and awareness of the resources available in the healthcare service system through mHealth.30 Compared to traditional offline health management and disease control methods, mHealth has the advantages of reduced costs, time efficiency and more accessibility. In the use of mHealth services, if patients feel that they can effectively manage their health and control their health status, this will increase the possibility of mHealth continuance and achieve savings in terms of cost and time. Perceived usefulness refers to the degree to which individuals believe that using a specific system will improve their work performance.28 mHealth is a tool or service with an evident utilitarian nature that can be used by users to seek health management services or carry out disease prevention and control. Whether mHealth can improve the effect and efficiency of its health management is the focus of the user’s concern; therefore, high perceived usefulness is an important factor that promotes the continuance intention of users. Perceived quality of health life refers to the results obtained by users through their interactions with the mHealth, and could be defined as a sense of overall wellbeing in health.31 Continuous self-health management behavior is not easy, and users need a regulatory mechanism that includes goal setting, monitoring, and feedback reception.32 Perceived quality of health life is a kind of feedback reception of health management behavior for users. Positive result feedback will give users encouragement to continue setting goals. When this regulatory mechanism works well, users will spontaneously carry out continuous health management behaviors. Therefore, perceived quality of health life is an important factor in promoting users’ continuance intention.
In summary, among the five factors with the largest size pooled effect on mHealth continuance intention, two factors were related to mHealth functions and service quality (the degree to which the mHealth serves its actual purpose and to what extent improvement in the efficiency of user health management has a positive impact on continuance intention) and two factors were related to the user’s comprehensive feelings about mHealth (the user’s comprehensive emotion and overall evaluation of the impact of mHealth use on continuance intention). Lastly, health empowerment, which is closely related to health management, has a significant impact on the continuance intention of mHealth. This is also a unique impact factor on the user’s behavior in the field of mHealth, which was not mentioned in the review of the continuance intention of information systems and online technologies,25,33 representing an important finding of our study.
A meta-analysis can clarify whether a certain impact factor has a significant influence on continuance intention, while a subgroup analysis can further explore whether a specific impact factor has a stronger influence on a certain type of research subject and find significant differences in the effect of the same factor after adjustment of different characteristics. We found that the economic development level of countries or regions has a significant moderating effect on impact. Compared with developed countries or regions, confirmation in developing countries or regions has a stronger effect on satisfaction ((0.606 [95% CI, 0.336, 0.784], P < 0.001, I2 = 96.55%) vs. (0.365 [95% CI, 0.281, 0.443], P < 0.001, I2 = 60.29%)), indicating that users in developing countries consider whether the performance of the mHealth has reached the expected level when deciding on whether to continue using it. Similarly, in developing countries or regions, the impact effect of perceived ease of use on perceived usefulness was strengthened ((0.653 [95% CI, 0.413, 0.808], P < 0.001, I2 = 86.93%) vs. (0.183 [95% CI, 0.083, 0.280], P < 0.001, I2 = 41.56%)). This indicates that users in developing countries or regions are more inclined to consider mHealth to be useful if they think that it is easy to use, compared to those in developed countries or regions, who believe that the perceived ease of use of mHealth has a relatively weak effect on its perceived usefulness. In addition, the impact of trust on continuance intention has a significant effect only in developing countries or regions ((0.353 [95% CI, 0.200, 0.489], P < 0.001, I2 = 90.13%) vs. (0.121 [95% CI, −0.398, 0.581], P = 0.477, I2 = 93.67%)), which may be attributed to the rapid development of science and technology in economically developed countries and their tendency to use more advanced technologies.34 However, mHealth technology in developing countries is still in its early stages of development, and users are still in the initial stage of accepting mHealth services and have more uncertainty about it. We hypothesize that once users trust mHealth services, they will be more inclined to continue using them.
The user type has a significant moderating effect on impact effects. The impact effect of satisfaction on continuance intention was only significant in the public ((0.442 [95% CI, 0.321, 0.550], P < 0.001, I2 = 96.27%) vs. (0.346 [95% CI, −0.120, 0.687], P = 0.054, I2 = 96.47%)), indicating that the public is more inclined to continue using mHealth when they have a higher satisfaction. The impact effect of confirmation on perceived usefulness was significantly enhanced in the public user group ((0.711 [95% CI, 0.455, 0.859], P < 0.001, I2 = 98.20%) vs. (0.387 [95% CI, −0.084, 0.716], P < 0.001, I2 = 90.33%)), indicating that when their expectations were confirmed, they were more inclined to think that mHealth was useful. Compared with patients who need disease management, the expectations of healthy people were relatively easy to be confirmed. In contrast, the impact of social influence on continuance intention was only significant in patients than healthy individuals ((0.248 [95% CI, −0.012, 0.477], P < 0.001, I2 = 57.77%) vs. (−0.012 [95% CI, −0.065, 0.040], P = 0.515, I2 = 0.00%)), indicating that if the social environment of the patient supports the use of mHealth technology, then patients are more inclined to continue using mHealth. The difference in impact effects between the two types of users is related to their purpose in using mHealth services and the types of services and tools; therefore, developers of mHealth technology should target their users accordingly.
The mHealth type has a significant moderating effect on impact effects. The impacts of perceived usefulness and social influence on continuance intention were significantly enhanced in mHealth targeted toward disease management and remote consultation. This phenomenon is related to the fact that the target users of this kind of mHealth are patients, and their main purpose when using it is the remote consultation or disease management. When the mHealth meets its utilitarian needs, users find it useful and are more likely to continue using it.
User age has a significant moderating effect on the impact effects. The pooled effect coefficient of satisfaction on continuance intention was the largest in older adults (0.761 [95% CI, 0.352, 0.926], P < 0.001, I2 = 97.91%) and the smallest in the entire age group (0.284 [95% CI, 0.221, 0.345], P < 0.001, I2 = 82.49%), indicating that when users are satisfied with mHealth, older users have a greater tendency to continue using it than other age groups. These results provide theoretical bases for establishing personalized mHealth designs. mHealth services can be designed to provide various functions of personalized experience according to the age of users, such as focusing on exploring the impact that affects the satisfaction of older adult users.
Analysis of the moderating effect of the publication year revealed the changing trends of the impact factors. The impact of trust on continuance intention was not significant in studies published earlier but showed a significant effect in studies published more recently ((0.220 [95% CI, −0.288, 0.632], P = 0.170, I2 = 92.30%) vs. (0.304 [95% CI, 0.090, 0.491], P = 0.001, I2 = 88.74%)). This finding can be attributed to the increased trust of users in mHealth services. With technological advances, users are gradually becoming concerned about the security issues associated with technology.
According to the research results, the factors with the strongest pooled impact effect on mHealth continuance intention can be divided into three aspects: mHealth function and service quality, users’ comprehensive feelings towards mHealth and health empowerment. Therefore, mHealth developers can improve the design in three ways. First, efforts should be made to improve the effectiveness of mHealth in health promotion and disease management. For example, the health interventions provided should be verified by evidence-based medicine and significantly improve the health status of users. Users’ perception that mHealth is useful for their health management is an important basis for continued use. Second, developers can collect users’ evaluation of various functions in their experience with the application through user generated content, solve the limitations of functions, and improve user satisfaction.35 Finally, health empowerment has a significant positive impact on continuance intention, indicating that users not only require mHealth to significantly improve their health status, but also hope that mHealth can improve their health management ability. Therefore, mHealth should provide enough health education to improve users’ health literacy, so that users can make health management decisions and fully participate in their own health management.
Subgroup analyses showed that the geographic region, user type and mHealth type significantly affected the results. Therefore, developers should clarify the target population of mobile health and distinguish the countries and regions of its distribution. First, trust had a significant impact on continuance intention only in developing countries, and the impact of perceived ease of use on perceived usefulness increased significantly in developing countries. This result may be due to the immature development of mHealth technology in developing countries and the consequent uncertainty among users. Developers should strengthen the usability of mHealth in developing countries, simplify the process of human-computer interaction, fully display the design and role of mHealth, improve its security, and increase users’ trust and perceived ease of use. Second, developers should pay attention to the differences between user types and mHealth types. The impact of social influence on continuance intention is only significant in the patients’ population and mHealth for disease management and remote consultation. Therefore, mHealth for patients should take measures to increase the social influence of products. For example, mHealth can provide an online community for exchange between patients and increase users’ opportunities to accept social influence. In contrast, operators can consider promoting mHealth among medical professionals. After recognition, medical professionals may support their patients to continue using mHealth to improve their health status.
This study had some limitations. First, although we searched the literature as comprehensively as possible, several studies were not retrieved owing to the limitations of the literature database. Nevertheless, we searched eight databases from multidisciplinary focus areas and developed a retrieval strategy considering that search terms have multiple meanings. Therefore, we consider our study to be representative. Second, although this study verified the moderating effects of the economic development level of countries or regions, user type, mHealth type, user age, and publication time on the impact effects, characteristics that have moderating effects, such as cultural characteristics, income, gender, health literacy, race, and user occupations, may have been unidentified. Owing to the lack of comprehensive data in the included literature, we did not analyze the role of the above-mentioned factors; thus, follow-up studies should explore these characteristics.
The continuance of mHealth plays an important role in building a self-health management model that realizes user health empowerment and is also the key to the survival of mHealth companies in the market. A comprehensive evaluation of the impact factors and moderating factors of mHealth continuance intention is of great value for proposing improvement strategies. To summarize, this study analyzed 58 quantitative studies on the continuance intention of mHealth services, and explored the pooled effect of 28 impact effects through meta-analysis. The results showed that the theoretical basis of the current mHealth continuance intention studies tend to be integrated and diversified; ECM-ISC, TAM, and UTAUT are the widely used theoretical models, of which ECM-ISC is the most widely recognized. Moreover, ranked according to the size of pooled effect coefficients, the top five factors that affect the continuance intention of mHealth were the attitude, satisfaction, health empowerment, perceived usefulness, and perceived quality of health life. Health empowerment is a specific factor of the user’s information behavior in the health field and may attract the attention of scholars and developers in the future. The results of subgroup analysis showed that the geographic region, user type, mHealth type, user age and research publication time have a significant moderating effect on some impact effects. Therefore, researchers and developers should consider the countries or regions where mHealth is used, accurately identify the user characteristics of the target users, and design personalized mHealth services to improve the continuance of mHealth and ultimately achieve a sustainable self-health management model.
Methods
Search strategy
We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for conducting and reporting items for systematic reviews (Supplementary Table 3). A systematic literature search for cross-sectional studies up to October 8, 2021, was conducted in the following databases: PubMed, Embase, WOS core collection, CINAHL, Scopus, PsycInfo, EI and ACM. The retrieval formula consisted of three parts: “mHealth”, “continuance”, and “intention”. The search had no language restriction. We also searched and reviewed the references cited within the retrieved relevant reports for any additional studies. The detailed retrieval formula is shown in Supplementary Table 4.
Study selection
Studies were included in the current meta-analysis if they met the following criteria: (1) The full text could be obtained. For articles of which the full text was not provided by the literature database and publishers, we contacted the author of the article through ResearchGate (a scientific research social network service website) to request it. If by the end of the data analysis there was no response to the full-text request, it was regarded as being unable to obtain the full-text. (2) The main outcome of the study was the continuance intention. Continuance intention is the user’s willingness and tendency to continue using mHealth.15 This variable was measured by a self-reported questionnaire, usually on a 5 or 7 point Likert scale, such as “I intend to continue using the mHealth App I used rather than discontinue its use”. (3) The type of study was quantitative. (4) The research object was mHealth related products or services. WHO defined mHealth as “medical and public health practice supported by mobile devices, such as mobile phones, patient monitoring devices, PDAs, and other wireless devices”.1 Therefore, the mHealth selected in this study needed to meet two characteristics: the products or services should be provided through mobile devices and the service provided by mHealth belonged to the scope of medical or health care. The participants of the study were users who had used mHealth, including the general population for preventive care and patients for disease management. The exclusion criteria were as follows: (1) studies not showing regression coefficients between the variables (research methods were not based on correlation analysis or regression analysis); (2) reviews, letters, comments, editorial; and (3) studies not published under a peer-review process. Three researchers (Tong Wang, Jun Liang, and Mingfu Nuo) independently screened titles and abstracts and the full text of each potentially relevant article was then evaluated.
Data extraction and quality assessment
A standardized data collection form was used to extract data. From each included study, we extracted the following information: first author, publication year, paper title, mHealth type, user type and age characteristics, sample size, country or region where the study was conducted, statistical methods, independent and dependent variables, regression coefficient, P value and other statistical indices. In some of the included studies, the hypothesis of the association is based on the relevant theories of psychology or behavior, therefore, we collected the theories or models on which the hypothesis is based. Two independent investigators (Tong Wang and Mingfu Nuo) performed the data extraction process, and any disagreements were resolved with group discussion.
The quality of included studies was evaluated according to the JBI PACES checklist for analytical cross-sectional studies36 by two researchers (Tong Wang and Jun Liang).
Statistical analysis
In this meta-analysis, the main outcome was the pooled regression coefficient with 95% confidence intervals. According to Sarkar et al.,37 the influence relationships included in the meta-analysis must be tested at least three times in different studies. Statistical analysis was performed on the associations between the impact factors and continuance intention that were tested at least three times in the included studies. Path analysis was usually used in the study of continuance intention to explore the direct and indirect effects of impact factors on continuance intention. Therefore, we not only integrated the direct impact factors of continuance intention, but also integrated the impact factors of its main direct impact factors to analyze the variables that have indirect effects. Taking the three most relevant impact factors of continuance intention as mediating factors, we analyzed the integration effect of the association between the impact factors and mediating factors. We calculated the summarized regression coefficients and their corresponding 95% CI using a random-effects model24, which could incorporate both within- and between-study variability. Additionally, we applied the inverse variance weighting method with an additive between-studies variance component in the random effects model based on the DerSimonian-Laird estimator to pool the effect sizes. Owing to many variables included in the studies, with most of them being users’ subjective feelings, the definitions and measurements of all variables in each study were distinct. We grouped the same construct from the same theory or model as the same variable. For the same constructs derived from different theories or no theoretical basis, researchers differentiated them according to definition and measurement items. Taking the definition with more occurrences as the standard, the concepts that are different from the standard definition were regarded as different variables and were not integrated. Any disagreements were solved by group discussion.
The included studies were analyzed for bias risk using funnel plots and Egger’s tests. Heterogeneity between studies was assessed using I2 ( <50%, 50–74%, and >75% were low, moderate and high heterogeneity, respectively).
To examine the significance of the difference in regression coefficients and the possible influence of residual confounding factors, we performed subgroup analyses on possible sources of heterogeneity, including geographic location, user’s type, mHealth type, user’s age, and study quality. First, some studies have shown that the economic development of a country or region has a moderating effect on the use of information systems;25 therefore, we classified the studies into economically developed and developing groups according to the countries or regions where the survey was conducted. Second, Chauhan et al. found that the types of users and eHealth app have a significant moderating effect on their acceptance. Based on their classification of the user types, we categorized the studies into the general public and patient groups (subgroup analyses of healthcare professionals were not performed due to the small number of studies using healthcare professionals as mHealth users).24 Users of mHealth were mainly divided into healthy individuals and patients with diseases.24 According to different target users, mHealth can be divided into two categories: 1. health promotion and prevention, and 2. disease management and remote consultation.24,38 In addition, according to the main functions of the device, wearable devices for health status monitoring were an important category of mHealth. Therefore, mHealth was divided into three subgroups in this study: 1. health promotion and prevention, 2. disease management and remote consultation, and 3. wearable devices. Finally, some studies categorized the study participants as college students39 or older adults aged ≥60 years32; therefore, we analyzed the age characteristics of the participants and categorized the studies as follows: young adults (18–35 years old), older adults (≥60 years old), and the entire age group. In addition, the studies were divided into two groups according to publication year: early (2010–2015) and recent (2016–2021).
We used the SPSS statistical software version 24 and meta-essentials 1.1 for all statistical analyses40, and all P values were two-sided with a significance level of 0.05. This study was not registered.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Data availability
The authors declare that all the data included in this study are available within the paper and its Supplementary Information files.
References
WHO. Global Observatory for eHealth. mHealth: new horizons for health through mobile technologies: second global survey on eHealth. (2011).
Bonaccorsi, M., Fiorini, L., Cavallo, F., Esposito, R. & Dario, P. Design of Cloud Robotic Services for Senior Citizens to Improve Independent Living and Personal Health Management. in Ambient Assisted Living (eds. Andò, B., Siciliano, P., Marletta, V. & Monteriù, A.) 11 465–475 (Springer International Publishing, 2015).
Michie, S., Yardley, L., West, R., Patrick, K. & Greaves, F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J. Med. Internet Res. 19, e232 (2017).
Statista Research Department. Cost drivers where mobile health will have the highest positive impact worldwide in the next five years, as of 2016. Statista https://www.statista.com/statistics/625219/mobile-health-global-healthcare-cost-reductions/ (2016).
Mordor Intelligence. Mobile Health (mHealth) Market|2021–26|Industry Share, Size, Growth. https://www.mordorintelligence.com/industry-reports/mobile-health-market (2021).
Khalil, A.-A., Meyliana, Hidayanto, A. N. & Prabowo, H. Identification of factor affecting continuance usage intention of mhealth application: a systematic literature review. in 2020 4th International Conference on Informatics and Computational Sciences (ICICoS) 1–6 (2020). https://doi.org/10.1109/ICICoS51170.2020.9299038.
mHealth Apps Market Size|Industry Report, 2021–2028. https://www.grandviewresearch.com/industry-analysis/mhealth-app-market (2020).
Phelps, R. G., Taylor, J., Simpson, K., Samuel, J. & Turner, A. N. Patients’ continuing use of an online health record: a quantitative evaluation of 14,000 patient years of access data. J. Med. Internet Res. 16, e241 (2014).
Bhattacherjee, A. Understanding information systems continuance: an expectation-confirmation model. MIS Q. 25, 351 (2001).
Y, W., H, X., Y, H., L, H. & D, Z. A systematic review of application and effectiveness of mHealth interventions for obesity and diabetes treatment and self-management. Adv. Nutr. 8, 449–462 (2017).
Helander, E., Kaipainen, K., Korhonen, I. & Wansink, B. Factors related to sustained use of a free mobile app for dietary self-monitoring with photography and peer feedback: retrospective cohort study. J. Med. Internet Res. 16, e109 (2014).
Gideon et al. Rates of attrition and dropout in app-based interventions for chronic disease: systematic review and meta-analysis. J. Med. Internet Res. 22, e20283 (2020).
Research 2 Guidance. monthly active users of mHealth apps: 7% have more than 50k MAUs|R2G. research2guidance https://research2guidance.com/only-7-percent-of-mhealth-apps-have-more-than-50000-monthly-active-users-best-mhealth-user-retention-concepts/ (2018).
AppsFlyer. The uninstall threat: 2020 app uninstall benchmarks [Data study]. AppsFlyer https://www.appsflyer.com/resources/others/app-uninstall-benchmarks/ (2021).
Wang, T. et al. The impact of gamification-induced users’ feelings on the continued use of mHealth apps: a structural equation model with the self-determination theory approach. J. Med. Internet Res. 23, e24546 (2021).
Liu, W., Fan, X., Ji, R. & Jiang, Y. Perceived community support, users’ interactions, and value co-creation in online health community: the moderating effect of social exclusion. IJERPH 17, 204 (2019).
Park, M., Yoo, H., Kim, J. & Lee, J. Why do young people use fitness apps? Cognitive characteristics and app quality. Electron. Commer. Res. 18, 755–761 (2018).
Ahmad, A., Rasul, T., Yousaf, A. & Zaman, U. Understanding factors influencing elderly diabetic patients’ continuance intention to use digital health wearables: extending the technology acceptance model (TAM). J. Open Innov. 68, 81–81 (2020).
Grenier Ouimet, A., Wagner, G., Raymond, L. & Pare, G. Investigating patients’ intention to continue using teleconsultation to anticipate postcrisis momentum: survey study. J. Med. Internet Res. 22, e22081 (2020).
Paré, G., Leaver, C. & Bourget, C. Diffusion of the digital health self-tracking movement in canada: results of a national survey. J. Med. Internet Res. 20, e9388 (2018).
Cho, J. & Lee, H. E. Post-adoption beliefs and continuance intention of smart device use among people with physical disabilities. Disability and Health J. 13, (2020).
Gu, D., Yang, X., Li, X., Jain, H. K. & Liang, C. Understanding the role of mobile internet-based health services on patient satisfaction and word-of-mouth. Int. J. Environ. Res. Public Health 15, (2018).
Hartono, I. K., Della, T. K., Kawi, Y. A., & Yuniarty. Determinants factor affecting user continuance usage and intention to recommend of mobile telemedicine. in IOP Conference Series: Earth and Environmental Science 794 (IOP Publishing Ltd, 2021).
Chauhan, S. & Jaiswal, M. A meta-analysis of e-health applications acceptance: moderating impact of user types and e-health application types. J. Enterp. Inf. Manag. 30, 295–319 (2017).
Franque, F. B., Oliveira, T., Tam, C. & Santini, F. De O. A meta-analysis of the quantitative studies in continuance intention to use an information system. Internet Research ahead-of-print, (2020).
Luo, Y., Wang, G., Li, Y. & Ye, Q. Examining protection motivation and network externality perspective regarding the continued intention to use m-health apps. Int. J. Environ. Res. Public Health 18, (2021).
Azjen, I. Understanding attitudes and predicting social behavior. Englewood Cliffs (1980).
Yan, M., Filieri, R., Raguseo, E. & Gorton, M. Mobile apps for healthy living: Factors influencing continuance intention for health apps. Technological Forecasting and Social Change 166, (2021).
Liu, Y., Jiang, F. & Lin, P. Influence mechanism of the affordances of chronic disease management apps on continuance intention: questionnaire study. JMIR Mhealth Uhealth 9, e21831 (2021).
Akter, S., Mohiuddin Babu, M., Hossain, M. A. & Hani, U. How does value co-creation transform quality of life at the bottom of the pyramid? J. Mark. Manag. 37, 962–992 (2021).
Akter, S., D’Ambra, J. & Ray, P. Service quality of mHealth platforms: development and validation of a hierarchical model using PLS. Electron Mark. 20, 209–227 (2010).
Kim, E. & Han, S. Determinants of continuance intention to use health apps among users over 60: a test of social cognitive model. Int. J. Environ. Res. Public Health 18, (2021).
Yan, M., Filieri, R. & Gorton, M. Continuance intention of online technologies: a systematic literature review. Int. J. Inf. Manag. 58, 102315 (2021).
Kim, Y. & Peterson, R. A. A meta-analysis of online trust relationships in E-commerce. J. Interact. Mark. 38, 44–54 (2017).
Wang, T. et al. Use of machine learning to mine user-generated content from mobile health apps for weight loss to assess factors correlated with user satisfaction. JAMA Netw. Open 5, e2215014 (2022).
JBI PACES: A new era of auditing Your easy guide. PACEsetterS 1, 12–13 (2004).
Sarkar, S., Chauhan, S. & Khare, A. A meta-analysis of antecedents and consequences of trust in mobile commerce. Int. J. Inf. Manag. 50, 286–301 (2020).
Davies, A. & Mueller, J. Developing Medical Apps and mHealth Interventions. in 6–9 (Springer International Publishing, 2020). https://doi.org/10.1007/978-3-030-47499-7_1.
Lee, H. E. & Cho, J. What motivates users to continue using diet and fitness apps? Application of the uses and gratifications approach. Health Commun. 32, 1445–1453 (2017).
Suurmond, R., van Rhee, H. & Hak, T. Introduction, comparison, and validation of Meta-Essentials: a free and simple tool for meta-analysis. Res Syn. Meth 8, 537–553 (2017).
Hamari, J. & Koivisto, J. Why do people use gamification services? Int. J. Inf. Manag. 35, 419–431 (2015).
Rho, M. J., Yoon, K. H., Kim, H.-S. & Choi, I. Y. Users’ perception on telemedicine service: a comparative study of public healthcare and private healthcare. Multimed. Tools Appl. 74, 2483–2497 (2015).
Li, J., Liu, X., Ma, L. & Zhang, W. Users’ intention to continue using social fitness-tracking apps: expectation confirmation theory and social comparison theory perspective. Inform. Health Soc. Care 44, 298–312 (2019).
Cho, H., Chi, C. & Chiu, W. Understanding sustained usage of health and fitness apps: Incorporating the technology acceptance model with the investment model. Technology in Society 63, (2020).
Hsiao, J.-L. & Chen, R.-F. Understanding determinants of health care professionals’ perspectives on mobile health continuance and performance. JMIR Med. Inf. 7, e12350 (2019).
Kaium, M. A., Bao, Y., Alam, M. Z. & Hoque, Md. R. Understanding continuance usage intention of mHealth in a developing country: An empirical investigation. IJPHM 14, 251–272 (2020).
Akter, S., D’Ambra, J. & Ray, P. Trustworthiness in mHealth information services: an assessment of a hierarchical model with mediating and moderating effects using partial least squares (PLS). J. Am. Soc. Inf. Sci. 62, 100–116 (2011).
Meng, F., Guo, X., Peng, Z., Ye, Q. & Lai, K.-H. Trust and elderly users’ continuance intention regarding mobile health services: the contingent role of health and technology anxieties. Information Technology & People ahead-of-print, (2021).
Zhang, X. et al. The role of perceived e-health literacy in users’ continuance intention to use mobile healthcare applications: an exploratory empirical study in China. Inf. Technol. Dev. 24, 198–223 (2018).
Esmaeilzadeh, P. The role of information technology mindfulness in the postadoption stage of using personal health devices: cross-sectional questionnaire study in mobile health. JMIR mHealth uHealth 8, e18122 (2020).
Yin, M., Tayyab, S. M. U., Xu, X.-Y., Jia, S.-W. & Wu, C.-L. The Investigation of Mobile Health Stickiness: The Role of Social Support in a Sustainable Health Approach. Sustainability 13, 1693 (2021).
Esmaeilzadeh, P. The influence of gamification and information technology identity on postadoption behaviors of health and fitness app users: empirical study in the united states. JMIR Serious Games 9, (2021).
Cho, J. The impact of post-adoption beliefs on the continued use of health apps. Int. J. Med. Inform. 87, 75–83 (2016).
Uei, S.-L., Tsai, C.-H. & Yang, M.-S. Telecare service use among Taiwanese aged 60 and over: satisfaction, trust, and continued use intention. Soc. Behav. Personal. 41, 1309–1318 (2013).
Lee, J. & Kim, B. Social impacts of the continuous usage of digital healthcare service: a case of South Korea. Innovative Mark. 17, 79–89 (2021).
Sharma, S. & Khadka, A. Role of empowerment and sense of community on online social health support group. Inf. Technol. People 32, 1564–1590 (2019).
Devina, R., Handayani, P. W. & Pinem, A. A. Privacy Concern on Continuance of use in Online Doctor Consultation. in 5th International Conference on Computing Engineering and Design, ICCED 2019 (Institute of Electrical and Electronics Engineers Inc., 2019). https://doi.org/10.1109/ICCED46541.2019.9161134.
Damberg, S. Predicting future use intention of fitness apps among fitness app users in the United Kingdom: the role of health consciousness. International Journal of Sports Marketing and Sponsorship (2021) https://doi.org/10.1108/IJSMS-01-2021-0013.
Akter, S., D’Ambra, J., Ray, P. & Hani, U. Modelling the impact of mHealth service quality on satisfaction, continuance and quality of life. Behav. Inf. Technol. 32, 1225–1241 (2013).
Soni, M., Jain, K. & Jajodia, I. Mobile health (mHealth) application loyalty in young consumers. Young-. Consum. 22, 429–455 (2021).
Song, T. et al. Measuring success of patients’ continuous use of mobile health services for self-management of chronic conditions: Model development and validation. J. Med. Int. Res. 23, (2021).
Huang, G. & Ren, Y. Linking technological functions of fitness mobile apps with continuance usage among Chinese users: moderating role of exercise self-efficacy. Computers Hum. Behav. 103, 151–160 (2020).
Yuan, S., Ma, W., Kanthawala, S. & Peng, W. Keep using my health apps: discover users’ perception of health and fitness apps with the UTAUT2 model. Telemed. J. E Health 21, 735–741 (2015).
Tsai, C.-H., Kuo, Y.-M. & Uei, S.-L. Influences of satisfaction with telecare and family trust in older Taiwanese people. Int. J. Environ. Res. Public Health 11, 1359–1368 (2014).
Kim, K.-H., Kim, K.-J., Lee, D.-H. & Kim, M.-G. Identification of critical quality dimensions for continuance intention in mHealth services: Case study of onecare service. Int. J. Inf. Manag. 46, 187–197 (2019).
Lee, S. M. & Lee, D. H. Healthcare wearable devices: an analysis of key factors for continuous use intention. Serv. Bus. 14, 503–531 (2020).
Guo, X., Chen, S., Zhang, X., Ju, X. & Wang, X. Exploring patients’ intentions for continuous usage of mHealth services: elaboration-likelihood perspective study. JMIR Mhealth Uhealth 8, e17258 (2020).
Beldad, A. D. & Hegner, S. M. Expanding the technology acceptance model with the inclusion of trust, social influence, and health valuation to determine the predictors of german users’ willingness to continue using a fitness app: a structural equation modeling approach. Int. J. Hum.–Computer Interact. 34, 882–893 (2018).
Meng, F., Guo, X., Zhang, X., Peng, Z. & Lai, K.-H. Examining the Role of Technology Anxiety and Health Anxiety on Elderly Users’ Continuance Intention for Mobile Health Services Use. in (2020). https://doi.org/10.24251/HICSS.2020.403.
Hong, Z., Deng, Z. & Zhang, W. Examining factors affecting patients trust in online healthcare services in China: the moderating role of the purpose of use. Health Inform. J. 25, 1647–1660 (2019).
Leung, L. & Chen, C. E-health/m-health adoption and lifestyle improvements: Exploring the roles of technology readiness, the expectation-confirmation model, and health-related information activities. Telecommun. Policy 43, 563–575 (2019).
Akter, S., D’Ambra, J. & Ray, P. Development and validation of an instrument to measure user perceived service quality of mHealth. Inf. Manag. 50, 181–195 (2013).
Birkmeyer, S., Wirtz, B. W. & Langer, P. F. Determinants of mHealth success: An empirical investigation of the user perspective. International Journal of Information Management 59, (2021).
Kim, E. hae, Gellis, Z. D., Bradway, C. K. & Kenaley, B. Depression care services and telehealth technology use for homebound elderly in the United States. Aging Ment. Health 23, 1164–1173 (2019).
Zhang, X. & Xu, X. Continuous use of fitness apps and shaping factors among college students: a mixed-method investigation. Int. J. Nurs. Sci. 7, 580–587 (2020).
Chiu, W., Cho, H. & Chi, C. G. Consumers’ continuance intention to use fitness and health apps: an integration of the expectation–confirmation model and investment model. Information Technology & People ahead-of-print, (2020).
Jaana, M. & Paré, G. Comparison of mobile health technology use for self-tracking between older adults and the general adult population in Canada: Cross-sectional survey. JMIR mHealth and uHealth 8, (2020).
Chen, Y., Yang, L., Zhang, M. & Yang, J. Central or peripheral? Cognition elaboration cues’ effect on users’ continuance intention of mobile health applications in the developing markets. Int. J. Med. Inform. 116, 33–45 (2018).
Chen, S.-C., Jong, D. & Lai, M.-T. Assessing the relationship between technology readiness and continuance intention in an E-appointment system: relationship quality as a mediator. J. Med Syst. 38, 76 (2014).
Hossain, M. A. Assessing m-Health success in Bangladesh: an empirical investigation using IS success models. J. Ent Info Manag. 29, 774–796 (2016).
Chen, J., Ma, J. & Zhang, Y. An investigation of factors affecting patients’ intention of online continuous consultation and offline visiting in eHealth. Chin. Gen. Pract. 23, 3164–3169 (2020).
Anil Kumar, K. & Natarajan, S. An extension of the Expectation Confirmation Model (ECM) to study continuance behavior in using e-Health services. Innovative Mark. 16, 15–28 (2020).
Hsieh, P.-J., Lai, H.-M., Ma, C.-C., Alexander, J. W. & Lin, M.-Y. An extended expectation-confirmation model for mobile nursing information system continuance. Res Theory Nurs. Pr. 30, 282–301 (2016).
Choi, B. C. F. & Lee, N. T. A study on mobile fitness application usage. in 2nd International Conference on HCI in Business, HCIB 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015, August 2, 2015–August 7, 2015 9191 446–457 (Springer Verlag, 2015).
Acknowledgements
This work was supported by the Municipal Natural Science Foundation of Beijing of China [Grant numbers 7222306]; National TCM innovation team and talent support projects [Grant numbers ZYYCXTD-C-202210]; National Natural Science Foundation of China [Grant numbers 81871455]; Zhejiang Provincial Natural Science Foundation of China [Grant number LY22H180001].
Author information
Authors and Affiliations
Contributions
T.W.: Conceptualization, writing—original draft, methodology, project administration, data curation, data analysis. W.W.: Conceptualization, project administration. J.L.: Data curation, methodology, software, investigation. M.N.: Data curation, investigation. Q.W.: Data analysis, assisting in the design. W.W.: Assisting in the design and writing. H.H.: Assisting in the design and writing. J.L.: Conceptualization, writing—review and editing, Project administration, funding acquisition, supervision.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Wang, T., Wang, W., Liang, J. et al. Identifying major impact factors affecting the continuance intention of mHealth: a systematic review and multi-subgroup meta-analysis. npj Digit. Med. 5, 145 (2022). https://doi.org/10.1038/s41746-022-00692-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41746-022-00692-9
This article is cited by
-
Characterization of adults concerning the use of a hypothetical mHealth application addressing stress-overeating: an online survey
BMC Public Health (2024)
-
Digital interventions to promote psychological resilience: a systematic review and meta-analysis
npj Digital Medicine (2024)
-
A framework for integrating artificial intelligence for clinical care with continuous therapeutic monitoring
Nature Biomedical Engineering (2023)