Abstract
Background
With the Experience Sampling Method (ESM) participants are asked to provide self-reports of their symptoms, feelings, thoughts and behaviours in daily life. This preregistered systematic review assessed how ESM is being used to monitor emotional well-being, somatic health, fatigue and pain in children and adolescents with a chronic somatic illness.
Methods
Databases were searched from inception. Studies were selected if they included children or adolescents aged 0–25 years with a chronic somatic illness and used ESM focussing on mental health or psychosocial wellbeing, biopsychosocial factors and/or somatic health. Two reviewers extracted data of the final 47 papers, describing 48 studies.
Results
Most studies evaluated what factors influence medical or psychological symptoms and how symptoms influence each other. Another common purpose was to study the feasibility of ESM or ESM as part of an app or intervention. Study methods were heterogeneous and most studies lack adequate reporting of ESM applications and results.
Conclusions
While ESM holds great potential for providing results and feedback to patients and caregivers, little use is being made of this option. Future studies should consider what they report in their studies, conduct a priori power analyses and how ESM can be embedded in clinical practice.
Impact
-
While ESM has many clinical applications, it is currently mostly used for research purposes.
-
Current studies using ESM are heterogeneous and lack consistent, high-quality reporting.
-
There is great potential in ESM for providing patients and parents with personalised feedback.
Similar content being viewed by others
Introduction
To ensure that paediatric healthcare professionals adequately support the health and well-being of children and adolescents, it is important that they gain and provide insight into both the physical and mental well-being of their patients. For instance, it may help to better understand how mental and somatic health problems/symptoms are related and interact.1 Furthermore, by gaining insight into both the physical and mental well-being of patients, treatment and functional outcomes can be improved2 and optimal care using a holistic perspective can be provided.
Historically, healthcare providers have attempted to gain insight into well-being through (retrospective) paper-and-pencil questionnaires, but there are several disadvantages related to this method of data-collection. For instance, questionnaires are affected by recall bias3 and they do not enable scholars and clinicians to efficiently examine the context in which the investigated feelings, thoughts or behaviour take place in real-time.4
With the rise of technological possibilities in recent years, the number of studies using the Experience Sampling Method (ESM), also called Ecological Momentary Assessment (EMA) or Ambulatory Assessment (AA), have increased both in scientific studies and in clinical practice.5,6 In an ESM study, participants report on their thoughts, feelings, symptoms and/or behaviour in their daily life,7 typically during multiple (random) times per day for several days or weeks.3 Questions may include: Where are you right now? Do you feel tired right now? and Are you alone? The intensive longitudinal data resulting from this data-collection method, may enable both researchers and clinicians4 to answer questions on the dynamics of psychological, behavioural and/or medical processes as they occur.8
Experience Sampling may have several benefits. First, as ESM is highly suited for inquiring how participants feel, behave and think in the actual context,3 it allows researchers and clinicians to relate symptoms, mental well-being and behaviour to contextual factors, such as someone’s whereabouts or their company. Second, ESM may be beneficial for investigating specific age groups such as adolescents.6 As adolescents spent on average up to 3 h and 45 min per day on their smartphone,9 using applications on their smartphone (ESM apps) may be a convenient way to reach this age group and gather data at different moments during their daily lives. Third, ESM apps provide clinicians and researchers with the ability to provide personalised feedback to their patients.10 Or, the ESM apps may provide direct feedback to participants to enable self-monitoring to alleviate symptoms of anxiety or depression.11,12
While ESM is increasingly popular in the field of (clinical) psychology and psychiatry,13,14 it is also being used in children and adolescents with a chronic somatic illness.15,16 For instance, ESM has been combined with Bluetooth sensors on asthma inhalers17 or with data from blood glucose meters in adolescents with diabetes.18 Since the use of ESM in a paediatric patient population with a chronic somatic illness might have important clinical implications, it is crucial to have an overview on the use of ESM in this particular population. Therefore, this preregistered systematic review aimed to provide an overview of how ESM is used in paediatric healthcare and research. Our main research question was: In which way is ESM used to monitor emotional well-being, somatic health, fatigue and pain of children and adolescents with a chronic somatic illness? More specifically, we sought to answer the following questions: (1) To what purpose do studies deploy ESM? (2) In what way is ESM deployed (i.e., on what device, with which frequency and how long)? and (3) What is the quality of the ESM data and the reporting of ESM data?
Methods
This article was written in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement19 and the AMSTAR 2 checklist,20 and was registered prospectively in the international prospective register of systematic reviews, PROSPERO, registration number CRD42022268954.
Search strategy
A broad search focusing on the use of ESM in children and adolescents with a chronic somatic illness was conducted by a research librarian from the Erasmus Medical Centre. The search was first conducted on the 19th of July 2021 and updated on the 21st of July 2022. The following databases were searched from inception; Embase, Medline ALL, Web of Science Core Collection, Cochrane Central Register of Controlled Trials and Google Scholar. The terms included in the search were related to Experience Sampling Method, Ecological Momentary Assessment, children, adolescents and paediatrics. The full search can be found in the Supplementary Materials (S1).
Eligibility criteria
Peer-reviewed studies were eligible if they included children and adolescents (0–25 years of age) with a chronic somatic illness. Chronic somatic illnesses were defined by one or more of the following characteristics: (a) the condition was permanent, (b) left residual disability, (c) was caused by nonreversible pathological alteration, (d) required special training of the patient for rehabilitation or (e) may be expected to require a long period of supervision, observation or care.21 In addition, studies were only included if they used ESM or EMA and collected data regarding; (a) mental or psychosocial wellbeing (e.g., affective wellbeing, anxiety, happiness, social functioning, school performance), (b) (psychosomatic) symptoms (e.g., fatigue or pain) or (c) somatic health (e.g., medication use, disease activity). Studies were excluded if they (a) reported no original data (e.g., case reports, conference abstracts, n = 1 studies or systematic reviews), (b) used daily dairies or had less than two measurements a day, as these were not deemed to be prototypical ESM22 or (c) the article was not written in English. When multiple papers from the same trial were retrieved, only the earliest paper was included in the review.
Study selection
Studies were selected if they met the inclusion criteria. Two rounds were used to screen the title and abstract. Four reviewers (MA, KB, ED and AS) independently assessed the title and abstract of the articles retrieved in the first search in 2021. The average interrater agreement was 96.82%. Two reviewers (MvD and AS) independently assessed the title and abstract of the papers retrieved in the updated search in July 2022. The average interrater agreement was 94.88%. Subsequently, three reviewers independently assessed the full text articles for eligibility (KB, MvD and AS). The average interrater agreement was 87.41%. In all rounds, consensus was used to resolve discrepancies.
Data extraction
Two researchers (MvD and AS) performed data-extraction of selected articles. Both researchers extracted data from 50% of selected articles and double-checked the data-extraction for the other 50%. The following information was extracted: general information about the sample (i.e., age, sex, sample size and medical diagnosis), as well as information about the ESM method (e.g., device used, prompt design, duration, ESM intervals, number of prompts, items per assessment and questionnaires) and ESM quality (e.g., compliance rate, timeframe for responding, user experience, reliability).
Quality and risk of bias
Van Roekel et al. published a checklist for good practices when designing and reporting on ambulatory assessment, which was used for quality and risk of bias assessment. This checklist focusses on participants, procedure (including technology, design of study, participant inclusion and monitoring protocol and compliance) and materials. The checklist was used to assess the quality and risk of bias, with each item rated as 1, 0.5 or 0, or cannot determine/not applicable. Scores were converted to percentages. Papers rated >80% were considered good quality, 60–80% was considered fair quality and <60% was considered poor quality. Quality assessment was done by two reviewers (MvD and AS).
Data synthesis
Summary statistics were created for the average sample size, sex ratio and average age. When means and standard deviations were not available in the original paper, medians were transformed to means and standard deviations as described by Shi et al.23 The final data extraction sheets, reasons for exclusion of full text articles and the quality and risk of bias assessment are available on the Open Science Framework (OSF): https://tinyurl.com/2p8w35ps.
Results
Study selection
The literature search yielded 3005 unique records, of which 2862 were excluded based on the title and abstract. Subsequently, 143 records were retrieved for full-text screening, of which 47 were included in the current systematic review. The complete flowchart is shown in Fig. 1. These 47 papers described 48 studies, with a total of 1726 participants. One paper did not report a sample size.24 The mean sample size per study was 36.72 participants (range 10 to 88). The weighted mean age of all participants was 14.65 (SD = 2.24) and 23.76% was male. The most common diagnoses studied were asthma (n = 9), overweight and/or obesity (n = 9) and type 1 diabetes (n = 7).
Purpose of ESM studies
Results of the selected studies are shown in Table 1. The most common purpose of using ESM in children with a chronic illness was to understand what factors influence symptoms and how symptoms influence each other (n = 25 studies). These factors may be external, such as relating weather conditions to headaches,25 or internal, such as studying the relationship between sleep, pain and daily functioning.26 Other common purposes were to study the feasibility of using ESM within a certain patient group (n = 9 studies), using ESM to study the feasibility of using an app or intervention for a specific patient group (n = 8) or using ESM to study how symptoms of a disease fluctuate over time (n = 6). Less common purposes were to study medication adherence (n = 5), study social functioning within the context of chronic illness (n = 3) or creating self-awareness in participants (n = 1).
Studies used different primary outcome measures. Most studies (n = 17) looked at the feasibility of ESM, either as part of an app or intervention or as a stand-alone methodology. Other studies (n = 10) looked at medical outcomes such as pain intensity24 or lung functioning,27 or at psychological outcomes (n = 7) such as social inclusion28 and depressive symptoms.18 A complete overview is shown in Table 1.
There were no studies using ESM as independent application for patient self-monitoring. Four out of 48 studies reported involving a healthcare provider in the ESM protocol and results.29,30,31,32 In two of these studies, the healthcare providers were involved in choosing the content of the micro-questionnaires. Three of the four studies reported that the healthcare provider discussed the results of the ESM with the patient and caregiver. One study reported that the data was available for the healthcare professional, but does not mention the data being discussed with the patient. The remaining studies do not mention the involvement of the healthcare provider, except for Heathcote et al.,33 where a visit to the outpatient clinic was part of protocol. However, this visit did not include discussing ESM results.
Characteristics of ESM
See Table 2 for an overview of technical and design characteristics of the ESM.
Software/Devices
The majority of studies (n = 24) reported using either a loaned or owned smartphone to disseminate the ESM. An additional five studies did not provide clarity on whether they used a smartphone or other (mobile) phone. Some other studies reported using a personal digital assistant. Most of these studies used a Palm device (n = 11), but Royal Brand (n = 1) has also been used. As not all studies reported their time frame of data collection, there was not enough information to determine whether these were primarily older studies. Fifteen studies combined the ESM device with a wearable, such as blood glucose meters, Bluetooth asthma inhaler caps or accelerometers. The majority of the studies using a wearable combined this with ESM via a smartphone application.
Sampling scheme
The duration of the ESM studies ranged from 13 h to two months, with the majority of the studies (70.83%) using ESM for 14 days or less (median = 14, IQR 7; 15.75). The number of prompts per day ranged from 1 to 16 promptsa, with a mean of 4.3 prompts per day and a mean of 54.37 prompts over the course of the study (range 12 to 147). Ten studies had different numbers of prompts for different days, often participants received more prompts during the weekend than during weekdays.
Micro-questionnaires
Most studies included around 10–20 items, with a range of 4 to 61 items. However, almost half of the studies (n = 24) did not report the number of items they included in their ESM prompts.
Compliance and incentives
To ensure sufficient compliance (i.e., number of answered questionnaires), half of the studies (47.92%) motivated participants with financial means or through study credits (2.08%). Most studies with a financial incentive used different incentives based on the compliance rate or completed research visit. For instance, participants received money at the start of the study and at the final research visit.29,34,35 Other studies gave participants money if the compliance was at least 70%,36 75%,37 80%,32,38 85%39 or 90%.40 A third approach was to add a small amount of money (e.g., $0.25 to $2.5025,26,33,41) to the total incentive for each ESM measure completed. Nineteen studies did not report whether their participants received an incentive for participating.
Personalised feedback
Eight studies reported giving participants insight into their ESM results. This feedback was provided by a healthcare provider32 or researcher,18 but most often through a personalised report,15,30,31,38,42,43 which was sometimes discussed by a healthcare provider f.e.31
Quality of ESM data and studies
The quality of the ESM studies was determined using the checklist for good practice when reporting on ambulatory assessment.6 The results are shown in Table 3. Overall, 27 studies (56.25%) were deemed to be of poor quality. The remaining 21 studies (43.75%) were of fair quality. No studies were of good quality.
Power
Table 1 shows most studies had small sample sizes (M = 36.72 participants), with sample sizes ranging from 10 to 88 participants. Twelve studies (25.00%) included 20 participants or less. Notably, only four studies performed an a priori power analysis, using computer programs to generate either minimum sample sizes with moderate regression coefficients24,25,30 or multi-level Monte Carlo simulations.41 One study based their sample size on the minimum recommended sample size for multilevel designs by Maas and Hox,44 instead of performing a formal statistical power analysis.40 However, eight studies were feasibility studies. A power analysis may not be applicable to those studies.
Reporting
Several studies lacked sufficient details in the methods section to replicate the study. For instance, two studies did not report on the software nor the devices used to gather the ESM data.45,46 An additional 11 studies reported on the devices used during the study but did not report which software was used.18,25,34,39,41,46,47,48,49,50
Most studies (95.83%) described the prompt design, reporting on both intervals (e.g., random intervals or fixed intervals) and/or prompt contingent (e.g., signal-contingent or event-contingent). Sixteen out of 48 studies reported on the response window available for participants to complete the ESM after being given the prompt.
About half of the studies (n = 22) also reported a monitoring scheme, detailing when and how many reminders participants received to ensure compliance. Most studies used automated reminders,29 contacted the participant at least once a week24,34,41,42,43,51,52,53,54 or contacted participants when compliance rates declined.17,26,35,55 A few studies combined automated reminders with contacting participants.30,38
Four studies reported problems during data collection (mostly related to technical issues). None of these studies reported subsequent adjustments to protocol.31,51,52,53 The other studies (n = 44) reported no problems or technical issues during data collection. It is unclear whether this indicates that there were no problems or whether problems were not reported.
Compliance
The majority of the studies (39 out of 48/81%) reported the overall compliance. Table 2 shows that the overall compliances range from 20% to 95% (M = 69.77, SD = 14.87). Some studies (n = 13) reported excluding participants based on compliance score. Six studies reported a compliance cut off score. These cut off scores varied between ≥25%,26,56 or ≥33%42,54,57 or ≥50%.52 In addition, two studies omitted ESM data that could not be matched to the data points of a wearable.55,58 Of these 13 studies, three studies reported recalibrating the overall compliance after exclusion of participants.42,55,59 Other studies (n = 10) only included questionnaires completed within a certain time window. The remaining 25 studies did not provide clarity on the overall compliance. Notably, only five studies reported reasons for noncompliance, such as technical problems, illness or missed time windows. Fifteen studies provided some insight into compliance reasons by reporting on (non)compliance patterns. Two studies reported compliance was higher for the morning questionnaires and on the weekend days.30,50
User experience
Twelve out of 48 studies reported on user experience, typically based on satisfaction with the study procedures and willingness to participate again. Most studies used either a questionnaire or brief interview. Four studies indicated that the majority of participants thought ESM was easy to use and gave a positive recommendation for peers.31,32,33,43
Materials
The last three items of the checklist for good practice assess the materials used in the studies. Almost all studies (n = 43) reported on scale construction and transformation. Over half of these studies (n = 25) also reported on the psychometric properties of the used scales. Five studies did not report on scale construction and transformation, nor on the psychometric properties of the scale. Lastly, thirty-five articles specified whether the participants answered the ESM questions about their current state (in-the-moment) or about the past hour(s).
Discussion
Whereas ESM is booming in clinical psychology, psychiatry and other fields of study (e.g., communication sciences, organisational psychology),5,6 relatively little is known about its application in paediatrics, despite showing promise for the field. Hence, this preregistered systematic review aimed to provide an overview of the application of ESM in paediatrics. More specifically, we aimed to study the purposes of the studies using ESM, the way ESM was deployed and the quality of the ESM studies as well as their reporting. A systematic literature search yielded 47 papers, describing 48 studies.
Almost all studies had an aim that was primarily related to doing research. Most often, the purpose was to investigate what factors influenced medical or psychological symptoms and how symptoms influenced each other. With regards to using ESM to provide personalised feedback, only one study used ESM to create self-awareness in participants and eight studies gave participants insight into their ESM results, of which five without professional guidance or support. Four studies involved the healthcare professional in the ESM methodology or results. Previous ESM applications in psychology provided personalised feedback to participants,60 so they may change their behaviour61 or to alleviate psychological symptoms.62 Similar applications could also be used in paediatrics to benefit both the healthcare provider and the patient or caregiver. For instance, monitoring of symptoms or medication adherence may provide the healthcare provider with useful insights for monitoring wellbeing and treatment adherence,63 as well as insight into the influence of contextual factors on the physical and mental well-being. The patient and caregiver may also gain insight and adopt their behaviour according to the feedback provided. Using ESM in this way also aligns with recent developments in paediatrics, such as value-based healthcare and shared decision making.64 In addition, by using ESM in routine outcome monitoring, more positive health outcomes and a subsequent reduction in healthcare costs may be realised.65,66
In comparison to other fields of study, the field of ESM in paediatrics seems in its infancy, both in terms of the number of studies as in terms of quality indicators. Most existing studies in paediatrics were much smaller than typical ESM studies on adolescents in other fields of study.6 In our review, the mean sample size was 36.72 and the average number of assessments was 54.37. Whether this was sufficient is an urgent question, as the topic of how precise estimates from ESM data are is still under investigation by methodologists. However, it may less feasible to recruit large samples of adolescents with a chronic illness into studies compared to large samples of adolescents from the general population. As not all adolescents are diagnosed with a chronic illness, the group of potential participants is much smaller and large study samples may thus be harder to achieve.
With regards to the quality of reporting, ESM research in paediatrics may benefit from developments in other domains. Many of the selected studies lacked sufficient details to replicate work (e.g., reasons for noncompliance or patterns of (non)compliance). Although the study design was often well-described, studies often omitted reporting the response window, the amount of items per assessment or the monitoring scheme. Hence, we recommend that future research make use of the checklist published by van Roekel et al.6 for reporting their findings and may also benefit from a strong Open Science Movement with regards to good practices for ESM.67
This study also has several strengths and limitations. This is the first overview of how ESM is applied in paediatrics. A particular strength is its preregistered design with a thorough literature search. A first limitation is that the checklist used to assess quality and risk of bias assessment was developed primarily for studies within the field of psychology. Hence, the quality of reporting relating the chronic illness itself was not assessed. A second limitation is that our search was tailored primarily to chronic illness and ESM, but not towards wearables. This review may not provide a complete overview of the application of wearables in paediatrics.
This overview can serve as inspiration for clinicians working with children with a chronic illness. ESM can be embedded in the clinical practice in many ways, for instance by combining ESM with data from wearables (e.g., heart rate monitors or blood glucose meters). Another possibility is to provide feedback to patients and parents either by the healthcare provider themselves, or through personalised reports. In terms of the duration of ESM, this systematic review showed there are many possible durations. Another option that was not highlighted in this review, but has been previously suggested is to incorporate ESM throughout various stages of the treatment,68 for instance by starting with a few days ESM at baseline and doing a follow-up period after six weeks.
Future research using ESM for either scientific or clinical purposes can be strengthened by learning from other domains. For instance, studies should conduct a priori power analyses (e.g., using Mplus or PowerAnalysisIL), and items and questionnaires (including branching and dependencies) could be shared through open science, in repositories such as the ESM item repository.69 Following guidelines for reporting ESM studies, authors should provide stronger rationales for their sample schemes and frequencies to enable replication and faster progress in paediatric research and practice. In addition, future research should establish whether the use of ESM in clinical practice may lead to a reduction of healthcare costs.
In conclusion, there are many different applications of ESM in paediatrics. Although the reporting of many papers can be improved, these applications may be of inspiration to other researchers and healthcare professionals. Despite the field of ESM in paediatrics being in its infancy, ESM can be embedded into the healthcare process in a myriad of ways. Incorporating ESM into healthcare could also ensure a reduction in healthcare costs by enhancing treatment adherence through personal feedback, or by allowing clinicians to provide early interventions based on ESM responses. However, this should be investigated in future studies.
Data availability
The datasets generated during the current study are available in the OSF repository, https://osf.io/k7z63/?view_only=b479f9ee620f43acaf0242c4aa21486a.
References
Prince, M. et al. No Health without Mental Health. Lancet 370, 859–877 (2007).
Bele, S. et al. Patient-reported outcome measures in routine pediatric clinical care: a systematic review. Front. Pediatr. 8 (2020).
Myin-Germeys, I. et al. Experience sampling methodology in mental health research: new insights and technical developments. World Psychiatry 17, 123–132 (2018).
Smyth, J. M. & Heron, K. E. in Emerging Methods in Family Research (McHale, S. M., Amato, P. & Booth, A. eds.) 145–161 (Springer International Publishing, 2014).
Hamaker, E. L. & Wichers, M. No time like the present:discovering the hidden dynamics in intensive longitudinal data. Curr. Dir. Psychol. Sci. 26, 10–15 (2017).
van Roekel, E., Keijsers, L. & Chung, J. M. A review of current ambulatory assessment studies in adolescent samples and practical recommendations. J. Adolesc. 29, 560–577 (2019).
Kuppens, P. & Myin-Germeys, I. The open handbook of experience sampling methodology: a step-by-step guide to designing, conducting, and analyzing ESM studies (Center for Research on Experience Sampling and Ambulatory Methods Leuven (REAL), 2021).
Trull, T. J. & Ebner-Priemer, U. The role of ambulatory assessment in psychological science. Curr. Dir. Psychol. Sci. 23, 466–470 (2014).
Wade, N. E. et al. Passive sensing of Preteens’ smartphone use: an adolescent brain cognitive development (Abcd) Cohort Substudy. JMIR Ment. Health 8, e29426 (2021).
Leertouwer, I., Cramer, A. O. J., Vermunt, J. K. & Schuurman, N. K. A review of explicit and implicit assumptions when providing personalized feedback based on self-report Ema data. Front. Psychol. 12 (2021).
Gatto, A. J., Miyazaki, Y. & Cooper, L. D. Help me help myself: examining an electronic mental health self-monitoring system in college students. High. Educ. 83, 163–182 (2022).
Kauer, S. D. et al. Self-monitoring using mobile phones in the early stages of adolescent depression: randomized controlled trial. JMIR 14, e1858 (2012).
Larson, R. W. Experiencing sampling research from its beginnings into the future. J. Adolesc. 29, 551–559 (2019).
Russell, M. A. & Gajos, J. M. Annual research review: ecological momentary assessment studies in child psychology and psychiatry. J. Child Psychol. Psychiatry 61, 376–394 (2020).
Zhang, P. et al. Using Momentary Assessment and Machine Learning to Identify Barriers to Self-Management in Type 1 Diabetes: Observational Study. JMIR Mhealth Uhealth 10, e21959 (2022).
Manasse, S. M. et al. The moderating role of sleep duration on momentary relations between negative affect and loss-of-control eating in children and adolescents. Eur. Eating Disord. Rev. 30, 815–822 (2022).
Hao, H. et al. Daily associations of air pollution and pediatric asthma risk using the biomedical reai-time health evaluation (Breathe) Kit. Int. J. Environ. Res. Public Health 19, 1–17 (2022).
Helgeson, V. S., Lopez, L. C. & Kamarck, T. Peer relationships and diabetes: retrospective and ecological momentary assessment approaches. Health Psychol. 28, 273–282 (2009).
Page, M. J. et al. The Prisma 2020 statement: an updated guideline for reporting systematic reviews. BMJ 372, n71 (2021).
Shea, B. J. et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 358, 1–9 (2017).
Bernstein, A. B. et al. Health care in America: trends in utilization Hyattsville. Md: National Center for Health Statistics (2003).
Myin-Germeys, I. & Kuppens, P. (Eds.). The open handbook of experience sampling methodology: A step-by-step guide to designing, conducting, and analyzing ESM studies 2nd ed. (Center for Research on Experience Sampling and Ambulatory Methods Leuven, Leuven, 2022).
Shi, J. et al. Optimally estimating the sample standard deviation from the five‐number summary. Res. Synth. Methods 11, 641–654 (2020).
Stinson, J. N. et al. Comparison of average weekly pain using recalled paper and momentary assessment electronic diary reports in children with arthritis. Clin. J. Pain. 30, 1044–1050 (2014).
Connelly, M., Miller, T., Gerry, G. & Bickel, J. Electronic momentary assessment of weather changes as a trigger of headaches in children. Headache 50, 779–789 (2010).
Bromberg, M. H., Connelly, M., Anthony, K. K., Gil, K. M. & Schanberg, L. E. Prospective mediation models of sleep, pain, and daily function in children with arthritis using ecological momentary assessment. Clin. J. Pain. 32, 471–477 (2016).
Ghriwati, N. A., Everhart, R. S. & Winter, M. A. Interactive effects of family functioning and sleep experiences on daily lung functioning in pediatric asthma: an ecological momentary assessment approach. J. Asthma 57, 262–270 (2020).
Jessup, G., Bundy, A. C., Broom, A. & Hancock, N. The social experiences of high school students with visual impairments. J. Vis. Impairment Blindness 111, 5–19 (2017).
Teufel Ii, R. J. et al. Smartphones for real-time assessment of adherence behavior and symptom exacerbation for high-risk youth with asthma: pilot study. JMIR Pediatr. Parent 1, e8 (2018).
Psihogios, A. M. et al. Daily text message assessments of 6-mercaptopurine adherence and its proximal contexts in adolescents and young adults with Leukemia: a pilot study. Pediatr. Blood Cancer 68, 1–10 (2021).
Nap-van der Vlist, M. M. et al. Internet and smartphone-based ecological momentary assessment and personalized advice (PROfeel) in adolescents with chronic conditions: a feasibility study. Internet Interv. 25, 1–10 (2021).
Cushing, C. C., Kichline, T., Blossom, J. B., Friesen, C. A. & Schurman, J. V. Tailoring individualized evaluation of pediatric abdominal pain using Ecological Momentary Assessment (EMA): a pilot study testing feasibility and acceptability. Clin. J. Pain. 35, 859–868 (2019).
Heathcote, L. C. et al. Smartphone-based ecological momentary assessment to study “scanxiety” among adolescent and young adult survivors of childhood cancer: a feasibility study. Psychooncology 31, 1322–1330 (2022).
Valrie, C. R. et al. Investigating the sleep-pain relationship in youth with sickle cell utilizing mhealth technology. J. Pediatr. Psychol. 44, 323–332 (2019).
Dougherty, E. N. et al. Gender differences in the relation between interpersonal stress and momentary shape and weight concerns in youth with overweight/obesity. Body Image 40, 249–255 (2022).
Borus, J. S., Blood, E., Volkening, L. K., Laffel, L. & Shrier, L. A. Momentary assessment of social context and glucose monitoring adherence in adolescents with Type 1 diabetes. J. Adolesc. Health 52, 578–583 (2013).
Sweenie, R., Cushing, C. C., Fleming, K. K., Prabhakaran, S. & Fedele, D. A. Daily adherence variability and psychosocial differences in adolescents with asthma: a pilot study. J. Behav. Med. 45, 148–158 (2022).
Mulvaney, S. A. et al. Mobile momentary assessment and biobehavioral feedback for adolescents with Type 1 diabetes: feasibility and engagement patterns. Diabetes Technol. Ther. 20, 465–474 (2018).
Tasian, G. E. et al. Ecological momentary assessment of factors associated with water intake among adolescents with kidney stone disease. J. Urol. 201, 606–613 (2019).
Connelly, M. A. & Boorigie, M. E. Feasibility of using “smarter” methodology for monitoring precipitating conditions of pediatric migraine episodes. Headache 61, 500–510 (2021).
Goldschmidt, A. B. et al. Ecological momentary assessment of maladaptive eating in children and adolescents with overweight or obesity. Int J. Eat. Disord. 51, 549–557 (2018).
Feller, C., Ilen, L., Eliez, S. & Schneider, M. Characterizing daily-life social interactions in adolescents and young adults with neurodevelopmental disorders: a comparison between individuals with autism spectrum disorders and 22q11.2 Deletion Syndrome. J. Autism Dev. Disord. 53, 245–262 (2022).
Lee, R. R., Shoop-Worrall, S., Rashid, A., Thomson, W. & Cordingley, L. “Asking Too Much?”: Randomized N-of-1 trial exploring patient preferences and measurement reactivity to frequent use of remote multidimensional pain assessments in children and young people with juvenile idiopathic arthritis. J. Med. Internet Res. 22, 1–14 (2020).
Maas, C. J. M. & Hox, J. J. Sufficient sample sizes for multilevel modeling. Methodology 1, 86–92 (2005).
Egbert, A. H. et al. Momentary associations between positive affect dimensions and dysregulated eating during puberty in a diverse sample of youth with overweight/obesity. Int. J. Eat. Disord. 53, 1667–1677 (2020).
MacDonell, K., Gibson-Scipio, W., Lam, P., Naar-King, S. & Chen, X. Text messaging to measure asthma medication use and symptoms in Urban African American emerging adults: a feasibility study. J. Asthma 49, 1092–1096 (2012).
Egbert, A. H., Smith, K. E., Ranzenhofer, L. M., Goldschmidt, A. B. & Hilbert, A. The role of affective instability in loss of control eating in youth with overweight/obesity across development: findings from two Ema studies. Res. Child Adolesc. Psychopathol. 50, 945–957 (2022).
Miadich, S. A., Everhart, R. S., Heron, K. E. & Cobb, C. O. Medication use, sleep, and caregiver smoking status among Urban children with asthma. J. Asthma 55, 588–595 (2018).
Rancourt, D., Leahey, T. M., LaRose, J. G. & Crowther, J. H. Effects of weight-focused social comparisons on diet and activity outcomes in overweight and obese young women. Obesity 23, 85–89 (2015).
Schurman, J. V. & Friesen, C. A. Identifying potential pediatric chronic abdominal pain triggers using ecological momentary assessment. Clin. Pract. Pediatr. Psychol. 3, 131–141 (2015).
Björling, E. A. & Singh, N. Exploring temporal patterns of stress in adolescent girls with headache. Stress Health 33, 69–79 (2017).
Bray, P., Bundy, A. C., Ryan, M. M. & North, K. N. Feasibility of a computerized method to measure quality of “everyday” life in children with neuromuscular disorders. Phys. Occup. Ther. Pediatr. 30, 43–53 (2010).
Bray, P., Bundy, A. C., Ryan, M. M. & North, K. N. Can in-the-moment diary methods measure health-related quality of life in duchenne muscular dystrophy? Qual. Life Res. 26, 1145–1152 (2017).
Feller, C., Ilen, L., Eliez, S. & Schneider, M. Psychotic experiences in daily-life in adolescents and young adults with 22q11.2 deletion syndrome: an ecological momentary assessment study. Schizophr. Res. 238, 54–61 (2021).
Smith, K. E. et al. Bi-directional associations between real-time affect and physical activity in weight-discordant siblings. J. Pediatr. Psychol. 46, 443–453 (2021).
Mulvaney, S. A. et al. Using Mobile Phones to Measure Adolescent Diabetes Adherence. Health Psychol. 31, 43–50 (2012).
Gevonden, M. J. et al. Psychotic reactions to daily life stress and dopamine function in people with severe hearing impairment. Psycholog. Med. 45, 1665–1674 (2015).
Shapira, A., Volkening, L. K., Borus, J. & Laffel, L. M. Ecological momentary assessment of positive and negative affect, social context, and blood glucose in teens with Type 1 diabetes. Diabetes 17, 195–200 (2020).
Beal, D. J. Esm 2.0: state of the art and future potential of experience sampling methods in organizational research. Annu. Rev. Organ. Psychol. Organ. Behav. 2, 383–407 (2015).
Leertouwer, I., Vermunt, J. & Schuurman, N. K. A pre-post design for testing insight from personalized feedback about positive affect in contexts. Preprint (2022).
Snippe, E. et al. Change in daily life behaviors and depression: within-person and between-person associations. Health Psychol. 35, 433 (2016).
Kramer, I. et al. A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry 13, 68–77 (2014).
Carlier, I. V. E. et al. Routine outcome monitoring and feedback on physical or mental health status: evidence and theory. J. Eval. Clin. Pr. 18, 104–110 (2012).
Steinmann, G., Delnoij, D., van de Bovenkamp, H., Groote, R. & Ahaus, K. Expert consensus on moving towards a value-based healthcare system in the Netherlands: a Delphi study. BMJ Open 11, e043367 (2021).
Barkham, M. et al. Routine outcome monitoring (ROM) and feedback: research review and recommendations. Psychother. Res. 33, 841–855 (2023).
van Deen, W. K. et al. The impact of value-based healthcare for inflammatory bowel diseases on healthcare utilization: a pilot study. Eur. J. Gastroenterol. Hepatol. 29, 331–337 (2017).
Kirtley, O. J., Lafit, G., Achterhof, R., Hiekkaranta, A. P. & Myin-Germeys, I. Making the black box transparent: a template and tutorial for registration of studies using experience-sampling methods. Adv. Meth. Pract. Psychol. Sci. 4, 2515245920924686 (2021).
van Os, J. et al. The experience sampling method as an mhealth tool to support self-monitoring, self-insight, and personalized health care in clinical practice. Depress Anxiety 34, 481–493 (2017).
Kirtley, O. J. et al. The Experience Sampling Method (ESM) Item Repository. (2020). https://doi.org/10.17605/OSF.IO/KG376.
Bui, A. A. T. et al. Biomedical real-time health evaluation (Breathe): toward an Mhealth informatics platform. JAMIA Open 3, 190–200 (2020).
Campbell, T. S. et al. Asthma self-efficacy, high frequency heart rate variability, and airflow obstruction during negative affect in daily life. Int. J. Psychophysiol. 62, 109–114 (2006).
Cushing, C. C., Kichline, T., Friesen, C. & Schurman, J. V. Individual differences in the relationship between pain fear, avoidance, and pain severity in a chronic abdominal pain sample and the moderating effect of child age. Ann. Behav. Med. 55, 571–579 (2021).
Dunton, G. et al. Momentary assessment of psychosocial stressors, context, and asthma symptoms in hispanic adolescents. Behav. Modif. 40, 257–280 (2016).
Glista, D., O’Hagan, R., Van Eeckhoutte, M., Lai, Y. & Scollie, S. The use of ecological momentary assessment to evaluate real-world aided outcomes with children. Int J. Audio. 60, S68–S78 (2021).
Kichline, T., Cushing, C. C., Ortega, A., Friesen, C. & Schurman, J. V. Associations between physical activity and chronic pain severity in youth with chronic abdominal pain. Clin. J. Pain. 35, 618–624 (2019).
Kolmodin MacDonell, K., Naar, S., Gibson-Scipio, W., Lam, P. & Secord, E. The detroit young adult asthma project: pilot of a technology-based medication adherence intervention for African-American emerging adults. J. Adolesc. Health 59, 465–471 (2016).
Kubiak, T., Vögele, C., Siering, M., Schiel, R. & Weber, H. Daily hassles and emotional eating in obese adolescents under restricted dietary conditions-the role of ruminative thinking. Appetite 51, 206–209 (2008).
Rofey, D. L. et al. Utilizing ecological momentary assessment in pediatric obesity to quantify behavior, emotion, and sleep. Obesity 18, 1270–1272 (2010).
Warnick, J. L. et al. Use of ecological momentary assessment to measure self-monitoring of blood glucose adherence in youth with Type 1 diabetes. Diabetes Spectr. 33, 280–289 (2020).
Acknowledgements
The authors wish to thank Michelle Aukes for her work on setting up the search and initiating the abstract screening. The authors thank Elise Krabbendam and Dr. Sabrina Meertens-Gunput from the Erasmus MC Medical Library for developing the search strategies.
Funding
This work was supported by Sophia Foundation (grant number B18-05). This publication is part of the ‘eHealth junior’ project (with project number NWA.1292.19.226) of the NWA research program ‘Research on Routes by Consortia (ORC)’, which is funded by the Netherlands Organization for Scientific Research (NWO).
Author information
Authors and Affiliations
Contributions
M.D.: Screening of papers, data extraction, writing, and editing the manuscript. A.S.: Screening of papers, data extraction, writing, and editing the manuscript. E.D.: Screening of papers, reviewing and editing the manuscript. K.B.: Screening of papers, reviewing and editing the manuscript. S.N.: Funding acquisition, reviewing, and editing the manuscript. L.K.: Funding acquisition, conceptualisation of the study, writing and editing the manuscript. M.H.: Funding acquisition, writing, and editing the manuscript. J.L.: Funding acquisition, conceptualisation of the study, supervision of data collection, editing the manuscript. All authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
van Dalen, M., Snijders, A., Dietvorst, E. et al. Applications of the experience sampling method (ESM) in paediatric healthcare: a systematic review. Pediatr Res 95, 887–900 (2024). https://doi.org/10.1038/s41390-023-02918-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41390-023-02918-2