Abstract
This study aimed to validate a wearable device’s walking speed estimation pipeline, considering complexity, speed, and walking bout duration. The goal was to provide recommendations on the use of wearable devices for real-world mobility analysis. Participants with Parkinson’s Disease, Multiple Sclerosis, Proximal Femoral Fracture, Chronic Obstructive Pulmonary Disease, Congestive Heart Failure, and healthy older adults (n = 97) were monitored in the laboratory and the real-world (2.5 h), using a lower back wearable device. Two walking speed estimation pipelines were validated across 4408/1298 (2.5 h/laboratory) detected walking bouts, compared to 4620/1365 bouts detected by a multi-sensor reference system. In the laboratory, the mean absolute error (MAE) and mean relative error (MRE) for walking speed estimation ranged from 0.06 to 0.12 m/s and − 2.1 to 14.4%, with ICCs (Intraclass correlation coefficients) between good (0.79) and excellent (0.91). Real-world MAE ranged from 0.09 to 0.13, MARE from 1.3 to 22.7%, with ICCs indicating moderate (0.57) to good (0.88) agreement. Lower errors were observed for cohorts without major gait impairments, less complex tasks, and longer walking bouts. The analytical pipelines demonstrated moderate to good accuracy in estimating walking speed. Accuracy depended on confounding factors, emphasizing the need for robust technical validation before clinical application.
Trial registration: ISRCTN – 12246987.
Similar content being viewed by others
Introduction
Mobility has been defined as the ability to move freely and easily, representing an essential component of health and quality of life, being key to physical, mental, and social well-being1. Sudden loss in mobility has been associated with morbidity, falls, dementia, cognitive decline, hospitalizations, mortality and symptoms of chronic disorders2,3,4,5,6. Mobility loss translates to an inability to perform activities of daily living, which has also been defined as mobility disability1,7. According to the World Health Organization (WHO), it is estimated that 1 billion people currently live with mobility disability due to impairments in their respiratory, cardiovascular, musculoskeletal or neurological systems8. This number is expected to rise further due to increased longevity of the worldwide population and prolonged survival in people with chronic diseases leading to motor detriment. This will entail large public health implications and increase an already growing social and economic burden upon healthcare systems.
Efforts to mitigate the loss of mobility disability are of increasing priority and have been the focus of several recent clinical intervention trials9,10,11,12. Existing mobility endpoints are based upon patient self-reporting and one-off assessments of physical function, such as the timed up and go test or a 6 minutes walk test. While such an assessment provides useful insights on an individual’s mobility capacity (how much they can do), it lacks ecological validity as it does not reflect an individual’s mobility performance (how much they actually do) during daily life1,7,13,14. This incomplete assessment of mobility limits therapeutic development and clinical management14. Therefore, valid and easy-to-use methods to accurately and reliably assess mobility performance would provide insight into how mobility disability manifests in the real-world7.
Digital health technology, such as wearable devices, offer an objective, low-cost and ecologically valid approach of continuously monitoring real-world mobility performance through characterisation of Digital Mobility Outcomes (DMOs)7. A single wearable device can be worn unobtrusively and comfortably on the lower back, attached to a belt or affixed to the skin15,16. Walking speed remains the most widely explored DMO17, where reduced walking speed has been associated with ageing, mortality, neurological and cardiovascular conditions, cognitive decline, and risk of falling2,5,18,19,20,21. Furthermore, walking speed represents a composite measure of walking ability, as it is estimated from the combination of other spatial and temporal DMOs, specifically stepping cadence and stride length. As such, walking speed represents a global measure of mobility that can be interpreted and is meaningful to patients and clinicians alike17.
A lack of robust technical validation of real-world walking speed measurements has prevented the adoption of walking speed derived from wearable devices as a clinical endpoint for interventional trials7,22,23. Technical validation requires the comparison of DMOs quantified from a wearable device with DMOs quantified by an established reference system, whilst accounting for and acknowledging a wide range of contextual factors24. The majority of algorithms to estimate walking speed have typically been validated based upon healthy adults assessed in simple laboratory tasks in standardized and supervised settings that do not represent the more challenging and variable nature of real-world environments24. Furthermore, studies often validate DMO algorithms in isolation, without considering the complexity of a comprehensive multi-stage pipeline needed to estimate walking speed25,26,27,28. This first requires the identification of walking activity, followed by the quantification of DMOs (e.g., steps, cadence, stride length, walking speed). Interactions between all algorithmic steps in the pipeline will influence final outputs, and errors will accumulate along the pipeline. A robust validation of walking speed therefore requires analysis of the estimate of walking speed at a walking bout (WB) level from the implementation of the full pipeline.
The aim of this study was to provide a comprehensive validation of walking speed estimated from a single inertial measurement unit based wearable device against a multi-sensor reference system integrating pressure insoles (INDIP)29,30,31, to enable a robust validation: (i) in both laboratory and real-world settings, (ii) across different clinical cohorts with a range of mobility disabilities, (iii) across gait tasks of varying complexity and (iv) accounting for confounding factors (WB duration and walking speed). Subsequently, we provide recommendations for the suitability of a wearable device paired with the proposed analytical pipeline as a measure of real-world mobility and suggest a framework for future studies aiming to validate DMOs for real-world monitoring.
Results
Clinical and demographic characteristics of the participants are presented by cohort in Table 1 (Mean ranges: Age 47–79 years, Height 166–176 cm, mass 70.6–83.6 kg). Participants were recruited (n = 108) from the following cohorts: congestive heart failure (CHF), chronic obstructive pulmonary disease (COPD), healthy adult (HA), multiple sclerosis (MS), Parkinson’s disease (PD) and proximal femoral fracture (PFF). Eleven participants (CHF: 4, MS: 3, PD: 1, PFF: 3) were excluded from the laboratory recordings and 26 participants (CHF: 3, HA: 3, MS: 7, PD: 5, PFF: 8) from the real-world recordings due to technical difficulties with either the reference system or the wearable device.
An overview of the method of validating walking speed can be viewed in Fig. 1.
True Positive Evaluation
In the laboratory assessments a total of 1365 WBs were detected by the reference system and 1298 WBs by the wearable device. To be able to compare DMOs on a WB level, the analysis included WBs that were concurrently detected by both systems (true positive analysis). All WBs with a time-overlap of more than 80% of their duration were considered true positive, resulting in 692 WBs that were considered for analysis and considered a TP (see Methods and Supplementary Figs. 1 and 2 for more details). Based on these true positive WBs, we observed a mean error of 0.01 m/s (MRE = 5.9%), and MAE of 0.10 m/s (MARE = 14.96%) across all cohorts (Fig. 2, left. Table 2). We found that walking speed was estimated with good reliability (ICC = 0.84) by the wearable device, with a slight overestimation compared to the INDIP reference system.
In the 2.5-h real-world assessment, the reference system detected 4409 WBs, while the wearable device identified 4620 WBs. The average sensitivity and specificity for WB detection compared to the reference system were 0.65 and 0.99, respectively (Table 3). Across all detected WBs, 1414 (30% of all WBs) were identified as true positive WBs (i.e., more than 80% overlap with a reference WB). Based on these WBs, we observed a mean error of 0.06 m/s (MRE = 14.48%) and a MAE of 0.11 m/s (MARE = 20.31%) across all cohorts (Fig. 2, right, Table 2). As observed in the laboratory data, results showed a good reliability (ICC = 0.77) (Table 4), with an overestimation of walking speed by the wearable device (0.01 m/s).
Combined evaluation
To remove potential bias by focusing only on the true-positive WBs and to mimic actual use of wearable device where reference data may not be available, we performed a second evaluation for which we combined all WBs for a Laboratory test and 2.5 h recording in the real world by taking the median of the calculated DMOs (see Methods). These combined values were then compared between the systems. Results from laboratory data showed a mean error over all tests of 0.01 m/s (MRE = 7.47%) and a MAE of 0.12 m/s (MARE = 17.82%) (Fig. 3, left. Table 4). In contrast, in the real-world we observed a higher mean error over all participants of 0.11 m/s (MRE = 24.48%) and a MAE of 0.13 m/s (MARE = 26.47%) (Fig. 3, right. Table 4). For both environments the errors were higher than those estimated from the analysis on true-positive WBs. The biggest effect was seen on the ICC during the real-world recording which dropped considerably to 0.33 (poor) across all cohorts and showed no (PFF: 0.04) or even negative correlation (MS: − 0.15). This is not surprising due to the limited number of datapoints included for this type of analysis (one datapoint per participant).
Factors that can influence walking speed validity
Influence of the cohort
The MAE based on the true-positive evaluation differed by < 0.05 m/s between cohorts in both laboratory and real-world settings. In the laboratory, the COPD cohort had the lowest MAE (0.06 m/s) followed by HAs (0.08 m/s) (Table 2), whereas the PFF and CHF cohorts had the largest MAE of 0.12 m/s. In the real-world, HAs presented the lowest MAE (0.09 m/s) followed by the PFF cohort (MAE = 0.11 m/s) (Table 2). Walking speed tended to be overestimated for all cohorts apart from CHF, for which walking speed was underestimated by 0.06 m/s in the laboratory and 0.04 m/s in the real-world.
Influence of WB duration and walking speed
In the analysis based on the true positive WBs, errors decreased for longer WB durations (Fig. 4). MAE across all cohorts for very short WBs < 10 s ranged between 0.09 and 0.16 m/s, compared to 0.06–0.11 m/s for long WBs (between 60 and 120 s). However, as WB duration increased, the number of available WBs included in the validation analysis decreased as well. When looking at the combined approach (across all detected WBs) (Fig. 5) the trends from the true-positive analysis were confirmed. The MAE for the very short WBs (< 10 s) was lower than for the short WBs (10–30 s), and the number of very short WBs detected by the wearable device was disproportionally higher compared to the reference system. Overall, about two thirds of all WBs were shorter than 30 s. When removing very short WBs (< 10 s) from the calculation of the mean/median errors, the range in error was marginally smaller for some cohorts than the error observed at all WBs for the true positive analysis (improvement < 0.1 m/s). The median of the absolute difference of the combined analysis increased from 0.1 m/s over all WBs to 0.14 m/s for the WBs longer than 10 s.
In both environments, a clear linear negative relationship between the magnitude of the reference walking speed and the measurement errors was observed (Fig. 2). For the slowest WBs (< 0.6 m/s), we observed the largest absolute errors, increasing to 0.8 m/s in real-worlds WBs. Walking speed tended to be overestimated for slow WBs and underestimated for fast WBs. This trend can also be observed in the overall speed distribution of the WBs (Supplementary Fig. 2), which shows a larger number of slow walking bouts and a lower median gait velocity for the reference system compared to the wearable device.
Influence of task complexity
As task complexity increased, so did the MAE. For instance, the most complex laboratory gait task (“simulated daily activities”) presented the highest MAE across all cohorts (0.17 m/s) and the least complex task (the slow straight walking test) presented the lowest MAE (0.08 m/s) (Table 5, Fig. 6). Furthermore, the influence of task complexity was cohort dependent. The largest differences between the simple and complex gait tests were observed for the MS, PD, and PFF cohorts (P1 pipeline). In the real-world, for the same cohorts, differences were observed in the errors estimated between the WBs without turns and WBs with turns. For all cohorts, mean error and MAE from real-world assessments were comparable or slightly lower than from simulated daily activities.
Discussion
To our knowledge, this study is the most extensive validation of a complex comprehensive multi-stage analytical pipeline for estimation of walking speed from a single wearable device. Overall, our findings showed good to excellent validation results in the laboratory and moderate to good agreement in the real-world. We demonstrated that validity of walking speed estimation is slightly impacted by several factors including environment (laboratory vs real-world), clinical cohort, gait task complexity and other confounding factors (number of turns, WB duration, WB speed). Our results have strong implications for future research, below we provide our recommendations for future validations and on the use of wearable device-based walking speed in daily life and more broadly, DMOs in general.
Overall validation results
Overall, laboratory walking speed demonstrated excellent agreement with the reference system, with the ICCs of the true positive WBs ranging from good (0.79) to excellent (0.91) and MAEs ranging from 0.06 to 0.12 m/s across all cohorts. Within the combined evaluation, the ICC of walking speed was slightly lower (0.72–0.82), indicating that only a small difference was introduced by the true positive evaluation. Previous studies conducted across various HAs and various clinical cohorts in laboratory settings have shown lower or comparable results27,32,33,34. However, in comparison to those studies, the pipelines in this study were validated over a wider variety of more complex gait tasks, challenging the estimation of walking speed as the signals are more variable and less cyclic, in comparison to steady-state and straight path gait.
Estimating walking speed in real-world gait assessment poses challenges due to the complexity and non-standardized nature of environments. This difficulty is supported by previous literature, which has found that real-world assessments present a greater challenge for DMO estimation35,36.
Despite these challenges, we achieved good results, since agreement was found to be moderate to good (ICCs within true positive WBs ranging between 0.57 and 0.88) and MAE ranged from 0.09 to 0.13 m/s. As regards to the combined real-world WB analysis, the ICCs were lower than the ICCs from true positive WBs. The MAE remained within usable ranges (< = 0.18 m/s), but MARE increased up to 44% primarily due to large relative errors for low gait speeds. In the combined analysis, median average walking speeds for each participant was calculated, which may have increased the impact of individual datapoints with larger errors, as there was only one data point per participant. In some instances, we also observed negative ICCs (MS cohort = − 0.15), which indicates a very poor correlation. Furthermore, this analysis reduced the range in walking speeds, where a larger number of slow WBs were included, which further increased the estimation error.
The WB detection results further show that, dependent upon the cohort, the detected WBs on average only cover between 57 and 72% of the overall walking present in the data. As the pipeline is tuned to provide high specificity, this relatively low sensitivity is expected and this difference in the underlying data distribution partially explained the increased error values for the combined analysis. This demonstrated the bias introduced in the true-positive analysis. Furthermore, the combined approach aggregates real-world data into singular values, which does not reflect the entire distribution of walking speed37.
Comparing to one of the few other studies that performed a real-world validation of walking speed, the work by Soltani et al.38 validated an algorithm based on a single wrist-worn sensor against a head-mounted Global Navigation Satellite System device, finding low bias [interquartile range (IQR) = − 0.01, 0.00 m/s] and an accuracy expressed by root mean square error [IQR = 0.04, 0.06 m/s]. However, this validation was only performed in 30 HAs (mean age = 37 years)38. Given the promising results we report for estimation of walking speed, and the results provided for the individual algorithmic blocks previously reported26, we demonstrate that it is possible to use a single wearable device on the lower back for accurate quantification of mobility. However, it must be considered that the performance of algorithms and pipelines are dependent upon a variety of factors that should be taken into consideration during study design, future validation, and data interpretation.
Recommendation for real-world DMO validation
Validation protocol
Across all cohorts we observed larger absolute errors and lower ICCs with walking speed estimated from the real-world in comparison to laboratory assessment, showing the importance of real-world validations to obtain realistic and ecologically valid error estimates of DMOs.
Despite this, our results also show that some real-world challenges can be replicated within laboratory settings, as the errors observed during the simulated-daily activities in the laboratory were in fact higher than in the real-world. In these tasks, participants undertook short WBs containing turns, changes of direction and transitions. Scott et al.39 compared the walking speed ranges recorded from the laboratory and 2.5 h protocol that were adopted in the present study and found a diverse profile of walking speed ranges in the laboratory that was representative of the walking speed range observed in the real-world. Future validation studies should take into account an adequate balance between challenging tasks (short WBs, turns and transitions) and long uninterrupted walks in the laboratory protocol to properly replicate the expected error ranges from the real-world.
In general, the expected error ranges were dependent upon task complexity. Most condition specific differences were only prevalent in the real-world, which is consistent with previous research reported in HAs and people with MS and PD13,18,40. Our findings motivate the inclusion of complex tasks and simulated daily activities into any future laboratory validation. However, we also recommend inclusion of real-world measurements to capture the true range of gait task complexity performed in daily life as well as a myriad of contextual factors, including the distribution of WB duration and walking speed.
Reference system
Utilization of the INDIP system as a reference during both the laboratory-based and real-world protocol proved to be successful in overcoming limitations in accuracy, battery life and usability, all of which are common restrictions of real-world reference systems previously adopted in the literature (e.g., wearable camera and GNSS (global navigation satellite system)38,41). Specifically, the INDIP system has been validated, showing excellent agreement (ICC > 0.95) and very low MAEs (simulated daily activities = ≤ 0.05 m/s) against a stereophotogrammetric system in the same cohorts and laboratory protocol as in the present study31. The INDIP system was designed to enable the detection of gait and calculation of parameters based on as few assumptions as possible, particularly concerning the type of walking and the walking environment. Gait event detection relies on pressure insoles that are expected to work independently of the setting, and spatial parameter estimation is based purely on physics-based integration methods that estimate the 3D trajectory of the foot. The INDIP’s performance was evaluated based on a complex experimental protocol specifically designed for mobility assessment. Experiments included selected cohorts of participants with various conditions affecting gait characteristics, performing a complex battery of motor tests designed to produce a heterogeneous and broad range of gait patterns. Results showed overall good/excellent reliability and high repeatability and accuracy for the DMOs analyzed across populations, walking speeds, and WBs. Therefore, the INDIP system is a valuable candidate to collect reference standard data for the analysis of gait in real-world conditions42,43. Other existing technologies can be used for obtaining reference data “out-of-the laboratory” (e.g., cameras, markerless systems), but they have intrinsic limitations that make their use inefficient (time consuming data analysis or small volume of data capture), less accurate for stride-by-stride description or not robust to quantify specific gait outcomes (e.g., spatial outcomes).
The INDIP system can be used in both laboratory and real-world settings to enable a concurrent validation of walking speed measurements, as provided in the present study. The recording duration of 2.5 h with the INDIP system enabled recording of a wide range of activities and walking speeds.
Data analysis
We adopted two approaches to analyzing walking speed, (i) only considering WBs that were directly matched between the wearable device and reference system (true positive evaluation) and (ii) considering the median value of walking speed across all available data (combined analysis).
The true positive evaluation allowed comparisons to be performed with high granularity on a WB level, allowing better understanding of the circumstances under which the wearable device performs best. However, for the true positive analysis we observed bias with regards to the overall walking speed ranges (Supplementary Figs. 1 and 2), resulting in a non-negligible impact on the real-world results. Therefore, the combined analysis is required to confirm observed error ranges and differences in the results of the two approaches should be considered and discussed. Furthermore, this type of analysis introduced the true-positive threshold as a parameter that influences the results. While we could not find a relevant effect of the selection of this parameter value on the walking speed error (Supplementary Figs. 1 and 2), this might influence other DMOs. As our results indicate, no single type of analysis can provide a definite and full picture of the error ranges. Given the lack of other established approaches to perform real-world comparisons of DMOs with a high granularity, we suggest our framework as a basis for future DMO validation studies.
Practical recommendations for the use of wearable devices for real-world walking speed measurements
Our results demonstrate that walking speed can be estimated accurately and reliably across a range of environments, cohorts, tasks and contextual factors. Based upon our promising validation results, below we provide our recommendations on the use of wearable device for real-world walking speed measurement.
Influence of pipeline
For improved understanding of the error, the impact on individual DMOs within the pipeline should be considered. In our case, given the complexity of the respective algorithms, stride length is expected to have a larger contribution to the observed walking speed error compared to cadence (Supplementary Tables 1 and 2)26. This motivates further research in more robust methods for spatial parameter estimation. Furthermore, the wearable device seems to record more shorter WBs than the reference, suggesting that longer continuous bouts of walking were split into multiple shorter WBs. Based on specific investigations of such cases, this was often due to limitations of the initial contact and left–right detection. Under challenging conditions (e.g., turns or stairs), these algorithms could not provide reliable stride information leading to a separation of longer periods of walking into multiple WBs, as no valid stride was detected for multiple seconds. This could be the result of the wearable device being positioned on the lower back, where the reference system was also comprised of feet sensors, thus being more robust to quantify gait events across longer periods. The full pipeline is implemented separately for each system, so the combined estimates of all DMOs needed to meet criteria of a WB leads to heterogeneity between systems. This motivates further research in the detection of initial contacts and their laterality under challenging real-world conditions.
Walking bout duration
Real-world walking speed encapsulates a rich dataset of mobility that has been undertaken across various WBs which differ in their length, duration, and context. Each WB reflects a different profile of walking in terms of the number of turns, transitions, and periods of straight walking, which influences walking speed measurement. Therefore, it is not surprising that walking speed estimations were influenced by the WB duration, where very short WBs (< 10 s) presented the largest error. Additionally, the wearable device tends to detect a larger number of shorter WBs than the reference system but fewer medium WBs with intermediate durations (Fig. 5). This suggests that the wearable device tends to fragment gait sequences into smaller segments, possibly attributable to mis-detected initial contacts. We speculate that short WBs predominantly took place within confined indoor spaces such as the home environment. While walking speed captured at this short duration does not reflect steady state gait activities, it could still hold valuable information about balance and functional status (e.g., postural transition, weight-shift, sit-to-stand44. Algorithms optimized for straight walking in controlled settings had an increased likelihood of higher absolute errors at very short durations. Based on this, we would recommend using a lower cut-off (WBs > 10 s), to trade-off between the number of removed WBs and still including a minimum threshold of 401 WBs, needed to ensure reliability and validity for real-world gait monitoring in a single cohort39.
Moving toward clinical application of wearable devices and walking speed measurement, it is important to consider in which specific real-world context wearable devices can quantify mobility most accurately and reliably. Our findings demonstrated that WBs > 30 s provide the most accurate and reliable measurement. WBs > 30 can be characterized as medium to long in their duration. Walking speed estimated from medium length WBs (between 30 and 60 s), may reflect activities of daily living, such as intermittent periods of shopping or undertaking other errands in public spaces outside the home18,45. In contrast, longer WBs (> 60 s), typically capture faster walking speeds that are closer to what is already being measured in the laboratory. Thus, walking speed measured in medium length WBs reflects a balance between capturing activities of daily living, and sufficient periods of straight walking activity that enable the robust quantification of walking speed. However, for certain patients walking continuously for 30 s as our cut-off suggests might already be strenuous. Thus, we would recommend using all (WBs > 10 s) to include a balance between capturing a sufficient number of WBs for patients with a variety of condition severities, whilst ensuring walking speed can still be quantified reliably. Future clinical validation studies with a larger number of participants with severe gait impairments are required to confirm the reported error ranges for specific disease populations and can confirm the influence of WB duration upon the functional insight of mobility provided by walking speed46.
Walking speed
The influence of the speed at which each WB is completed upon the validity of the walking speed is considered a confounding factor of gait analysis47. When exploring the average walking speed across all WBs, we found that walking speed in WBs undertaken at slower speeds (< 0.6 m/s) tended to be overestimated by ≤ 0.8 m/s. The wearable device and WBs with faster speeds were underestimated, where moderate walking speeds provided the highest accuracy (Fig. 2). Longer WBs (> 60 s) were completed at faster walking speed in comparison to medium length WBs, which were undertaken at moderate speeds. Further, the overall number of slow WBs appears to be smaller for the wearable device. The speed distribution of only the true-positive WBs exhibits a similar shift in distributions but at overall higher speeds (Supplementary Fig. 2). In conjunction with the presented error values, this suggests that slow WBs are detected correctly, but their speed values are overestimated. Notably, these lower speeds were predominantly observed in short WBs. Consequently, this further justifies our recommendation that medium-length WBs provide the right balance between functional relevance and accuracy. Exploration of the clinical properties of walking speed encapsulated within these WBs, will become a topic of research and further investigated in on-going clinical validation efforts46. Furthermore, measurements with cohorts consisting of predominantly slow walkers will likely result in larger error ranges. This is consistent with previous research that also validated algorithms based upon a single lower back sensor33,48.
The algorithms used in this study were optimized and developed based on independent datasets to avoid bias. We foresee that future algorithms developed on the TVS dataset, and other similar real-world datasets can improve on the speed dependency observed here.
Real-world complexity
Aside from the WB duration, accuracy of walking speed estimation was also dependent upon the complexity of tasks/activities. The influence of complexity was cohort dependent and had the largest influence upon error for the MS, PD and PFF cohorts (estimated from P1 pipeline). We would expect those cohorts to experience more gait impairments than the CHF, COPD and HA cohorts (estimated from the P2 pipeline). However, whether the observed effect is caused by specific gait properties of the respective cohorts or by shortcomings in the selected algorithms, cannot be concluded based on the performed analysis.
Despite the challenges posed by outdoor environments (changes in terrain, weather and traffic negotiation (humans and vehicles))49,50, outdoor environments capture more prolonged and uninterrupted walks in comparison to indoor environments, such as the household, which represent more confined and cluttered spaces with limited capacity for completing sequences of straight walking. Thus, we would expect error ranges from long uninterrupted outdoor walks are expected to be lower than results from confined indoor environments. Therefore, the combination of gait parameters with further contextual information might help to take this into account during data interpretation.
Limitations
While this study is one of the largest and most comprehensive validation studies for gait analysis based on wearable devices to date, the analysis of specific subgroup effects would require larger sample sizes. Potential links between the error, the condition severity and other medical comorbidities could not be established. Furthermore, the effect of walking aid use on results has not been assessed in this study. Future studies with more variable condition severity are needed to explore the influence of walking aid usage upon the validity of the analytical pipelines.
The real-world data was limited to 2.5 h for technical reasons. However, we accept that a recording of this length may not be sufficient to capture all the variability and patterns that would be included in multiple days of consecutive assessment. Due to technical issues with the devices, we were unable to assess some participants, which reduced our dataset. Data was also collected during the COVID-19 pandemic which may have impacted on participants’ activity. While the analytical pipeline offers several strengths, its combined implementation does have limitations. As previously stated, the analytical pipelines for the wearable device data have the tendency to split longer WBs into multiple individual WBs. Hence, future research should explore whether this is caused by limitations of the initial contact and Left–Right detections, and how specific real-world contexts may influence walking speed performance. We found that error in walking speed estimation was more dependent upon stride length (spatial) estimation (MARE across all cohorts; laboratory = 14.31% and real-world 20.35%), however cadence (temporal) can be estimated with substantially lower errors (MARE across all cohorts; laboratory = 4.1% and real-world 4.8%) (Supplementary Tables 1 and 2). Therefore, future researchers looking to further improve performance of walking speed estimation, should target optimization of spatial algorithms.
Conclusion
Through the extensive real-world and laboratory validation across multiple cohorts, this study represents, to the best of our knowledge, the most accurate estimate of the expected error ranges of a lower-back wearable device for estimation of walking speed. The presented state-of-the-art algorithms pipelines could reliably estimate DMOs across a wide range of scenarios, providing a solid foundation for future studies to establish their clinical meaningfulness46. While complex setups like camera-based motion capture systems in the laboratory and wearable multi-modal sensor system in real-world scenarios still provide superior performance and might be required for certain types of clinical analysis, we demonstrated the suitability of a single easy-to-use and inexpensive wearable device for movement monitoring across a wide range of clinical indications. This has the potential to make gait related parameters from long-term real world recordings ubiquitously available for clinical decision making. Our results showed that various parameters can influence DMO performance and multi-faceted analysis is crucial for understanding of the capabilities of any DMO pipeline. This motivates the capture of additional context information during real-world measurements to focus analysis on signal areas where high reliability can be expected. Furthermore, we identified clear areas where future algorithm pipelines can still improve, and we believe that the captured dataset will be vital for the development of future algorithms specifically targeting the challenges of unsupervised real-world recordings.
Methods
Participants
For the Mobilise-D technical validation study (TVS), participants were recruited from five clinical cohorts (CHF, COPD, MS, PD, and PFF) alongside HA. Participants were recruited at five sites: The Newcastle upon Tyne Hospitals NHS Foundation Trust, UK (Sponsor of the study) and Sheffield Teaching Hospitals NHS Foundation Trust, UK (ethics approval granted by London – Bloomsbury Research Ethics committee, 19/LO/1507); Tel Aviv Sourasky Medical Center, Israel (ethics approval granted by the Helsinki Committee, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel, 0551-19TLV), Robert Bosch Foundation for Medical Research, Germany (ethics approval granted by the ethical committee of the medical faculty of The University of Tübingen, 647/2019BO2), University of Kiel, Germany (ethics approval granted by the ethical committee of the medical faculty of Kiel University, D438/18). Informed consent was provided by all participants to take part in the study and all research was performed in accordance with the Declaration of Helsinki. Inclusion and exclusion criteria are fully described in24.
Protocol
The protocol has been extensively detailed in24. Participants were assessed in the laboratory and during a 2.5-h real-world observation. Mobility data was collected with a wearable device (McRoberts Dynaport MM+ , sampling frequency: 100 Hz, triaxial acceleration range: ± 8 g/resolution: 1 mg, triaxial gyroscope range: ± 2000 degrees per second (dps)/ resolution: 70 mdps), secured at the lower back with a Velcro belt. Participants were also asked to wear a multisensor INDIP reference system (sampling frequency: 100 Hz)24,30. Specifically, two magneto-IMUs were positioned over the instep and fixed to shoelaces with clips, and a third IMU was attached to the lower back with Velcro. Distance sensors were then positioned asymmetrically with Velcro (one above left ankle and another 3 cm higher on the right leg). Pressure insoles were selected for each participant’s foot size and inserted into the shoe. The INDIP system has been validated in previous studies across a range of conditions and in this TVS cohorts also, showing excellent results and reliability in the qualification of mobility outcomes (MAE laboratory ≤ 0.02 m/s, simulated daily activities = 0.03 to 0.05 m/s), a complete overview of the validation results can be found in31. The INDIP and the wearable device were synchronized using their timestamps (± 10 ms). Participants only performed tasks that they felt comfortable and safe to do in both protocols.
Laboratory protocol
Participants were asked to complete seven motor tasks with increasing complexity: Straight walking (slow, normal and fast speed), Timed Up and Go, L-Test, Surface Test, Hallway Test and Simulated Daily Activities. Each task was designed to capture and assess various elements associated with real-world walking including a range of walking speeds, incline/steps, surface, path shape, turns and specific motor tasks to simulate typical real-world transitions24,39.
Real-world protocol
Participants were assessed for up to 2.5 h in the real-world, as they went about their normal activities unsupervised (home/work/community/outdoor). The duration of the observation has been established as a trade-off between experimental, clinical, and technical requirements. To capture the largest possible range of activities during this assessment, participants were guided by the following list of activities: if relevant for their chosen environment, rise from a chair and walk to another room; walk to the kitchen and make a drink; walk up and down a set of stairs (if possible); walk outdoors (if possible, for a minimum of 2 min); if walking outside, walk up and down an inclined path. We did not provide supervision or structure on how these tasks should be completed to the participants24.
Calculation of walking speed
The evaluation of walking speed requires the combination of various algorithmic steps, including the identification of gait sequences and of initial contacts, estimation of DMOs, i.e., cadence and stride length. Selection of the top-ranked algorithms to detect gait-sequences, estimate initial contact events, cadence and stride length within identified gait-sequences was determined in our previous work26 (Fig. 1). The best performing algorithm was then used to estimate walking speed using the outputs of the stride length and cadence algorithms using Eq. (1):
Two independent analytical pipelines (P1 and P2) were identified in this process due to differences in algorithm selection for gait-sequence detection and cadence for the different conditions included in the study26. P1 provides the optimal combination of algorithms selected for HA, COPD, and CHF conditions, and P2 provides the optimal combination for PD, MS, and PFF (Fig. 7).
Two additional algorithms were added to both gait analysis pipelines: turn detection algorithm51, and a customized algorithm to detect the laterality (left or right step) of each IC52. Laterality was used to interpolate the cadence, stride length, and walking speed parameters (provided as per-second values by the algorithms) to stride-level values (stride interpolation).
DMOs were evaluated on a stride level, conforming to consensus agreed definitions53 for WBs. Accordingly, a WB was defined as a continuous sequence containing at least two consecutive strides of both feet (e.g., R–L–R–L–R–L or L–R–L–R–L–R, being R/L the right/left foot making contact with the ground); consecutive WBs were defined if a break greater than 3 s was identified between them; and, for a stride to be included in a given WB it had to have a duration between 0.2 and 3.0 s and a stride length > 0.15 m54. WBs compliant with this definition were generated by first filtering the list of identified strides based on the stride level definition (stride selection) and then grouped into final WBs based on breaks within the stride sequence (walking bout assembly). The same definitions were also used to define the WBs for the reference system. For both systems final DMOs were calculated as the average value over all strides within a WB.
Validation of walking speed
All comparisons between the wearable device and the reference system were performed based on the average walking speed within each identified WB. In addition, comparison results for cadence and stride length can be found in Supplementary Tables 1 and 2. Further, we evaluated the performance of the WB detection on the 2.5-h real-world assessment to provide additional context for the error parameters. For this we calculated the accuracy, sensitivity, specificity and positive predictive value, by comparing the regions of the WBs detected by the wearable device with the WBs reported by the reference system on a sample-by-sample basis following the same approach used for evaluation of the gait sequence detection (GSD) methods in26. Real-world recordings also provide new challenges during data analysis. WBs detected by the wearable device, and the reference system might not match up, thus direct comparison of individual strides or WBs is not possible. One straight-forward approach is to average DMOs across all WBs before comparison. However, this reduced granularity makes it difficult to fully understand under which circumstances a wearable device works well and can “mask” the bias or error (e.g., over or underestimation under specific circumstances) that only considering a single WB could be identified. We proposed a new approach for these types of data analysis, by splitting the analysis into a detailed comparison of only WBs that were identified in both systems (True positive WBs) and a traditional analysis of all data combined (Combined WBs).
-
1.
True Positive Evaluation Novel method of analysis, which directly compares the performance of the DMOs on only the WBs that were detected in both systems (true positives). This allows for the calculation of traditional of comparison metrics (e.g., interclass correlation and Bland–Altman plots), that require a direct comparison of individual measurement points. WBs were included in the true positive analysis, if there was an overlap of more than 80% between the two systems (details about the selection of this threshold can be found in Supplementary Fig. 1). The threshold of 80% was selected as a trade-off to allow us: (i) to consider as much as possible a like-for-like comparison between selected WBs (INDIP vs. wearable device), and at the same time (ii) to include the minimum number of walking bouts to ensure sufficient statistical power for the analyses (i.e., at least 101 walking bouts for each cohort). This target was based upon the number of walking bouts rather than a percentage of total walking bouts that would allow us to meet criteria established by statistical experts for robust statistical analysis after sample-size re-evaluation (total walking bouts number > 101 corresponding to ICC > 0.7 and a CI = 0.2).
-
2.
Combined Evaluation Traditional method of analysis, where we calculated the median walking speed from all identified WBs within each laboratory task (resulting in one value per gait task per participant) or within the 2.5 h real-world assessment per participant (resulting in one value per participant) and compared these combined values between the systems. This comparison is free of potential biases introduced by the selection of only the true-positive WB and reflects how DMOs will typically be evaluated in a research or clinical setting or when reference data may not be available.
Factors that can influence walking speed validity
A range of factors can influence walking speed, and this may impact the algorithm performance and validity of the results. We investigated the possible sources of confounding such as: the cohort, environment (laboratory vs real-world), task complexity, walking speed and walking bout duration, and participant performance upon walking speed validity. All comparisons (unless otherwise stated) are performed using WBs identified as true positive (true positive evaluation).
Influence of the cohort and environment
We compared errors in the estimation of walking speed between each of the different clinical cohorts included in the study, alongside differences between laboratory and real-world environments.
Influence of gait task complexity
Real world walking contains complex gait sequences, which are comprised of short steps, frequent turns, or obstacle negotiation where individuals often multitask during walking. Thus, gait patterns observed in the real-world are not comparable with the straight walking tasks undertaken in controlled environments, even if we account for differences in WB duration and walking speed. To assess the effect of gait-task complexity we compared validation results of walking speed estimated from the (i) simulated daily activities (high complexity), (ii) slow straight walking (low complexity), (iii) all straight walking tasks (low complexity), and (iv) all laboratory tests with the validation results of walking speed estimated from real-world walking. We further subdivided real world walking based on the percentage of a WB that was assessed to be a turn. Based on this we defined the following levels of gait complexity: (v) “simple” straight gait (< 20% covered by turns) and (vi) “complex gait” (> = 60% covered by turns).
Influence of walking speed and walking bout duration
Given the impact of real-world WB durations and speeds44 on the adopted biomechanical strategies55, we analyzed their influence on the validity of the walking speed. For this, we assessed whether validity of walking speed estimation differed within specific WB durations bins (< 10 s, > 10 s, 10–30 s, 30–60 s, > 60 s and > 120 s). This was first performed for all true positive WBs comparing their errors across each WB threshold, and subsequently repeated for the combined analysis, by calculating the median walking speed for each participant within the respective speed bout and comparing the median values between the reference system and the wearable device. All these analyses permitted the validation of the quantification of walking speed across different walking strategies.
Validation measures
For all types of evaluations (all available WBs/aggregated values or on the respective subgroups), we calculated various statistical/comparison measures to quantify the walking speed estimation error for the sensitivity analysis:
-
Intraclass Coefficient (ICC(2,1))56 was calculated to assess the association between the DMOs of the two systems. Based on ICC estimates, values < 0.5, between 0.5 and 0.75, between 0.75 and 0.9, and > 0.90 were deemed to be indicative of poor, moderate, good, and excellent reliability, respectively57.
-
Absolute agreement was assessed by quantifying (i) the accuracy/mean absolute error (MAE), (ii) bias/mean error and (iii) precision/limits of agreements (LoA)58 between walking speed estimates of both systems.
-
Mean relative errors (MRE) and mean absolute relative error (MARE) were estimated as the ratio between the (absolute) errors per WB and the corresponding estimates from the reference system, expressed as a percentage.
Data availability
Representative data from the dataset presented in this study can be found on Zenodo: https://doi.org/https://doi.org/10.5281/zenodo.7547125. The complete dataset of the Mobilise-D Technical Validation study will be made publicly available in the future.
References
Viceconti, M. et al. On the use of wearable sensors as mobility biomarkers in the marketing authorization of new drugs: A regulatory perspective. Front. Med. 9, 996903 (2022).
Jehu, D. A. et al. Risk factors for recurrent falls in older adults: A systematic review with meta-analysis. Maturitas 144, 23–28 (2021).
Walsh, J. A. et al. Gait speed and adverse outcomes following hospitalised exacerbation of COPD. Eur. Respir. J. 58, 2004047 (2021).
Del Din, S. et al. Analysis of free-living gait in older adults with and without Parkinson’s disease and with and without a history of falls: Identifying generic and disease-specific characteristics. J. Gerontol. A Biol. Sci. Med. Sci. 74, 500–506 (2019).
Cameron, M. H. & Nilsagard, Y. Balance, gait, and falls in multiple sclerosis. Handb. Clin. Neurol. 159, 237–250 (2018).
Dyer, S. M. et al. A critical review of the long-term disability outcomes following hip fracture. BMC Geriatr. 16, 158 (2016).
Rochester, L. et al. A roadmap to inform development, validation and approval of digital mobility outcomes: The mobilise-D approach. Digit. Biomark. 4, 13–27 (2020).
Disability and health. https://www.who.int/news-room/fact-sheets/detail/disability-and-health.
Ginis, P. et al. Feasibility and effects of home-based smartphone-delivered automated feedback training for gait in people with Parkinson’s disease: A pilot randomized controlled trial. Parkinsonism Relat. Disord. 22, 28–34 (2016).
Jonsdottir, J. et al. Intensive multimodal training to improve gait resistance, mobility, balance and cognitive function in persons with multiple sclerosis: A pilot randomized controlled trial. Front. Neurol. 9, 800 (2018).
Zhang, Y.-Y., Zhang, Y.-G., Li, Z., Li, S.-H. & Xu, W.-G. Effect of home-based telerehabilitation on the postoperative rehabilitation outcome of hip fracture in the aging population. Orthop. Surg. 14, 1768–1777 (2022).
Bisht, B. et al. Effects of a multimodal intervention on gait and balance of subjects with progressive multiple sclerosis: A prospective longitudinal pilot study. Degener. Neurol. Neuromuscul. Dis. 7, 79–93 (2017).
Hillel, I. et al. Is every-day walking in older adults more analogous to dual-task walking or to usual walking? Elucidating the gaps between gait performance in the lab and during 24/7 monitoring. Eur. Rev. Aging Phys. Act. 16, 6 (2019).
Warmerdam, E., Hausdorff, J. M., Atrsaei, A., Zhou, Y. & Maetzler, W. Long-term unsupervised mobility assessment in movement disorders. Lancet Neurol. https://doi.org/10.1016/S1474-4422(19)30397-7 (2020).
Keogh, A., Taraldsen, K., Caulfield, B. & Vereijken, B. It’s not about the capture, it’s about what we can learn”: A qualitative study of experts’ opinions and experiences regarding the use of wearable sensors to measure gait and physical activity. J. NeuroEng. Rehabilit. 18, 78 (2021).
Keogh, A. et al. Acceptability of wearable devices for measuring mobility remotely: Observations from the Mobilise-D technical validation study. Digit. Health 9, 205520762211507 (2023).
Polhemus, A. et al. Walking on common ground: a cross-disciplinary scoping review on the clinical utility of digital mobility outcomes. npj Digit. Med. 4, 1–14 (2021).
Del Din, S., Godfrey, A., Galna, B., Lord, S. & Rochester, L. Free-living gait characteristics in ageing and Parkinson’s disease: Impact of environment and ambulatory bout length. J. NeuroEng. Rehabil. 13, 46 (2016).
Rosmaninho, I., Ribeirinho-Soares, P. & Nunes, J. P. L. Walking speed and mortality: An updated systematic review. South Med. J. 114, 697–702 (2021).
Fonseca Alves, D. J. et al. Walking speed, risk factors, and cardiovascular events in older adults-systematic review. J. Strength Cond. Res. 31, 3235–3244 (2017).
Morris, R., Lord, S., Bunce, J., Burn, D. & Rochester, L. Gait and cognition: Mapping the global and discrete relationships in ageing and neurodegenerative disease. Neurosci. Biobehav. Rev. 64, 326–345 (2016).
Del Din, S., Kirk, C., Yarnall, A. J., Rochester, L. & Hausdorff, J. M. Body-worn sensors for remote monitoring of parkinson’s disease motor symptoms: Vision, state of the art, and challenges ahead. J. Parkinsons Dis. 11, S35–S47 (2021).
Viceconti, M. et al. Toward a regulatory qualification of real-world mobility performance biomarkers in parkinson’s patients using digital mobility outcomes. Sensors 20, 1–13 (2020).
Mazzà, C. et al. Technical validation of real-world monitoring of gait: A multicentric observational study. BMJ Open 11, e050785 (2021).
Pacini Panebianco, G., Bisi, M. C., Stagni, R. & Fantozzi, S. Analysis of the performance of 17 algorithms from a systematic review: Influence of sensor position, analysed variable and computational approach in gait timing estimation from IMU measurements. Gait Post. 66, 76–82 (2018).
Micó-Amigo, M. E. et al. Assessing real-world gait with digital technology? Validation, insights and recommendations from the Mobilise-D consortium. J. NeuroEng. Rehabilit. https://doi.org/10.21203/rs.3.rs-2088115/v1 (2022).
Soltani, A. et al. Algorithms for walking speed estimation using a lower-back-worn inertial sensor: A cross-validation on speed ranges. IEEE Trans Neural Syst. Rehabil. Eng. 29, 1955–1964 (2021).
Paraschiv-Ionescu, A. et al. Locomotion and cadence detection using a single trunk-fixed accelerometer: Validity for children with cerebral palsy in daily life-like conditions. J. NeuroEng. Rehabilit. 16, 24 (2019).
Madgwick, S. O. H., Harrison, A. J. L. & Vaidyanathan, R. Estimation of IMU and MARG orientation using a gradient descent algorithm. in 2011 IEEE International Conference on Rehabilitation Robotics 1–7 (2011). https://doi.org/10.1109/ICORR.2011.5975346.
Bertuletti, S., Della Croce, U. & Cereatti, A. A wearable solution for accurate step detection based on the direct measurement of the inter-foot distance. J. Biomech. 84, 274–277 (2019).
Salis, F. et al. A Multi-Sensor Wearable System for Gait Assessment in Real- World Conditions: Performance in Individuals with Impaired Mobility. (2023). https://doi.org/10.21203/rs.3.rs-2486943/v1
Paraschiv-Ionescu, A., Soltani, A. & Aminian, K. Real-world speed estimation using single trunk IMU: methodological challenges for impaired gait patterns*. in 2020 42nd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC) 4596–4599 (2020). https://doi.org/10.1109/EMBC44109.2020.9176281.
Del Din, S., Godfrey, A. & Rochester, L. Validation of an accelerometer to quantify a comprehensive battery of gait characteristics in healthy older adults and Parkinson’s disease: Toward clinical and at home use. IEEE J. Biomed. Health Inform. 20, 838–847 (2016).
Byun, S. et al. Walking-speed estimation using a single inertial measurement unit for the older adults. PLoS ONE 14, e0227075 (2019).
Ilg, W. et al. Real-life gait assessment in degenerative cerebellar ataxia: Toward ecologically valid biomarkers. Neurology 95, e1199–e1210 (2020).
Renggli, D. et al. Wearable inertial measurement units for assessing gait in real-world environments. Front. Physiol. 11, 90 (2020).
Atrsaei, A. et al. Gait speed in clinical and daily living assessments in Parkinson’s disease patients: performance versus capacity. npj Parkinsons Dis. 7, 24 (2021).
Soltani, A., Dejnabadi, H., Savary, M. & Aminian, K. Real-world gait speed estimation using wrist sensor: A personalized approach. IEEE J. Biomed. Health Inform. 24, 658–668 (2020).
Scott, K. et al. Design and validation of a multi-task, multi-phase protocol for real-world gait simulation. J. NeuroEng. Rehabilit. https://doi.org/10.21203/rs.3.rs-1908917/v1 (2022).
Shema-Shiratzky, S. et al. A wearable sensor identifies alterations in community ambulation in multiple sclerosis: Contributors to real-world gait quality and physical activity. J. Neurol. 267, 1912–1921 (2020).
Hickey, A., Din, S. D., Rochester, L. & Godfrey, A. Detecting free-living steps and walking bouts: Validating an algorithm for macro gait analysis. Physiol. Meas. 38, N1 (2016).
Scott, K. et al. Design and validation of a multi-task, multi-context protocol for real-world gait simulation. J. NeuroEng. Rehabilit. 19, 141 (2022).
Salis, F. et al. A multi-sensor wearable system for the assessment of diseased gait in real-world conditions. Front. Bioeng. Biotechnol. 11, 1143248 (2023).
Rehman, R. Z. U. et al. Investigating the impact of environment and data aggregation by walking bout duration on Parkinson’s disease classification using machine learning. Front. Aging Neurosci. 14, 182 (2022).
Shah, V. V. et al. Effect of bout length on gait measures in people with and without Parkinson’s disease during daily Life. Sensors (Basel) 20, 5769 (2020).
Mikolaizak, A. S. et al. Connecting real-world digital mobility assessment to clinical outcomes for regulatory and clinical endorsement–the Mobilise-D study protocol. PLOS ONE 17, e0269615 (2022).
Hubble, R. P., Naughton, G. A., Silburn, P. A. & Cole, M. H. Wearable sensor use for assessing standing balance and walking stability in people with Parkinson’s disease: A systematic review. PLoS One 10, e0123705 (2015).
Trojaniello, D. et al. Estimation of step-by-step spatio-temporal parameters of normal and impaired gait using shank-mounted magneto-inertial sensors: application to elderly, hemiparetic, parkinsonian and choreic gait. J. NeuroEng. Rehabilit. 11, 152 (2014).
Kim, Y. & Brown, R. Effect of meteorological conditions on leisure walking: A time series analysis and the application of outdoor thermal comfort indexes. Int. J. Biometeorol. 66, 1109–1123 (2022).
Kowalsky, D. B., Rebula, J. R., Ojeda, L. V., Adamczyk, P. G. & Kuo, A. D. Human walking in the real world: Interactions between terrain type, gait parameters, and energy expenditure. PLoS One 16, e0228682 (2021).
El-Gohary, M. et al. Continuous monitoring of turning in patients with movement disability. Sensors 14, 356–369 (2014).
Ullrich, M. et al. Machine learning-based distinction of left and right foot contacts in lower back inertial sensor gait data. in 2021 43rd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC) 5958–5961 (2021). https://doi.org/10.1109/EMBC46164.2021.9630653.
Kluge, F. et al. Consensus based framework for digital mobility monitoring. PLOS ONE 16, e0256541 (2021).
Bonci, T. et al. An objective methodology for the selection of a device for continuous mobility assessment. Sensors 20, 6509 (2020).
Najafi, B., Helbostad, J. L., Moe-Nilssen, R., Zijlstra, W. & Aminian, K. Does walking strategy in older people change as a function of walking distance?. Gait Posture 29, 261–266 (2009).
McGraw, K. O. & Wong, S. P. Forming inferences about some intraclass correlation coefficients. Psychol. Methods 1, 30–46 (1996).
Koo, T. K. & Li, M. Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 15, 155–163 (2016).
Giavarina, D. Understanding bland Altman analysis. Biochem Med (Zagreb) 25, 141–151 (2015).
Acknowledgements
The authors acknowledge all the members of the Mobilise-D Work Package 2 for continuous discussion and critical input. They are particularly grateful to the participants in the study for their time and enthusiastic contribution, especially during the pandemic.
Funding
This work was supported by the Mobilise-D project that has received funding from the Innovative Medicines Initiative 2 Joint Undertaking (JU) under grant agreement No. 820820. This JU receives support from the European Union's Horizon 2020 research and innovation program and the European Federation of Pharmaceutical Industries and Associations (EFPIA). SDD, LR, AY were also supported by the Innovative Medicines Initiative 2 Joint Undertaking (IMI2 JU) project IDEA-FAST—Grant Agreement 853981. LA, LR, AY and SDD were also supported by the National Institute for Health Research (NIHR) Newcastle Biomedical Research Centre (BRC) based at The Newcastle upon Tyne Hospital NHS Foundation Trust, Newcastle University and the Cumbria, Northumberland and Tyne and Wear (CNTW) NHS Foundation Trust. LA, LR, AY and SDD were also supported by the NIHR/Wellcome Trust Clinical Research Facility (CRF) infrastructure at Newcastle upon Tyne Hospitals NHS Foundation Trust. This study was also supported by the National Institute for Health Research (NIHR) through the Sheffield Biomedical Research Centre (BRC, Grant Number IS-BRC-1215–20017). ISGlobal acknowledges support from the Spanish Ministry of Science and Innovation through the “Centro de Excelencia Severo Ochoa 2019–2023” Program (CEX2018-000806-S), and from the Generalitat de Catalunya through the CERCA Program. All opinions are those of the authors and not the funders. The content in this publication reflects the authors’ view, and neither IMI nor the European Union, EFPIA, NHS, NIHR, DHSC, or any associated partners are responsible for any use that may be made of the information contained herein.
Author information
Authors and Affiliations
Consortia
Contributions
PIs—Project development and study design: S.D.D., C.M., L.R., A.C., A.M., B.V. Data collection and pre-processing of the data: T.B., F.S., K.S., L.A., P.B., S.B., F.S., M.C., E.B., E.G., C.H., L.P., I.A. and L.S. Patient recruitment and clinical oversight: B.S., W.M., C.B., J.H., I.V., E.H., D.M., A.Y., L.R. Algorithm development: A.K., A.P.I., A.S., M.U., E.G., F.K. Data management platform and analysis: H.H., D.S., A.K., C.K., M.U. Data analysis, statistical analysis: A.K., E.M.A. and C.K. Figures and tables preparation: A.K., C.K. Data interpretation: E.M.A., S.D.D., A.K., T.B., L.R., A.C., C.M. Drafting of the manuscript: A.K., C.K., E.M.A. Intellectual contribution: E.M.A., A.K., S.D.D., T.B., L.R., A.C., S.B., S.K., J.G., C.M., A.C., C.K., A.M., H.S., K.A., B.E., B.C., A.K., B.V., F.K., L.C., M.N. All authors have provided critical intellectual input during the revision of the manuscript. All authors have reviewed the manuscript and approved the submitted version.
Corresponding author
Ethics declarations
Competing interests
A. Mueller and F. Kluge are employees of, and may hold stock in, Novartis. B. Eskofier reports consulting activities with adidas AG, Siemens AG, Siemens Healthineers AG, WSAudiology GmbH outside of the study. He is a shareholder in Portabiles HealthCare Technologies GmbH. In addition, B. Eskofier holds a patent related to gait assessment. H. Sillén is an employee of, and may hold stock in, AstraZeneca. L. Palmerini and L. Chiari are co-founders and own shares of mHealth Technologies (https://mhealthtechnologies.it/). L. Schwickert and C. Becker are consultants of Philipps Healthcare, Bosch Healthcare, Eli Lilly, Gait-up. M. Niessen is an employee of McRoberts. Jeff Hausdorff reports having submitted a patent for assessment of mobility using wearable sensors in 400 Parkinson’s disease. The intellectual property rights 401 are held by the Tel Aviv Medical Center. S. Del Din reports consultancy activity with Hoffmann-La Roche Ltd. outside of this study. The other authors have no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kirk, C., Küderle, A., Micó-Amigo, M.E. et al. Mobilise-D insights to estimate real-world walking speed in multiple conditions with a wearable device. Sci Rep 14, 1754 (2024). https://doi.org/10.1038/s41598-024-51766-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-51766-5
This article is cited by
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.