Abstract
Background
With the development of Artificial Intelligence (AI) techniques, smart health monitoring, particularly neonatal cardiorespiratory monitoring with wearable devices, is becoming more popular. To this end, it is crucial to investigate the trend of AI and wearable sensors being developed in this domain.
Methods
We performed a review of papers published in IEEE Xplore, Scopus, and PubMed from the year 2000 onwards, to understand the use of AI for neonatal cardiorespiratory monitoring with wearable technologies. We reviewed the advances in AI development for this application and potential future directions. For this review, we assimilated machine learning (ML) algorithms developed for neonatal cardiorespiratory monitoring, designed a taxonomy, and categorised the methods based on their learning capabilities and performance.
Results
For AI related to wearable technologies for neonatal cardio-respiratory monitoring, 63% of studies utilised traditional ML techniques and 35% utilised deep learning techniques, including 6% that applied transfer learning on pre-trained models.
Conclusions
A detailed review of AI methods for neonatal cardiorespiratory wearable sensors is presented along with their advantages and disadvantages. Hierarchical models and suggestions for future developments are highlighted to translate these AI technologies into patient benefit.
Impact
-
State-of-the-art review in artificial intelligence used for wearable neonatal cardiorespiratory monitoring.
-
Taxonomy design for artificial intelligence methods.
-
Comparative study of AI methods based on their advantages and disadvantages.
Similar content being viewed by others
Introduction
The United Nations 3.2.2 Sustainable Development Goal aims to reduce neonatal mortality to 1.2% of live births by 2030.1 Virtually all (99%) of neonatal deaths occur in the developing world, in low- and middle-income countries.2,3 These deaths are associated with conditions and diseases due to lack of skilled care.4 According to the World Health Organisation, effective care could reduce deaths by 75%.3 A key factor to essential care is monitoring and assessment for signs of serious health problems, particularly for sick, low birth weight and preterm babies. The major causes of mortality relate to cardiorespiratory conditions such as pneumonia, underdeveloped lungs due to preterm birth and birth asphyxia.2,3,4,5 Hence, cardiorespiratory monitoring is essential, as it enables the detection, monitoring and prognosis of diseases, allowing timely and specific care to be provided.3,4
Wearable technology enables continuous cardiorespiratory monitoring in both hospital and home environments. In conjunction with AI, it offers the possibility of early detection of diseases, reducing the workload for clinicians, and providing the best possible outcomes for newborns. Wearable technologies were reviewed in detail in part 1 of our review article. We now focus on AI techniques for neonatal cardiorespiratory monitoring in part 2.
In this study, AI refers to the techniques used to detect or predict a cardiorespiratory condition or process signals to obtain cardiorespiratory information. These techniques have ranged from traditional ML classifiers to deep learning models. AI-driven wearable technologies have shown promise in continuous health monitoring for paediatric clinical practice.6 These applications have included disease diagnosis, individualised treatment guidance, and prognostic evaluation.7
Although the use of AI for neonatal monitoring has great potential, it has not been widely studied. It is crucial to identify the feasibility and potential of AI methods on the data sets extracted from wearable technologies in neonatal cardiorespiratory monitoring. This review will help inform the future direction of the best AI techniques to accompany the most promising wearable technologies in this domain.
The search methodology used in this study is presented in “Review methodology”. We describe the various AI technologies used with wearable sensors for neonatal cardiorespiratory monitoring (“AI techniques”). We present the evolution of AI technologies, followed by a novel taxonomy design and analysis of each technique. The proposed taxonomy helps the understanding of the types of AI technologies being employed in the literature and identify appropriate AI techniques that could be useful in clinical practice. For example, the traditional ML methods are, in most cases, interpretable and explainable, and require less data for training and hence are preferred by clinicians. Furthermore, the documentation of the evolution and progress of AI technologies, and analysis of the benefits and drawbacks of each technique, enables us to select the best AI technique based on clinical needs. Lastly, we recommend the most popular wearable sensors and AI methods to be used in the future, based on their advantages and disadvantages, evolution, and taxonomy (“Discussion” and “Conclusions”).
Review methodology
A search was proposed for wearable technology and AI for neonatal cardiorespiratory monitoring. In part 1 of our review article, we found 107 articles related to wearable technology for neonatal cardiorespiratory monitoring. Of these 107 articles, 14 were included as they were related to AI.
An additional search in Google Scholar was also performed with the below query string on 05 January 2022:
-
1.
Restrict to neonatal population
-
a.
Search terms: “Neonatal”, “Pediatric” and “Paediatric”
-
a.
-
2.
Restrict to wearable technology
-
a.
Search terms: “Wearables”
-
a.
-
3.
AI
-
a.
Search terms: “Artificial Intelligence”, “Machine Learning” and “Deep Learning”
-
a.
-
4.
Restrict to cardiorespiratory monitoring
-
a.
Search terms: “Cardiac”, “Heart”, “Respiratory”, “Lung”, and “Breathing”
-
a.
This resulted in a total of 1680 articles. Articles that were unrelated (i.e., not neonatal, AI, nor cardiorespiratory monitoring focused) and missing full-text and/or minimal information provided were removed. Two authors (C.S. and E.G.) independently searched for additional articles. Five further papers were obtained using a snowballing technique. In total, 56 articles were obtained to review in this paper. The PRISMA flow diagram is presented in Fig. 1. Based on the literature review in the neonatal cardiorespiratory monitoring-related articles, we designed a new taxonomy to provide more insights into AI techniques under the study domain. Similarly, we created a stacked plot to show the popularity of AI methods in this study.
AI techniques
For neonatal health monitoring, AI techniques have been used on data obtained from both wearable and non-wearable devices.8,9 To implement AI techniques in general, there are four major steps: (i) data extraction, (ii) pre-processing, (iii) training, and (iv) testing steps.10 For example, the continuous data obtained from wearable technologies such as textile electrodes (e.g., electrocardiogram (ECG)), or non-wearable devices such as digital stethoscopes (e.g., heart and lung sound) are pre-processed to remove artefacts and noises, which are used for training the AI models. Furthermore, the pre-processing task depends on the nature of extracted data. As an example, ECG signals are notch filtered at 50 Hz11 and band-pass filtered. Audio signals are also band-pass filtered.12 The AI techniques identified for this application are categorised into supervised learning,6 unsupervised learning,13 and reinforcement learning (RL).14 In the next subsection, we focus on the evolution, taxonomy and comparative study of AI techniques used for cardiorespiratory monitoring of wearable data.
Evolution of AI
In this section, the evolution of AI techniques is presented using six different perspectives.
Wearable cardiorespiratory monitoring for infants
The initial AI work using wearable cardiorespiratory monitoring was conducted in 2012, which employed the support vector machine (SVM) algorithm with radial basis function on pulse oximetry data acquired from neonates.6 SVM is a popular traditional ML algorithm, that classifies data based on hyperplanes, which can be linear, polynomial, and radial basis functions. Patron et al.15 and Mongan et al.16 employed the SVM algorithm and artificial neural network (ANN) respectively, on data collected from radio-frequency identification (RFID) tags in a wearable belt. The ANN is a deep learning algorithm, which contains different intermediate layers for the semantic information, and requires one-dimensional feature vector representation to train the model during classification. Furthermore, Vu et al.11 employed different combinations of popular traditional ML algorithms such as Decision tree, SVM, k-nearest neighbours (K-NN), and deep learning algorithm (ANN) as a two-stage classifier on ECG data. First, they selected the combination of the classifiers giving the optimal performance. Second, they used the optimal classifier for the final classification. The decision tree algorithm is based on the rules, which splits data into roots and nodes during classification.
De Greef et al.17 employed the traditional ML algorithm, called the random forest (RF) algorithm, to classify the vital signs data obtained from the clothing wearable sensors for newborn heart diseases detection. At the same time, Munz and Wolf18 realised the importance of the deep learning approach and proposed to use of the ANN algorithm for the classification of infant breathing patterns on data obtained from the breathing sensor. Furthermore, Acharya et al.8 utilised three classifiers (naive Bayes (NB), logistic regression (LR), and decision trees) for respiratory monitoring on data obtained from the abdomen and shoulder. In the meantime, considering the efficacy of LR for the classification, Raknim et al.19 employed multiple LR models for neonatal sepsis monitoring on the data achieved from the wearable ballistocardiography sensor.
Using traditional ML algorithms, Urdal et al.20 implemented the Vu classifier for newborn resuscitation detection on ECG data. They also used accelerometer data to observe the heart rate (HR) during different activities. These activities included chest compressions, back stimulation, tactile stimulation, drying thoroughly, moving the baby and uncategorised movements. Furthermore, Ostojic et al.21 proposed to use of four traditional ML algorithms (decision tree, K-NN, NB, and SVM) on pulse oximetry data for reducing the false alarm rate. Here, the NB algorithm considers the prior and posterior probabilities to predict the class labels in the data. Similarly, Shamsir et al.22 proposed deep learning methods (convolutional neural network (CNN) and long short-term memory (LSTM)) for the classification of neonatal breathing and blood oxygen level data obtained from thermal sensors to detect respiratory failure. The LSTM model captures the sequential information of data during classification. Xu et al.23 employed both deep learning (ANN) and traditional ML methods (LR) on the vital signs data extracted from two patches stuck on the neonate’s body. LR is based on the statistical model that employs the logistic function to learn the data. Following the efficacy of traditional ML methods, Hansen et al.24 employed the hidden Markov model (HMM) coupling with the higher-order features obtained from the Minkowski and Mahalanobis distances on multi-tag RFID measurements from abdominal belts for respiratory monitoring.
More recently, Vahabi et al.25 proposed to use of deep learning (ResNet-50) and traditional ML methods (SVM) on wearable electrical impedance tomography (EIT) data for neonatal sleep apnoea detection. Here, the ResNet-50, a 50-layer deep learning model, extracts the semantic information of the input image using the residual connection (the output of a layer is a convolution of its input plus input) and batch normalisation.
Electrical-based cardiorespiratory monitoring
Four studies reported using electrical-based sensors for cardiorespiratory monitoring. Khodadad et al.26 devised a breath detector classifier, which is based on the traditional ML method, on the EIT data for lung function. This classifier relies on zero-crossing, which utilises the optimised threshold parameters above and below the zero value of the data for the classification. Gomez et al.27 used several traditional ML algorithms such as RF, LR, and K-NN to detect the HR variability for neonatal sepsis on ECG data. The RF algorithm is an ensemble learning algorithm that creates multiple decision trees during training and ensembles the output from multiple trees. The K-NN algorithm classifies the ECG data based on similarity matching. Their results show that the proposed model can assist physicians in remote monitoring. Also, Mahmud et al.28 employed the XGBoost algorithm, a traditional ML algorithm, on the ECG data of neonates. The XGBoost algorithm is a decision tree ensemble algorithm, using gradient boosting. More recently, Macfarlane et al.29 recommended a deep learning method (CNN model) for the ECG interpretation during the monitoring of both neonates and adults as ANN was not found to be superior. The CNN algorithm employs the visual input and extracts the semantic information after several levels of convolution operation across the input image.
Optical-based cardiorespiratory monitoring
Three studies report optical sensors for data extraction during cardiorespiratory monitoring. Villarroel et al.30 employed the deep learning models (VGG-16 and ResNet-50) to monitor the vital signs on video and pulse oximeter data collected from preterm infants. The original VGG-16 model comprises 16 deep layers to extract the semantic information of the input image (e.g., video frame) during its analysis. Hunter et al.31 employed the traditional ML methods (SVM and XGBoost algorithms) on pulse oximeter data for the clinical judgement of capillary refill time in children aged 1 to 12. The XGBoost algorithm is a decision tree ensemble algorithm, using gradient boosting. Recently, Huang et al.32 employed both video and PPG data obtained from pulse oximeter data to train the deep learning model (LSTM model) for neonatal HR monitoring.
Mechanical-based cardiorespiratory monitoring
The first AI work for cardiorespiratory monitoring using mechanical sensors for newborns was carried out in 2001. The researchers implemented the deep learning method (ANN algorithm) on data captured from a digital stethoscope attached to the infant After 14 years, there was a gradual increase in mechanical sensors for neonatal cardiorespiratory monitoring. Amiri et al.33 proposed the use of an RF algorithm, a traditional ML method, for heart murmur detection on phonocardiogram (PCG) data achieved from a digital stethoscope that was connected to a mobile phone. Bokov et al.34 employed the SVM algorithm for wheeze detection on the audio data recorded using smartphones in the paediatric population. In 2016, Sola et al.35 proposed to use traditional ML algorithms (Gaussian mixture model (GMM) and HMM) on the Mel-frequency filter bank from audio signals obtained from the digital stethoscope to detect childhood pneumonia. The GMM helps learn the unsupervised pattern of data, whereas the HMM helps find the sequential pattern of data.
In 2018, three groups reported cardiorespiratory monitoring using mechanical sensors. Shelevytsky et al.36 proposed to use of the traditional ML method (SVM) for the classification of PCG data during the heart condition classification of the newborn. Bardou et al.13 employed different algorithms such as K-NN, SVM, GMM, and CNN algorithms on the audio data extracted by digital stethoscopes from the heart of different age groups, including newborns and adults. To train the traditional ML algorithms (K-NN, SVM, and GMM), the handcrafted features for audio data were used, whereas, for the deep learning method (CNN), the spectrogram, which is the visual representation of audio data, was used. In their work, handcrafted features include the Mel frequency cepstral coefficients and texture features. Ramanathan et al.37 underscored the application of the deep learning method (ANN) being used in a digital stethoscope used for extracting audio signals from the human body, including children and newborns.
In 2020, Grooby et al.38 a applied SVM, Decision trees, K-NN, and dynamic classifiers for the classification during the quality assessment of chest sounds obtained from a digital stethoscope. Here, the dynamic classifier is based on the ensemble approach, which selects the optimal base classifiers or their combination to improve the performance. Their result shows that the dynamic classifier outperforms the individual classifiers.
By 2021, there was an increasing number of studies using AI for cardiorespiratory monitoring. Gomez-Quintana et al.39 employed the XGBoost algorithm, for the classification of neonatal PCG signals that were obtained from a digital stethoscope. Apart from traditional ML methods in the same year, Jani et al.40 suggested using a deep learning method (ANN) on the PCG data obtained from the digital stethoscope for heart murmur detection from neonatal to adult health monitoring. Similarly, Oliveira et al.41 highlighted the application of heart murmur detection using ANN and logistic regression, from a paediatric and neonatal population on PCG data. Grooby et al.42,43 proposed to use deep learning algorithms (e.g., YAMNet), and traditional ML algorithms (e.g., non-negative matrix co-factorisation (NMCF), SVM, decision trees, K-NN, and LR) for neonatal chest sound separation, which contains both noisy and mixed samples as well as heart/lung quality assessment problems on digital stethoscope data. Lastly, Gomez-Quintana et al.12 employed the XGBoost algorithm for the classification of neonatal PCG signals. The XGBoost algorithm was responsible for detecting patent ductus arteriosus in neonates.
Multi-sensor-based cardiorespiratory monitoring
Research using multi-sensor-based cardiorespiratory monitoring began in 2013. The purpose of their AI method is to predict the mortality of infants. Furthermore, Rinta-Koski et al.44 used a Gaussian process classifier on standard clinical features, which includes HR and blood pressure, to predict mortality. Gaussian process classifier is based on Laplace approximation, which focuses on the posterior probabilities of the variables. Following the similar trend of using traditional ML algorithms, Pais et al.45 employed the LDA algorithm for the classification of ECG and pulse oximetry data to determine HR variability. The LDA algorithm expresses the data as the linear combination of features that discriminate between two or more classes. Here, the LDA algorithm is responsible for detecting apnoea in neonates.
Similarly, Jalali et al.46 proposed to use of the SVM classifier for the classification of periventricular leukomalacia after cardiac surgery. Their method utilises vital signs of neonates, including HR data achieved from pulse oximetry. In their method, SVM is used to predict periventricular leukomalacia based on vital signs data. Moreover, Joshi et al.47 proposed to use the XGBoost algorithm trained on HR, respiratory rate (RR), and pulse oximetry data obtained from neonates to predict critical cardiorespiratory conditions. Hassan et al.48 employed the ANN to detect sleep apnoea on temperature and pulse oximeter data from neonates. Similarly, Pini49 utilised the random forest and K-NN algorithms for the maternal, foetal, and neonatal profiling of the physiological signals with qualitative data such as maternal lifestyle factors.
Recently in 2021, Zuzarte et al.50 employed GMM and LR methods for the classification of cardiorespiratory and movement features achieved from the pulse oximeter and ECG electrodes. The GMM and LR methods are used to detect neonatal apnoeic events. Their results suggest that the use of such technologies helps reduce morbidity and mortality. Cabrera-Quiros et al.51 utilised LR, NB, and nearest mean classifiers for the detection of late-onset sepsis on continuous high-resolution ECG and chest impedance data in neonates. The nearest mean classifier, also called the Rocchio classifier, classifies the data to the nearest mean of the training data belonging to the class.
Review papers
Here we discuss review papers on neonatal, paediatric, and/or adult health monitoring, including cardiorespiratory, using AI techniques on either wearable- or non-wearable-based data.
In 2019, Chisi et al.52 suggested using AI for overall health monitoring of clinical data obtained from wearable sensors such as ECG and pulse oximeter data in the paediatric population. Tandon et al.53 also highlighted the efficacy of ML algorithms for the detection of paediatric cardiovascular disease on continuous physiological data (CPD) obtained from wearable biosensors.
Ranjit and Kissoon14 discussed different applications of AI, particularly RL for early detection of sepsis and septic shock in the paediatric population on different data such as RR, HR, and SpO2. During the same year, Chong et al.54 highlighted the use of decision trees and RF for the health monitoring of HR, RR, and oxygen saturation in the paediatric population. Goulooze et al.55 explained algorithms such as RF and decision trees for paediatric and neonatal health monitoring such as sepsis detection on the early results of laboratory tests and nursing observations. Johnson et al.56 underscored the importance of ML algorithms for health monitoring, including neonatal population on clinical features such as HR, RR and oxygen level. They highlighted these data could be extracted using mobile devices and body-worn wearable sensors. Memon et al.57 underscored the application of ML algorithms on the data extracted from the RFID-based abdominal band sensors capturing the RR of neonates. Hasan et al.58 also discussed the ML algorithms for neonatal health monitoring using vital signs data (e.g., HR, oxygen level, etc.) achieved from the wearable sensors.
Sobhan et al.59 elaborated on the popular AI techniques (e.g., LR and SVM) for the heart and respiration functions on the health data (e.g., ECG and SCG) collected using wearable or non-wearable sensors for both adult and non-adult populations. Lin et al.60 discussed using deep learning methods for the classification of heart sound signals on wearable data, including ECG and PCG for both neonatal and adult health monitoring. Furthermore, Lyu et al.61 also underscored the use of deep learning algorithms (e.g., ANN, CNN and LSTM) on the wearable data (e.g., ECG and blood pressure,) for both neonatal and adult health monitoring in 2021.
The overall evolution of AI techniques ranging from 2001 to 2021 is summarised using a stacked bar plot (Fig. 2) and a timeline (Fig. 3). From Fig. 4, we observed that the SVM algorithms are the most popular (12 publications), whereas the ANNs (10 publications) are the second most used algorithms in the literature. This data shows that the traditional ML algorithm (e.g., SVM) is still dominant for neonatal cardiorespiratory monitoring despite the great promise of the deep learning algorithm (ANN) in this domain.
Taxonomy of AI techniques used with wearable technology for neonatal cardiorespiratory monitoring purpose
Based on the research works using several AI methods for cardiorespiratory monitoring in the literature, we categorise them into three broad categories: traditional ML (e.g., SVM,38 Decision trees,11 etc.), deep learning-based (e.g., CNN,22 LSTM,22 etc.) and reward/punishment-based AI methods (e.g., RL method14). Deep learning-based methods22 extract the higher-order information from the input data to improve performance. The higher-order information is achieved by using different operations such as convolution and activation; however, traditional ML AI techniques do not produce such types of information during their learning process. The reward/punishment AI techniques (e.g., RL algorithm) learn the data based on rewards and punishment strategy as discussed in “Evolution of AI”. Under the traditional AI techniques, there are several algorithms, for example, SVM, RF, Logistic regression, etc. The deep learning AI techniques are further divided into two groups: pre-trained and non-pre-trained AI techniques. Pre-trained AI techniques (e.g., ResNet-50, VGG-16, etc.) have been already pre-trained with large data sets (e.g., image data sets), which help produce features based on them, whereas non-pre-trained AI techniques (e.g., LSTM) need to be trained from scratch. The taxonomy is presented in Fig. 5.
Comparison of AI techniques used with wearable technology for neonatal cardiorespiratory monitoring
The AI technologies used for neonatal cardiorespiratory monitoring have their own peculiarities and importance in terms of applicability and viability. For example, most of the traditional AI techniques are more appropriate for small data sets common in biomedical research. Also, they have a higher level of interpretability, which helps establish trust and acceptability among clinicians and healthcare professionals. Tables 1 and 2 summarise the comparison of different AI techniques used in cardiorespiratory monitoring alongside their advantages and disadvantages. We compare the AI methods based on several factors such as model complexity, performance, and interpretability.
Discussion
AI techniques, sensor technologies and their evolution being adopted in neonatal cardiorespiratory monitoring are discussed in this section.
For data collected from wearable sensors, AI has been used mainly for apnoea detection, along with sepsis and general critical health detection. However, as presented in “Wearable cardiorespiratory monitoring for infants” and Supplementary Table 1, there have been few studies that evaluate the use of wearable sensor collected data. While many of the existing AI techniques presented for neonatal cardiorespiratory monitoring in this paper seem suitable, further research and clinical validation would be required. This is especially important as wearable sensor data is typically more prone to noise such as motion artefact and typically provides weaker physiological signals. Therefore, it would be expected these AI techniques would either not work off-the-shelf or provide lower accuracy than reported. In future, the use of AI to improve the signal quality of wearable sensor collected data would be of interest to resolve this limitation. Furthermore, wearable sensors typically offer the opportunity of multiple physiological signals and vitals which has yet to be fully utilised in AI techniques.
According to Figs. 2–4, more AI techniques, including both traditional ML and deep learning, have been used for neonatal cardiorespiratory monitoring. Also, we noted that the SVM algorithm is the most popular AI technique to date, particularly prior to 2019. After 2019, there are several emerging AI techniques, including K-NN, ANN, SVM, RF, LR, and XGBoost. Furthermore, the number of traditional ML methods outnumbers the number of deep learning and reward/punishment methods (Fig. 2). In addition, some classifiers such as Gaussian process classifiers that were published before 2019 are less popular in recent years, whereas methods such as XGBoost and LR are on the rise along with deep learning methods such as LSTM and ResNet-50.
The taxonomy diagram in Fig. 5 illustrates that AI techniques for cardiorespiratory monitoring of wearable data are moving towards more traditional ML methods. As an example, the SVM classifier, one of the most popular algorithms, is being used mostly for classification problems. The reasons for their popularity could be explained twofold. First, traditional ML models59 are easy to implement and have fewer hyperparameters, thereby reducing the time for the optimal model deployment. Second, health practitioners/clinicians prefer interpretable and explainable AI models. The traditional AI methods are mostly interpretable and explainable and could work on limited data. We observe that both deep learning methods and traditional ML methods have both advantages and disadvantages in their application (Table 1). For instance, SVM may work for higher dimensional data, but it fails to produce the expected result using big data. However, deep learning methods30 such as ResNet-50 and VGG-16, might be more useful with big data, but less so with limited data.
Furthermore, we compared AI methods in terms of explainability and performance. From Table 2, we observed that the highest-performing algorithms are ANN and K-NN, which provide the highest specificity of 100% and 99.46%, respectively. Regarding explainability and interpretability features, the ANN algorithm is difficult to explain and interpret, whereas K-NN is interpretable and explainable.
While AI offers great promise in the home and hospital environment, further studies are required in two areas. First, the impact of the AI algorithms needs to be investigated to demonstrate the benefit of these algorithms to improve health (reduction in mortality and morbidity) and financial (reduction in clinician workload and health interventions) outcomes. Second, studies determining the acceptability and key concerns of these AI algorithms from clinicians in the hospital environment and parents in the home environment are required. These two areas are important to see the translation of these AI techniques from research into clinical practice.
Conclusions
We reviewed several AI techniques for neonatal cardiorespiratory monitoring on wearable data and designed a hierarchical taxonomy and AI timeline based on them. We found the rising popularity of traditional AI methods (e.g., SVM, XGBoost) compared to deep learning methods (e.g., ANN, CNN). Our study also found that the application of AI methods in this domain is still in its infancy. As more sensor technology develops and produces more data, we need to identify the best AI methods in this domain.
Data availability
Data sharing is not applicable to this article as no data sets were generated or analysed during the current study.
References
United Nations Department of Economic and Social Affairs. Goal 3: ensure healthy lives and promote well-being for all at all ages. https://sdgs.un.org/goals/goal3 (2021).
UNICEF. Neonatal mortality. https://data.unicef.org/topic/child-survival/neonatal-mortality/ (2020).
World Health Organisation. Newborn death and illness. https://www.who.int/pmnch/media/press_materials/fs/fs_newborndealth_illness/en/ (2020).
World Health Organisation. Newborns: improving survival and well-being. https://www.who.int/news-room/fact-sheets/detail/newborns-reducing-mortality (2020).
World Health Organisation. Preterm birth. https://www.who.int/news-room/fact-sheets/detail/preterm-birth (2022).
Daly, J., Monasterio, V. & Clifford, G. D. A neonatal apnoea monitor for resource-constrained environments. In Proc. 2012 Computing in Cardiology 321–324 (IEEE, 2012).
Gleason, C. A. & Juul, S. E. Avery’s Diseases of the Newborn E-book (Elsevier Health Sciences, 2017).
Acharya, S. et al. Ensemble learning approach via kalman filtering for a passive wearable respiratory monitor. IEEE J. Biomed. Health Inform. 23, 1022–1031 (2018).
Abreu, V., Oliveira, A., Duarte, J. A. & Marques, A. Computerized respiratory sounds in paediatrics: a systematic review. Respir. Med. 3, 100027 (2021).
DeGroff, C. G. et al. Artificial neural network–based method of screening heart murmurs in children. Circulation 103, 2711–2716 (2001).
Vu, H. et al. Automatic classification of resuscitation activities on birth-asphyxiated newborns using acceleration and ECG signals. Biomed. Signal Process. Control 36, 20–26 (2017).
Gómez-Quintana, S. et al. A framework for AI-assisted detection of patent ductus arteriosus from neonatal phonocardiogram. Healthcare 9, 169 (2021).
Bardou, D., Zhang, K. & Ahmad, S. M. Lung sounds classification using convolutional neural networks. Artif. Intell. Med. 88, 58–69 (2018).
Ranjit, S. & Kissoon, N. Challenges and solutions in translating sepsis guidelines into practice in resource-limited settings. Transl. Pediatr. 10, 2646 (2021).
Patron, D. et al. On the use of knitted antennas and inductively coupled RFID tags for wearable applications. IEEE Trans. Biomed. Circuits Syst. 10, 1047–1057 (2016).
Mongan, W. M. et al. Real-time detection of apnea via signal processing of time-series properties of RFID-based smart garments. In Proc. 2016 IEEE Signal Processing in Medicine and Biology Symposium (SPMB) 1–6 (IEEE, 2016).
de Greef, L. Using Consumer Devices to Monitor Acute Medical Conditions for Infants. PhD thesis, Univ. Washington (2019).
Munz, M. & Wolf, N. Simulation of breathing patterns and classification of sensor data for the early detection of impending sudden infant death. Curr. Direct. Biomed. Eng. 5, 401–403 (2019).
Raknim, P. et al. On the use of low-cost sensors for non-intrustive newborn sepsis monitoring. In WearSys '19: The 5th ACM Workshop on Wearable Systems and Applications 39–40 (ACM, 2019).
Urdal, J. et al. Automatic identification of stimulation activities during newborn resuscitation using ECG and accelerometer signals. Comput. Methods Prog. Biomed. 193, 105445 (2020).
Ostojic, D. et al. Reducing false alarm rates in neonatal intensive care: a new machine learning approach. Adv. Exp. Med. Biol. 1232, 285–290 (2020).
Shamsir, S., Hassan, O. & Islam, S. K. Smart infant-monitoring system with machine learning model to detect physiological activities and ambient conditions. In Proc. 2020 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) 1–6 (IEEE, 2020).
Xu, S. et al. Wireless skin sensors for physiological monitoring of infants in low-income and middle-income countries. Lancet Digital Health 3, e266–e273 (2021).
Hansen, S. et al. Fusion learning on multiple-tag RFID measurements for respiratory rate monitoring. Proc. IEEE Int. Symp. Bioinformatics Bioeng. 2020, 472–480 (2020).
Vahabi, N. et al. Deep analysis of EIT dataset to classify apnea and non-apnea cases in neonatal patients. IEEE Access 9, 25131–25139 (2021).
Khodadad, D. et al. Optimized breath detection algorithm in electrical impedance tomography. Physiol. Meas. 39, 094001 (2018).
Gómez, R., García, N., Collantes, G., Ponce, F. & Redon, P. Development of a non-invasive procedure to early detect neonatal sepsis using HRV monitoring and machine learning algorithms. In Proc. 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS) 132–137 (IEEE, 2019).
Mahmud, M. S., Wang, H. & Kim, Y. Accelerated prediction of bradycardia in preterm infants using time-frequency analysis. In Proc. 2019 International Conference on Computing, Networking and Communications (ICNC) 468–472 (IEEE, 2019).
Macfarlane, P. W. & Kennedy, J. Automated ECG interpretation—a brief history from high expectations to deepest. Netw. Hearts 2, 433–448 (2021).
Villarroel, M. et al. Non-contact physiological monitoring of preterm infants in the neonatal intensive care unit. NPJ Digital Med. 2, 1–18 (2019).
Hunter, R. B. et al. Supervised machine learning applied to automate flash and prolonged capillary refill detection by pulse oximetry. Front. Physiol. 11, 564589 (2020).
Huang, B. et al. A neonatal dataset and benchmark for non-contact neonatal heart rate monitoring based on spatio-temporal neural networks. Eng. Appl. Artif. Intell. 106, 104447 (2021).
Amiri, A. M., Armano, G., Rahmani, A. M. & Mankodiya, K. PhonoSys: mobile phonocardiography diagnostic system for newborns. In Proc. 5th EAI International Conference on Wireless Mobile Communication and Healthcare (EAI, 2015).
Bokov, P., Mahut, B., Flaud, P. & Delclaux, C. Wheezing recognition algorithm using recordings of respiratory sounds at the mouth in a pediatric population. Comput. Biol. Med. 70, 40–50 (2016).
Solà, J. et al. Towards an unsupervised device for the diagnosis of childhood pneumonia in low resource settings: automatic segmentation of respiratory sounds. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2016, 283–286 (2016).
Shelevytsky, I., Shelevytska, V., Golovko., V. & Semenov, B. Segmentation and parametrization of the phonocardiogram for the heart conditions classification in newborns. In Proc. 2018 IEEE Second International Conference on Data Stream Mining & Processing (DSMP) 430–433 (IEEE, 2018).
Ramanathan, A. et al. Digital stethoscopes in paediatric medicine. Acta Paediatr. 108, 814–822 (2019).
Grooby, E. et al. Neonatal heart and lung sound quality assessment for robust heart and breathing rate estimation for telehealth applications. IEEE J. Biomed. Health Inform. 25, 4255–4266 (2020).
Gómez-Quintana, S., Shelevytsky, I., Shelevytska, V., Popovici, E. & Temko, A. Automatic segmentation for neonatal phonocardiogram. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2021, 135–138 (2021).
Jani, V. et al. The discerning ear: cardiac auscultation in the era of artificial intelligence and telemedicine. Eur. Heart J. Digital Health 2, 456–466 (2021).
Oliveira, M., Oliveira, J., Camacho, R. & Ferreira, C. A. A multi-spot murmur sound detection algorithm and its application to a pediatric and neonate population. In Proc. 14th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2021), Vol. 4 228–234 (IEEE, 2021).
Grooby, E. et al. Real-time multi-level neonatal heart and lung sound quality assessment for telehealth applications. IEEE Access 10, 10934–10948 (2022).
Grooby, E. et al. A new non-negative matrix co-factorisation approach for noisy neonatal chest sound separation. In Proc. 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) 5668–5673 (IEEE, 2021).
Rinta-Koski O-P, Särkkä S, Hollmen J, Andersson S. Prediction of preterm infant mortality with Gaussian process classification. 2017:193-198.
Pais, C. M. & Arévalo González, S. in Applied Computer Sciences in Engineering. WEA 2017. Communications in Computer and Information Science, Vol. 742 (eds Figueroa-García, J., López-Santana, E., Villa-Ramírez, J., Ferro-Escobar, R.) 667–678 (Springer, 2017).
Jalali, A., Simpao, A. F., Gálvez, J. A., Licht, D. J. & Nataraj, C. Prediction of periventricular leukomalacia in neonates after cardiac surgery using machine learning algorithms. J. Med. Syst. 42, 1–11 (2018).
Joshi, R. et al. Predictive monitoring of critical cardiorespiratory alarms in neonates under intensive care. IEEE J. Transl. Eng. Health Med. 7, 1–10 (2019).
Hassan, O., Parvin, D. & Kamrul, S. Machine learning model based digital hardware system design for detection of sleep apnea among neonatal infants. In Proc. 2020 IEEE 63rd International Midwest Symposium on Circuits and Systems (MWSCAS) 607–610 (IEEE, 2020).
Pini, N. Physiology Based Machine Learning and Data Analytics for Perinatal Monitoring-a Novel Framework for a Comprehensive Maternal, Fetal, and Neonatal Profiling. Doctoral dissertation, Politecnico di Milano (2020).
Zuzarte, I., Sternad, D. & Paydarfar, D. Predicting apneic events in preterm infants using cardio-respiratory and movement features. Comput. Methods Prog. Biomed. 209, 106321 (2021).
Cabrera-Quiros, L. et al. Prediction of late-onset sepsis in preterm infants using monitoring signals and machine learning. Crit. Care Explor. 3, e0302 (2021).
Chisi, T. F. T. Determining the Potential of Wearable Technologies Within the Disease Landscape of Sub-Saharan Africa (Stellenbosch University, 2019).
Tandon, A., De & Ferranti, S. D. Wearable biosensors in pediatric cardiovascular disease: promises and pitfalls toward generating actionable insights. Circulation 140, 350–352 (2019).
Chong, N. K., Elaine, C. C. S. & de Korne, D. F. Creating a learning televillage and automated digital child health ecosystem. Pediatr. Clin. 67, 707–724 (2020).
Goulooze, S. C. et al. Beyond the randomized clinical trial: innovative data science to close the pediatric evidence gap. Clin. Pharmacol. Ther. 107, 786–795 (2020).
Johnson, K. T. & Picard, R. W. Advancing neuroscience through wearable devices. Neuron 108, 8–12 (2020).
Memon, S. F., Memon, M. & Bhatti, S. Wearable technology for infant health monitoring: a survey. IET Circuits Devices Syst. 14, 115–129 (2020).
Hasan, N. & Negulescu, I. Wearable technology for baby monitoring: a review. J. Text. Eng. Fash. Technol. 6, 15406 (2020).
Sobhan, S., Islam, S., Valero, M., Shahriar, H. & Ahamed, S. I. Data analysis methods for health monitoring sensors: a survey. In Proc. 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC) 669–676 (IEEE, 2021).
Lin, J. et al. Wearable sensors and devices for real-time cardiovascular disease monitoring. Cell Rep. Phys. Sci. 2, 100541 (2021).
Lyu, Q., Gong, S., Yin, J., Dyson, J. M. & Cheng, W. Soft wearable healthcare materials and devices. Adv. Healthc. Mater. 10, 2100577 (2021).
Funding
E.G. acknowledges the support of the MIME-Monash Partners-CSIRO sponsored PhD research support programme and Research Training Program (RTP). T.C.K. and D.S. are supported by the National Institute of Health Research (NIHR) Children and Young People MedTech Co-operative (CYP MedTech). D.S. has received funding for technology development from the Medical Research Council, NIHR and Action Medical Research, and is a non-executive director of SurePulse Medical who are developing monitoring solutions for neonatal care. A.M.’s research is supported by the NHMRC (Aus) and Cerebral Palsy Alliance. The study is supported by the Monash Institute of Medical Engineering (MIME). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or of the Department of Health.
Author information
Authors and Affiliations
Contributions
Substantial contributions to conception and design, acquisition of data, or analysis and interpretation of data; drafting the article or revising it critically for important intellectual content; final approval of the version to be published: all authors.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Ethics approval and consent to participate
Patient consent was not required.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sitaula, C., Grooby, E., Kwok, T.C. et al. Artificial intelligence-driven wearable technologies for neonatal cardiorespiratory monitoring. Part 2: artificial intelligence. Pediatr Res 93, 426–436 (2023). https://doi.org/10.1038/s41390-022-02417-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41390-022-02417-w