In recent years, there has been a significant expansion in the development and use of multi-modal sensors and technologies to monitor physical activity, sleep and circadian rhythms. These developments make accurate sleep monitoring at scale a possibility for the first time. Vast amounts of multi-sensor data are being generated with potential applications ranging from large-scale epidemiological research linking sleep patterns to disease, to wellness applications, including the sleep coaching of individuals with chronic conditions. However, in order to realise the full potential of these technologies for individuals, medicine and research, several significant challenges must be overcome. There are important outstanding questions regarding performance evaluation, as well as data storage, curation, processing, integration, modelling and interpretation. Here, we leverage expertise across neuroscience, clinical medicine, bioengineering, electrical engineering, epidemiology, computer science, mHealth and human–computer interaction to discuss the digitisation of sleep from a inter-disciplinary perspective. We introduce the state-of-the-art in sleep-monitoring technologies, and discuss the opportunities and challenges from data acquisition to the eventual application of insights in clinical and consumer settings. Further, we explore the strengths and limitations of current and emerging sensing methods with a particular focus on novel data-driven technologies, such as Artificial Intelligence.
Sleep is a crucial biological process, and has long been recognised as an essential determinant of human health and performance. Whilst not all of sleep’s functions are fully understood, it is known to restore energy, promote healing, interact with the immune system and impact upon both brain function and behaviour1,2. Even transient changes in sleep patterns, such as acute sleep deprivation, can impair judgement and cognitive performance, whilst long-term aberrations have been linked to disease development3,4. Global trends in sleep suggest a decrease on average sleep duration5,6,7,8. Given these trends and the implications of sleep for health and well-being, better characterisation of sleep characteristics represents a public health priority9,10,11.
Sleep is known to be regulated by three main factors: circadian rhythms, sleep–wake homoeostasis and cognitive-behavioural influences1. With regards to behavioural determinants, poor sleep quality12 (as defined by the National Sleep Foundation’s recommendations based on total sleep time, sleep latency, wake after sleep onset, number of awakenings >5 min and sleep efficiency) has been associated with stress, anxiety, smoking, sugary drink consumption, workplace pressures, financial concerns, regularity of working hours, physical activity, sleep regularity and commuting times9,13. Indeed longitudinal research has linked changes in physical activity to changes in the severity of sleep-disordered breathing and, hence, disturbed sleep14. Furthermore, dietary patterns have shown associations with sleep quality15. It is now understood that the associations between diet, physical activity and sleep are bidirectional. Thus, poor sleep, high levels of inactivity and a poor diet comprise inter-related public health priorities16. The mental and physical impairments associated with a single night of poor sleep can outweigh those caused by an equivalent lack of exercise or food17.
Sleep loss affects every major system in the human body. Chronic changes in sleep have been associated with a plethora of serious medical problems from obesity and diabetes to neuropsychiatric disorders13,18,19. For example, chronic insomnia is associated with both incident cardiovascular disease and all-cause mortality4,20. A 2011 meta-analysis of prospective studies, which included 470,000 individuals, explored the association between sleep duration and cardiovascular disease21. Relative to those who slept between 7 and 8 h per night, those who slept less than 6 h exhibited a 48% increase in the incidence of coronary heart disease and 15% increase in the incidence of stroke, whilst those who slept greater than 8 to 9 h exhibited a 38% increase in coronary heart disease, a 65% increase in stroke and a 45% overall increase in cardiovascular disease21. Other large epidemiological studies have also reported associations between sleep and cardio-metabolic disease, including reports studying the effects of shift-work22,23,24,25. Short sleep duration has further been associated with incident diabetes and weight gain, as well as impaired appetite control18,26. Shortened sleep and poor sleep quality have also been identified as risk factors for cognitive decline, neurodegenerative disease, mood changes and depression, as well as other neuropsychiatric conditions27,28,29,30. There is also mounting evidence linking sleep to both immune function31 and cancer32,33. In a seminal study published in 2002, Spiegel et al. demonstrated an association between sleep deprivation and a muted immune response to flu vaccination34.
Besides its ramifications for the health of individuals, sleep has macro-level economic implications. A recent study estimated the annual economic cost of poor sleep to the Australian population at $45.2 billion, comprising direct healthcare costs, the cost of associated health conditions, reduced productivity, accidents and informal care10. Moreover, in a 2016 report, RAND Corp quantified that the combined cost of insufficient sleep across five OECD countries (Canada, USA, UK, Germany and Japan) exceeds $600 billion a year9.
Following mounting evidence of the role of sleep in well-being, its relationship with disease and mortality and its economic impact, there has been increased interest in measuring sleep characteristics. This has led to an expansion in the development and use of sleep-related technology. In particular, recent developments in digital technologies designed to improve the measurement and characterisation of sleep have demonstrated particular potential. These advances facilitate the objective and unobtrusive measurement of sleep characteristics in large, free-living populations at scale, facilitating well-powered epidemiological investigations designed to explore the relationships between sleep and disease35. Furthermore, these developments are set to have clinical implications for the monitoring and diagnosis of sleep disorders and, ultimately, could be used for the modulation of sleep36.
The core contribution of this paper is to discuss the implications of digital technologies for the study, monitoring and modulation of sleep. To aid this discussion, we introduce a five-step Digital Sleep Framework, which comprises the complete process from sleep data acquisition to end-user applications of insights. Figure 1 depicts the framework. This paper is structured around the framework’s five steps: data acquisition; data storage and curation; data processing; modelling and applications. Finally, we discuss the biggest challenges and opportunities in this field followed by conclusions based on our findings.
Sleep data acquisition
Sensors have been used to study sleep for decades. Traditionally, polysomnography (PSG), paired with clinical evaluation, has been the gold-standard and de-facto technique to study sleep in clinical and laboratory settings, as well as to diagnose a subset of sleep disorders37. However, in recent years, industry and academia have invested heavily in the development of smaller, less obstructive and more portable devices for the continuous monitoring of sleep38. This is motivated by a desire to enable data acquisition in larger participant groups over more extended periods and in a more natural setting by decreasing both the cost of monitoring and the burden to participants. However, challenges remain in data acquisition, including the provision of ubiquitous, less obtrusive and stigmatising long-term acquisition mechanisms. Moreover, long-term patient monitoring usually suffers from missing periods that may mislead the estimations of health markers. Here, we discuss the current state-of-the-art of sleep data acquisition in clinical and free-living settings, including an overview of traditional and novel approaches and their strengths and weaknesses.
Traditional sleep monitoring and monitoring in laboratory settings
Since the 1960s, polysomnography (PSG) has been used in clinical settings to monitor sleep through a battery of simultaneous, complementary sensors39. These sensors typically allow for the measurement of (1) brain activity through electroencephalogram (EEG), (2) airflow, (3) breathing effort and rate, (4) blood oxygen levels, (5) body position, (6) eye movement, (7) electrical activity of muscles and (8) heart rate. Traditionally, PSG requires participants to sleep in a laboratory setting. The results are then scored by an expert who has received training on how to interpret these signals. Ambulatory PSG is an alternative modality which often uses a reduced number of sensors and allows monitoring to occur at home, outside of the laboratory. This facilitates the monitoring of patients with disorders that may not be easy to evaluate in a laboratory setting40.
To-date, PSG remains the gold-standard for sleep measurement. However, the technology is limited in its use as it remains impractical for long-term home use. This precludes its use in long-term sleep monitoring or sleep in free-living settings beyond the laboratory. Furthermore, PSG is expensive, time-consuming and requires trained technicians to administer and interpret. As a result, the scalability of this technique for large-scale population-based studies is very limited, particularly when the aim is to assess typical sleep patterns in free-living, naturalistic conditions. Whilst ambulatory PSG provides a partial solution to some of the issues, it remains both expensive and burdensome.
Another conventional method used in clinical settings to evaluate sleep is Videosomnography (VSG). VSG encompasses a range of video-based methods used to record a person as they sleep. These video recordings are subsequently used score sleep behaviours. VSG has been typically paired with PSG in clinical settings to study sleep disorders. However, recent advances in telemedicine have made the use of home VSG increasingly possible. Although VSG is typically scored by experts in a time-consuming manner, advances in signal processing and AI have led to the new possibility of automatically scored VSG41. However, VSG presents similar scalability issues as PSG. It is costly and, at present, requires expert monitoring and scoring.
Sleep monitoring outside the laboratory
To understand the role of sleep in health and disease, sleep must be monitored in a free-living environment and in a non-obtrusive way to ensure the sleep captured is as representative of typical sleep as possible. As such, low-cost, wearable sleep detection systems are a promising tool to study sleep architectures in free-living individuals at a population level. At present, there are several options for the monitoring of sleep outside the laboratory. These comprise actigraphy, heart rate sensing and other wearable technologies. Multiple published works have demonstrated that a single modality sensor representation, such as heart rate alone, is not sufficient to accurately complete sophisticated sleep stage classification42. The availability and range of digital technologies for the measurement of sleep has significantly expanded in the last decade. Both consumer and medical grade devices across a variety of fields (wearable, remote sensing, mobile health, clinical grade) have become more sophisticated and affordable. Nevertheless, comparing performance across different platforms and methods remains a challenge, and few methods have been validated against gold-standard PSG or undergone systematic reliability assessment43.
Traditional free-living sleep sensing and measurement approaches: actigraphy and accelerometry
Actigraphy and accelerometry are non-invasive methods to monitor human activity and rest cycles. They have been used to describe physical activity levels in large-scale populations44, and can also be used to monitor sleep. These methods offer an affordable, scalable alternative to PSG to monitor sleep–wake cycles, and have now been recognised by the American Academy of Sleep Medicine as a valid method for the assessment of sleep45. Recent advances in AI and larger studies in conjunction with PSG have resulted in the refinement of the method46. However, three key limitations of actigraphy and accelerometry remain. These are (1) the lack of validation studies for the different consumer-grade devices, (2) lack of standardisation of approaches for human-activity recognition and (3) the lack of assessment techniques for daytime sleeping. Nowadays, wearable sensors are often used in combination with other minimally invasive sensors (such as heart rate monitors, miniaturised ECG, pulse-oximetry, blood pressure monitors, galvanic skin conduction, light sensors, gyroscopes, barometric altimeters and GPS trackers). Sleep can also be monitored through a combination of wrist actigraphy, hip sensors, smartphone sensors and under-mattress sensors47. Nevertheless, this increased availability of sensors also results in a greater challenges when optimising the match between the end-application and the sensor used43. A description of actigraphy specific sleep metrics is provided in the Supplementary Material.
Data on sleep can be also obtained from devices to treat sleep apnoea, such as Continuous Positive Air Pressure (CPAP). For example, Aggarwal et al.48 showed that CPAP can be used to classify and track sleep metrics, which could be used to monitor the response of CPAP therapy in sleep apnoea patients.
Emerging sleep-sensing technologies
The fundamental aim of ubiquitous computing in sleep tracking is to achieve miniaturisation of sensors and non-intrusive sensing that can pervasively monitor physiological signals related to sleep activities. Embedding different types of ambient sensors into objects that we interact daily is more attractive than using multiple redundant sensors collecting homogeneous information. Embedded devices, such as bed sensors, have been developed to track different sleep-related metrics, such as sleep time, breathing, snoring, heart rate, body and room temperature or humidity levels49,50,51. Whilst these sensors are interesting and potentially valuable for clinical and epidemiological research, as well as wellness and sleep education, very little is known about how their performance against gold-standard measures and more research is required to evaluate their usability. Some have emerged in recent years but remain at an early stage of development (e.g., WiFi and radio-signal approaches), whilst others have been around for longer (e.g., smartwatches). They are depicted in Fig. 2 and discussed below. Some of the potential techniques to unobtrusively measure sleep through the acquisition of physiological signals include the following:
Bed sensors may be defined as any sensor that sits on the bed and can be used for monitoring physiological processes. Body movements, breathing and even cardiac activities can be detected by the volume change of the pneumatic underneath an individual whilst they are lying in bed52,53,54. For instance, using micro-bend fibre optic sensors underneath the mattress allows for monitoring of breathing and body movement activities that can be then used to extrapolate some valuable sleep metrics55. Similarly, fibre-optic based systems have allowed not only for the analysis of different motion types but also for the introduction of retroactive feedback based on those movements56. Unobtrusive sleep monitoring using bed sensors (either on the mattress or the bed frame) usually entails monitoring of movement and also respiration rate and occasionally heart rate. Several companies, including Apple (Beddit), Nokia and Withings, have released new sensor accessories that can be attached to a person’s mattress or bed frame and often interact with a separate mobile application or dashboard. Nevertheless, a range of determinants can influence the performance of these methods, from postural differences to inter-subject variability in BMI and pre-existing clinical conditions54.
Consumer-graded wireless EEG and reduced-array EEG
EEG is an integral part of PSG and is also used in a variety of neuropsychiatric tests and applications. Conventional EEG requires expert set-up and can be burdensome, uncomfortable and is not portable. Wireless EEGs have gained traction in recent years, with several established companies, as well as start-ups, launching products. Their performance for sleep monitoring has been compared with conventional EEG that is part of PSG and has demonstrated strong results57,58. Furthermore, Koley et al.59 showed that automatic scoring using ensemble models on a single-channel EEG could yield agreement rates of 0.87 when compared with expert scoring of the same signal. Whilst this study was conducted in a clinical environment, and hence lacks the recording conditions required for free-living validation, together these investigations show that the results of conventional EEG can be approximated by simpler devices that may be able to be scored automatically.
Similarly, several miniaturised EEG devices have shown promising results with regards to their ability to classify sleep stages60,61. In ear, EEG is a modality that has shown promise in recent years, for instance, Mikkelsen et al.62 compared in-ear mobile EEG analysed through machine learning-based automated scoring to conventional, manual scored PSG and commercial-grade actigraphy showed promising results, although also constrained to a laboratory environment. A 2019 study showed that automatic sleep stage prediction based on a single in-ear sensor demonstrated a 74% agreement with the hypnogram generated from full PSG, which is promising but still requires further work for it to be at a clinical standard of performance (\(\approx\)90% agreement)63. These devices are particularly interesting given their potential for free-living application. They also have the advantage of conserving much of the granularity and information that a conventional PSG-based EEG would offer in non-laboratory set-ups64.
Although the performance of these wireless, miniaturised and in-ear EEG devices is promising, more extensive studies are required to determine the feasibility for use in population science and in a free-living environment as well as for applied sleep research studies.
Smartwatches and fitness trackers
A plethora of wearable smartwatches and activity bands have been developed to infer sleep. These devices often derive their metrics using a combination of movement signals (accelerometry, as explored in previous sections) and heart rate and heart rate variability. Henriksen et al.65 assessed the validation or reliability of some of the most common brands on the measurement of physical activity and sleep (Fitbit, Garmin, Misfit, Apple, Polar, Samsung, Withings and Mio).
Mobile phone sensing
Mobile phones offer a wide range of sensors, such as gyroscopes, microphones and accelerometers, that can be used to monitor sleep patterns66. For instance, iSleep, developed by Hao et al.67, leverages a smartphone’s built-in microphone to detect events that happened during sleep, such as body movement, cough, and snoring by processing the acoustic signals. The software achieves accuracy of over 90% for event classification (snoring, cough, sleep) under different environmental conditions. An important limitation of the system is that the high-rate microphone sampling represents a significant source of energy (and battery) consumption.
Several other sleep applications can be found on the different app stores these days. Sleep cycle is among the most popular ones, using both accelerometry and the built-in microphone to track sleep and provide personalised alarm clocks, waking up the users at ideal timings (during light sleep)68.
Ultrasound sensors can be used to detect body movement and breathing patterns during sleep54,69,70. These sensors provide information regarding the frequency and type of body movement through the Doppler technique. This technique mirrors that used in conventional radar systems and allows the retrieval of parameters related to breathing rate, heart rate and body motion. The method has been shown to detect physical movements with an 86% recall rate and error rates of <10%71. The most pressing limitations of this method are, however, the fine-tuning required based on the type of targeted body and the sensitivity to small movements72.
WiFi and radio-signal approaches
In the past decade, high frequency and sub-millimetre wavelength radio technologies have demonstrated the ability to capture physiological signals without body contact. The principle is to send a low-energy radio wave towards an individual who is in bed and then to detect the signal bounced back from the body. Through signal processing, it is possible to extract biological information, such as breathing patterns, heart rate and full-body motion from these findings71,73,74,75. These biological signals can be used to determine sleep stages as shown by Zhao et al.76, as well as to monitor insomnia77. The main challenge with this approach is that the signal is subject to a lot of ‘noise’ and the information related to sleep needs to be extracted. Moreover, the measurement conditions are also strongly dependent on the individuals being monitored. In particular, the signal reflects all objects in the bedroom and is affected by the sleeping position of the individual78.
Some of the methods described in this section are, in general, more accurate or more usable than others. Figure 3 shows a scheme of the accuracy versus usability trade-off for the main methods described in this section.
Data collected from different modalities representing diverse physiological information may have varying predictive power and noise topology as explored in Fig. 4. However, different modalities and the information they collect may be highly complementary and, in practice, aggregating sleep data from various sources may make models more robust and tolerant both to noise and missing data. Such complementary fusion protocols have been shown to significantly improve the classification performance of sleep stages79,80.
Sleep data storage and curation
Regardless of its intended end-use, all the data collected using the methods and sensors previously discussed requires appropriate storage, curation and processing prior to analysis. Until the turn of the century, analogue PSG systems, limited to analogue amplifiers and paper tracings, were common practice for storing sleep information. However, with the development of digital recording systems, these types of analogue recordings have become outdated, as different challenges have emerged for handling data from new digital sleep technologies. For example, in the era of digital medicine, systems often require real-time storage and processing of data collected as part the so-called Internet of Things (IoT)81 and Big Data Analytics82. IoT links all sorts of connected devices into comprehensive networks of inter-correlated computing intelligence without with need for human input. With regards to sleep, the integration of IoT technology has several challenges. These include data storage, management and exchange across different devices and sensors, alongside privacy, security and data access concerns.
Cloud computing integration with IoT is gaining traction in healthcare, and is being used for digital sleep applications. For instance, three-layered architectures composed of (1) an IoT layer sensor acquisition/data compilation; (2) a fog computing layer for event processing and (3) a cloud layer for data management and Big Data Analytics have been proposed for sleep monitoring use cases that integrate several sensors83. In Fig. 5, an overview of data acquisition and the movement of information from sensors to the cloud is explored. The remainder of this section discusses the fog computing and cloud storage layer more fully.
Fog computing layer
Fog computing entails data analysis on edge devices, which enables real-time data processing, reducing costs and also improving data privacy. Fog computing is commonly deemed mini-cloud computing, as it performs all the processing locally. The fog computing layer abstracts the heterogeneity of the incoming data formats, communication technologies and protocols from the sleep-sensor IoT layer. Platforms, such as Smart IoT Gateway, have emerged as solutions to communicate with all the heterogeneous IoT sensors potentially deployed in home environments and perform local processing before transmitting the data to the cloud layer84. Fog computing seeks to achieve a seamless continuum of computing services connecting the cloud to the devices (IoT). This contrasts to edge computing which isolates and keeps the computing at the ‘network edges’85 and facilitates the aggregation of multi-modal physiological data from different devices and sensors that are then processed locally (e.g., processing data directly on an IoT Gateway). This architecture can provide near real-time decision-making to support sleep monitoring and intervention.
Following the receipt of signals from the devices, pre-processing at the fog computing layer includes three main operations: (1) the fusion of signals provided by different IoT sensors; (2) detection of periods containing missed data and (3) imputation of missed data. When sleep sensor signals contain missing data, it is usually because the user did not wear or was not in contact with the sensors. However, functional errors can also occur. For example, smartwatches may run out of battery or memory and may fail to communicate with the user’s smartphone. Missing data can be detected by various algorithms, including through simply thresholding the smoothed signal.
Besides data pre-processing, the fog computing layer also enables the inter-operability of heterogeneous sources of the data. Inter-operability is a key function of Smart IoT Gateways. It allows for communication and integration of devices, which are operated on different protocols and use different technologies. Furthermore, the Gateways facilitate the sharing of information and the driving of actuators or components that meet the required needs of the system86. For instance, it can be used to detect sleep apnoea events and activate motors designed to change the users’ body position or to play sounds or music during particular sleep stages87.
Cloud storage layer
Cloud computing architectures include servers, networking, software, databases and data analysis over the internet which enable fast deployment, flexibility and economies of scale. Cloud computing is often considered the centralised paradigm, while the fog computing layer previously described would be a decentralised paradigm. Nevertheless, as explained in Fig. 5, they can effectively work together.
Sensor data integrity is paramount for successful application and analysis in digital medicine and requires appropriate data storage in order to be realised88. Relational databases can be limited when storing and analysing semi-structured data obtained from multi-modal sleep-sensing technologies. Hence, current trends to store and query digital sleep data are based on Not Only SQL (NoSQL) databases such as MongoDB, Cassandra, HBase or CouchDB, which allow for better representation of heterogeneous data structures and batch data. Moreover, several of these NoSQL databases provide connectors to cluster-computing frameworks, such as Apache Spark, Storm, Flink and Hadoop, enabling Big Data Analytics. These Apache products are a good fit for both batch processing and stream processing via in-memory computation and processing optimisation89. Resilient Distributed Dataset (RDD) allows Apache Spark to simultaneously store data on memory and write to storage media based on pre-defined criteria from the real-time data stream. Hadoop allows for batch processing and the use of MapReduce algorithms to analyse data stored in Hadoop Distributed File System (HDFS). HDFS can handle petabyte level data analysis, which can be used to provide in-depth statistical analysis of clinical sleep data and can also be used in large population epidemiology studies.
Before sleep data can be used for modelling, it must be pre-processed. As discussed in the preceding sections, there is a growing trend towards the integration of sleep data from various sensors. As such, there is a preponderance of unstructured multi-modal time-series data with substantial noise. For example, different equipment brands and models may be equipped with different quality of sensors, amplifiers and electrodes that result in different noise topology as a result of their unique materials and manufacturing process. Data measurement, processing and storage may also differ between sensors. For example, depending on the application and device, it might store RR interval, instead of raw ECG. Hence, data need to be cleaned and filtered, removing artefacts that differ depending on the modality employed before any feature extraction or modelling can take place.
Depending on the nature of the data, several pre-processing approaches can be applied. Smoothing and de-noising can remove unwanted spikes, trends and outliers from a signal90. For example, polynomial de-trending methods can remove continuous quadratic or linear trends that may be caused by impedance changes on the skin. Similarly, Hampel filtering can remove unwanted spikes from sinusoidal signals. Noise arising from other sources should also be be considered. This may include power line interference, thermal-based resistive changes or contact conductive artefacts. These noises can be filtered by applying various bandpass filters. The ultimate objective of de-noising is to ensure that the noise is subject to a specific distribution, such as a Gaussian distribution, as far as possible.
Beyond de-noising and smoothing, re-sampling and standardising can be used to improve data integrity and consistency in the pre-processing stages. Linear or higher-order interpolation can be used to fill missing or corrupted data, as well as for data scaling, through methods such as linear scale-transformation91. These methods can suppress the noise levels and variability in the signal and transform the data into a pre-defined range without altering its distribution. Data standardisation, such as min–max standardisation and z-score standardisation, can suppress noise levels and variability in the signal and transform the signal such that it approximates a normal distribution.
Artificial intelligence-based sleep modelling
Once sleep data has been pre-processed, data modelling can be commenced for different applications. Today, many of these modelling and application tasks are based on AI, which entails the use of algorithms and techniques that mimic human cognitive functions, reasoning and problem-solving skills and have brought a paradigm shift to digital medicine. Indeed, the influence of AI in medicine is growing rapidly and is being exploited in a variety of fields from clinical medicine to population studies92. In essence, the application of AI in medicine aims to aid clinical decision-making through analysing complex medical data. The insights generated can then be used in diagnosis, treatment, the prediction of clinical scenarios and to aid scientific discovery93. Increasingly, AI is changing research methodology and facilitating the personalisation of medicine through its advancements92.
With regards to sleep science, the impact of AI is multifaceted. First, it can aid clinicians in making sleep disorder diagnoses94. This is achieved by translating collected sensor data into pre-defined knowledge (e.g., class label), providing an inexpensive and objective alternative to manual sleep stage scoring95. Similarly, through its automated analysis capabilities, AI can provide wellness and lifestyle recommendations based on the interpretation of data collected from wearable devices and mobile apps96,97, enable clinicians and researchers to track changes in sleep patterns from people’s homes98 or interact with smart-home set-ups to provide better quality sleep through the adjustment of lights and temperature in rooms99. Here, we discuss methods of AI-based sleep modelling.
AI applied to sleep science
Traditional AI systems were rule-based, requiring the programming of pre-conceived rule sets and demonstrating limited flexibility. By contrast, machine learning (ML) provides a more flexible alternative to data modelling, especially when applied to the raw unstructured signals. In plain terms, ML aims to train, learn and optimise a mathematical model which can transform or map the collected (complex) signals into comprehensible knowledge.
Usually, ML approaches, which include logistic regression, support vector machines and random forest, tend to use structured data as input. This makes feature engineering or feature extraction a standard procedure before model training. Feature engineering can be achieved in various forms. For example, given a sliding window (from the raw time-series data), statistical features such as mean, standard deviation, energy, entropy and so on, or time–frequency features such as wavelet/Fourier transform coefficients can be extracted and used as input for the traditional ML models. Moreover, in some applications, domain experts can also design features based on their understanding of the signal in certain fields. Compared with the raw signals, the engineered features tend to be low-dimensional with information redundancy suppressed, making the model training tasks more effective.
From a ML perspective, the most common tasks for sleep research are the classification of sleep–wake cycles and stages as well as the derivation of sleep–wake metrics. Although heuristic approaches and some traditional ML approaches have demonstrated reasonable performance in some tasks, the feature engineering process tends to be time-consuming, and may require domain knowledge in some circumstances, making the whole system design an expensive process. On the other hand, the new methodologies offer more flexibility in sleep modelling. For example, deep-learning methods can be used to perform end-to-end training, which directly maps the raw signal into the target labels. It is a pure data-driven process, and latent patterns can be automatically learned without the feature engineering process.
In Table 1, we highlight several popular ML models that can be applied to different sensing modalities.
Conventional sleep classification methods
Following the American Academy of Sleep Medicine (AASM) guidelines, traditional sleep scoring in neurophysiology laboratories assigns 1 of 6 labels to each 30-s epoch. These are as follows: (1) awake; (2) rapid eye movement sleep (REM); (3) non-rapid eye movement (Non-REM); (4) sleep stage 1 (N1); (5) sleep stage 2 (N2) and (6) sleep stage 3 (N3). This task is performed manually by trained sleep technicians based upon data generated through PSG. Sleep stages themselves are associated with physiological changes that are useful for the diagnosis and assessment of specific sleep disorders such narcolepsy100. For example, respiratory monitoring in PSG facilitates the detection of sleep-disordered breathing, such as obstructive sleep apnoea. In this disorder, abnormal breathing events are less severe in N3 than N1 sleep due to the change in central control of breathing, and more severe again during REM given upper airway muscle tone reduction101.
Manual sleep scoring suffers from several drawbacks. It is time-consuming, subject to biases, inconsistent, expensive and must be done offline. Rosenberg et al. reported that the average inter-scorer reliability for sleep stage scoring was approximately 83%102. This estimate is similar to that reported in other studies103. By contrast, the use of AI and automated sleep stage classification algorithms represents a fast, non-subjective, inexpensive and scalable alternative to this traditional sleep-scoring approach. Aside from issues of reliability, it can take 1–2 h for an expert to score a night of clinical PSG recordings104, whilst the automated system can finish the same task in seconds. Thus, multiple approaches and methods have been used to distinguish sleep from wake automatically as well as to characterise specific sleep stages. In broad terms, sleep classification algorithms fall into different categories, but these categories can be closely inter-related, as shown in Fig. 6. The different categories comprise traditional algorithms and both ML and deep-learning approaches. These are elaborated below.
Traditional algorithms for scoring of sleep from either PSG or actigraphy signals tend to be based on heuristic approaches105. These heuristic approaches are themselves based on prior knowledge of the sensing modality and sleep physiology. In actigraphy, the use of the magnitude feature as a proxy of movement for sleep/wake classification provides one example. This approach offers quick solutions with fast implementation and also tends to be biased by the programmer’s understanding and interpretation of the problem and to perform differently depending on the population, in which they are applied. For example, the algorithm developed for a nocturnal sleep pattern may not suitable for non-nocturnal sleep. Penzel et al. provided an in depth review of some of these approaches in clinical settings, offering a quantitative analysis of their performance and requirements106. Palotti et al. evaluated the performance of some of the most common approaches, including statistical ML, on actigraphy data107.
Machine learning and deep learning approaches have gained traction in recent years for the task of classifying sleep–wake cycles and sleep stages in multi-modal sensor data108,109. With the availability of raw actigraphy signals, several deep-learning techniques such as convolutional neural networks110 and recurrent neural networks111 have been used to exploit the temporal nature of this unstructured data to distinguish the sleep–wake cycles107 robustly and understand the role of activity in sleep-related disorders112. Whilst the evaluation of most traditional and ML algorithms are performed using standard quality metrics such as accuracy, precision and recall per class, it is also important to measure clinically relevant metrics such as waking after sleep onset (WASO) and sleep efficiency107. By optimising clinical metrics, ML methods enable the physicians to make informed, clinically relevant decisions. Adequate performance defined by quality metrics varies depending on the task intended. For instance some sleep disorders may not require high levels of granularity for their diagnosis whereas interventions that aim to boost deep sleep ought to rely on accurate granular classifications of sleep stages.
Table 1 provides a holistic overview of the most common classification methods based on the modality used (PSG/EEG, wearable device (accelerometry/actigraphy), others (heart rate/PPG/etc)). References are provided for methods by modality in the appropriate cells. It is important to note that different methods are ought to be used based on the objective at hand. For instance, deep-learning methods often provide better performance than traditional statistical learning methods, but require large computational power and lack the interpretability that other models offer107. Performance and model evaluation is discussed in further detail on the Supplementary Material.
Emerging approaches for sleep classification
There are a plethora of methods available for the predictive modelling of sleep-related problems, as mentioned in previous sections. However, several outstanding questions remain regarding their application. Issues such as model sustainability, handling the heterogeneity of the data and variability in the demographics, behaviour and lifestyle of the population and generalisation to unseen data, need to be investigated more comprehensively. Below, we highlight some of the emerging technological solutions for the handling of these issues.
An important consideration is that the majority of existing ML models perform a task (such as sleep–wake classification and sleep-related disorder prediction) by learning from an underlying distribution of data. However, in real-world conditions, the data generated from participants can change over time due to age, lifestyle changes, new sensing modalities, the progression of sleep/health disorders or other changes. An imperative question then is how to make the trained model sustainable in response to changing domains. Life-long learning might be the first step to address some of these challenges. This would facilitate sustainability by allowing the model to evolve over time113.
Personalised sleep classification
One of the major challenges that AI encounters when facing sleep classification tasks is inter-subject differences. That is, the intra-class variability (e.g., differences in length of REM sleep between participants) can be too large to be captured by the trained model, making inference process prone to errors. By contrast, by taking personal information into account, a human analyst can address this problem easily. In the case of PSG scoring, a skilled neurophysiologist may consider demographic characteristics (such as age and gender) and adjust their scores accordingly. Despite advances in AI methods for sleep classification across different sensing modalities, most of the current models do not adapt to individual characteristics. There may exist large inter-subject variation and the trained model (on the population-level data) may not be the optimised one for certain individuals.
In the future, personalisation could be a useful approach to improving the performance of the AI-based sleep modelling systems, improving the performance of algorithms114,115. It has been suggested that personalisation may be especially useful when using data from noisy modalities, such as wearable devices116. Model personalising has been successfully applied in other fields, such as mood recognition117 and seizure detection118. However, it remains relatively untapped in sleep science. Recent works have shown that transfer learning could be used to realise personalisation. For example, based on EEG modality deep neural networks were trained on a large population, followed by a fine-tuning process at the subject-level116. The results suggested that substantial performance gain can be achieved116.
The process of personalisation can also be applied in the aforementioned distributed networking environment. Federated learning proposes a distributed way of updating a centralised model by aggregating each patient’s local updates into a central server119. The distributed update framework not only provides a model parameter update mechanism but also creates a personalised predictive model by feeding individual data to a global model in the localised updating process.
Generalised sleep classification
Another way of improving the performance of AI-based systems is to reduce the effect of the contextual information for better generalisation120. Based on adversarial training process, some of the most recent works performed subject-invariant learning, which makes the system less sensitive to personal and environmental factors112,121. Similarly, by undergoing an adversarial training procedure, temporal dependencies can be learned. These then transfer well to new subjects and different environments in sleep classification tasks76. Pillay et al. used EEG data in combination with a generative modelling process to obtain agreement between the labels estimated and clinician’s labels for automatic four stage sleep classification in infants67. In general, by learning the representative features that are less sensitive to contextual factors and thus robust in various (complex) sleep classification tasks (such as diagnosing sleep apnoea or insomnia), these approaches aim to increase the generalisation capabilities for better performance. This is an alternative to the aforementioned personalisation approaches.
Data-driven sleep applications
There is a wide and growing range of commercial, health and clinical situations for which data-driven sleep applications are being used. In hospitals, sleep medicine units have traditionally used PSG and more recently actigraphy/accelerometry, for the diagnosis and monitoring of sleep disorders122. One of the main challenges in sleep medicine is the increasing incidence of sleep disorders, which in turn leads to higher demand on sleep labs to provide diagnoses. Consequently, software for sleep medicine is being gradually upgraded to include automated sleep-metric calculations and seamless integration of sleep data sources, such as sleep questionnaires. These upgrades have the potential to compliment Electronic Health Records, enabling healthcare practitioners to better manage their patients sleep disorders123. Figure 7 gives a brief overview of key areas that will be affected by the impact of sleep technologies and newly generated sleep data.
Sleep data in health and disease
As discussed, disturbed sleep has been linked to reductions in quality of life and to a higher risk of a plethora of chronic conditions124,125. Thus, it is of vital importance for digital self-management and monitoring solutions to include tools that allow accurate monitoring and assessment of sleep quality. Aside from its direct role in ill-health, poor sleep quality can worsen the symptoms of many serious and chronic conditions, including cancer and multiple sclerosis126,127,128. Moreover, pharmacological treatments may in turn worsen sleep disorders as side effects. For example, smoking-cessation drugs and some treatments for cancer have been shown to reduce patients’ sleep quality126,129. Due to the complexity of the relationship between sleep and health, there is a need for the design of digital intervention methods to address the unique requirements of sleep within long-term or chronic conditions. There are early examples of mHealth interventions to improve sleep quality on people with cancer and diabetes, amongst others130,131,132.
Amongst otherwise healthy individuals, there is also an increasing interest in mobile and wearable applications for health and wellness97. Ultimately, it has been proposed that such technologies could be used to direct personalised sleep health recommendations to individual users36. Furthermore, other consumer sleep technologies have gained traction in recent years, and although they still need appropriate clinical evaluation, they could enhance patient–clinician interaction and sleep self-management133. Some of the most common commercial and familiar technologies, such as Fitbit or SleepAsAndroid, offer monitoring and tracking sleep quality. In addition, new sensing technologies, such as those discussed in the sleep data acquisition section, are gaining traction and devices like Beddit have attracted investments from large technology companies134. These monitoring technologies are complemented by applications aimed at improving quality of sleep by supporting a more suited wake timing using approaches such as smart lighting or smart alarms that only ring when the user is in light sleep. Despite their growing popularity, at present, most of these consumer-oriented technologies lack validation and their underlying models change frequently97,133. This fast growing industry needs to be matched by multidisciplinary scientific efforts that evaluate the performance, usability and value proposition of new sleep technologies.
When exploring the impact of the digitisation of sleep on wellness and health promotion, it is also important to mention occupational health applications. Often sleep disorders are the result of lifestyle factors including, for example, prolonged screen time before bed. The resulting poor quality of sleep can feedback to that lifestyle, by reducing productivity. Consequently, corporate and health insurance wellness programmes are starting to offer incentives and personalised coaching to clients and employees, with some initiatives directly promoting sleep quality at the workplace135. For instance, FirstBeat provides a solution for companies that comprises personalised sleep and physical activity monitoring for employees combined with personal face-to-face coaching with the aim of increasing employee health and employment satisfaction136. However, these technologies can also be exploited, as in West Virginia prior to the teacher’s strike, where declining to wear a fitness tracker and meet a certain step count resulted in a $500 penalty annually for their healthcare payments.
Data visualisation and visual analytics
Data visualisation, in general terms, is the graphic representation of data. Abstract data are processed such that they can be represented using visual objects (e.g., points, lines, bars, etc.) ease of interpretation and better understanding. Visualisation relies on human’s high throughput visual perception channel, and the ability to connect data representations to human knowledge and expertise which are not encoded directly in the data137.
Visualising health-related data goes back to the days of paper charts and maps. Since the rise of internet and mobile application, digital displays are ubiquitous and people are now widely educated to read standard graphics representing data. Typically, activity data are presented based on the time component, which is usually visualised using line charts, where the horizontal \(x\)-axis is time. Raw signal visualisation is mainly meaningful for domain experts trained and experienced to interpret complex patterns. Specific patterns can be automatically detected or highlighted on the chart, for instance, when activity levels go above or below a threshold138. Projection techniques are also a popular means of reducing the dimension of high-dimensional data for better visualisation and knowledge generation139,140.
Sleep data visualisation is only meaningful if the resulting visualised data make sense to the end-user, which can be challenging for non-expert users of wearable technology. SleepExplorer is an example of visualisation research aimed at understanding how users can benefit from visualising their own personal sleep data141. SleepExplorer organises a flux of sleep data into sleep structure, guides sleep-tracking activities and highlights connections between sleep and other related factors such as napping, coffee and alcohol intake, as well as mood. Recent studies have analysed behavioural change resulting from techniques implemented in activity trackers and their visualisation, but few studies are focused on sleep142. Ravichandran et al. conducted a study of user’s experience and understanding of sleep metrics provided by sleep sensing devices. Their findings suggest that visual feedback may be helpful to users143.
However, several challenges remain in regards to sleep data visualisation. (1) Scalability: for large-scale historical health data, visualisation requires adapting to large time scales (from minute-level to year-level information) and displaying meaningful data summaries to the user or primary care practitioner. (2) Heterogeneity: the data collected from different devices varies greatly from, for example, GPS location or glucose levels to pictures of food or phone-screen time. This poses a challenge for the visualisation of personal data for patients and for the healthcare professional144,145. (3) Usability: sleep data visualisation should be tailored to end-users and their specific needs146.
Challenges and opportunities
With advances in technology, the volume of physiological and clinical data resources available to biomedical research is expanding147. This includes open-source data from Electronic Health Records, medical image repositories, genomic archives and massive person-generated data from wearable technologies147,148,149. Recently, sleep data repositories, such as Sleepdata.org, have been created to advance the field150. These repositories include multi-modal sleep data (from clinical-grade PSG to actigraphy and questionnaires)150, and are being used to create ML benchmarks107. These developments are crucial for the creation of generalised ML models that can be applied reliably to clinical and commercial settings to further our understanding of the role of sleep in well-being and disease.
Sleep-related technologies are not only useful for monitoring but may also be used to aid intervention. For example, the portability and pervasive use of mobile phones makes them an attractive option for the delivery of interventions and several studies have already shown promising results when using mobile phone platforms for sleep interventions. These interventions include, but are not limited to sleep advice for behavioural change151,152, optimised alarms based on sleep stage153 and sleep tracking and feedback96,154. Furthermore, new sleep technologies may be able to complement or augment current clinical-grade diagnostic tools for sleep disorders. A 2017 review by Shin provides an in depth overview of this area of research as well as the strengths and limitations of the current efforts155.
Despite the potential of technologies and open resources, challenges must be overcome if their potential is to be realised. Their heterogeneity, variability (both between sources and over time) and data quality is, at present, a strong barrier to efficient data reuse. Appropriate analysis also remains a challenge. To overcome this, temporal and source variability of signal repositories must be characterised156,157 and common representation spaces should be defined to exploit shared latent information among data distributions. Indeed, appropriately representing data and metadata originating from different sensors (type, make, version, etc) is critical in order to later harmonise and integrate data from disparate sources as well as for sensor data fusion. Models should adapt their inferences from different data sources and at different points in time.
In addition to data handling and analysis challenges, new sensing technologies require systematic validation158. These validation requirements vary based on the end-use of the technology, and must be held to higher standards if they are to be used in clinical settings158. On a population level, there is a wide and growing interest from the general public in wellness mobile and wearable applications, which in many cases are related to sleep and inform people’s lifestyle decisions and understanding of their health143. Nowadays, there are hundreds of sleep applications and a plethora of wearable devices that claim to track sleep quality159. However, most of those devices have little or no information regarding their reliability and validity, the testing they underwent or how the data is acquired (i.e., sampling rates, pre-processing, etc) and processed160,161. As such, individuals could become concerned or reassured about their sleep based on unreliable data. Further, concerns have been raised about the performance of these devices in populations with chronic conditions and mobility problems162. Whilst this has, to-date, mainly been confined to concern regarding the tracking steps and physical activity, these devices must be tested in a range of populations, in particular, those with sleep problems. Massive usage of consumer-grade sleep tools may also increase individual’s health concerns and have a ripple effect on overstretched healthcare systems133.
Lack of reliability and validity testing also poses several obstacles to the use of data-driven applications in sleep medicine and research. As explained in a 2016 editorial by Wilbanks and Topol163, the lack of transparency in these technologies limits researchers’ capabilities to study any potential bias due to the lack of information on the characteristics of the cohorts. Further, this lack of transparency makes it more difficult for researchers and clinicians to use these devices and mobile applications. Despite some initiatives, such as Apple HealthKit or C3-PRO164, which aim to facilitate data sharing across platforms, these data tend to be highly summarised and in a post-processed state. Summary-level data is not always appropriate for use in academic research or some AI applications, as the processing steps are often not described.
To generate maximum benefit to the end-user or other stakeholders (e.g., hospitals, researchers, public health officials, regulators, industry), there is an increasing need for a safe and effective clinical biomarker ecosystem with algorithmic transparency, inter-operable components and sensors and open interfaces that allow for high integrity measurement systems165. This will allow for the verification and validation of digital biomarkers for sleep health.
Finally, there are data-privacy concerns. Sleep tracking mobile applications and wearable technologies often collect information such as movement, GPS location and sound, which could have potential applications beyond the tracking of sleep. These privacy concerns may be mitigated through the deployment of data-processing functions on the user’s mobile equipment, without requiring server processing166. Similarly, an alternative is to empower users to decide what data they want to send to the server166.
The impact that sleep has on human health is undeniable. Recent advances in sensing technology, big data analytics and AI allow for truly ubiquitous and unobtrusive monitoring of sleep and circadian rhythms. However, challenges remain to realisation of the benefits of this monitoring for individuals, research and clinicans. Here, we introduced the Digital Sleep Framework, a framework outlining the steps required from the multi-modal acquisition of sleep-related data through to its clinical and commercial application and exploring all aspects of this chain. As the number and scope of sleep monitoring technologies continues to grow and the diversity of digital sleep solutions and applications continues to multiply, the need for careful, risk-based product validation has become increasingly important. The heterogeneity of sensors used for the monitoring of sleep–wake cycles and circadian rhythms poses a unique set of challenges for modelling and interpretability. Hence, the identification and standardisation of robust, reproducible digital sleep biomarkers is of paramount importance. Modelling based on these signals must be as free as possible from conscious and unconscious bias and the development of algorithms must be transparent and readily available for all stakeholders.
The digitisation of sleep is likely to have repercussions across industry, healthcare, academia and personal health. With regards to disorders of sleep, reliable and scalable sleep monitoring is set to provide a better understanding of sleep disorder progression and severity. This could facilitate better and earlier diagnosis and decision-making for individual patients, including in instances where individuals need to be progressed to a new treatment. Digitisation may also be used in disease prevention and to provide lifestyle recommendations. Objective ubiquitous monitoring of sleep–wake cycles, combined with multi-modal data inputs reflecting an individual’s physical activity profiles, nutrition, all-day heart rate and genetic information will allow users to receive personalised feedback for health and well-being purposes and disease prevention. New technological advancements will allow for improved sleep coaching interventions that are aimed to improve sleep hygiene or provide with better recovery for example. Furthermore, data generated from these technologies could be used to help monitor the impact of pharmaceutical and post-operative interventions. Similarly, the accrued data gathered from clinical and epidemiological studies, as well as from commercial wearable devices, represents an unparalleled opportunity to deepen our understanding of the role of sleep in well-being and disease.
From the perspective of pharmaceutical companies, there are several benefits to the digitisation of sleep. Wearables offer the potential to deploy sleep monitoring at scale, in large populations that are required for late-phase clinical trials and can be used to provide better and earlier evidence of treatment efficacy in sleep disorders, thus facilitating the progression of promising candidates through trial phases. Further, there are implications for patient centricity. Across diseases, sleep is meaningful to patients and their health. It is therefore important to objectively assess sleep metrics such as sleep quality, WASO or time spent sleeping through quantitative measures, instead of relying on questionnaires. A summary of these metrics is provided in the Supplementary Fig. 1. Low-burden monitoring will facilitate sleep collection in trials and potentially help to increase trial participation and reduce attrition. Moreover, many metrics of sleep are strongly tied to the quality of life, thus, industry may welcome the use of these sensing technologies for post-market surveillance. The added knowledge of a potential positive impact of medicine on patients’ sleep quality may enable better reimbursement rates.
Ultimately, the digitisation of sleep could facilitate a truly personalised sleep monitoring experience, empowering people to improve their sleep92. However, the reproducibility and robustness of novel sleep monitoring and data analysis methods must be addressed prior to their use on large, longitudinal and multi-modal collaborative studies. The impact that these technologies can have on the management and understanding of sleep, as well as the treatment and prevention of sleep disorders, is set to be paradigm-changing. Industry, academic, public policy and clinical stakeholders should collaboratively enable this process of validation to take place, moving a step closer to truly personalised digital health.
In sum, digitisation of sleep and ubiquitous sleep monitoring will have important implications on the characterisation of sleep, diagnostics and therapeutics. Large-scale collection of objective, longitudinal sleep data through unobtrusive sleep sensing devices will facilitate epidemiological studies exploring the impact of sleep on health and disease. Furthermore, these applications will likely expand into sleep health, becoming increasingly accessible to individuals with the potential to empower and enable individuals to understand, manage and change their sleeping habits36.
Schwartz, J. R. L. & Roth, T. Neurophysiology of sleep and wakefulness: basic science and clinical implications. Curr. Neuropharmacol. 6, 367–378 (2008).
Imeri, L. & Opp, M. R. How (and why) the immune system makes us sleep. Nat. Rev. Neurosci. 10, 199–210 (2009).
Dawson, D. & Reid, K. Fatigue, alcohol and performance impairment. Nature 388, 235 (1997).
Bertisch, S. M. et al. Insomnia with objective short sleep duration and risk of incident cardiovascular disease and all-cause mortality: Sleep Heart Health Study. Sleep 41, zsy047 (2018).
Bonnet, M. H. & Arand, D. L. We are chronically sleep deprived. Sleep 18, 908–911 (1995).
Drake, C. L., Roehrs, T., Richardson, G., Walsh, J. K. & Roth, T. Shift work sleep disorder: prevalence and consequences beyond that of symptomatic day workers. Sleep 27, 1453–1462 (2004).
Dement, W. C. & Vaughan, C. C. The Promise of Sleep: A Pioneer in Sleep Medicine Explores the Vital Connection Between Health, Happiness, and a Good Night’s Sleep (Delacorte Press, New York, 1999).
Groeger, J. A., Zijlstra, F. & Dijk, D.-J. Sleep quantity, sleep difficulties and their perceived consequences in a representative sample of some 2000 British adults. J. Sleep. Res. 13, 359–371 (2004).
Hafner, M., Stepanek, M., Taylor, J., Troxel, W. M. & van Stolk, C. Why sleep matters—the economic costs of insufficient sleep: a cross-country comparative analysis. Rand Health Q. 6, 11 (2017).
Hillman, D. R., Murphy, A. S., Antic, R. & Pezzullo, L. The economic cost of sleep disorders. Sleep 29, 299–305 (2006).
Ozminkowski, R. J., Wang, S. & Walsh, J. K. The direct and indirect costs of untreated insomnia in adults in the United States. Sleep 30, 263–273 (2007).
Ohayon, M. et al. National sleep foundation’s sleep quality recommendations: first report. Sleep. Health 3, 6–19 (2017).
Taheri, S. The link between short sleep duration and obesity: we should recommend more sleep to prevent obesity. Arch. Dis. Child. 91, 881–884 (2006).
Awad, K. M., Malhotra, A., Barnet, J. H., Quan, S. F. & Peppard, P. E. Exercise is associated with a reduced incidence of sleep-disordered breathing. Am. J. Med. 125, 485–490 (2012).
St-Onge, M.-P., Mikic, A. & Pietrolungo, C. E. Effects of diet on sleep quality. Adv. Nutr. 7, 938–949 (2016).
Kline, C. E. The bidirectional relationship between exercise and sleep: implications for exercise adherence and sleep improvement. Am. J. Lifestyle Med. 8, 375–379 (2014).
Walker, M. Why We Sleep: The New Science of Sleep and Dreams (Penguin, UK, 2017).
Shan, Z. et al. Sleep duration and risk of type 2 diabetes: a meta-analysis of prospective studies. Diabetes Care 38, 529–537 (2015).
Wulff, K., Gatti, S., Wettstein, J. G. & Foster, R. G. Sleep and circadian rhythm disruption in psychiatric and neurodegenerative disease. Nat. Rev. Neurosci. 11, 589 (2010).
Marshall, N. S. et al. Sleep apnea as an independent risk factor for all-cause mortality: the Busselton Health Study. Sleep 31, 1079–1085 (2008).
Cappuccio, F. P., Cooper, D., D’elia, L., Strazzullo, P. & Miller, M. A. Sleep duration predicts cardiovascular outcomes: a systematic review and meta-analysis of prospective studies. Eur. Heart J. 32, 1484–1492 (2011).
King, C. R. et al. Short sleep duration and incident coronary artery calcification. J. Am. Med. Assoc. 300, 2859–2866 (2008).
Chandola, T., Ferrie, J. E., Perski, A., Akbaraly, T. & Marmot, M. G. The effect of short sleep duration on coronary heart disease risk is greatest among those with sleep disturbance: a prospective study from the Whitehall II Cohort. Sleep 33, 739–744 (2010).
Nagai, M., Hoshide, S. & Kario, K. Sleep duration as a risk factor for cardiovascular disease-a review of the recent literature. Curr. Cardiol. Rev. 6, 54–61 (2010).
Lin, X. et al. Night-shift work increases morbidity of breast cancer and all-cause mortality: a meta-analysis of 16 prospective cohort studies. Sleep. Med. 16, 1381–1387 (2015).
Knutson, K. L., Spiegel, K., Penev, P. & Van Cauter, E. The metabolic consequences of sleep deprivation. Sleep. Med. Rev. 11, 163–178 (2007).
Ju, Y.-E. S., Lucey, B. P. & Holtzman, D. M. Sleep and Alzheimer disease pathology—a bidirectional relationship. Nat. Rev. Neurol. 10, 115–119 (2014).
Spira, A. P., Chen-Edinboro, L. P., Wu, M. N. & Yaffe, K. Impact of sleep on the risk of cognitive decline and dementia. Curr. Opin. psychiatry 27, 478 (2014).
Brown, B. M., Rainey-Smith, S. R., Bucks, R. S., Weinborn, M. & Martins, R. N. Exploring the bi-directional relationship between sleep and beta-amyloid. Curr. Opin. psychiatry 29, 397–401 (2016).
Becker, N. B. et al. Depression and quality of life in older adults: mediation effect of sleep quality. Int. J. Clin. Health Psychol. 18, 8–17 (2018).
Besedovsky, L., Lange, T. & Born, J. Sleep and immune function. Pflügers Arch.-Eur. J. Physiol. 463, 121–137 (2012).
Lu, Y., Tian, N., Yin, J., Shi, Y. & Huang, Z. Association between sleep duration and cancer risk: a meta-analysis of prospective cohort studies. PLoS ONE 8, e74723 (2013).
Blask, D. E. Melatonin, sleep disturbance and cancer risk. Sleep. Med. Rev. 13, 257–264 (2009).
Spiegel, K., Sheridan, J. F. & Van Cauter, E. Effect of sleep deprivation on response to immunizaton. Jama 288, 1471–1472 (2002).
Willetts, M., Hollowell, S., Aslett, L., Holmes, C. & Doherty, A. Statistical machine learning of sleep and physical activity phenotypes from sensor data in 96,220 UK Biobank participants. Sci. Rep. 8, 7961 (2018).
Jaiswal, S. J., Topol, E. J. & Steinhubl, S. R. Digitising the way to better sleep health. Lancet 393, 639 (2019).
Morgenthaler, T. I. et al. Practice parameters for the clinical evaluation and treatment of circadian rhythm sleep disorders. An American Academy of Sleep Medicine report. Sleep 30, 1445–1459 (2007).
Hao, Y. & Foster, R. Wireless body sensor networks for health-monitoring applications. Physiol. Meas. 29, R27–R56 (2008).
Shepard, J. W. et al. History of the development of sleep medicine in the united states. J. Clin. Sleep Med. 1, 61–82 (2005).
Phelps, A. J. et al. An ambulatory polysomnography study of the post-traumatic nightmares of post-traumatic stress Disorder. Sleep, 41. https://doi.org/10.1093/sleep/zsx188 (2018).
Schwichtenberg, A. J., Choe, J., Kellerman, A., Abel, E. A. & Delp, E. J. Pediatric videosomnography: can signal/video processing distinguish sleep and wake states? Front. Pediatr. 6, 158 (2018).
Baltrušaitis, T., Ahuja, C. & Morency, L.-P. Multimodal machine learning: a survey and taxonomy. IEEE Trans. Pattern Anal. Mach. Intell. 41, 423–443 (2018).
Caulfield, B., Reginatto, B. & Slevin, P. Not all sensors are created equal: a framework for evaluating human performance measurement technologies. npj Digital Med. 2, 7 (2019).
Troiano, R. P. et al. Physical activity in the united states measured by accelerometer. Med. Sci. Sports Exerc. 40, 181–188 (2008).
Sadeh, A. The role and validity of actigraphy in sleep medicine: an update. Sleep. Med. Rev. 15, 259–267 (2011).
Martin, J. L. & Hakim, A. D. Wrist actigraphy. Chest 139, 1514–1527 (2011).
Moon, Y. et al. Monitoring gait in multiple sclerosis with novel wearable motion sensors. PLoS ONE 12, e0171346 (2017).
Aggarwal, K., Khadanga, S., Joty, S., Kazaglis, L. & Srivastava, J. A structured learning approach with neural conditional random fields for sleep staging. in 2018 IEEE International Conference on Big Data (Big Data) 1318–1327 (IEEE, 2018). https://www.ieee.org/conferences/publishing/index.html.
Tal, A., Shinar, Z., Shaki, D., Codish, S. & Goldbart, A. Validation of contact-free sleep monitoring device with comparison to polysomnography. J. Clin. Sleep Med. 13, 517–522 (2017).
Paalasmaa, J., Leppakorpi, L. & Partinen, M. Quantifying respiratory variation with force sensor measurements. in 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 2011, 3812–3815 (IEEE, 2011). https://www.ieee.org/conferences/publishing/index.html.
Paalasmaa, J., Toivonen, H. & Partinen, M. Adaptive heartbeat modeling for beat-to-beat heart rate measurement in ballistocardiograms. IEEE J. Biomed. Health Inform. 19, 1945–1952 (2015).
Chow, P., Nagendra, G., Abisheganaden, J. & Wang, Y. Respiratory monitoring using an air-mattress system. Physiol. Meas. 21, 345 (2000).
Chee, Y., Han, J., Youn, J. & Park, K. Air mattress sensor system with balancing tube for unconstrained measurement of respiration and heart beat movements. Physiol. Meas. 26, 413 (2005).
Arlotto, P., Grimaldi, M., Naeck, R. & Ginoux, J.-M. An ultrasonic contactless sensor for breathing monitoring. Sensors 14, 15371–15386 (2014).
Sadek, I., Bellmunt, J., Kodyš, M., Abdulrazak, B. & Mokhtari, M. Novel unobtrusive approach for sleep monitoring using fiber optics in an ambient assisted living platform. in International Conference on Smart Homes and Health Telematics, 48–60 (Springer, 2017).
Chen, Z. et al. Simultaneous measurement of breathing rate and heart rate using a microbend multimode fiber optic sensor. J. Biomed. Opt. 19, 057001 (2014).
Kam, J. W. et al. Systematic comparison between a wireless eeg system with dry electrodes and a wired eeg system with wet electrodes. NeuroImage 184, 119–129 (2019).
Finan, P. H. et al. Validation of a wireless, self-application, ambulatory electroencephalographic sleep monitoring device in healthy volunteers. J. Clin. Sleep Med. 12, 1443–1451 (2016).
Koley, B. & Dey, D. An ensemble system for automatic sleep stage classification using single channel EEG signal. Comput. Biol. Med. 42, 1186–1195 (2012).
Myllymaa, S. et al. Assessment of the suitability of using a forehead EEG electrode set and chin EMG electrodes for sleep staging in polysomnography. J. Sleep Res. 25, 636–645 (2016).
Looney, D., Goverdovsky, V., Rosenzweig, I., Morrell, M. J. & Mandic, D. P. Wearable in-ear encephalography sensor for monitoring sleep. preliminary observations from nap studies. Ann. Am. Thorac. Soc. 13, 2229–2233 (2016).
Mikkelsen, K. B. et al. Machine-learning-derived sleep-wake staging from around-the-ear electroencephalogram outperforms manual scoring and actigraphy. J. Sleep Res. 28, e12786 (2018).
Nakamura, T., Alqurashi, Y. D., Morrell, M. J. & Mandic, D. Hearables: automatic overnight sleep monitoring with standardised in-ear eeg sensor. IEEE Trans. Biomed. Eng. 67, 203–212 (2019).
Wang, F., Li, G., Chen, J., Duan, Y. & Zhang, D. Novel semi-dry electrodes for brain-computer interface applications. J. Neural Eng. 13, 046021 (2016).
Henriksen, A. et al. Using fitness trackers and smartwatches to measure physical activity in research: analysis of consumer wrist-worn wearables. J. Med. Internet Res. 20, e110 (2018).
Borger, J. N., Huber, R. & Ghosh, A. Capturing sleep-wake cycles by using day-to-day smartphone touchscreen interactions. npj Digital Med. 2, 73 (2019).
Hao, T., Xing, G. & Zhou, G. iSleep: unobtrusive sleep quality monitoring using smartphones. in Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems, 4 (ACM, 2013). https://www.acm.org/publications.
Ong, A. A. & Gillespie, M. B. Overview of smartphone applications for sleep analysis. World J. Otorhinolaryngol. - Head. Neck Surg. 2, 45 (2016).
Min, S. D., Yoon, D. J., Yoon, S. W., Yun, Y. H. & Lee, M. A study on a non-contacting respiration signal monitoring system using doppler ultrasound. Med. Biol. Eng. Comput. 45, 1113–1119 (2007).
Shahshahani, A., Bhadra, S. & Zilic, Z. A continuous respiratory monitoring system using ultrasound piezo transducer. in Circuits and Systems (ISCAS), 2018 IEEE International Symposium on, 1–4 (IEEE, 2018). https://www.ieee.org/conferences/publishing/index.html.
Rahman, T. et al. DoppleSleep: a contactless unobtrusive sleep sensing system using short-range Doppler radar. in Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 39–50 (ACM, 2015). https://www.acm.org/publications.
Nijsure, Y. et al. An impulse radio ultrawideband system for contactless noninvasive respiratory monitoring. IEEE Trans. Biomed. Eng. 60, 1509–1517 (2013).
Kaltiokallio, O. J., Yigitler, H., Jäntti, R. & Patwari, N. Non-invasive respiration rate monitoring using a single COTS TX-RX pair. in Proceedings of the 13th International Symposium on Information Processing in Sensor Networks, 59–70 (IEEE Press, 2014). https://www.ieee.org/conferences/publishing/index.html.
Adib, F., Mao, H., Kabelac, Z., Katabi, D. & Miller, R. C. Smart homes that monitor breathing and heart rate. in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 837–846 (ACM, 2015). https://www.acm.org/publications.
Droitcour, A. D., Boric-Lubecke, O. & Kovacs, G. T. Signal-to-noise ratio in Doppler radar system for heart and respiratory rate measurements. IEEE Trans. Microw. Theory Tech. 57, 2498–2507 (2009).
Zhao, M., Yue, S., Katabi, D., Jaakkola, T. S. & Bianchi, M. T. Learning sleep stages from radio signals: a conditional adversarial architecture. in Proceedings of the 34th International Conference on Machine Learning, 4100–4109 (2017). https://www.acm.org/publications.
Hsu, C.-Y. et al. Zero-effort in-home sleep and insomnia monitoring using radio signals. Proc. ACM Interact., Mob., Wearable Ubiquitous Technol. 1, 59 (2017).
Tataraidze, A. et al. Bioradiolocation-based sleep stage classification. in Engineering in Medicine and Biology Society (EMBC), 2016 IEEE 38th Annual International Conference of the, 2839–2842 (IEEE, 2016). https://www.ieee.org/conferences/publishing/index.html.
Nam, Y., Kim, Y. & Lee, J. Sleep monitoring based on a tri-axial accelerometer and a pressure sensor. Sensors 16, 750 (2016).
Radha, M. et al. Sleep stage classification from heart-rate variability using long short-term memory neural networks. Sci. Rep. 9(1), 1–11 (2019).
Yasumoto, K., Yamaguchi, H. & Shigeno, H. Survey of real-time processing technologies of IoT data streams. J. Inf. Process. 24, 195–202 (2016).
Bragazzi, N. L., Guglielmi, O. & Garbarino, S. SleepOMICS: how big data can revolutionize sleep science. Int. J. Environ. Res. Public Health 16, E291 (2019).
Yacchirema, D. C., Sarabia-Jácome, D., Palau, C. E. & Esteve, M. A. Smart system for sleep monitoring by integrating IoT with big data analytics. IEEE Access 6, 35988–36001 (2018).
Chiang, M. & Zhang, T. Fog and IoT: an overview of research opportunities. IEEE Internet Things J. 3, 854–864 (2016).
Yousefpour, A. et al. All one needs to know about fog computing and related edge computing paradigms: a complete survey. J. Syst. Architecture 98, 289–330 (2019).
Aazam, M. & Huh, E.-N. Fog computing and smart gateway based communication for cloud of things. in 2014 International Conference on Future Internet of Things and Cloud, 464–470 (IEEE, 2014). https://www.ieee.org/conferences/publishing/index.html.
Hsieh, Y.-Z. Internet of things pillow detecting sleeping quality. in 2018 1st International Cognitive Cities Conference (IC3), 266–267 (IEEE, 2018). https://www.ieee.org/conferences/publishing/index.html.
Sangat, P., Indrawan-Santiago, M. & Taniar, D. Sensor data management in the cloud: data storage, data ingestion, and data retrieval. Concurr. Comput.: Pract. Exp. 30, e4354 (2018).
Zaharia, M., Chowdhury, M., Franklin, M. J., Shenker, S. & Stoica, I. Spark: cluster computing with working sets. HotCloud 10, 95 (2010).
Van Drongelen, W. Signal Processing for Neuroscientists (Academic Press, 2018).
Devasahayam, S. R. Signals and Systems in Biomedical Engineering: Signal Processing and Physiological Systems Modeling (Springer Science & Business Media, 2012).
Topol, E. J. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 25, 44 (2019).
Ramesh, A., Kambhampati, C., Monson, J. R. & Drew, P. Artificial intelligence in medicine. Ann. R. Coll. Surg. Engl. 86, 334 (2004).
Shahin, M. et al. Deep learning and insomnia: assisting clinicians with their diagnosis. IEEE J. Biomed. Health Inform. 21, 1546–1553 (2017).
Malafeev, A. et al. Automatic human sleep stage scoring using deep. Neural Netw. Front. Neurosci. 12, 781 (2018).
Bauer, J. S. et al. ShutEye: encouraging awareness of healthy sleep recommendations with a mobile, peripheral display. in Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems - CHI ’12, 1401–1410. ACM (ACM Press, 2012). https://www.acm.org/publications.
Choi, Y. K. et al. Smartphone applications to support sleep self-management: review and evaluation. J. Clin. Sleep. Med. 14, 1783–1790 (2018).
Bhat, S. et al. Is there a clinical role for smartphone sleep apps? Comparison of sleep cycle detection by a smartphone application to polysomnography. J. Clin. Sleep. Med. 11, 709–15 (2015).
Majumder, S. et al. Smart homes for elderly healthcare-recent advances and research challenges. Sensors 17, E2496 (2017).
Sateia, M. J. International classification of sleep disorders. Chest 146, 1387–1394 (2014).
Subramanian, S., Hesselbacher, S., Mattewal, A. & Surani, S. Gender and age influence the effects of slow-wave sleep on respiration in patients with obstructive sleep apnea. Sleep Breath. 17, 51–56 (2013).
Rosenberg, R. S. & Van Hout, S. The American academy of sleep medicine inter-scorer reliability program: sleep stage scoring. J. Clin. Sleep Med. 9, 81–87 (2013).
Danker-hopfe, H. et al. Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard. J. Sleep Res. 18, 74–84 (2009).
Biswal, S. et al. Expert-level sleep scoring with deep neural networks. J. Am. Med. Inform. Assoc. 25, 1643–1650 (2018).
Sadeh, A., Sharkey, K. M. & Carskadon, M. A. Activity-based sleep-wake identification: an empirical test of methodological issues. Sleep 17, 201–207 (1994).
Penzel, T. et al. Digital analysis and technical specifications. J. Clin. Sleep Med. 3, 109–120 (2007).
Palotti, J. et al. Benchmark on a large cohort for sleep-wake classification with machine learning techniques. npj Digital Med. 2, 50 (2019).
Yan, R. et al. Multi-modality of polysomnography signals’ fusion for automatic sleep scoring. Biomed. Signal Process. Control 49, 14–23 (2019).
Sano, A. & Picard, R. W. Recognition of sleep dependent memory consolidation with multi-modal sensor data. in 2013 IEEE International Conference on Body Sensor Networks, 1–4 (IEEE, 2013). https://www.ieee.org/conferences/publishing/index.html.
LeCun, Y. et al. Convolutional networks for images, speech, and time series. Handb. Brain Theory Neural Netw. 3361, 1995 (1995).
Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735–1780 (1997).
Aggarwal, K., Joty, S., Fernandez-Luque, L. & Srivastava, J. Adversarial unsupervised representation learning for activity time-series. in Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33, 834–841 (AAAI, 2019).
Chen, Z. & Liu, B. Lifelong machine learning. Synth. Lectures Artif. Intell. Mach. Learn. 10, 1–145 (2016).
Finelli, L. A., Achermann, P. & Borbély, A. A. Individual fingerprints in human sleep EEG topography. Neuropsychopharmacology 25, S57 (2001).
Buckelmüller, J., Landolt, H.-P., Stassen, H. & Achermann, P. Trait-like individual differences in the human sleep electroencephalogram. Neuroscience 138, 351–356 (2006).
Mikkelsen, K. & de Vos, M. Personalizing deep learning models for automatic sleep staging. Preprint at https://arxiv.org/abs/1801.02645 (2018).
Yin, Z., Wang, Y., Liu, L., Zhang, W. & Zhang, J. Cross-subject EEG feature selection for emotion recognition using transfer recursive feature elimination. Front. neurorobotics 11, 19 (2017).
Jiang, Y. et al. Seizure classification from EEG signals using transfer learning, semi-supervised learning and TSK fuzzy system. IEEE Trans. Neural Syst. Rehabilitation Eng. 25, 2270–2284 (2017).
Konečnỳ, J. et al. Federated learning: strategies for improving communication efficiency. Preprint at https://arxiv.org/abs/1610.05492 (2016) (workshop paper at NIPS).
Guan, Y., Li, C. & Roli, F. On reducing the effect of covariate factors in gait recognition: a classifier ensemble method. IEEE Trans. Pattern Anal. Mach. Intell. 37, 1521–1528 (2015).
Pillay, K. et al. Automated EEG sleep staging in the term-age baby using a generative modelling approach. J. Neural Eng. 15, 036004 (2018).
Smith, M. T. et al. Use of actigraphy for the evaluation of sleep disorders and circadian rhythm sleep-wake disorders: an American Academy of Sleep Medicine Clinical Practice Guideline. J. Clin. Sleep Med. 14, 1231–1237 (2018).
Stretch, R. et al. Sleepdb: a clinical and administrative database developed to improve the diagnosis, management and longitudinal tracking of sleep disorders. in A34. Screening, Diagnosis, and Treatment in Sleep Disorders, A1389–A1389 (American Thoracic Society Journals, 2019). https://www.atsjournals.org/doi/abs/10.1164/ajrccm-conference.2019.199.1_MeetingAbstracts.A1389.
Stenholm, S. et al. Sleep duration and sleep disturbances as predictors of healthy and chronic disease–free life expectancy between ages 50 and 75: a pooled analysis of three cohorts. J. Gerontology: Ser. A 74, 204–210 (2018).
Castell, M., Makovski, T., Bocquet, V. & Stranges, S. Sleep duration and multimorbidity in Luxembourg. Results from the European Health Examination Survey. Rev. Épidémiol Santé Publique 66, S414 (2018).
Fox, R. S. et al. Sleep disturbance and cancer-related fatigue symptom cluster in breast cancer patients undergoing chemotherapy. Support. Care Cancer 28, 845–855 (2019).
Jung, D. et al. Longitudinal association of poor sleep quality with chemotherapy-induced nausea and vomiting in patients with breast cancer. Psychosom. Med. 78, 959–965 (2016).
Braley, T. J., Kratz, A. L., Kaplish, N. & Chervin, R. D. Sleep and cognitive function in multiple sclerosis. Sleep 39, 1525–1533 (2016).
Ashare, R. L. et al. Sleep disturbance during smoking cessation: withdrawal or side effect of treatment? J. Smok. Cessat. 12, 63–70 (2017).
Silva, E. H., Lawler, S. & Langbecker, D. The effectiveness of mhealth for self-management in improving pain, psychological distress, fatigue, and sleep in cancer survivors: a systematic review. J. Cancer Survivorship 13, 97–107 (2019).
Palesh, O. et al. Secondary outcomes of a behavioral sleep intervention: a randomized clinical trial. Health Psychol. 38, 196 (2019).
Mussa, B. M., Schauman, M., Kumar, V., Skaria, S. & Abusnana, S. Personalized intervention to improve stress and sleep patterns for glycemic control and weight management in obese Emirati patients with type 2 diabetes: a randomized controlled clinical trial. Diabetes, Metab. Syndr. Obes.: targets Ther. 12, 991 (2019).
Khosla, S. et al. Consumer sleep technology: an American academy of sleep medicine position statement. J. Clin. Sleep Med. 14, 877–880 (2018).
Tuominen, J., Peltola, K., Saaresranta, T. & Valli, K. Sleep parameter assessment accuracy of a consumer home sleep monitoring ballistocardiograph beddit sleep tracker: a validation study. J. Clin. Sleep Med. 15, 483–487 (2019).
de Korte, E. M., Wiezer, N., Janssen, J. H., Vink, P. & Kraaij, W. Evaluating an mHealth app for health and well-being at work: mixed-method qualitative study. JMIR mHealth uHealth 6, e72 (2018).
Sjövall, S. et al. Coping with Stress: Firstbeat Lifestyle Assessments for Family Workers. Ph.D. thesis, Satakunta University of Applied Sciences, Satakunnan ammattikorkeakoulu (2015).
Munzner, T. et al. Visualization Analysis and Design. A.K. Peters visualization series (AK Peters, 2014). http://www.cs.ubc.ca/%7Etmm/vadbook/.
Choi, Y. K. et al. Smartphone applications to support sleep self-management: review and evaluation. J. Clin. Sleep Med. 14, 1783–1790 (2018).
Nonato, L. G. & Aupetit, M. Multidimensional projection for visual analytics: linking techniques with distortions, tasks, and layout enrichment. IEEE Trans. Vis. Comput. Graph. 25, 2650–2673 (2019).
Fuster-Garcia, E., Bresó, A., Miranda, J. M. & García-Gómez, J. M. Actigraphy Pattern Analysis for Outpatient Monitoring. In Data Mining in Clinical Medicine, Ch 1, 3–17 (Humana Press, New York, NY, 2015).
Liang, Z. et al. Sleepexplorer: a visualization tool to make sense of correlations between personal sleep data and contextual factors. Pers. Ubiquit. Comput. 20, 985–1000 (2016).
Duncan, M. et al. Activity trackers implement different behavior change techniques for activity, sleep, and sedentary behaviors. Interact. J. Med. Res. 6, e13 (2017).
Ravichandran, R., Sien, S.-W., Patel, S. N., Kientz, J. A. & Pina, L. R. Making sense of sleep sensors: how sleep sensing technologies support and undermine sleep health. in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI’17, 6864–6875 (ACM, New York, NY, USA, 2017). https://www.acm.org/publications.
IEEE. IEEE VIS 2015 Workshop on Personal Visualization: Exploring Data in Everyday Life. https://www.vis4me.com/personalvis15/papers.html (2015).
Ryokai, K., Michahelles, F., Kritzler, M. & Syed, S. Communicating and interpreting wearable sensor data with health coaches. in 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), 221–224 (2015).
Khairat, S. S. et al. The impact of visualization dashboards on quality of care and clinician satisfaction: integrative literature review. JMIR Hum. Factors 5, e22 (2018).
Gewin, V. Data sharing: an open mind on open data. Nature 529, 117–119 (2016).
Dinov, I. D. Methodological challenges and analytic opportunities for modeling and interpreting big healthcare data. GigaScience 5, 12 (2016).
Turakhia, M. P. et al. Rationale and design of a large-scale, app-based study to identify cardiac arrhythmias using a smartwatch: the Apple Heart Study. Am. Heart J. 207, 66–75 (2019).
Dean, D. A. et al. Scaling up scientific discovery in sleep medicine: the national sleep research resource. Sleep 39, 1151–1164 (2016).
Lichstein, K. L. et al. Telehealth cognitive behavior therapy for co-occurring insomnia and depression symptoms in older adults. J. Clin. Psychol. 69, 1056–1065 (2013).
Holmqvist, M., Vincent, N. & Walsh, K. Web-vs telehealth-based delivery of cognitive behavioral therapy for insomnia: a randomized controlled trial. Sleep. Med. 15, 187–195 (2014).
van Drongelen, A. et al. Evaluation of an mhealth intervention aiming to improve health-related behavior and sleep and reduce fatigue among airline pilots. Scand. J. work, Environ. Health 40, 557–568 (2014).
Babson, K. A., Ramo, D. E., Baldini, L., Vandrey, R. & Bonn-Miller, M. O. Mobile app-delivered cognitive behavioral therapy for insomnia: feasibility and initial efficacy among veterans with cannabis use disorders. JMIR Res. Protoc. 4, e87 (2015).
Shin, J. C., Kim, J. & Grigsby-Toussaint, D. Mobile phone interventions for sleep disorders and sleep quality: systematic review. JMIR mHealth uHealth 5, e131 (2017).
Sáez, C. & García-Gómez, J. M. Kinematics of big biomedical data to characterize temporal variability and seasonality of data repositories: functional data analysis of data temporal evolution over non-parametric statistical manifolds. Int. J. Med. Inform. 119, 109–124 (2018).
Sáez, C., Robles, M. & García-Gómez, J. M. Stability metrics for multi-source biomedical data based on simplicial projections from probability distribution distances. Stat. Methods Med. Res. 26, 312–336 (2017).
Mathews, S. C. et al. Digital health: a path to validation. npj Digital Med. 2, 38 (2019).
Grigsby-Toussaint, D. S. et al. Sleep apps and behavioral constructs: a content analysis. Preventive Med. Rep. 6, 126–129 (2017).
Fino, E. & Mazzetti, M. Monitoring healthy and disturbed sleep through smartphone applications: a review of experimental evidence. Sleep Breath. 23, 13–24 (2018).
Piwek, L., Ellis, D. A., Andrews, S. & Joinson, A. The rise of consumer health wearables: promises and barriers. PLoS Med. 13, e1001953 (2016).
Lauritzen, J., Munoz, A., Luis, J. S. & Civit, A. The usefulness of activity trackers in elderly with reduced mobility: a case study. Stud. Health Technol. Inform. 192, 759–762 (2013).
Wilbanks, J. T. & Topol, E. J. Stop the privatization of health data. Nat. N. 535, 345 (2016).
Pfiffner, P. B., Pinyol, I., Natter, M. D. & Mandl, K. D. C3-PRO: connecting researchkit to the health system using i2b2 and FHIR. PLoS ONE 11, e0152722 (2016).
Coravos, A., Khozin, S. & Mandl, K. D. Developing and adopting safe and effective digital biomarkers to improve patient outcomes. npj Digital Med. 2, 14 (2019).
Kay, M. et al. Lullaby: a capture and access system for understanding the sleep environment. in Proceedings of the 2012 ACM Conference on Ubiquitous Computing, 226–234 (organization ACM, 2012). https://www.acm.org/publications.
Zhang, Y. et al. A comparison study on multidomain EEG features for sleep stage classification. Comput. Intell. Neurosci. 2017, 4574079 (2017).
Giannakeas Biomed Sci, N. J. & Res, T. EEG-based automatic sleep stage classification. Biomed. J. Sci. Tech. Res. 5 (2018). https://biomedres.us/pdfs/BJSTR.MS.ID.001535.pdf.
Park, J., Kim, D., Yang, C. & Ko, H. SVM based dynamic classifier for sleep disorder monitoring wearable device. in 2016 IEEE International Conference on Consumer Electronics (ICCE), 309–310 (IEEE, 2016). https://www.ieee.org/conferences/publishing/index.html.
Pan, S.-T., Kuo, C.-E., Zeng, J.-H. & Liang, S.-F. A transition-constrained discrete hidden Markov model for automatic sleep staging. Biomed. Eng. Online 11, 52 (2012).
Huang, Q. et al. Hidden Markov models for monitoring circadian rhythmicity in telemetric activity data. J. R. Soc., Interface 15, 20170885 (2018).
Yílmaz, B., Asyalí, M. H., Aríkan, E., Yetkin, S. & Özgen, F. Sleep stage and obstructive apneaic epoch classification using single-lead ecg. Biomed. Eng. Online 9, 39 (2010).
Khalighi, S., Sousa, T. & Nunes, U. Adaptive automatic sleep stage classification under covariate shift. in 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 2012, 2259–2262 (IEEE, 2012). https://www.ieee.org/conferences/publishing/index.html.
Fonseca, P., den Teuling, N., Long, X. & Aarts, R. M. A comparison of probabilistic classifiers for sleep stage classification. Physiol. Meas. 39, 055001 (2018).
Lajnef, T. et al. Learning machines and sleeping brains: automatic sleep stage classification using decision-tree multi-class support vector machines. J. Neurosci. Methods 250, 94–105 (2015).
Samy, L., Huang, M.-C., Liu, J. J., Xu, W. & Sarrafzadeh, M. Unobtrusive sleep stage identification using a pressure-sensitive bed sheet. IEEE Sens. J. 14, 2092–2101 (2013).
Hassan, A. R. & Bhuiyan, M. I. H. Automatic sleep scoring using statistical features in the emd domain and ensemble methods. Biocybern. Biomed. Eng. 36, 248–255 (2016).
Hassan, A. R., Bashar, S. K. & Bhuiyan, M. I. H. On the classification of sleep states by means of statistical and spectral features from single channel electroencephalogram. in 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI), 2238–2243 (IEEE, 2015). https://www.ieee.org/conferences/publishing/index.html.
Radha, M., Garcia-Molina, G., Poel, M. & Tononi, G. Comparison of feature and classifier algorithms for online automatic sleep staging based on a single EEG signal. in 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 1876–1880 (IEEE, 2014). https://www.ieee.org/conferences/publishing/index.html.
Reimer, U., Emmenegger, S., Maier, E., Zhang, Z. & Khatami, R. Recognizing sleep stages with wearable sensors in everyday settings. In Proceedings of the 3rd International Conference on Information and Communication Technologies for Ageing Well and e-Health ICT4AgeingWell, Vol. 1, 172–179 (SciTePress, 2017).
Pouyan, M. B., Nourani, M. & Pompeo, M. Sleep state classification using pressure sensor mats. in 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 1207–1210 (IEEE, 2015). https://www.ieee.org/conferences/publishing/index.html.
Wang, Q., Zhao, D., Wang, Y. & Hou, X. Ensemble learning algorithm based on multi-parameters for sleep staging. Med. Biol. Eng. Comput. 57, 1693–1707 (2019).
Na, S., Xumin, L. & Yong, G. Research on k-means clustering algorithm: an improved k-means clustering algorithm. in 2010 Third International Symposium on Intelligent Information Technology and Security Informatics, 63–67 (IEEE, 2010). https://www.ieee.org/conferences/publishing/index.html.
Acharya, U. R., Chua, E. C.-P., Chua, K. C., Min, L. C. & Tamura, T. Analysis and automatic identification of sleep stages using higher order spectra. Int. J. Neural Syst. 20, 509–521 (2010).
Tsinalis, O., Matthews, P.M., Guo, Y. & Zafeiriou, S. Automatic sleep stage scoring with single-channel EEG using convolutional neural networks. Preprint at https://arxiv.org/abs/1610.01683 (2016).
Biswal, S. et al. Sleepnet: automated sleep staging system via deep learning. Preprint at http://arxiv.org/abs/1707.08262 (2017).
Zhang, X. et al. Sleep stage classification based on multi-level feature learning and recurrent neural networks via wearable device. Comput. Biol. Med. 103, 71–81 (2018).
Chen, W. et al. Multimodal ambulatory sleep detection. in 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), 465–468 (IEEE, 2017). https://www.ieee.org/conferences/publishing/index.html.
Dursun, M., Gunes, S., Ozsen, S., & Yosunkaya, S. Comparison of artificial immune clustering with fuzzy c-means clustering in the sleep stage classification problem. in 2012 International Symposium on Innovations in Intelligent Systems and Applications, 1–4 (IEEE, 2012).
Correa, A. G. & Leber, E. L. An automatic detector of drowsiness based on spectral analysis and wavelet decomposition of eeg records. in 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, 1405–1408 (IEEE, 2010).
Sazonov, E., Sazonova, N., Schuckers, S. & Neuman, M., CHIME Study Group. Activity-based sleep-wake identification in infants. Physiol. Meas. 25, 1291–1304 (2004).
Oakley, N. Validation with polysomnography of the sleepwatch sleep/wake scoring algorithm used by the actiwatch activity monitoring system. Technical Report to Mini Mitter Co, Inc. (1997).
Cole, R. J., Kripke, D. F., Gruen, W., Mullaney, D. J. & Gillin, J. C. Automatic sleep/wake identification from wrist activity. Sleep 15, 461–469 (1992).
Webster, J. B., Kripke, D. F., Messin, S., Mullaney, D. J. & Wyborney, G. An activity-based sleep monitor system for ambulatory use. Sleep 5, 389–399 (1982).
Jean-Louis, G. et al. Determination of sleep and wakefulness with the actigraph data analysis software (ADAS). Sleep 19, 739–743 (1996).
Kripke, D. F. et al. Wrist actigraphic scoring for sleep laboratory patients: algorithm development. J. Sleep Res. 19, 612–619 (2010).
The publication of this open access article was funded by the Qatar National Library. We would like to thank Valentin Hamy and Luis Garcia-Gancedo from GlaxoSmithKline (GSK) for their insightful comments regarding the impact of the digitisation of sleep in industry. We would also like to thank Emma Clifton for her insightful comments on the implications of new sleep-sensing technology in the field of epidemiology.
L.F. is a shareholder of Salumedia, a digital health company that provides mHealth solutions for patient empowerment. The remaining authors declare no competing interests.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Perez-Pozuelo, I., Zhai, B., Palotti, J. et al. The future of sleep health: a data-driven revolution in sleep science and medicine. npj Digit. Med. 3, 42 (2020). https://doi.org/10.1038/s41746-020-0244-4
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (2020)