Article | Open

The interrelated effect of sleep and learning in dogs (Canis familiaris); an EEG and behavioural study

  • Scientific Reports 7, Article number: 41873 (2017)
  • doi:10.1038/srep41873
  • Download Citation
Published online:


The active role of sleep in memory consolidation is still debated, and due to a large between-species variation, the investigation of a wide range of different animal species (besides humans and laboratory rodents) is necessary. The present study applied a fully non-invasive methodology to study sleep and memory in domestic dogs, a species proven to be a good model of human awake behaviours. Polysomnography recordings performed following a command learning task provide evidence that learning has an effect on dogs’ sleep EEG spectrum. Furthermore, spectral features of the EEG were related to post-sleep performance improvement. Testing an additional group of dogs in the command learning task revealed that sleep or awake activity during the retention interval has both short- and long-term effects. This is the first evidence to show that dogs’ human-analogue social learning skills might be related to sleep-dependent memory consolidation.


Sleep is a fundamental, but compared to the awake processes often neglected, behavioural state present in almost all vertebrate species1. Despite the intertwined nature of sleep and awake states2, and the widely accepted notion that sleep has a vital function, there is still no general, unifying and quantitative theory of sleep, which explains the origins, features, mechanisms and functions in a detailed model3. One of the most studied, and yet debated4 functions of sleep is memory consolidation5 but evidence for this theory comes exclusively from human and laboratory rodent data, except for some results on arthropods6. Variation exists in the nature and the amount of sleep found in non-human species, and these variations suggest that functions of sleep may differ across species2, calling for the integration of human and laboratory rodent research into a wider set of results from different animal species7. In an effort to widen the framework to study both the general features and functions of vertebrate sleep8, here we investigate the relationship between sleep and memory in domestic dogs. Although extensive research has been carried out on dogs’ sleep EEG with ‘traditional’ invasive methods9,10,11,12, which mostly focused on neurological conditions such as epilepsy13,14 and narcolepsy15, this species has not been used previously to study the function of sleep in a way directly comparable to that of human studies. Dogs are one of the most interesting model species in comparative cognition research due their human-analogue social skills16,17 and their approximately 18–32 thousand years of domestication history18, during which they have adapted in evolutionary terms to the same environmental challenges as humans.

A non-invasive canine polysomnography method was developed for dogs19, and used here to investigate the differences in sleep EEG spectrum following a command learning (CL), and a non-learning (NL) task, respectively. Fifteen dogs participated in two polysomnography recordings (3-hour-long each), that immediately followed either CL, during which they had to associate unknown commands (unfamiliar words) to already known actions (sit and lie down), or NL, during which they were required to perform the same two actions after the usual (known) commands, in the very same way as in the CL task (see Experimental Procedures). After an initial adaptation session (where the polysomnography recording was not preceded by behavioural pre-treatment), dogs participated in both CL and NL conditions on two subsequent days in a counterbalanced order. Polysomnography recordings after the CL condition were followed by a post-sleep re-test session with the newly learned commands, in order to asses any change in the dogs’ performance, and its relation to sleep EEG spectrum. Importantly, this task allowed for the investigation of reward-related memory processing20, while current evidence for memory consolidation in non-human species mainly comes from aversive conditioning.

Results and Discussion

The effect of learning on sleep physiology

The relative EEG spectrum (proportion of total power) was first calculated for 4 Hz frequency ranges. This showed a redistribution of EEG power in a way that Non-REM sleep delta (1–4 Hz) activity increased (t(14) = 2.943, p = 0.011), while alpha (8–12 Hz) activity decreased (t(14) = 2.225, p = 0.043), after the learning task. The decrease in theta (4–8 Hz) activity was not significant (t(14) = 1.926, p = 0.075), and no difference was found in beta (12–30 Hz) activity (t(14) = 1.311, p = 0.211). The bin-by-bin (0.25 Hz resolution) analysis revealed that the relative delta activity increase occurred in the 1–1.5 and 2.75–3.25 Hz frequency ranges. There was a significant relative decrease in the 5–5.75 Hz (theta) range and in the 7–10.25 Hz (alpha) range (Fig. 1i). During REM sleep relative theta (4–8 Hz) activity increased after learning (t(10) = 3.130, p = 0.011), while the relative decrease in delta (1–4 Hz) activity was not significant (t(10) = 1.898, p = 0.087). No effect of learning on REM sleep EEG alpha (8–12 Hz; t(10) = 0.539, p = 0.602), or beta (12–30 Hz; t(10) = 1.305, p = 0.221) activity was found. According to the bin-by-bin analysis, there was a significant relative decrease in the 1.5–2 Hz (delta) frequency range after learning during REM sleep, while the relative increase in the 3.5–4 Hz (delta) frequency did not remain significant after correction for multiple comparisons. No significant bin-wise differences were found in the theta, alpha and beta ranges during REM sleep (Fig. 1ii). Spectral changes during Non-REM and REM sleep (when examining the difference between CL and NL conditions), were found to be related to each other in the theta range (pooled data, 4–8 Hz; r = −0.613, p = 0.045), but no such relationship was found for the other ranges (delta, alpha, beta; all p > 0.1). Within both sleep stages the change in slow activity (delta, 1–4 Hz), was negatively related to the change in fast activity (Non-REM alpha: r = −0.890, p < 0.001; beta: r = −0.730, p = 0.002; REM beta: r = −0.793, p = 0.004). Learning did not affect sleep macrostructure (see Supplemental Results), contrary to our expectations, but in line with some human studies, where similarly to our findings no differences were found between learning and non-learning conditions, regarding the time spent in different sleep stages21.

Figure 1
Figure 1

Relative power spectra (proportion of total power) for (i). Non-REM and (ii). REM sleep, following the command learning and the non-learning task. Bin-by-bin data (mean ± SE for the N = 15 participating dogs) are shown on a logarithmic scale for both Non-REM and REM sleep.

Behavioural data showed that subjects’ performance significantly increased after the 3-hour-long polysomnography recording compared to the pre-sleep baseline (t(14) = 3.833, p = 0.002), although the performance increase was not related to sleep duration or any of the macrostructural variables (see Supplemental Results). However, evidence was found for a correlation between performance improvement and relative EEG spectrum power. Decreased REM sleep delta (1–4 Hz) activity (Pearson correlation; r = −0.683, p = 0.01), as well as increased REM sleep beta (12–30 Hz) activity (r = 0.536, p = 0.05), were related to higher performance (Fig. 2). There was no significant correlation of performance improvement with theta or alpha activity during REM sleep, or with any of the frequency ranges during Non-REM sleep.

Figure 2: Relationship between performance improvement (the relative difference between pre-sleep and post-sleep performance) in the learning task, and relative delta power (left) as well as beta power (right) during post-learning REM sleep.
Figure 2

These results provide the first evidence that learning new commands influences sleep EEG spectrum in dogs, and that the EEG spectrum during sleep is predictive of memory performance. Although “memory” is often used as a unitary term in the literature, it is not a single entity, and while in the case of humans there is a widely accepted distinction between declarative and non-declarative memory, we know little about how learning in non-human species fits into these categories. Our results suggest that command learning in dogs influences both REM and non-REM sleep, with the former being traditionally associated with non-declarative and the latter with declarative memory consolidation22. During non-REM sleep an increased delta power was found after learning, which is consistent with human data23,24.

Theta activity is typically thought to be implicated in many aspects of memory processing and consolidation, mostly due to the neuronal re-play of memories in the hippocampus during REM sleep25, but the direction of this relationship is controversial (e.g. in humans, learning of word pairs was reported to enhance theta activity during REM sleep26, however, mice exhibited reduced REM sleep theta activity after fear conditioning27). The present study also provided inconsistent results in the case of dogs, with some indications for increased theta activity during REM sleep after learning, and also reduced theta activity during non-REM sleep. However, these two changes were found to be functionally related, that is in line with the predictions of the two-stage model suggesting that subsequent occurrence of non-REM and REM sleep is essential for memory consolidation28. A decrease in alpha activity during non-REM sleep was also found, which together with the fact that alpha activity was negatively related to slow wave activity, might signal an increase in sleep depth after learning29.

The effect of sleep and awake activity on learning

Having demonstrated learning-induced changes in sleep EEG spectrum and a relationship between sleep and memory formation in dogs, in the second experiment we aimed to test how post-learning activities (sleep or awake) influenced memory consolidation. A group of task-naïve adult pet dogs (n = 53) participated in the previously described command learning task (CL), during which their learning performance (Baseline) was assessed (see Experimental Procedures). After this, subjects were randomly assigned to four short (1 h) retention interval conditions (RIC) (n = 12–14/group). These either included sleeping, or one of three awake activities of varying physical and mental intensity: on-leash walk (physical activity with minimal cognitive interference), learning an unrelated task (low physical activity with high cognitive interference), playing with a dog toy Kong® while lying on the floor (minimal physical activity, high emotional arousal). Subjects’ performance in response to previously known commands was also assessed in order to control for obedience.

Subjects in the four conditions did not differ in obedience (F(3) = 0.799, p = 0.512), nor in baseline learning performance (F(3) = 1.812, p = 0.157). Subjects were retested on the newly learned commands immediately after the retention interval (Retest), and after one week (Long-term), in order to assess short- and long-term memory effects of the different RICs. A Generalized Linear Mixed Model (Poisson Log; Table 1) showed that, as expected, performance was influenced by the interaction of test occasion (Baseline, Retest, Long-term) × RIC (χ2(4) = 14.435, p = 0.006), suggesting that differential learning patterns emerged as a consequence of the different activities following the initial learning task (Fig. 3).

Table 1: Mean ± SE performance (% of correct trials) of subjects in the different retention interval conditions (RICs).
Figure 3: The differential learning patterns in the four retention interval conditions are revealed in subjects’ performance change (mean ± SE) at the Retest and Long-term occasions compared to Baseline.
Figure 3

Values >0 indicate a performance improvement at the given occasion, while values <0 indicate a decreased performance.

Subjects’ obedience also influenced their performance in interaction with the other two factors (Occasion × RIC × Obedience: χ2(4) = 16.332, p = 0.003; RIC × Obedience: χ2(2) = 9.037, p = 0.011; Fig. S1). The effect of RIC was also significant as a main effect (χ2(2) = 8.020, p = 0.018), but the main effect of test occasion did not reach significance (χ2(2) = 5.860, p = 0.053). The main effect of obedience (χ2(1) = 0.770, p = 0.380) as well as its interaction with test occasion (Occasion × Obedience: χ2(2) = 2.300, p = 0.317) were also non-significant. The pairwise post hoc analysis revealed that in the Sleep condition, despite a tendency towards performance improvement, there was no difference between the post-sleep retest and the baseline (p > 0.05). This result seemingly contradicts the findings of our polysomnography study (see Exp. 1 above), where dogs’ performance increased after 3 hours of sleep, but can probably be attributed to the difference in the length of the retention interval (3 hours vs. 1 hour), as longer sleep durations have been found to yield greater memory improvements in humans30. Future studies should determine the optimal amount of sleep needed to benefit memory and how this might generalize across species.

However, subjects in the Sleep condition did improve in the long run; they performed better when tested on the Long-term occasion compared to both Baseline (p < 0.001) and Retest (p < 0.001). This suggests that memory consolidation after learning occurred during the subjects’ usual night-sleep at home. This is in line with previous findings showing that in the absence of interfering learning experience, sleep does not need to occur immediately after learning for memory consolidation to take place31 but should happen on the same day as the initial training32. Subjects in the Walk condition showed the same learning pattern: there was no difference between Baseline and post-walk Retest (p > 0.05), but the Long-term performance was significantly higher (compared to both Baseline: p < 0.001; and Retest: p < 0.01). This suggests that being awake per se does not interfere with long-term memory formation in dogs. Similar claims have been made for humans33, suggesting that slow EEG oscillations during non-sleep resting state activity (mind-wandering) also facilitates memory consolidation.

Dogs that learned an unrelated task during the retention interval (Learning condition), not only remained at their baseline performance on the Retest occasion (p > 0.05), but also did not improve after a week (Baseline vs. Long-term: p > 0.05), suggesting that an interfering learning experience impedes memory consolidation for the previously learned information. In the Play condition subjects’ performance decreased at Retest compared to Baseline (p < 0.001), which is indicative of emotional arousal having a deteriorative effect. However, subjects in this condition also performed better on the Long-term occasion compared to both Baseline (p < 0.001) and Retest (p < 0.001), suggesting that these subjects also benefited from the at-home night sleep after learning, and that play did not interfere with memory consolidation, but impacted on other domains (e.g. attention), which are necessary for performance during re-test.

The results of these two studies provide the first evidence of the interrelated effect of sleep and learning in dogs, suggesting that a sleep-dependent memory consolidation takes place in this species. Further studies should determine if sleep and memory in dogs is similarly modulated by individual variation, as in the case of humans. For example if age-related changes in sleep-wake pattern12, EEG spectrum19 and memory function34 lead to memory consolidation differences in old dogs. Functional analogies in awake functioning between dogs and humans have already been proposed both at the behavioural35 and neural36 level. Our results open up the possibility that dogs’ human-analogue social learning skills might be related to sleep-dependent memory consolidation.


Ethic statement

Research was carried out in accordance with the Hungarian regulations on animal experimentation and the Guidelines for the use of animals in research described by the Association for the Study Animal Behaviour (ASAB). The Hungarian “Animal Experiments Scientific and Ethical Committee” issued a statement (under the number PE/EA/853–2/2016), approving our experimental protocol by categorizing it as a non-invasive study that causes less pain or suffering than the equivalent of inserting a needle. All owners volunteered to participate in the study.

The effect of learning on sleep physiology

Subjects (N = 15 adult pet dogs, mean age ± SD: 3.67 ± 1.91; 8 males, 7 females; from 9 breeds and 3 mixed breeds), participated in 3-hour-long polysomnography recordings (according to the protocol described in ref. 19), for a total of three occasions (see Table S1). The first occasion was a 3-hour-long adaptation sleep, followed by a command learning (CL) and a non-learning (NL) occasion in a counterbalanced order (on three different days). In CL dogs were taught to perform two already known actions (sit and lie down), using unfamiliar commands (English phrases instead of the familiar Hungarian ones). The training procedure followed a standardized schedule and was concluded with an 18-trial baseline test session (for details see Supplemental Experimental Procedures). In the NL task dogs had to execute the same sequence of “Sit!” and “Lie down!” actions, but the experimenter always used the familiar commands (i.e. the Hungarian phrases for sitting and lying down), accompanied by the familiar hand signals (see Supplemental Experimental Procedures for details). Both the CL and NL tasks were followed by a 3-hour-long polysomnography recording. In the CL occasion, the polysomnography recording was followed by an 18-trial session where the dog had to execute the previously learned English commands (Retest).

Sleep recordings were visually scored according to standard criteria19 in 20 s epochs. Artefact rejection was carried out manually on 4 s epochs before further automatic analyses on all recordings. Average power spectral densities (1 Hz to 30 Hz) were calculated by a mixed-radix Fast Fourier Transformation (FFT) algorithm, applied to the 50% overlapping, Hanning-tapered 4 sec windows of the EEG signal of the Fz-Cz derivation. Relative power spectra were calculated separately for Non-REM and REM sleep for both the CL and NL occasions as proportion of total (1–30 Hz) power. The two conditions were compared with regard to the four frequency ranges of delta (1–4 Hz), theta (4–8 Hz), alpha (8–12 Hz) and beta (12–30 Hz), and additionally a bin-by-bin analysis was carried out on the full (1–30 Hz) spectrum with 0.25 Hz resolution.

Behavioural data was obtained from the learning task; the percent of correct actions was calculated for both the Baseline and the Retest sessions (18 trials each). The difference between the re-test and test sessions (improvement during sleep), was correlated with the relative spectrum in the four frequency ranges of delta (1–4 Hz), theta (4–8 Hz), alpha (8–12 Hz) and beta (12–30 Hz), for both Non-REM and REM sleep.

The effect of sleep and awake activity on learning

Subjects (N = 53 adult pet dogs, mean age ± SD: 3.89 ± 2.59; 22 males, 31 females; from 21 breeds and 25 mixed breeds) participated in the command learning task (CL) described in Exp. 1. The CL was concluded with a 18-trial Baseline test session and followed by a 1-hour-long retention interval (RI) during which dogs participated in one of the following activities according to the condition they were quasi-randomly allocated: (1) sleeping in their owners’ parked car (N = 14); (2) walking around the university campus on leash (N = 14); (3) learning new commands with the owner in 10–minute-long sessions (N = 12); (4) playing with a Kong® (N = 13). After the RI, dogs participated in an 18-trial Retest session as well as an 18-trial Obedience session with the known Hungarian commands. Approximately one week (mean ± SE: 7.64 ± 0.43 days) after the first occasion, dogs returned for another session of 18 trials to assess their long-term memory (Long-term; Table S2).

The percentage of correct actions was coded for the Baseline, Retest, Obedience and Long-term sessions respectively. A Generalized Linear Model (Poisson loglinear) was run with performance as the dependent variable, Occasion (Baseline, Retest, Longterm) and RI condition (Sleep, Walk, Learn, Play) as factors and Obedience as covariate.

Additional Information

How to cite this article: Kis, A. et al. The interrelated effect of sleep and learning in dogs (Canis familiaris); an EEG and behavioural study. Sci. Rep. 7, 41873; doi: 10.1038/srep41873 (2017).

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.


  1. 1.

    Vertebrates that never sleep: implications for sleep’s basic function. Brain Res. Bull. 46, 269–79 (1998).

  2. 2.

    Sleep viewed as a state of adaptive inactivity. Nat. Rev. Neurosci. 10, 747–753 (2009).

  3. 3.

    & A quantitative, theoretical framework for understanding mammalian sleep. Proc. Natl. Acad. Sci. USA 104, 1051–1056 (2007).

  4. 4.

    & Time for the sleep community to take a critical look at the purported role of sleep in memory processing. Sleep 28, 1223–1228 (2005).

  5. 5.

    & The memory function of sleep. Nat. Rev. Neurosci. 11, 114–26 (2010).

  6. 6.

    et al. Context odor presentation during sleep enhances memory in honeybees. Curr. Biol. 25, 2869–2874 (2015).

  7. 7.

    Clues to the functions of mammalian sleep. Nature 437, 1264–71 (2005).

  8. 8.

    Is sleep fundamentally different between mammalian species? Behav. Brain Res. 69, 35–41 (1995).

  9. 9.

    , & Baseline sleep-wake patterns in the pointer dog. Physiol. Behav. 19, 285–291 (1977).

  10. 10.

    , , & Visual and computer-based analysis of 24 h sleep-waking patterns in the dog. Electroencephalogr. Clin. Neuropsychol. 46, 33–48 (1979).

  11. 11.

    et al. Recording of electroencephalograms and electrocardiograms during daytime sleep in trained canines: preparation of the sleeping dogs. Psychiatry Clin. Neurosci. 51, 237–9 (1997).

  12. 12.

    & Age-related changes in sleep-wake rhythm in dog. Behav. Brain Res. 136, 193–9 (2002).

  13. 13.

    & An Electroencephalographic Study of Epilepsy in the Dog. J. Small Anim. Pract. 8, 703–708 (1967).

  14. 14.

    , , & Electroencephalographic examination of epileptic dogs under propofol restraint. Acta Vet. Hung. 60, 309–324 (2012).

  15. 15.

    & Sleep studies on canine narcolepsy: pattern and cycle comparisons between affected and normal dogs. Electroencephalogr. Clin. Neurophysiol. 43, 691–9 (1977).

  16. 16.

    & Human-like social skills in dogs? Trends Cogn. Sci. 9, 439–444 (2005).

  17. 17.

    & What does it take to become ‘best friends’? Evolutionary changes in canine social competence. Trends Cogn. Sci. 17, 287–294 (2013).

  18. 18.

    et al. Ancient DNA Analysis Affirms the Canid from Altai as a Primitive Dog. PLoS One 8, e57754 (2013).

  19. 19.

    et al. Development of a non-invasive polysomnography technique for dogs (Canis familiaris). Physiol. Behav. 130, 149–156 (2014).

  20. 20.

    & The roles of the reward system in sleep and dreaming. Neurosci. Biobehav. Rev. 36, 1934–1951 (2012).

  21. 21.

    , , & Learning-dependent increases in sleep spindle density. J. Neurosci. 22, 6830–4 (2002).

  22. 22.

    The role of sleep in learning and memory. Science (80-). 294, 1048–52 (2001).

  23. 23.

    , , & Local sleep and learning. Nature 430, 78–81 (2004).

  24. 24.

    , , & Boosting slow oscillations during sleep potentiates memory. Nature 444, 610–613 (2006).

  25. 25.

    & Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep. Neuron 29, 145–156 (2001).

  26. 26.

    , & Dissociable learning-dependent changes in REM and non-REM sleep in declarative and procedural memory systems. Behav. Brain Res. 180, 48–61 (2007).

  27. 27.

    & Fear conditioning increases NREM sleep. Behav. Neurosci. 121, 310–23 (2007).

  28. 28.

    & About Sleep’s rome in memory. Physiol. Rev. 93, 681–766 (2013).

  29. 29.

    , , , & Covert waking brain activity reveals instantaneous sleep depth. PLoS One 6, 1–7 (2011).

  30. 30.

    , , , & Visual discrimination task improvement: A multi-step process occurring during sleep. J. Cogn. Neurosci. 12, 246–254 (2000).

  31. 31.

    et al. Daytime sleep condenses the time course of motor memory consolidation. Nat. Neurosci. 10, 1206–1213 (2007).

  32. 32.

    , & Visual discrimination learning requires sleep after training. Nat. Neurosci. 3, 1237–8 (2000).

  33. 33.

    et al. Resting state EEG correlates of memory consolidation. Neurobiol. Learn. Mem. 130, 17–25 (2016).

  34. 34.

    et al. Use of a delayed non-matching to position task to model age-dependent cognitive decline in the dog. Behav. Brain Res. 108, 47–56 (2000).

  35. 35.

    et al. Dogs’ gaze following is tuned to human communicative signals. Curr. Biol. 22, 209–212 (2012).

  36. 36.

    , , , & Voice-sensitive regions in the dog and human brain are revealed by comparative fMRI. Curr. Biol. 24, 574–578 (2014).

Download references


The study was supported by Nestlé−Purina, the Hungarian Scientific Research Fund (OTKA K112138; K115862), the Hungarian Academy of Sciences (F01/031) and János Bolyai Research Scholarship (to PS). We thank Ádám Miklósi for his support and Lisa Wallis for correcting the English of the manuscript.

Author information


  1. Institute of Cognitive Neuroscience and Psychology, Hungarian Academy of Sciences, Budapest, Hungary

    • Anna Kis
    • , Csenge Török
    •  & József Topál
  2. Institute of Behavioural Sciences, Semmelweis University, Budapest, Hungary

    • Sára Szakadát
    •  & Róbert Bódizs
  3. MTA-ELTE Comparative Ethology Research Group, Budapest, Hungary

    • Márta Gácsi
  4. Department of Ethology, Eötvös Loránd University, Budapest, Hungary

    • Márta Gácsi
  5. Department of Ecology Faculty of Veterinary Sciences, Szent István University, Budapest, Hungary

    • Enikő Kovács
  6. Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary

    • Péter Simor
  7. Institute of Psychology, Eötvös Loránd University, Budapest, Hungary

    • Csenge Török
  8. Department of General Psychology, Pázmány Péter Catholic University, Budapest, Hungary.

    • Ferenc Gombos
    •  & Róbert Bódizs


  1. Search for Anna Kis in:

  2. Search for Sára Szakadát in:

  3. Search for Márta Gácsi in:

  4. Search for Enikő Kovács in:

  5. Search for Péter Simor in:

  6. Search for Csenge Török in:

  7. Search for Ferenc Gombos in:

  8. Search for Róbert Bódizs in:

  9. Search for József Topál in:


Conceptualization: A.K., S.S., M.G., P.S., R.B. and J.T.; Methodology: A.K., S.S., M.G. and R.B.; Software for data analysis: F.G.; Investigation: A.K., S.S., E.K. and C.T.; Formal analysis: A.K., S.S., E.K. and C.T.; Resources: R.B. and J.T.; Writing − original draft: A.K.; Writing – Review & Editing: all authors; Visualization: A.K.; Supervision: M.G., P.S., R.B. and J.T.; Project Administration: A.K. and S.S.; Funding Acquisition: A.K., M.G., R.B. and J.T.

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to Anna Kis.

Supplementary information


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Creative Commons BYThis work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit