Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

# Assessing Autonomic Function from Electrodermal Activity and Heart Rate Variability During Cold-Pressor Test and Emotional Challenge

## Abstract

Standard functional assessment of autonomic nervous system (ANS) activity on cardiovascular control relies on spectral analysis of heart rate variability (HRV) series. However, difficulties in obtaining a reliable measure of sympathetic activity from HRV spectra limits the exploitation of sympatho-vagal metrics. On the other hand, measures of electrodermal activity (EDA) have been demonstrated to provide a reliable quantifier of sympathetic dynamics. In this study we propose novel indices of phasic autonomic regulation mechanisms by combining HRV and EDA correlates and thoroughly investigating their time-varying dynamics. HRV and EDA series were gathered from 26 healthy subjects during a cold-pressor test and emotional stimuli. Instantaneous linear and nonlinear (bispectral) estimates of vagal dynamics were obtained from HRV through inhomogeneous point-process models, and combined with a sensitive maker of sympathetic tone from EDA spectral power. A wavelet decomposition analysis was applied to estimate phasic components of the proposed sympatho-vagal indices. Results show significant statistical differences for the proposed indices between the cold-pressor elicitation and previous resting state. Furthermore, an accuracy of 73.08% was achieved for the automatic emotional valence recognition. The proposed nonlinear processing of phasic ANS markers brings novel insights on autonomic functioning that can be exploited in the field of affective computing and psychophysiology.

## Introduction

The sympathetic nervous system (SNS) plays a fundamental role in driving cardiovascular control dynamics together with the other branch of the Autonomic Nervous System (ANS), the parasympathetic nervous system1,2, and includes the regulation of blood pressure, respiration, and heart rate1,3,4. Many sympathetic neurons are part of the central nervous system (CNS) having origins in the thoracic and lumbar regions (T1-L2) in the spinal cord. Most of the sympathetic activity control on cardiovascular functioning is performed through noradrenergic neurons. In case of a drop in arterial pressure during situations such as anger, fear or excitement, the arterial baroreflex senses these changes in blood pressure through the baroreceptors, and the ANS acts to increase the vasoconstriction. As a result, the afferent input to the central autonomic nuclei is decreased, which in turn results in an increase in the sympathetic neural outflow. The resulting sympathetic influences in conjunction with the parasympathetic ones leads to an increase in heart rate, oxygen intake, and the blood supply to the heart and skeletal muscles. The release of epinephrine (adrenaline) and norepinephrine (noradrenaline), as well as the stimulation of sweat glands are also the results of a sympathetic nervous system elicitation2,5. The sympathetic vasodilator nerves in the human skin results from a cholinergic co-transmission, which releases acetylcholine as a primary neurotransmitter. The acetylcholine binds to muscarinic receptors on sweat glands to activate sweating, defining a sympathetic skin response6. An early quantification of the sympathetic activity has been performed through measurement of plasma or urinary norepinephrine. However, these indices may not be reliable due to their low sensitivity and non specific localization of the sympathetic response1. While a standard sympathetic activity measurement in humans refers to the invasive recording of the muscle sympathetic neural activity at the peroneal nerve1,2, non-invasive recordings of Heart Rate Variability (HRV) and Electrodermal activity (EDA) series show functional links with sympathetic and sympathovagal changes1,7,8.

One way to functionally assess the ANS branches is through the spectral analysis of HRV series, whose spectrum has been divided in two main bands of interest: the high frequency (HF) band, comprising oscillations between 0.15 Hz and 0.4 Hz, and the low frequency (LF) band, between 0.04–0.15 Hz. While HF power has been proven to be a reliable metric of vagal cardiac tone, as long as the respiratory frequency is within the HF band, the LF power is known to be influenced by both branches of the ANS3,4,5. Nevertheless, although with several limitations, the LF/HF ratio has been regarded as a measure of sympatho-vagal balance3,4,5. In the literature several attempts have been done to tackle the quantification issues carried by the spectral analysis of HRV3,9,10. Prior attempts employed other quantification methods on either HRV or ECG derived series to assess the prevalence of sympathetic or parasympathetic modulations. Extraction of symbolic indices obtained from short term heart-period variability11 and spectral analysis implementation on spontaneous beat-to-beat variability of RR and QT intervals12 are among them. On the other hand, EDA, linked to the activity of eccrine sweat glands controlled by the sudomotor nerves, has been proven to be a reliable measure of sympathetic activation. This is because the sympathetic nervous system is responsible for controlling the sudomotor activity13,14, and its assessment is based on EDA spectral analysis7,15.

Aiming at improving quantification of the sympatho-vagal balance, in this study we propose to combine EDA and HRV spectral estimates related to sympathetic and parasympathetic activity, respectively. ANS quantifiers from HRV and EDA signals have been exploited in recent studies in various application settings. Reviews of studies aiming at detecting emotional states and proposing automatic early stress recognition system through multimodal measurement of physiological signals (including HRV and EDA) are done in16 and17, respectively. Spectral quantifier of skin conductance, indexing sympathetic activity and high frequency spectral power of HRV, indexing parasympathetic activity have been shown to be useful in the evaluation of effort and/or stress tested during auditory tasks with different difficulty levels18. Moreover, authors in19 observed augmented sympathetic modulation in patients with schizophrenia by assessing the nonlinear coupling between HRV and skin conductance level.

However, the multimodal approaches used in the aforementioned studies have considered the spectral quantifiers of HRV and EDA time series as separate sources of information reflecting ANS changes. In fact, to the best of our knowledge no previous study aimed at investigating the effect of combining the spectral measures from the two time series in ANS dynamics. Moreover, since sympathetic-parasympathetic interplay can effectively be estimated through HRV bispectral analysis20, here we also investigate a proper combination of EDA and HRV bispectral metrics. In fact, the functional analysis of HRV in the frequency domain does not fully characterize the dynamical properties of the ANS activity on cardiovascular control, while HRV nonlinear analysis, especially referring to higher-order spectra, can do so3,4,20,21. Because of the many interactions and feedback mechanisms between sympathetic and vagal activities, cardiac dynamics is deemed to the output of a complex, nonlinear system3,21. Consequently, a dynamical vagal activation concurrent with a sympathetic one may lead to heart rate increase21.

In this study we exploit our recently proposed nonlinear point-process framework20, particularly referring to instantaneous spectral and bispectral HRV analysis. Briefly, this powerful statistical tool embeds the probabilistic generative mechanisms of heartbeat while providing model goodness-of-fit metrics20. The first-order moment of an inverse-Gaussian distribution characterizing a given heartbeat event is parametrized through a linear and nonlinear function of the past events, following a Wiener-Volterra representation with a Laguerre expansion of the kernels20.

Since the hereby proposed sympatho-vagal balance indices combining EDA metrics with HRV spectral and bispectral measures are estimated in a time-varying fashion, we also investigate the low frequency dynamics to capture slow trends and high frequency dynamics which captures the fast dynamical oscillations using a wavelet analysis, thus uncovering indices of dynamical information beyond first-order statistics (the standard average along the time would be equivalent to the study of indices of slow activity exclusively).

We validate the new proposed metrics on two experimental protocols: a standard stress test to evaluate cardiac autonomic function so-called cold-pressor test (CPT), and an emotional elicitation study using high-arousing video clips. Preliminary findings of this research were recently reported in22,23.

The CPT test was selected due to the efficient release of sympathetic neurotransmitters leading to marked vasoconstriction having an indirect effect in baroreflex mediating interactions24,25,26. Prior clinical and experimental studies have demonstrated significant cardiovascular responses to the cold stimuli,27. Specifically, the significant effect of CPT on left ventricular function has been demonstrated in a recent study28. These studies have shown major changes in heart rate and blood pressure during the CPT phase in healthy subjects29, as well as in patients with pathological conditions such as hypertension30, depression31, and anxiety32. Nevertheless, due to methodological limitations results were controversial29,30,31,32.

The emotional elicitation study has been chosen as a paradigmatic application exploiting reliable estimates of sympathovagal activity. Emotional processing, in fact, involves the activity of the so-called central autonomic network (CAN), comprising sympathovagal changes also driven by prefrontal cortex and amygdala functioning33,34. Accordingly, the study of emotional responses at the peripheral level has been widely investigated (see exemplary reviews in35,36,37,38. Nevertheless, reliable and specific ANS markers of emotional states in humans are still missing, possibly because of the non-satisfactory performance of state of the art about ANS metrics. Note that the quantifiers proposed in this study are intended to be included as functional set of ANS correlates of emotional states that can be retrieved noninvasively through wearable systems, in the frame of a nonlinear and non-stationary functional assessment. Methodological details, as well as experimental results and conclusions, follow below.

## Materials and Methods

### Subjects recruitment, experimental protocol, and acquisition set-up

Twenty-six right-handed young healthy volunteers (8 females) from the University of Pisa participated in the study. Subjects did not have any history of neurological and cardiovascular diseases, or alcoholic or smoking habits. They were asked to avoid coffee and alcohol, as well as strenuous exercise, at least 2 hours before the laboratory visit39,40,41. Subjects aged between 21–32 (26 ± 3) with 60–100 kilograms of weight and 160–175 centimeters of height. All participants were screened using Patient Health Questionnaire (PHQ)42. This test intends to exclude the subjects with mental disorders for the experiment since the population under study is healthy control. Therefore, only participants with a PHQ score lower than 5 were included in the study. Valsalva maneuver and breathing holding was forbidden throughout the study. To ensure the hemodynamic stabilization, before the experiment participants were asked to sit in a comfortable chair, while watching a black screen. The experiment comprised two main phases: Cold-Pressor Test (CPT) and affective elicitation phase. The protocol timeline was as follows (see also Fig. 1):

• 4 minutes of resting state

• up to 3 minutes of CPT

• 3 minutes of resting state

• 4 minutes and half of emotional stimuli through videos

• 4 minutes of recovery.

The presentation order of CPT and emotional stimuli was randomized among subjects.

Concerning the CPT, participants were asked to submerge their left hand (i.e, the non-dominant hand) up to wrist into a tank filled of ice and water (crushed ice) with the temperature of 0–4 degrees centigrade for a period of 3 minutes43. The choice of 3 minutes is consistent with the average pain threshold of healthy subjects44. In case a subject could not tolerate this kind of elicitation, they were quickly moved to the next resting phase.

The emotional elicitation phase foresaw video-clips using a video-projector. The well-known Circumplex Model of Affect (CMA)45 was used for the emotional modeling through its valence and arousal dimensions. Valence refers to the pleasantness of the emotional perception, whereas arousal represents the strength of such a perception. In our study, the three categories of video-clips were associated with the following sessions: (1) high arousal and high positive valence, (2) neutral arousal/valence, (3) high arousal and high negative valence. The three categories have the same duration of 1 minute and 30 seconds and the presentation of the clips was randomized among subjects. The experiment ended by asking subjects for a complete self-evaluation of the stimuli through the visual analog scale questionnaire (VAS)46. Throughout the experiment, continuous electrocardiogram (ECG) and EDA signals were acquired using the BIOPAC MP35 device with a sampling rate of 500 Hz for further analyses47. The dedicated modules, ECG100C Electrocardiogram Amplifier and EDA100C Electrodermal Activity Amplifier from BIOPAC inc. were used to acquire the ECG signal and the electrodermal activity, respectively. The ECG100C ECG Amplifier has a noise voltage of 0.1 V (rms) in the bandwidth 0.05–35 Hz, a CMRR of 110 dB, a 16-bit ADC, and an amplitude resolution of 0.4 mV to record the D2 lead ECG signal. Pregelled Ag/AgCl electrodes for the ECG acquisition were placed following the Einthoven triangle configuration. EDA sensors were placed on the distal phalanx of the second and third finger of the dominant hand, imposing a DC voltage of 0.5V.

The RR series, defined as the interval between two successive QRS complexes, were derived by applying the automatic QRS complex detection algorithm on acquired ECG signals48. The technical artifacts due to the errors in R-peak detection algorithm were removed by applying cubic spline interpolation method49. The implementation was performed using Matlab software (R2017b version) and the Kubios HRV software50. The experimental procedure was approved by the “Comitato Etico Regionale per la Sperimentazione Clinica della Regione Toscana”, section “Area Vasta Nord Ovest” - Protocol n. 7803, Registry number 1072, approved on 18 Jan 2018. The recordings were carried out in agreement with the Declaration of Helsinki. Written informed consent was obtained from all subjects.

### Instantaneous estimates of vagal activity from inhomogeneous point-processes for heartbeat dynamics

Full details in this methodological framework are reported in20, referring to the recently proposed nonlinear parametric point-process model continuously characterizing the probabilistic properties of heartbeat events.

Briefly, assuming the history dependence, an inverse-Gaussian probability density function (f(tHtξ(t))), parametrized in its first-order moment (i.e., the instantaneous mean μRR(tHtξ(t))) and the shape parameter $${\xi }_{0}^{a}(t) > 0$$, characterizes each heartbeat event as a function of the history Ht = (ujRRjRRj−1, . . . , RRjM+1), with t the continuous time, j the index of previous R-wave from the ECG, and RRj = uj − uj−1 > 0 the time of successive R-wave events. The time varying parameters are in the vector $$\xi (t)=[{\xi }_{0}^{a}(t),{g}_{0}(t),\{{g}_{1}(i,t)\},\{{g}_{2}(i,j,t)\}]$$, which are estimated through a maximum log-likelihood procedure with Newton-Raphson algorithm20. Note also that this formulation is used to pre-process all heartbeat data to identify and eventually correct errors including peak mis-detection and ectopic beats51.

The first-order moment is defined as a nonlinear Volterra-Wiener autoregressive model:

$$\begin{array}{lll}{\mu }_{RR}(t,{H}_{t},\xi (t)) & = & {{\rm{RR}}}_{\widetilde{N}(t)}+{g}_{0}(t)+\mathop{\sum }\limits_{i=0}^{p}{g}_{1}(i,t)\ {l}_{i}(k)\\ & & +\mathop{\sum }\limits_{i=0}^{q}\mathop{\sum }\limits_{j=0}^{q}{g}_{2}(i,j,t)\ {l}_{i}(k)\ {l}_{j}(k)\end{array}$$
(1)

where

$${l}_{i}(t)=\mathop{\sum }\limits_{n=1}^{\widetilde{N}(t)}{\phi }_{i}(n)({{\rm{RR}}}_{\widetilde{N}(t)-n}-{{\rm{RR}}}_{\widetilde{N}(t)-n-1})$$
(2)

is the output of the Laguerre filters before time t and

$${\phi }_{i}(n)={\alpha }^{\frac{n-i}{2}}{(1-\alpha )}^{\frac{1}{2}}{\sum }_{j=0}^{i}{(-1)}^{j}\left(\genfrac{}{}{0.0pt}{}{k}{j}\right)\left(\genfrac{}{}{0.0pt}{}{i}{j}\right){\alpha }^{i-j}{(1-\alpha )}^{j}$$
(3)

is the ith-order discrete time orthonormal Laguerre function, with (n ≥ 0) and α the discrete-time Laguerre parameter20. Kolmogorov-Smirnov (KS) test and associated KS statistics are employed to calculate the model goodness-of-fit20. The independence of the model-transfomed intervals are tested with the use of Auto-correlation plots20. Through this framework, three levels of quantitative tools defined in the time, spectral, and bispectral domains can be obtained.

Time domain estimates refer to the first-order (μRR(tHtξ(t))) and second-order (σRR(tHtξ(t))) moments of the underlying probability function f(tHtξ(t)) characterizing the heartbeat series at each moment in time20. Spectral quantifiers come from the linear power spectrum estimation Q(ftHtξ(t)), which depends on the linear terms g1(it) and related transformation from the Laguerre space to the Wiener-Volterra input-output terms20. Once estimated, the continuous Q(ftHtξ(t)) can be integrated within the low frequency (LF = 0.05–0.15 Hz) and high frequency (HF = 0.15–0.5 Hz) bands to derive instantaneous sympatho-vagal and vagal estimates, respectively. On the bispectral domain, the bispectrum Bis(f1f2t) is defined from the linear and nonlinear input-output Wiener-Volterra terms, and can be integrated in the LF and HF bands to derive the following quantifiers:

$$LL(t)={\int }_{{f}_{1}={0}^{+}}^{0.15}{\int }_{{f}_{2}={0}^{+}}^{0.15}Bis({f}_{1},{f}_{2},t)d{f}_{1}d{f}_{2}$$
(4)
$$LH(t)={\int }_{{f}_{1}={0}^{+}}^{0.15}{\int }_{{f}_{2}=0.1{5}^{+}}^{0.4}Bis({f}_{1},{f}_{2},t)d{f}_{1}d{f}_{2}$$
(5)
$$HH(t)={\int }_{{f}_{1}=0.1{5}^{+}}^{0.4}{\int }_{{f}_{2}=0.1{5}^{+}}^{0.4}Bis({f}_{1},{f}_{2},t)d{f}_{1}d{f}_{2}$$
(6)

Note that the bispectral quantifier HH has been demonstrated to provide estimates of vagal autonomic outflow52. All the introduced estimates are calculated with a 5 ms time resolution. More details about the formulation of the bispectrum can be found in53.

### Instantaneous estimates of sympathetic activity from EDA

The EDA signal reflects changes in the skin conductance induced by the sweat gland activity, which is directly controlled by the sympathetic branch of the ANS. Therefore, it is possible to rely on EDA signal processing to quantify the sympathetic dynamics through a proper functional analysis in the frequency domain7,15.

Specifically, a normalized EDA series, as a result of a Z-score transformation, is downsampled to 50 Hz. Afterwards, a time-frequency representation of the series is obtained through short-time Fourier transform and Welch periodogram, with a Blackman window of 60s and 59s overlap. Hence, a time-varying estimate of sympathetic outflow EDASymp(k) in k discrete time samples, within the interval (0, T), is obtained by integrating the time-frequency plane within the (0.045–0.25 Hz) band7,15.

Previously, a convex optimization modeling approach has been proposed for the decomposition of the skin conductance measure of EDA54. As the result of this decomposition, low and high frequency components of the skin conductance response (SCR) known as tonic and phasic activities, respectively, are separated. Mainly the SCR has been quantified by calculating the number of significant (above threshold) phasic driver peaks (EDA.nSCR), the sum of SCR amplitudes with respect to significant peaks (EDA.SumAmpSCR), the maximum value of phasic activity (EDA.PhasicMax). The quantification of the tonic component is done through the mean tonic activity computation (EDA.Tonic) as well.

### Proposed instantaneous indices of sympatho-vagal balance and related phasic dynamics

Aiming to derive reliable sympatho-vagal balance estimators, we combined the aforementioned EDASymp(k), taken as a consistent measure of the sympathetic tone, and point-process derived measures from HRV linked to vagal activity, namely spectral power HF and bispectral powers LL, LH, and HH. Specifically, the following sympatho-vagal measures are defined:

$${S}_{HF}(k)=\frac{ED{A}_{Symp}(k)}{H{F}_{pp}(t){| }_{t=k}}$$
(7)
$${S}_{HH}(k)=\frac{ED{A}_{Symp}(k)}{H{H}_{pp}(t){| }_{t=k}}$$
(8)
$${S}_{LH}(k)=\frac{ED{A}_{Symp}(k)}{L{H}_{pp}(t){| }_{t=k}}$$
(9)
$${S}_{LL}(k)=\frac{ED{A}_{Symp}(k)}{L{L}_{pp}(t){| }_{t=k}}$$
(10)

The derivation of sympatho-vagal measures is summarized in Fig. 2. We take a step further characterizing sympatho-vagal balance by (i) decomposing their time-varying dynamics into two components (1) the tonic activity representing a slow trend dynamic and (2) superimposed phasic component known to reflect high frequency oscillations of the time series and (ii) quantifying phasic dynamics using the median and area under the curve (AUC) metrics. Tonic and phasic decomposition of time-varying bispectral estimates LL, LH, and HH is further performed. An exemplary decomposition is shown in Fig. 3. Using a wavelet decomposition procedure55, tonic (Ston) and phasic (Sph) dynamics were derived from the first level of approximation coefficients and fifth level of detail coefficients, respectively, with a Daubechie5 function as the mother wavelet55,56.

### Classification for automatic valence recognition

Features were grouped into six categories. The first category F1 is from HRV measures, including instantaneous point-process estimates defined in the time and frequency domains and standard HRV time domain measures including Root Mean Square of the Successive Differences (RMSSD) and normalized mean number of times an hour in which the change in successive normal sinus (NN) intervals exceeds 50 ms (pNN50). F1 [μRR, $${\sigma }_{RR}^{2}$$, RMSSD, pNN50, LFpp, HFpp, LFpp/HFpp]. The HRV bispectral measures constitute the second feature category F2 [LLpp, LHpp, HHpp]. The third category F3 comprises EDA-related features estimated in the frequency domain F3 [EDASympSHF]. Obtaining the decomposed tonic and phasic driver of SCR constitutes the fourth feature set: F4 [EDA.nSCR, EDA.SumAmpSCR,EDA.PhasicMax, EDA.Tonic]. The fifth category F5 comprises combined (tonic) indices from EDA and HRV bispectral features: F5 [SLL, SLH, SHH]. The sixth category F6 comprises median and AUC quantifiers of combined EDA and HRV bispctral phasic dynamics: $${F}_{{6}_{1}}\equiv$$ Median(Sphasic) and $${F}_{{6}_{2}}\equiv$$ AUC(Sphasic), where Sphasic [LLph, LHph, HHph, $${{S}_{LL}}_{ph}$$, $${{S}_{LH}}_{ph}$$, $${{S}_{HH}}_{ph}$$]. A list of all features used in this study along with the definitions and references from the literature are shown in Table 1.

Time-varying dynamics were averaged within a 90s time window, which corresponds to the duration of either the neutral, pleasant and unpleasant elicitation. In order to minimize the inter-subject variability, for each subject the feature set related to a negative or positive stimulus was normalized by dividing for the value computed during a neutral session. These features were used to automatically classify emotional states associated with negative and positive elicitations through a standard nonlinear Support Vector Machine (SVM) with recursive feature elimination (RFE), which was validated through a Leave-One-Subject-Out (LOSO) procedure. RFE is a wrapper feature selection method that chooses a subset of features with size r among m features (r  <  m) that optimizes the performance of the SVM classifier57,58. The method is based on a backward sequential selection. Particularly, the feature that has the least impact on the SVM weight-vector norm is eliminated for each repetition. Therefore, the features are ranked and the SVM classification is repeated m times while the last ranked features are removed at each iteration. In this study, a recently developed nonlinear SVM-RFE which is an improved version of the previous RFE algorithm is implemented59. This developed method tackles the issue of the correlation bias of the previous method which makes it reliable if the input feature set contains highly correlated features.

The LOSO validation scheme foresees that, at each iteration, the SVM-RFE model is trained using feature samples from N − 1 subjects (where N is the total number of subjects), and tested on the feature samples from the left-out subject. This is iterated N times. Final feature ranking was obtained by summation of the ranks from each iteration.

Classification results are reported in terms of confusion matrix associated with the feature subset giving highest accuracy. Note that diagonal values of this matrix represent sensitivity and specificity of classification, which are defined as the proportion of actual positives and negative valence elicitations that were correctly identified, respectively. The recognition was performed using MATLAB v8.4 and an additional toolbox for classification60. The processing chain of the classification for valence recognition is depicted in Fig. 4.

## Experimental Results

We first report on a comprehensive characterization in the statistical sense of the proposed features performance by comparing resting vs. CPT phases. Given the non-Gaussianity of samples, as revealed by p < 0.05 from Kolmogorov-Smirnov tests with null hypothesis of data Normality, p-values for the Rest vs. CPT comparison are from Wilcoxon non-parametric tests for paired data, with null hypothesis of equal medians between samples. These results aim at ensuring that the phasic dynamics of the proposed linear and nonlinear sympatho-vagal measures carry significant information on ANS changes. Afterwards, we exploit this knowledge in recognizing positive vs. negative valence during the emotional video elicitations by applying the aforementioned SVM-RFE algorithm.

### Results on CPT

Group-wise dynamics for all features are shown in Fig. 5. Results from the Rest vs. CPT statistical comparison are shown in Table 2, where the feature time-varying evolution is expressed as Median ± $$1.4826{\rm{MAD}}(X)/\sqrt{n}$$, (where MAD(X) = Median(X − Median(X)), with X as the feature and n is the number of subjects in group) along the last 30s of rest and the first t s of CPT elicitation (where the t [30, 90, 180]).

Among the F1 feature set (HRV time and frequency domain features), only μRR showed significant differences between rest and CPT for all the selected time windows. Significant differences were found also in HFpp for the 30s and 180s windows. In the F2 feature set (HRV bispectral features), significant differences were found for LLpp at all time windows, as well as for LHpp taking estimates from 180s CPT. Remarkably, significant differences were found for the proposed features in F3 and F5, combining sympathetic EDA with linear and nonlinear vagal dynamics from HRV, but SLL in the 180s time window. Concerning features from phasic dynamics in F6, significant p-values were found for $${{S}_{LL}}_{ph}$$ for the 90s and 180s time windows. However, calculating the AUC of such phasic dynamics, bispectral features showed differences at 90s, whereas the ones from nonlinear sympatho-vagal balance were all different except for $${{S}_{HH}}_{ph}$$ estimated at 30s.

### Valence recognition results

The recognition accuracy as a function of the number of features, ranked through the SVM-RFE procedure, is shown in Fig. 6, whereas the confusion matrix associated with the best classification accuracy is reported in Table 3. This was achieved using four features, namely $${{S}_{LH}}_{ph}$$, LFpp, LHph, and $${{S}_{HH}}_{ph}$$, with a balanced accuracy of 73.08% resulting in 75% and 71.43% of positive predictive value and negative predictive values, respectively.

Note that such most informative features come from spectral power in the LF, as well as from the proposed phasic dynamics of bispectral sympatho-vagal features. The complete feature set used for the classification, ranked through the SVM-RFE procedure, is reported in Table 4. As a comparison the classification results using other feature sets including only the indices extracted from HRV (F1 and F2) and the standard EDA indices (F4) are also reported (Tables 5 and 6, respectively).

## Discussion and Conclusion

In this study we investigated novel ANS metrics linked to sympatho-vagal dynamics by combining EDA and HRV spectral powers, as well as combining EDA spectral power with HRV bispectral power. To this end, while sympathetic estimates were gathered from the electrodermal activity (EDA), vagal estimates were from HRV series. Features from phasic activity series of HRV bispectral power and combined EDA spectra were investigated as well. Preliminary results of this study can be found in22,23.

More in detail, we combined features from EDA power spectra, namely EDASymp, with instantaneous spectral and bispectral features from point-process models for heartbeat dynamics. The choice of a point process framework as a physiologically inspired probabilistic method lies in its uniqueness in parameterizing heartbeat dynamics continuously with any time resolution, without the need of an interpolation method. The quadratic autoregressive nonlinearities allows for the estimation of instantaneous bispectral measures and their decomposed high frequency component, which refers to the superimposed phasic activity. Time-varying information of such instantaneous phasic dynamics was quantified through central tendency (median) and AUC quantifiers. Previous studies accounted for first-and second-order moments exclusively to characterize instantaneous ANS activity7,15,20,61,62,63,64, therefore neglecting effective information from the superimposed phasic dynamics.

We first evaluated the proposed methodology during a paradigmatic ANS elicitation through prolonged cold-pressor test (CPT) in twenty six healthy volunteers. The significant decrease in μRR following the CPT onset is consistent with previous studies (see29 and references therein), and RMSSD and pNN50 also showed a significant decrease in specific time windows. Note that significant p-values were obtained from standard EDA measurements (F4) at all time intervals from the CPT onset, and a delayed response in EDASymp of about 30s from the CPT onset was also observed. We demonstrated that the sympatho-vagal balance can be better characterized by combining spectral and bispectral features derived from HRV with measures computed from EDA spectral analysis. The discriminative power of these measures is proven by the significant p-values associated with all time windows following the CPT onset, whereas the traditional LF/HF ratio was not able to discern CPT dynamics with respect to a previous resting state (Table 2 and Fig. 5).

Considering the 90s time windows from the CPT onset, while the HH did not show significant changes, the HHph(AUC) was associated with a significant p-value. This result confirms the main hypothesis of this study for which relevant information on the ANS activity can be retrieved from the superimposed phasic behavior of HRV time-varying bispectral measures. Furthermore, the proposed new indices characterizing the cardiovascular control through EDA and HRV seem to provide a more effective indicator of the sympathovagal balance then traditional indices from HRV series only7,15,29.

The statistical comparison between the two valence levels showed no significant differences in the proposed feature sets. However, such features allowed to discern between pleasant and unpleasant affective elicitation through an automatic decision support system. Indeed, features associated with a non-significant p-value may provide meaningful information in a machine learning framework. By applying the SVM-RFE algorithm, the discriminant power of the high oscillations of nonlinear bispectral estimates are confirmed with respect to measures obtained from first-order moments only. A balanced accuracy of 73.08% is achieved for a valence recognition through a proper selection of both spectral and higher-order spectral features and their integration with power spectral estimates of EDA and related phasic activations (Table 4). As a comparison analysis, an HRV feature set including indices defined in the time and frequency domains (F1) and related bispectral estimates (F2) was fed to the classifier and an accuracy of 63.43% was obtained (Table 5), with 64% and 62.96% as positive predictive value and negative predictive value, respectively. On the other hand, a 68.48% accuracy with positive and negative predictive values of 65.52% and 71.43%, respectively, was associated with the use of a standard EDA feature set F4 (see Table 6). By comparing results in Tables 1 and 4, we may conclude that the proposed methodology could be a viable approach to integrate HRV and EDA dynamics in case of thermal and emotional elicitations tasks.

The different number of males and females in the dataset is a limitation of this study. Moreover, although the VAS phsychological test scores have proven the strong impact of stimuli in all subjects, there is no gold-standard procedure to evoke a sympathetic elicitation both at a cardiac and at a skin sympathetic outflow level. Furthermore, the emotional responses may not be consistent across the individuals, this increasing the inter-subject variability. However, it is important to remark that we did not aim to develop the most performant emotion recognition system, but rather we aimed to devise a computational method that effectively combines HRV and EDA information to asses autonomic changes during CPT and emotional processing. We performed the cold pressor test to induce changes in the autonomic control of cardiovascular dynamics different than an emotional elicitation task. Indeed, we could have performed other autonomic maneuvers including active and passive postural changes, lower body negative pressure, valsalva maneuver, handgrip test, and others. Moreover, the administration of the cold pressor test may have caused not negligible pain that might have affected the ANS estimates derived from HRV and EDA for further analyses. We are aware that specific lab conditions are required to study complex physiological phenomena related to emotional processing, and a direct translation of the proposed methodology to emotion recognition in ecological conditions may be challenging. Another limitation of this study is that in spite of the fact that the bispectral measure HH can be considered as a reliable index of cardiovascular vagal activity, the integration of LH and LL in the defined frequency bands may contain oscillations originating in the low frequency band which may not be linked to a a sympathetic activity exclusively.

Due to the asymmetric nature of the EDA signals, asymmetrically shaped Daubechies (dbN) wavelets were widely used to analyze the raw waveforms65,66. In our study, db5 (chosen among db1 to db10) was the most appropriate choice of the mother wavelet for a better decomposition of tonic and phasic activities. However, a procedure to select a specific mother wavelet should be carried out in the future. Moreover, although previous studies found a correlation between EDAsymp and sympathetic activity7,15, sympathetic sudomotor nerve activity may be different from the cardiac sympathetic dynamics. Further studies are therefore needed to quantitatively investigate the functional relationship between different sympathetic markers from physiological series.

Despite the mentioned limitations, this study opens new horizons for the study of autonomic control mechanisms and the functional assessment of emotional responses of human. Future work will be directed to the evaluation of the proposed methodology on data gathered during orthostatisc stressors such as head-up tilt, handgrip, and lower body negative pressure, as well as from different patient population with cardiovascular or mental disorders, or autonomic dysfunctions.

## Data availability

The informed consent forms signed by the subjects prevent data from being publicly available. Data may be requested via email by researchers, upon reasonable request and verification of all ethical aspects, at: gaetano.valenza@unipi.it.

## References

1. 1.

Malpas, S. C. Sympathetic nervous system overactivity and its role in the development of cardiovascular disease. Physiological reviews 90, 513–557 (2010).

2. 2.

Charkoudian, N. and Rabbitts, J. A.  Sympathetic neural mechanisms in human cardiovascular health and disease. In Mayo Clinic Proceedings, vol. 84, 822–830 (Elsevier, 2009).

3. 3.

Acharya, U. R., Joseph, K. P., Kannathal, N., Lim, C. M. & Suri, J. S. Heart rate variability: a review. Medical and biological engineering and computing 44, 1031–1051 (2006).

4. 4.

Sassi, R. et al. Advances in heart rate variability signal analysis: joint position statement by the e-cardiology esc working group and the european heart rhythm association co-endorsed by the asia pacific heart rhythm society. Ep Europace 17, 1341–1353 (2015).

5. 5.

Valenza, G., Citi, L., Saul, J. P. and Barbieri, R.  Measures of sympathetic and parasympathetic autonomic outflow from heartbeat dynamics. Journal of Applied Physiology (2018).

6. 6.

Vetrugno, R., Liguori, R., Cortelli, P. & Montagna, P. Sympathetic skin response. Clinical autonomic research 13, 256–270 (2003).

7. 7.

Posada-Quintero, H. F., Florian, J. P., Orjuela-Cañón, Á. D. & Chon, K. H. Highly sensitive index of sympathetic activity based on time-frequency spectral analysis of electrodermal activity. American Journal of Physiology-Regulatory, Integrative and Comparative Physiology 311, R582–R591 (2016).

8. 8.

Schwartz, P. J. & De Ferrari, G. M. Sympathetic-parasympathetic interaction in health and disease: abnormalities and relevance in heart failure. Heart failure reviews 16, 101–107 (2011).

9. 9.

Malliani, A., Lombardi, F. & Pagani, M. Power spectrum analysis of heart rate variability: a tool to explore neural regulatory mechanisms. British heart journal 71, 1 (1994).

10. 10.

Billman, G. E. The lf/hf ratio does not accurately measure cardiac sympatho-vagal balance. Frontiers in physiology 4, 26 (2013).

11. 11.

Porta, A. et al. Assessment of cardiac autonomic modulation during graded head-up tilt by symbolic analysis of heart rate variability. American Journal of Physiology-Heart and Circulatory Physiology 293, H702–H708 (2007).

12. 12.

Porta, A. et al. Autonomic control of heart rate and qt interval variability influences arrhythmic risk in long qt syndrome type 1. Journal of the American College of Cardiology 65, 367–374 (2015).

13. 13.

Boucsein, W.  Electrodermal activity (Springer Science & Business Media, 2012).

14. 14.

Critchley, H. D. Electrodermal responses: what happens in the brain. The Neuroscientist 8, 132–142 (2002).

15. 15.

Posada-Quintero, H. F. et al. Power spectral density analysis of electrodermal activity for sympathetic function assessment. Annals of biomedical engineering 44, 3124–3135 (2016).

16. 16.

Shu, L. et al. A review of emotion recognition using physiological signals. Sensors 18, 2074 (2018).

17. 17.

Alberdi, A., Aztiria, A. & Basarab, A. Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review. Journal of biomedical informatics 59, 49–75 (2016).

18. 18.

Mackersie, C. L. & Calderon-Moultrie, N. Autonomic nervous system reactivity during speech repetition tasks: Heart rate variability and skin conductance. Ear and Hearing 37, 118S–125S (2016).

19. 19.

Rachow, T. et al. Nonlinear relationship between electrodermal activity and heart rate variability in patients with acute schizophrenia. Psychophysiology 48, 1323–1332 (2011).

20. 20.

Valenza, G., Citi, L., Scilingo, E. P. & Barbieri, R. Point-process nonlinear models with laguerre and volterra expansions: Instantaneous assessment of heartbeat dynamics. IEEE Transactions on Signal Processing 61, 2914–2926 (2013).

21. 21.

Sunagawa, K., Kawada, T. & Nakahara, T. Dynamic nonlinear vago-sympathetic interaction in regulating heart rate. Heart and vessels 13, 157–174 (1998).

22. 22.

Ghiasi, S.  et al.  A new sympathovagal balance index from electrodermal activity and instantaneous vagal dynamics: A preliminary cold pressor study. In 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 3068–3071 (IEEE, 2018).

23. 23.

Ghiasi, S.  et al.  Investigating phasic activity of time-varying high-order spectra: A heartbeat dynamics study during cold-pressor test. In 2018 Computing in Cardiology Conference (CinC), vol. 45, 1–4 (IEEE, 2018).

24. 24.

McGinley, J. J. & Friedman, B. H. Autonomic responses to lateralized cold pressor and facial cooling tasks. Psychophysiology 52, 416–424 (2015).

25. 25.

Mourot, L., Bouhaddi, M. & Regnard, J. Effects of the cold pressor test on cardiac autonomic control in normal subjects. Physiological research 58, 83 (2009).

26. 26.

Betti, S.et al.  Evaluation of an integrated system of wearable physiological sensors for stress monitoring in working environments by using biological markers. IEEE Transactions on Biomedical Engineering (2017).

27. 27.

Deuter, C. E. et al. Effects of cold pressor stress on the human startle response. PloS one 7, e49866 (2012).

28. 28.

Elias, S. O. & Ajayi, R. E. Effect of sympathetic autonomic stress from the cold pressor test on left ventricular function in young healthy adults. Physiological reports 7, e13985 (2019).

29. 29.

Peng, R.-C.  et al.  Time-frequency analysis of heart rate variability during the cold pressor test using a time-varying autoregressive model. Physiological measurement  36.

30. 30.

Menkes, M. et al. Cardiovascular reactivity to the cold pressor test as a predictor of hypertension. Hypertension 14, 524–530 (1989).

31. 31.

Hughes, J. W. & Stoney, C. M. Depressed mood is related to high-frequency heart rate variability during stressors. Psychosomatic medicine 62, 796–803 (2000).

32. 32.

Dodo, N. & Hashimoto, R. The effect of anxiety sensitivity on psychological and biological variables during the cold pressor test. Autonomic Neuroscience: Basic and Clinical 205, 72–76 (2017).

33. 33.

Ruiz-Padial, E., Vila, J. & Thayer, J. F. The effect of conscious and non-conscious presentation of biologically relevant emotion pictures on emotion modulated startle and phasic heart rate. International Journal of Psychophysiology 79, 341–346 (2011).

34. 34.

Beissner, F., Meissner, K., Bär, K.-J. & Napadow, V. The autonomic brain: an activation likelihood estimation meta-analysis for central processing of autonomic function. Journal of Neuroscience 33, 10503–10511 (2013).

35. 35.

Calvo, R. A. & D’Mello, S. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on affective computing 1, 18–37 (2010).

36. 36.

Kreibig, S. D. Autonomic nervous system activity in emotion: A review. Biological psychology 84, 394–421 (2010).

37. 37.

Mauss, I. B. & Robinson, M. D. Measures of emotion: A review. Cognition and emotion 23, 209–237 (2009).

38. 38.

Levenson, R. W. The autonomic nervous system and emotion. Emotion Review 6, 100–112 (2014).

39. 39.

Corti, R. et al. Coffee acutely increases sympathetic nerve activity and blood pressure independently of caffeine content: role of habitual versus nonhabitual drinking. Circulation 106, 2935–2940 (2002).

40. 40.

Jee, S. H., He, J., Whelton, P. K., Suh, I. & Klag, M. J. The effect of chronic coffee drinking on blood pressure: a meta-analysis of controlled clinical trials. Hypertension 33, 647–652 (1999).

41. 41.

Maheswaran, R., Gill, J. S., Davies, P. & Beevers, D. G. High blood pressure due to alcohol. a rapidly reversible effect. Hypertension 17, 787–792 (1991).

42. 42.

Gilbody, S., Richards, D., Brealey, S. & Hewitt, C. Screening for depression in medical settings with the patient health questionnaire (phq): a diagnostic meta-analysis. Journal of general internal medicine 22, 1596–1602 (2007).

43. 43.

Wirch, J. L., Wolfe, L. A., Weissgerber, T. L. & Davies, G. A. Cold pressor test protocol to evaluate cardiac autonomic function. Applied physiology, nutrition, and metabolism 31, 235–243 (2006).

44. 44.

Cui, J., Wilson, T. E. & Crandall, C. G. Baroreflex modulation of muscle sympathetic nerve activity during cold pressor test in humans. American Journal of Physiology-Heart and Circulatory Physiology 282, H1717–H1723 (2002).

45. 45.

Russell, J. A. A circumplex model of affect. Journal of personality and social psychology 39, 1161 (1980).

46. 46.

Carlsson, A. M. Assessment of chronic pain. i. aspects of the reliability and validity of the visual analogue scale. Pain 16, 87–101 (1983).

47. 47.

Biopac systems, Inc. http://www.biopac.com/ (2016).

48. 48.

Pan, J. & Tompkins, W. J. A real-time qrs detection algorithm. IEEE Trans. Biomed. Eng 32, 230–236 (1985).

49. 49.

Tarvainen, M. P., Ranta-Aho, P. O. & Karjalainen, P. A. An advanced detrending method with application to hrv analysis. IEEE Transactions on Biomedical Engineering 49, 172–175 (2002).

50. 50.

Tarvainen, M. P., Niskanen, J.-P., Lipponen, J. A., Ranta-Aho, P. O. & Karjalainen, P. A. Kubios hrv-heart rate variability analysis software. Computer methods and programs in biomedicine 113, 210–220 (2014).

51. 51.

Citi, L., Brown, E. N. & Barbieri, R. A real-time automated point-process method for the detection and correction of erroneous and ectopic heartbeats. IEEE transactions on biomedical engineering 59, 2828–2837 (2012).

52. 52.

Valenza, G., Greco, A., Scilingo, E. P. & Barbieri, R.  Validation of instantaneous bispectral high-frequency power of heartbeat dynamics as a marker of cardiac vagal activity. In Engineering in Medicine and Biology Society (EMBC), 2017 39th Annual International Conference of the IEEE, 3765–3768 (IEEE, 2017).

53. 53.

Nichols, J. M., Olson, C. C., Michalowicz, J. V. & Bucholtz, F. The bispectrum and bicoherence for quadratically nonlinear systems subject to non-gaussian inputs. IEEE Transactions on Signal Processing 57, 3879–3890 (2009).

54. 54.

Greco, A., Valenza, G., Lanata, A., Scilingo, E. P. & Citi, L. cvxeda: A convex optimization approach to electrodermal activity processing. IEEE Transactions on Biomedical Engineering 63, 797–804 (2016).

55. 55.

Daubechies, I.  et al.  Ten lectures on wavelets. In CBMS-NSF regional conference series in applied mathematics, vol. 61 (1991).

56. 56.

Mallat, S. G.  A theory for multiresolution signal decomposition: the wavelet representation. IEEE Transactions on Pattern Analysis & Machine Intelligence 674–693 (1989).

57. 57.

Weston, J.  et al.  Feature selection for svms. In Advances in neural information processing systems, 668–674 (2001).

58. 58.

Guyon, I., Weston, J., Barnhill, S. & Vapnik, V. Gene selection for cancer classification using support vector machines. Machine learning 46, 389–422 (2002).

59. 59.

Yan, K. & Zhang, D. Feature selection and analysis on correlated gas sensor data with recursive feature elimination. Sensors and Actuators B: Chemical 212, 353–363 (2015).

60. 60.

Chang, C.-C. & Lin, C.-J. Libsvm: A library for support vector machines. ACM transactions on intelligent systems and technology (TIST) 2, 27 (2011).

61. 61.

Valenza, G., Citi, L., Lanatá, A., Scilingo, E. P. and Barbieri, R.  Revealing real-time emotional responses: a personalized assessment based on heartbeat dynamics. Scientific reports  4 (2014).

62. 62.

Valenza, G., Citi, L., Scilingo, E. P. & Barbieri, R. Inhomogeneous point-process entropy: An instantaneous measure of complexity in discrete systems. Physical Review E 89, 052803 (2014).

63. 63.

Valenza, G., Citi, L. & Barbieri, R. Estimation of instantaneous complex dynamics through lyapunov exponents: a study on heartbeat dynamics. PloS one 9, e105622 (2014).

64. 64.

Valenza, G. et al. Complexity variability assessment of nonlinear time-varying cardiovascular control. Scientific reports 7, 42779 (2017).

65. 65.

Shukla, J., Barreda-Ángeles, M., Oliver, J. & Puig, D. Efficient wavelet-based artifact removal for electrodermal activity in real-world applications. Biomedical Signal Processing and Control 42, 45–52 (2018).

66. 66.

Swangnetr, M. & Kaber, D. B. Emotional state classification in patient-robot interaction using wavelet analysis and statistics-based feature selection. IEEE Transactions on Human-Machine Systems 43, 63–75 (2012).

67. 67.

Valenza, G. et al. Combining electroencephalographic activity and instantaneous heart rate for assessing brain-heart dynamics during visual emotional elicitation in healthy subjects. Phil. Trans. R. Soc. A 374, 20150176 (2016).

## Acknowledgements

This project has received partial funding from the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No. 722022 “AffecTech”.

## Author information

Authors

### Contributions

S.G., G.V., A.G., E.P.S. designed the experimental protocol. S.G. and A.G. conducted the experiment. S.G., A.G., R.B., G.V. analyzed the data. All authors analyzed the results, wrote and reviewed the manuscript.

## Ethics declarations

### Competing interests

The authors declare no competing interests.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

Ghiasi, S., Greco, A., Barbieri, R. et al. Assessing Autonomic Function from Electrodermal Activity and Heart Rate Variability During Cold-Pressor Test and Emotional Challenge. Sci Rep 10, 5406 (2020). https://doi.org/10.1038/s41598-020-62225-2

• Accepted:

• Published:

• ### Can we predict experiential avoidance by measuring subjective and physiological emotional arousal?

• Chrysanthi Leonidou
•  & Georgia Panayiotou

Current Psychology (2021)

• ### Quantifying multidimensional control mechanisms of cardiovascular dynamics during multiple concurrent stressors

• , Alberto Greco
• , Luca Faes
• , Michal Javorka
• , Riccardo Barbieri
• , Enzo Pasquale Scilingo
•  & Gaetano Valenza

Medical & Biological Engineering & Computing (2021)

• ### Positive effects of music therapist’s selected auditory stimulation on the autonomic nervous system of patients with disorder of consciousness: a randomized controlled trial

• Xiao-Ying Zhang
• , Jian-Jun Li
• , Hai-Tao Lu
• , Wen-Jia Teng
•  & Song-Huai Liu

Neural Regeneration Research (2021)

• ### The role of stress reactivity and pre-injury psychosocial vulnerability to psychological and physical health immediately after traumatic injury

• Ilaria Pozzato
• , Yvonne Tran
• , Bamini Gopinath
• , Ranjit A. Thuraisingham
• , Ian D. Cameron
•  & Ashley Craig

Psychoneuroendocrinology (2021)

• ### Clinical Study of Autonomic Dysfunction in Patients With Anti-NMDA Receptor Encephalitis

• Lulu Yan
• , Shuang Zhang
• , Xiaoxue Huang
• , Yao Tang
•  & Jun Wu

Frontiers in Neurology (2021)