Abstract

The negative impact of strong sympathetic arousal on dexterous performance during formal surgical training is well-known. This study investigates how this relationship might change if surgical training takes place as a hobby in an informal environment. Fifteen medical students volunteered in a 5-week training regimen and weekly performed two standardized microsurgical tasks: circular cutting and simple interrupted suturing. Time was taken and two independent reviewers evaluated the surgical proficiency. The State Trait Anxiety Inventory (STAI) and the NASA Task Load Index (NASA-TLX) questionnaires measured subjective anxiety and workload, respectively. A high-resolution thermal imaging camera recorded facial imagery, from which a computational algorithm extracted the perinasal perspiration signal as indicator of sympathetic arousal. Anxiety scores on STAI questionnaires were indifferent for all five sessions. The continuously measured arousal signal from the thermal facial imagery was moderate and did not correlate with surgical proficiency or speed. Progressive experience was the strongest contributor to improved skill and speed, which were attained in record time. It appears that dexterous skill acquisition is facilitated by the absence of strong arousals, which can be naturally eliminated in the context of informal education. Given the low cost and availability of surgical simulators, this result opens the way for re-thinking the current practices in surgical training and beyond.

Introduction

Pavlidis et al.1 demonstrated that laparoscopic training in a surgery school is associated with strong arousals, manifesting stressful conditions. These arousals precipitate fight-or-flight responses, the net effect of which are fast, mindless actions leading to errors, and the sustenance of a vicious cycle. The researchers found no performance improvement in untrained surgery residents, after five practice sessions - a sign that high stress levels impede dexterous skill acquisition.

The source of strong arousals during surgical training is an open question. We are aware of no study that separated stressors inherent to surgical tasks from environmental stressors. Hence, while the negative effect of stress on surgical training is well documented1,2,3, the question of what happens if environmental stress factors are managed remains underexplored. Here we investigate how the absence of stressful environmental conditions during microsurgical training affects arousal levels, proficiency, and speed. We remove stressful environmental factors, leaving only the inherent challenge of the surgical tasks, by changing the educational model. Instead of recruiting subjects among surgical interns that undergo formal inanimate training, we recruit lowerclassmen medical students with interest in surgery. Furthermore, we carry out unsupervised training in a relaxed atmosphere outside the medical school. Hence, the participants do not have any stakes or pressures - their only motivation is their love for surgery, and they view the training course as a hobby.

We chose inanimate training in microsurgery as the experimental testbed, because it is challenging, easy to administer in any environment, and has broad applications. Indeed, the field of microsurgery is a subspecialty across several surgical disciplines but plays a particularly large role in plastic and reconstructive surgery. The common ground of all microsurgical procedures is the use of magnifying devices, such as loupes. Microsurgical cases typically entail the preparation of small vessels, nerves, or other vital tissue and their reanastomosis with other anatomical structures4. The primary goal is to return amputated tissue to the body and achieve wound closure5.

Inanimate microsurgical training can take place at any desktop using mobile instruments and affordable materials (Figs 1 and 2); thus, it is uniquely suited to ubiquitous courses on surgical skill. Furthermore, because such training does away with the traditional ‘Halstedian’ model6 associated with operating room (OR) apprenticeship, conforms with general trends in surgical education. Indeed, microsurgical tasks on an actual patient can be very stressful and technically challenging7. Small and refined movements are vital in order not to damage any anatomical entity. Working with minute anatomical structures would put a surgical novice at the unfavorable end of Yerkes-Dodson’s stress-performance chart8, with safety implications for the patient under his/her care. For this reason, in microsurgery, but also in laparoscopic surgery, training has moved towards inanimate modules7,9,10,11,12. The underlying objective of such modules is to educate residents in a way that will increase rather than compromise patient safety when they assume duties in the OR13,14.

Figure 1
Figure 1

Experimental setting and measurements. (Left) Weekly microsurgical setup. (Right) Facial thermal imagery with region of interest from where the perinasal perspiration signal is extracted.

Figure 2
Figure 2

Samples of the 5 × 5 cm rubber models and completed tasks; sutures were magnified for better visibility. On the left is the suturing model and on the right is the cutting model, after the completion of a subject trial.

Methods

Subjects

The student surgical societies of three allopathic medical schools in Houston, Texas were contacted for voluntary study participants. The only exclusion criterion was prior experience in microsurgery. After a brief instruction presentation (week 0) by the senior author (A.E.), the subjects weekly performed two standardized microsurgical tasks in our computational lab (weeks 1–5). At each of the five sessions, continuous thermal imaging was used to monitor the subjects’ perinasal perspiration15 at baseline and during each of the two microsurgical tasks (Fig. 1). Perinasal perspiration is a peripheral indicator of sympathetic responses15. Questionnaires taken in each session evaluated the students’ preoperative vs. postoperative anxiety, as well as their workload perceptions. The institutional review boards (IRB) of both the Methodist Hospital and the University of Houston approved this research. All participating students provided written informed consent, and the study was carried out according to the relevant rules and regulations. The subject appearing in Fig. 1 provided additional informed consent for the publication of his identifying image in an online open-access publication.

Baseline and Microsurgical Tasks

Each session started with a baseline, where the subjects sat quietly in a chair for 5 min. The mean perinasal perspiration during the baseline of each session i, for each subject k was used as his/her sympathetic tonic level for the day, and was subtracted from his mean perinasal perspiration (PP) in the two microsurgical tasks of session i. The thus formed \({\rm{\Delta }}(\overline{PP})\) variables were comparable across subjects because they normalized inter-individual tonic variability. Following the baseline, the subjects performed two microsurgical tasks, cutting and suturing, in a randomized order. To execute these tasks the subjects used 4.0x loupe magnification, microsurgical instruments, and 8-0 Ethicon® (Ethicon Inc., Somerville, New Jersey) microsurgical suturing material. For the cutting task, the subjects had to cut a circle within a 5 × 5 cm rubber model and then continue cutting inwards for another half lap (total of 540°). This task had a time limit of 10 min and would be considered incomplete if the subjects failed to finish the 540° loop. For the suturing task, the subjects first made a linear 3 cm cut in a separate 5 × 5 cm rubber model and then proceeded to place 6 single interrupted stitches to close the defect (Fig. 2). The time limit was set at 20 min. Ideally, the subjects had to place all 6 stitches during these 20 min or as many as they could until the clock ran out. Our senior author (A.E.) has previously studied such rubber models in microsurgical training modules7.

Two independent reviewers assessed the subjects’ microsurgical proficiency following a global scale16; the lowest possible score was 6 and the highest possible score was 30 points. The time taken to finish a task (or the time limit if the subject ran out of time) and the number of stitches placed during the suturing task were recorded. From these primary variables we derived the mean subtask time, which is a measure of surgical speed with superior analytic properties1. The cutting task consisted of a single subtask and thus, the mean subtask time coincided with the task time in that case. For the suturing task, the mean subtask time was obtained by dividing the total time spent on the task by the number of stitches completed.

Questionnaires

Upon the completion of the consenting process, we collected the students’ demographic details using an ad hoc form. Furthermore, we evaluated the anxiety status and the subjective postoperative workload impression using validated questionnaires. The trait module (TAI) of the State-Trait Anxiety Inventory (STAI)17 was administered to the subjects once at the start of the study; the state module (SAI) was administered at the beginning and at the end of each session. STAI consists of 20 statements where the subjects are asked to agree or disagree on 1–4 Likert scales. The total score is between 20 and 80 points; higher values indicate greater anxiety. The NASA Task Load Index (NASA-TLX)18 was administered at the end of each task in each training session. More precisely, we used the short version of the questionnaire without sub-weightings of the scales since it has similarly high validity with the longer version19. This multidimensional instrument consists of six Likert subscales (Mental, Physical, Temporal, Performance, Effort, Frustration), with each subscale scored between 1 and 20 points. The NASA-TLX measures a participant’s subjective assessment of the workload. Higher scores suggest a greater demand or burden associated with the assigned work.

Thermal Imaging

We imaged thermally the subjects’ faces during the baseline, cutting, and suturing tasks in each session. For that purpose we used a Tau 640 long-wave infrared (LWIR) camera (FLIR Systems, Wilsonville, OR); it features a small size (44 × 44 × 30 mm) and adequate thermal (50° mK) and spatial resolution (640 × 512 pixels). The Tau 640 camera was outfitted with a LWIR 35 mm lens f/1.2. Thermal data were collected at a frame rate of 7.5 fps. A computational algorithm15 was extracting a measure of instantaneous perspiration by operating upon tissue bounded by the upper lip and the nostrils (i.e., upper orbicularis oris region) - Fig. 1. Perinasal perspiration is an alternative to palmar electrodermal activity (EDA), and thus a valid measure of sympathetic arousal1. To ensure that the perinasal perspiration algorithm operated on the perinasal area despite head motions, we used a tracker20 to follow the region of interest around the image plane. The extracted perinasal perspiration signal was filtered via a Fast Fourier Transform (FFT).

Statistics

For all statistical analyses of the data we used R Version 3.4.4 (The R Foundation for Statistical Computing, Vienna, Austria). We did hypothesis testing, setting levels of significance at α = 0.05 designated by *, α = 0.01 designated by **, or α = 0.001 designated by ***.

Code availability

The R code used for the data analysis is available at the Open Science Framework: https://osf.io/9he58/.

Results

We designed a prospective observational cohort study using young medical students as novice microsurgical trainees; the testbed was inanimate. We had two key goals: First, to investigate if the proficiency and speed of these students could improve over a short-term unsupervised practice course in a controlled, but stress-free environment. Second, to examine whether sympathetic arousal, which was measured thermophysiologically and psychometrically, negatively impacted the students’ microsurgical efficiency under the said conditions. The sympathetic validity of the thermophysiological channel was previously confirmed in a formal residency training program on laparoscopic surgical tasks1.

Subject characteristics

Of the 21 medical students that originally signed consent forms and began the study, only 15 (10 male, 5 female) finished all five sessions of the experiment and are included in this article. Table 1 displays their demographic and personal details in the form of descriptive statistics. The sample’s age statistic was 23.1 ± 1.3 years and the great majority of the subjects (73.3%) were first year students. As per the exclusion criteria, no subject had prior experience in microsurgery. During the 5-week training, the subjects significantly (p < 0.001) strengthened their perception of surgical skills from 1.1 ± 0.4 to 3.0 ± 1.0 points on a 1–5 Likert scale (Table 1).

Table 1 Subjects’ personal characteristics.

The scores for the trait module of the STAI questionnaire were normal (38.8 ± 7.5 points on a 20–80 scale). The mean scores for the preoperative|postoperative state modules ranged between 30.2 | 34.5 and 31.6 | 37.6. Therefore, the subjects exhibited stable, normal anxiety levels.

Factor analysis for surgical proficiency and speed

We constructed generalized linear models with mixed effects aiming to capture the statistical relationship between certain independent variables and the proficiency scores the subjects received (Tables 2 and 3), as well as the speed with which they completed subtasks (Tables 4 and 5). In all these models, the subjects act as random effects, symbolized by 1|S in Eqs 14.

Table 2 Results of the generalized linear model for the outcome measure surgical proficiency, when independent variables include physiological indicators - Eq. 1.
Table 3 Results of the generalized linear model for the outcome measure surgical proficiency, when independent variables include psychometric indicators - Eq. 2.
Table 4 Results of the generalized linear model for the outcome measure mean subtask time (aka surgical speed), when independent variables include physiological indicators - Eq. 3.
Table 5 Results of the generalized linear model for the outcome measure mean subtask time (aka surgical speed), when independent variables include psychometric indicators - Eq. 4.

Model #1 (Eq. 1) features a physiological predictor, which is the difference of the mean perinasal perspiration between the subject’s task signal and his/her resting baseline, in the context of a training session; the predictor is corrected logarithmically due to its non-linearity: \(\mathrm{ln}({\rm{\Delta }}\overline{PP})\). This model revealed significant proficiency score improvement as the subjects progressed with their five training sessions (p < 0.001 with positive factor estimates in all sessions - Table 2). Performing the suturing task had a significantly negative impact on the score (p < 0.001 with negative factor estimate), which is consistent with the well-known difficulty of this task. Interestingly, the sympathetic arousal levels calculated via the normalized perinasal perspiration \(\mathrm{ln}({\rm{\Delta }}\overline{PP})\) were moderate and unrelated to the proficiency scores (p > 0.05 - Table 2), thanks likely to the informal educational framework of the study design. The proficiency scores were not affected by the reviewer judging the students (p > 0.05 - Table 2), which suggests inter-rater agreement.

Physiological Model #1

$$Score\sim 1+Session+Task+\,\mathrm{ln}({\rm{\Delta }}\overline{PP})+Scorer+1|S$$
(1)

In Model #2 (Eq. 2), we replaced the physiological variable with the psychometric measurements. These measurements included the anxiety induced by the tasks, as recorded by the scores of the postoperative vs. the preoperative State Anxiety Inventory (SAI) in each session. They also included the six subscales of the NASA-TLX instrument, measuring workload perceptions in each session: \({\rm{Mental}}\equiv {\mathcal M} \); \({\rm{Physical}}\equiv {\mathscr{P}}\); \({\rm{Temporal}}\equiv {\mathscr{T}}\); \({\rm{Performance}}\equiv {P}_{e}\); \({\rm{Effort}}\equiv {\mathcal E} \); \({\rm{Frustration}}\equiv {\mathcal F} \). The length of training remained the most important predictor of increased proficiency scores (p < 0.001 with positive factor estimates in all sessions - Table 3). Psychometrically measured anxiety (SAI in Eq. 2) was not a factor in proficiency, much like physiologically measured arousal was not a factor per Model #1. Subjects who were content with their performance (p < 0.01 with negative estimate in the Performance subscale - Table 3) or irritated with the tasks (p < 0.001 with negative estimate in the Frustration subscale - Table 3) achieved lower proficiency scores. Higher perceived physical demand (p = 0.01 with positive estimate in the Physical subscale - Table 3) correlated with better proficiency scores. Inter-rater agreement was confirmed once again (p > 0.05 - Table 3). The consistency of the results between Model #1 and Model #2 confirm the soundness of the study’s design and methods.

Psychometric Model #2

$$Score\sim 1+Session+Task+SAI+ {\mathcal M} +{\mathscr{P}}+{\mathscr{T}}+{P}_{e}+ {\mathcal E} + {\mathcal F} +Scorer+1|S$$
(2)

We observed similar trends when we replaced proficiency score with mean time per subtask (i.e., speed) as the dependent variable in the generalized linear models. In the thus formed Physiological Model #3 (Eq. 3), the strongest predictor of decreased subtask time (thus, higher surgical speed) was the number of microsurgical training sessions (p < 0.001 with negative factor estimates in all sessions - Table 4). Suturing subtasks were correlating with larger mean times (p = 0.001). Arousal levels, as expressed by the perinasal perspiration channel, did not correlate with mean subtask time (p > 0.05), much like in the case of proficiency scores.

Physiological Model #3

$$Time\sim 1+Session+Task+\,\mathrm{ln}({\rm{\Delta }}\overline{PP})+1|S$$
(3)

In Model #4 (Eq. 4), we replaced the physiological predictor of Model #3 with the psychometric predictors. This is part of our approach to predict surgical performance (proficiency score or mean subtask time) through either a physiological or psychometric channel. As in the Physiological Model #3, the strongest predictor of decreased subtask time was the number of microsurgical training sessions (p < 0.001 with negative factor estimates in all sessions - Table 5). Psychometrically measured anxiety was not a factor in time performance, much like physiologically measured arousal was not a factor in Model #3. Subjects who felt urgency featured reduced subtask times (p < 0.05 with negative estimate in the Temporal subscale). Subjects who were irritated ended up with increased subtask times (p < 0.001 with positive estimate in the Frustration subscale - Table 5).

Psychometric Model #4

$$Time\sim 1+Session+Task+SAI+ {\mathcal M} +{\mathscr{P}}+{\mathscr{T}}+{P}_{e}+ {\mathcal E} + {\mathcal F} +1|S$$
(4)

Discussion

To investigate if non-stressful conditions affect the relationship between sympathetic arousal and dexterous performance in surgical training, we developed a 5-week informal training regimen where subjects had to perform two standardized microsurgical tasks in randomized order. The tasks were cutting and suturing. Inexperienced allopathic students interested in surgical careers were contacted for voluntary participation in our educational study, which had no repercussion in case of subpar performance.

This informal microsurgical training module yielded strong educational results, with subjects (n = 15) exhibiting remarkable improvement in surgical proficiency and speed during the 5-week practice period (Figs 3 and 4). The physiologically measured distress in the form of sympathetic arousal, \({\rm{\Delta }}(\overline{PP})\), was moderate and unchanged throughout the five training sessions; it was not a factor in proficiency performance. The psychometrically measured distress in the form of SAI scores, was in agreement with the physiological indicator. When we replaced proficiency score with mean subtask time (i.e., speed of execution) as the measured outcome, we were able to replicate nearly all statistical associations in the respective models.

Figure 3
Figure 3

Proficiency score distributions for cutting and suturing, stratified by session number. The numbers in red are the p values of the tests against the base session (Session 1) carried out per Eq. 1.

Figure 4
Figure 4

Mean subtask time distributions for cutting and suturing, stratified by session number. The numbers in red are the p values of the tests against the base session (Session 1) carried out per Eq. 3.

In contradistinction to the moderate stress levels and rapid learning results in the present study, previous studies1,2,3 reported high stress levels in surgical trainees and slow learning processes. The main factor that sets the current study apart from these other studies is the educational context. In prior studies, researchers shadowed surgical residents during their mandatory training. In this study, young surgery enthusiasts rather than novice surgeons took up surgical training as hobby.

Hence, it appears that by removing exogenous stress factors, associated with the notoriously competitive and harsh lifestyle of surgery residencies, stress levels during inanimate surgical training plummet. The inherently challenging nature of standardized surgical tasks does not produce overwhelming arousal responses as a stand-alone factor. The residual arousal levels of moderate intensity allow dexterous skill acquisition to flourish.

What is of immense interest is the likely mechanism though which surgical training accelerates under relaxed environmental conditions. As it is reported by Pavlidis et al.1, high stress levels during formal surgical training precipitate fight-or-flight responses, which manifest as fast action (i.e., high speed). In the absence of experience, these fast actions contribute to high error rates (thus, low proficiency scores), spawning a vicious cycle that hampers dexterous skill acquisition. The moderate arousal levels in the current study design, apparently suppress fight-or-flight responses, enabling the trainees to start with low speeds (Fig. 4) that are appropriate for their level of expertise. This facilitates progress towards a lower error rate - thus, higher proficiency scores - (Fig. 3), locking the trainee on a positive reinforcement loop rather than a negative one.

It is worth noting that most of the previous studies focused on inanimate laparoscopic training, while the present study is centered on inanimate microsurgical training. While both forms of surgery are technically challenging21 and feature similar standardized tasks, they also have some differences. One key difference is the use of loupes versus endoscopic cameras for visual guidance. Hence, a question arises about the extent to which the type of surgery affects dexterous behaviors. Harwell et al.22 showed that human distress in the form of physiological tremor is inversely related to microsurgical proficiency - a finding that confirms microsurgery is no different than laparoscopy when it comes to sympathetic effects on novices1. In this respect, the results of our study are relevant to surgical training in general, and signal the need for a radical rethinking of educational norms and practices.

Data Availability

The data that support the findings of this study are available at the Open Science Framework: https://osf.io/9he58/.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Pavlidis, I., Tsiamyrtzis, P. & Shastri, D. Fast by nature - how stress patterns define human experience and performance in dexterous tasks. Sci Rep. 305 (2012).

  2. 2.

    Hassan, I., Weyers, P. & Maschuw, K. Negative stress-coping strategies among novices in surgery correlate with poor virtual laparoscopic performance. Br J Surg. 93, 1554–1559 (2006).

  3. 3.

    Arora, S. et al. Stress impairs psychomotor performance in novice laparoscopic surgeons. Br J Surg. 93, 1554–1559 (2010).

  4. 4.

    Tamai, S. History of microsurgery. Plast Reconstr Surg. 124, e282–294 (2009).

  5. 5.

    Park, J. & Chang, D. Advances and innovations in microsurgery. Plast Reconstr Surg. 138, 915e–924e (2016).

  6. 6.

    Ramachandran, S., Ghanem, A. & Myers, S. Assessment of microsurgery competency-where are we now? Microsurgery 33, 406–415 (2013).

  7. 7.

    Satterwhite, T., Son, J. & Carey, J. The stanford microsurgery and resident training (smart) scale: Validation of an on-line global rating scale for technical assessment. Ann Plast Surg. 72, S84–88 (2014).

  8. 8.

    Yerkes, R. & Dodson, J. The relation of strength of stimulus to rapidity of habit-formation. Journal of Comparative Neurology and Psychology 18, 459–482 (1908).

  9. 9.

    Satterwhite, T., Son, J. & Carey, J. Development of a training curriculum for microsurgery. Ann Plast Surg. 68, 410–414 (2012).

  10. 10.

    Mucke, T. et al. Microvascular training of medical students and surgeons - a comparative prospective study. J Craniomaxillofac Surg. 41, e187–190 (2013).

  11. 11.

    Scholz, M., Mucke, T. & Holzle, F. A program of microsurgical training for young medical students: Are younger students better? Microsurgery 26, 450–455 (2006).

  12. 12.

    Balasundaram, I., Aggarwal, R. & Darzi, L. Development of a training curriculum for microsurgery. Br J Oral Maxillofac Surg. 48, 598–606 (2010).

  13. 13.

    Sedlack, R. & Kolars, J. Computer simulator training enhances the competency of gastroenterology fellows at colonoscopy: Results of a pilot study. Am J Gastroenterol. 99, 33–37 (2004).

  14. 14.

    Sturm, L. et al. A systematic review of skills transfer after surgical simulation training. Ann Surg. 248, 166–179 (2004).

  15. 15.

    Shastri, D., Papadakis, M., Tsiamyrtzis, P., Bass, B. & Pavlidis, I. Perinasal imaging of physiological atress and its affective potential. IEEE Trans Affect Comput. 3, 366–378 (2012).

  16. 16.

    Osborn, H., Kuthubutheen, J., Yao, C., Chen, J. & Lin, V. Predicting microsurgical aptitude. Otol Neurotol. 36, 1203–1208 (2015).

  17. 17.

    Spielberger, C. D. State-Trait Anxiety Inventory (Wiley Online Library, 2010).

  18. 18.

    Hart, S. G. & Staveland, L. E. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Hancock, P. A. & Meshkati, N. (eds) Human Mental Workload (North Holland Press, Amsterdam, 1988).

  19. 19.

    Hart, S. NASA-Task Load Index (NASA-TLX); 20 years later. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, 904–908 (2006).

  20. 20.

    Zhou, Y., Tsiamyrtzis, P., Lindner, P., Timofeyev, I. & Pavlidis, I. Spatiotemporal smoothing as a basis for facial tissue tracking in thermal imaging. IEEE Trans Biomed Eng. 60, 1280–1289 (2013).

  21. 21.

    Koshima, I., Yamamoto, T., Narushima, M., Mihara, M. & Iida, T. Perforator flaps and supermicrosurgery. Clin Plast Surg. 37, 683–689 (2010).

  22. 22.

    Harwell, R. & Ferguson, R. Physiologic tremor and microsurgery. Microsurgery 4, 187–192 (1983).

Download references

Acknowledgements

We would like to express our gratitude to Christel Bastida-Wommack, Ph.D. for assisting with the initial preparation of the study. Furthermore, we would like to acknowledge Dr. Jeffrey D. Friedman and Dr. Shayan A. Izaddoost for their intellectual support of the study, for providing the microsurgical loupes, and for assisting in the study enrollment of medical students. The work presented in this manuscript was supported by a $10,000 grant from the Plastic Surgery Foundation (Arlington Heights, IL: consortium agreement no. 001). The suturing material used in this study was provided at no cost by © Ethicon US, LLC. (Somerville, NJ: grant agreement no. 263931). The microsurgical instruments were donated by Accurate Surgical & Scientific Instruments Corporation (Westbury, NY) and SYNOVIS (Birmingham, AL).

Author information

Author notes

  1. Ioannis Pavlidis and Dmitry Zavlin contributed equally

  2. Ioannis Pavlidis and Anthony Echo jointly supevised this work.

Affiliations

  1. Computational Physiology Laboratory, University of Houston, Houston, Texas, USA

    • Ioannis Pavlidis
    • , Ashik R. Khatri
    • , Amanveer Wesley
    •  & George Panagopoulos
  2. Institute of Reconstructive Surgery, Houston Methodist Hospital, Houston, Texas, USA

    • Dmitry Zavlin
    •  & Anthony Echo

Authors

  1. Search for Ioannis Pavlidis in:

  2. Search for Dmitry Zavlin in:

  3. Search for Ashik R. Khatri in:

  4. Search for Amanveer Wesley in:

  5. Search for George Panagopoulos in:

  6. Search for Anthony Echo in:

Contributions

The research was conceived and designed by I.P. and A.E. The experiment was conducted by D.Z., A.W. and A.K. The data analysis and interpretation was carried out by I.P., D.Z., A.K., A.W. and G.P. The paper was written by D.Z. and I.P. Editing was performed by A.E.

Competing Interests

The authors declare no competing interests.

Corresponding author

Correspondence to Ioannis Pavlidis.

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/s41598-019-38727-z

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.