One of the most complex forms of creativity is musical improvisation where new music is produced in real time. Brain behavior during music production has several dimensions depending on the conditions of the performance. The expression of creativity is suspected to be different whether novel ideas must be externalized using a musical instrument or can be imagined internally. This study explores whole brain functional network connectivity from fMRI data during jazz music improvisation compared against a baseline of prelearned score performance. Given that creativity might be affected by external execution, another dimension where musicians imagine or vocalize the music was also tested. We found improvisation was associated with a state of weak connectivity necessary for attenuated executive control network recruitment associated with a feeling of “flow” allowing unhindered musical creation. In addition, elicited connectivity for sensorimotor and executive control networks is not different whether musicians imagine or externalize (through vocalization) musical performance.
Creativity is an essential human trait supporting evolution through the ages up through inventions of our time. Typically, creativity has been studied using paradigms in which a process of generation results in the production of a creative product1. Recently, there has been increased interest in creative processes that occur in real time where idea generation and evaluation may occur in rapid succession or even simultaneously. One model behavior that has been studied extensively using neuroscience methods is musical improvisation especially within the style of jazz, for a review see2. Expert jazz musicians create novel musical output within given general constraints of style, specific constraints dictated by the current melody and harmony, and motoric constraints dictated by the instrument or voice apparatus3. In contrast to paradigms in which the creative product is not generated in real time (e.g. product invention or musical composition), improvisers have no opportunity to revise once the output is produced. Music improvisation thus offers a model to study spontaneous creativity under considerable temporal and motoric constraints.
One influential theoretical framework suggests improvisation is only possible because improvisers reuse learned patterns of notes inserted in the ongoing improvisation3. This view is supported by evidence of a high degree of repeated musical patterns in extant improvisations by experts4,5. These patterns are part of expert performers’ knowledgebase which also includes strategies for concatenating the known patterns, rules for generating new patterns, how the patterns relate to underlying harmonic and rhythmic contexts, which motor movements are needed to execute the patterns, and more general information about style and performance context3.
It has recently been suggested that creativity (including improvisation) requires a continuous process of idea generation/retrieval and evaluation and that this process aligns with specific brain network functionality6. The generation and evaluation of ideas is thought to be supported by an interplay between two major brain networks, the default mode network (DMN) and the executive control network (ECN). The DMN comprises a set of brain regions, including ventromedial prefrontal cortex (vmPFC) and posterior cingulate cortex (PCC), involved in generation of self-referential thought7. The vmPFC has a direct link with emotion8 while playing an important role in memory generalization9 and integration10. The PCC activates during freely unconstrained cognitive processes11 and when creating and consolidating coherent memory representations of complex events12. A previous study suggests that ideas may be generated or retrieved through internal consolidation of abstract representations in a bottom-up process supported by the DMN, which has also been implicated in mind wandering and other activities in which ideas are generated without constraints related to task demands13. With respect to improvisation, generated ideas may then be evaluated according to the current context and inserted into the ongoing improvisation through a process involving the ECN, which consists of the dorsolateral prefrontal (dlPFC) and dorsal parietal cortices14. Dorsal parietal and frontal cortices facilitate the preparation and execution of goal-directed stimuli and responses15. The ECN incorporates exogenous sensorial and more internal information to coordinate behavior16. Interaction of the ECN and DMN may therefore reflect a coordination of controlled and spontaneous processes during improvisation. In a simplified explanation, novel self-generated information flows from the DMN to find a concrete physical expression via ECN intervention. Indeed, activation in some areas of the ECN during musical improvisation, specifically the dlPFC, can be modulated by the improvisational context with higher constraints resulting in increased activation17.
The first study to implicate DMN in improvisation used a functional Magnetic Resonance Imaging (fMRI) paradigm where expert jazz pianists switched between playing prelearned and improvised material18. Compared to playing learned sequences, improvisation showed increased activation of DMN regions and concurrent deactivation of ECN regions. ECN deactivation was interpreted as attenuated evaluation, as experts typically insert ideas that fit the current context with minimal cognitive control necessary19,20. They referred to this deactivated state as hypofrontality which has previously been related to the state of flow21. Flow is specifically associated with high engagement in an interesting task to the point where brain activation related to self-referential processing is attenuated22,23. The results were duplicated in a different paradigm in which rhythmic language improvisation again elicited dissociated activity in medial and dorsolateral prefrontal cortices24. Interestingly, a later follow-up study in which expert participants engaged in interaction with another player saw increased activation in control areas associated with language production apparently interrupting the state of flow25.
During improvisation, the process of idea generation and evaluation occurs concurrently with other energy-demanding processes of perception and action. Brain interactions can occur in two ways. At one end, endogenous and exogenous processes can compete with each other, resulting in detrimental brain performance. This clash decreases performance when a failure to deactivate DMN creates interference for exogenous information processing during goal-directed task execution26,27. A recent model by Psyche Loui28 outlines the importance of the perception and action loop within the context of musical performance and improvisation. Any movement that triggers a sound will involve the temporal lobe in which the auditory signal is initially analyzed. From there, a dorsal network—consisting of the superior temporal gyrus, connected by the arcuate fasciculus to the frontal lobe—supports sensory-motor integration. At the same time, information about sound-object categories is sent via a ventral network from the middle temporal gyrus to inferior frontal regions through the uncinate and inferior longitudinal fascicule. While these processes are common to all music performance29, these networks may additionally underpin idea generation and evaluation during improvised music28. Indeed, musicians show higher fractional anisotropy (FA) in the arcuate fasciculus than non-musicians30. In addition, jazz musicians compared to non-improvising musicians showed higher tract volume and FA between mesial regions and left superior temporal gyrus and between mesial regions and right inferior frontal gyrus31. Differences between improvising and non-improvising musicians can also be seen in resting state functional connectivity where improvising musicians show higher integration of DMN and ECN32.
Previous literature has investigated anatomical and functional changes in connectivity, revealing definite neuroplasticity related to musical performance. To date, most functional connectivity studies have focused on a few regions of interests known to be involved in musical creativity32,33, leaving questions about whole-brain dynamics during improvisation. Moreover, most work has examined improvisation in the context of keyboard performance, with little attention paid to spontaneous creativity in other domains (e.g., vocal). Examining whole-brain dynamics during improvisation, beyond a single musical instrument, can provide further insight into the complex and multi-modal nature of spontaneous human creativity.
In a recent study, we examined functional activity and connectivity with expert jazz improvisers who either vocally improvised or recalled prelearned melodies33. We chose a vocalization task as jazz musicians often practice vocally independent of their instrumental specialization34. Critically, our prior study was limited to traditional activation contrasts and ROI-based connectivity analysis, and we did not examine whole-brain dynamics. In line with the theory of hypofrontality, the results showed decreased connectivity between left frontal, lateral premotor cortex, supplementary motor area and cerebellum during improvisation. Importantly, the context of the improvisation task was very well known to the participants (improvising on the common 12-bar blues) with the goal of minimizing external constraints and promoting a flow state. Interestingly, we also found decreased connectivity between regions of interest during improvisation in a study where we collected electroencephalography (EEG) while participants played or imagined prelearned or improvised short isochronous melodies35.
The current work substantially extends our previous study of expert jazz musicians by examining whole-brain functional connectivity during vocal and imagined improvisation. We comprehensively investigate whole-brain functional network connectivity while musicians either imagine or perform novel or prelearned vocal melodies. This data-driven analysis allowed us to examine how the whole brain dynamically functions during spontaneous musical creativity, providing a significant expansion of prior work focusing on localized activity and regions of interest25. Our previous studies contrasting prelearned and improvisation tasks would indicate that improvisation involves less connectivity between regions. Therefore, we hypothesized that whole brain connectivity in the current analysis would also be attenuated during improvisation.
A total of twenty-one male advanced jazz improvisers (4 left-handed, 17 right-handed; mean age ± standard deviation [SD] = 30.67 ± 9.97 years) were included in this study. Participants had at least 6 years of professional experience (mean ± SD = 20.48 ± 11.1 years) on jazz improvisation, see participants description in33. All participants had previous education in a University System School of Music; average schooling years for all participants was 16.21 ± 1.86 years. Reading music scores was also required for all participants. Primary instruments included piano (n = 5), saxophone (n = 10), guitar (n = 1), trumpet (n = 2), drums (n = 1), trombone (n = 1), and bass (n = 1). All participants had normal or corrected to normal vision and reported normal neurological history. Participants provided written and signed informed consent forms and were compensated for their participation in the experiment. The Institutional Review Board for Joint Georgia State University and Georgia Institute of Technology Center for Advanced Brain Imaging, Atlanta, Georgia, approved this study. All methods were performed in accordance with the relevant guidelines and regulations.
fMRI scanning protocol
All fMRI images were acquired on a 3-Tesla Siemens scanner available at Georgia State University and Georgia Institute of Technology Center for Advanced Brain Imaging, Atlanta, Georgia. Acquisition protocol was done with T2* weighted gradient echo-planar imaging sequence: echo time (TE) = 30 ms, repetition time (TR) = 1970 ms, flip-angle = 90°, field of view = 204 mm, matrix size = 68·68, voxel size = 3·3·3 mm3, and 37 interleaved axial slices with a thickness of 3 mm each. High-resolution anatomical images were acquired for anatomical references using a magnetization-prepared rapid gradient-echo sequence with TR = 2250 ms, TE = 4.18 ms, flip-angle = 9°, and voxelsize = 1·1·1 mm3.
Data were preprocessed by using Statistical Parametric Mapping (SPM12; www.fil.ion.ucl.ac.uk/spm). The preprocessing steps involved slice timing correction, motion correction, coregistration to individual anatomical image, and normalization to Montreal Neurological Institute (MNI) template36. Spatial smoothing of normalized image was done with an 8-mm isotropic Gaussian kernel.
Data from all subjects were subject to a “cleaning” group independent component analysis (gICA) using the GIFT software (https://trendscenter.org/software/gift/) to obtain a set of independent components. Artifactual components were detected and discarded based on their relationship with white matter, cerebrospinal fluid and frequency. Data was reconstructed and a second gICA was performed resulting in 100 components. We employed the package ICASSO currently integrated in GIFT to ensure a good quality of gICA decomposition37.
We selected a subset of 39 non-artifactual components representing the brain resting state networks (RSNs) of interest. RSNs were organized in functional domains: Basal Ganglia (BG), Auditory (AUD), Sensorimotor (SEN), Cerebellum (CER), Primary Visual (PrimVIS), High Visual (HighVIS), ventral default mode network (vDMN), dorsal default mode network (dDMN), salience (SAL), executive control network (ECN) and language (LAN). As sanity check, we confirmed RSN—domain matching by examining spatial overlap with Stanford resting state masks38. RSN time courses were detrended up to third-order trends and filtered with a Butterworth fifth-order filter of bandwidth [0.01, 0.15] Hz. Static functional network connectivity (FNC) was assessed using Pearson correlation between gICA component time courses within each task. Pearson Z transformation was applied to every pair of time courses for a total of 741 (39*38/2) connectivity values per subject and task.
Condition and task paradigms
This study included four important conditions affecting music performance: vocalize (Voc), imagine (Ima), improvise (Imp) and perform prelearned music (Pre). Participants familiarized themselves with four tasks designed to investigate the four mentioned conditions: vocalize prelearned (VocPre), vocalize improvised (VocImp), imagine prelearned (ImaPre), and imagine improvised (ImaImp) before the fMRI scan. During the prelearned condition, participants were prompted to vocalize or imagine one of the four scores that can be seen in Fig. 1: Au Privave, Now’s the Time, Blues for Alice, and Billies Bounce. These four melodies were chosen from the Bebop era of jazz, as the complexity of these melodies is comparable with expected improvisations34. Compositions are based on a standard 12-bar blues chordal progression. All melodies were memorized and rehearsed before the day of the experiment. In addition, participants were asked to complete each task module before the scan to ensure they could perform accurately within appropriate time durations. During the scan, each performance was self-paced according to a tempo specified by a metronome beat audible at the beginning of each trial resulting in a length of approximately 32 s.
Participants were instructed to imagine singing without any overt vocalization during the imagine condition and to sing (vocalize) during the vocalization condition. The VocPre and ImaPre tasks provided optimal condition control because they do not require creativity to recall from memory. Results from the two prelearned tasks (VocPre and ImaPre) were contrasted with the two improvised tasks (VocImp and ImaImp), during which participants vocalized or imagined a spontaneously improvised melody over the blues chord progression. We did not require participants to vocalize melodies and improvisations at the quality of a trained jazz singer. Here, we simply asked the musicians to vocalize as they would during a practice session (non wind instrumentalists) or during casual practice without the instrument. Such practice is common among jazz musicians and jazz students are typically asked to vocalize improvisation34.
Static functional network connectivity of task paradigm
Data was acquired continuously through the four tasks (VocPre, VocImp, ImaPre, and ImaImp). Each task lasted an approximate of 32 s. Time courses for each network obtained from gICA thus included time lapses for all four tasks. The beginning and ending of each task were located within the time courses of each network and the time lapses were separated. Frame-wise displacement values39 were also calculated for each time lapse as an estimate of the amount of movement within each task. A static FNC matrix was estimated using Fisher transformed Pearson correlation coefficients of all data within each task-separated time lapse. Figure 2 illustrates the procedure that was implemented in house using Matlab (version R2019a; https://www.mathworks.com/). Finally, FNC values were orthogonalized with respect to the mean frame-wise displacement of each subject during each task. All image result plots were created in Matlab and imported into Inkscape (version 1.0; https://inkscape.org/) for illustration refinement.
Analysis of functional network connectivity
The gICA algorithm decomposes brain signals into networks of weighted brain spatial content (spatial maps) and temporal evolution (time-courses). As explained in Fig. 2, 741 network-to-network (N2N) connectivity values were estimated using Fisher transformed Pearson correlations (z-values) from time-courses for each task and subject. A One-Way ANOVA was performed for each correlation based on the four tasks. Significance was corrected using the false discovery rate (FDR) method.
Post-hoc group tests were performed for each N2N correlation and four different contrasts including ImaPre-ImaImp, VocPre-VocImp, VocImp-ImaImp, and VocPre-ImaPre. We included two additional contrasts. A Pre-Imp = (VocPre + ImaPre) − (VocImp + ImaImp) contrast which consisted of differences between preleaned (Pre; merging VocPre and ImaPre) and improvisation (Imp; merging VocImp and ImaImp). A Voc-Ima = (VocPre + VocImp) − (ImaPre + ImaImp) contrasts consisted of differences between vocalization (Voc; merging VocPre and VocImp) and imagine (Ima; merging ImaPre and ImaImp). These analyses allowed us to identify brain networks associated with the imagination and vocalization of improvised and prelearned melodic sequences. FDR for multiple comparison correction was applied.
Graph metric analysis
Differences in N2N connectivity suggest connectivity reconfigurations that vary for each task. Graph metrics were estimated from FNC to study these reconfigurations and their differences on each task. The four whole brain metrics tested are modularity40, small-world41, characteristic path length (char-path) and transitivity42. These metrics were estimated using the Brain Connectivity Toolbox (https://sites.google.com/site/bctnet/). A one way ANOVA metric was applied to each graph metric to determine task related differences.
In the context of this paper, modularity refers to a N2N connectivity pattern where networks can be grouped in strongly connected non-overlapping modules43. The brain connectome is organized in this modular pattern44. The specific modules (groups of connected networks) found in FNC are more related to particular N2N connectivity recruited during each task (see Fig. 2) than anatomical location. A related concept is functional segregation or the ability to process information within tightly connected groups of networks which is estimated using the transitivity metric. The estimation is based on the rationale that if network A is connected to network B and network B is connected to network C, then there is a high probability that A and C are also connected thus forming an network triplet of information processing42. The number of connected triplets is an estimation of FNC segregation. For a single network, segregation can be measured using the clustering coefficient (CC) which is a normalized assessment of the number of triplets around the network41. For the whole brain (all networks), transitivity is used instead of the CC which is a normalized assessment of all network triplets42. Another important concept is integration or the ease with which distant brain networks communicate with each other. In many instances N2N communication is mediated along a connectivity path of linked networks. The char-path metric is a whole brain integration estimate consisting on the average distance between every two endpoint networks along a path of linked networks where the distance is related to the potential for integration45. Information of path lengths in individual networks was estimated using eccentricity as the maximum distance between the network and any other network46. The human connectome is characterized by simultaneous high segregation and high integration features which are the basis of a small-world organization topology47. However, small-world topologies also depend on the number of connected networks and the overall distribution of this connectivity. In practice, small-world assessments compare segregation and integration against a randomly connected graph of similar characteristics (null-model) based on number of connections and their distribution45. The small-world assessment was performed using the tool box in https://github.com/mdhumphries/SmallWorldNess48 which is based on the Brain Connectivity Toolbox. We investigated if changes in both segregation and integration lead to significant small-world differences on the different tasks. Detailed mathematical and semantic descriptions of these measures can be found in45.
Figure 3 shows a composite of resulting mean correlations, spatial maps from gICA components and significant ANOVA results. Figure 3a displays a matrix of transformed p-values (transformation -log10(p-value) is used to improve visualization of FDR p-values). Here, significant results can be observed in almost all functional domains. The 39 spatial maps are also displayed in Fig. 3a (identified by numeric indexes; peak activations are provided in Supplementary Table). The spatial map set includes brain areas that have been previously identified as relevant for the neuroscience of creativity and music18,24,49: medial prefrontal cortex (MPFC; IC 73 and 37); anterior cingulate cortex (ACC; IC 99); motor areas, including left dorsal premotor (L dPM; IC 78), right dorsal premotor (R dPM; IC 67), supplementary motor area (SMA; IC 53), and pre-SMA (IC 5); cerebellum (ICs 15, 58 & 38); dorsolateral prefrontal (dlPFC) including right dlPFC (IC 36) and left dlPFC (IC 44); putamen in the limbic area (IC 77); insula (ICs 13 & 97). Notably, several components in the dorsal and ventral default mode network were also uncovered. However, Fig. 3a shows that effects are not circumscribed to a few areas, but distributed through the brain.
Figure 3b displays four average correlation matrices corresponding to each task tested in the One-Way ANOVA. Since the data is not resting state there is no expectation of a generalized anticorrelation with default mode areas. However, some task matrices in Fig. 3b show this anticorrelation pattern with higher or lower averages. The stronger correlations can be seen within each domain, except for the cerebellum and language domains, indicating that brain function is segregated on specialized functional domains.
Comparing functional connectivity per task
Specific functional changes were investigated by examining connectivity differences between tasks based on the four contrasts ImaPre-ImaImp, VocPre-VocImp, VocImp-ImaImp and VocPre-ImaPre. In this case FDR was applied to the 741 correlations of each group difference test. However, since four tests are performed for each correlation, an additional correction was imposed by correcting FDR at p-values < 0.0125 (0.05/4).
The four contrasts exhibit many significant differences as illustrated in Fig. 4. The two contrasts ImaPre-ImaImp and VocPre-VocImp show a large number of significant results with similar differences involving higher connectivity of ECN against vDMN and PrimVIS. HighVIS shows combinations of stronger (ECN) and weaker (AUD and CER) correlations with other domains. The last two contrasts VocImp-ImaImp and VocPre-ImaPre exhibit few significant results suggesting little difference whether musicians vocalize or imagine musical performance. VocImp shows weaker connectivity of vDMN against BG and AUD, but stronger connectivity of vDMN against ECN and HighVIS compared to ImaImp. VocPre exhibits weaker connectivity than ImaPre among several connections AUD-visual, AUD-dDMN, LAN-HighVIS, and within dDMN.
Whole brain graph metrics
Results Fig. 4 show evidence of widespread network-to-network (N2N) connectivity differences across the whole brain. These N2N differences suggest connectivity reconfigurations that vary for each task resulting in significant graph metric differences. For each graph metric, we tested the influence of frame-wise displacement by applying a MANCOVAN model (MANCOVAN is included in the GIFT software https://trendscenter.org/software/gift/). All frame-wise displacement tests were non-significant (p > 0.1) and we excluded this covariate following a reduced model approach allowing for the direct use of one way ANOVA50. One way ANOVA results confirmed some task differences in graph metrics after testing for normality using the Lilliefors test51 and applying appropriate normalization transformation (Tx): small-worldness (TX: x (no transformation), F = 3.5, p < 0.016), modularity (Tx: x2, F = 0.7, p = 0.55), characteristic path length (TX: x2, F = 7.5, p < 9e-5) and transitivity (TX: 1/x, F = 5.9, p < 7e-4). Post-hoc tests were applied to each significant metric looking to specific differences among conditions. Figure 5 shows the significant task related differences. Only Transitivity had significant differences while all other whole brain tests were excluded from Fig. 5 because their ANOVA p-values were not significant. The ImaPre task resulted in higher transitivity (higher potential for segregation) compared to VocImp. Since this contrast is not shown in Fig. 4 we provide a Supplementary Figure (ImaPre − VocImp) to show that ImaPre FNC is also generally stronger than in VocImp. Stronger correlations imply higher similarity or functional closeness among network triplets. This contrast is consisted with previously reported lesser functional connectivity during musical improvisation33.
Node specific graph measures
After looking at whole brain results, we analyzed specific connectivity effects related to specific networks as illustrated in Fig. 5. A One-Way ANOVA was performed for CC and eccentricity metrics of each network. Eccentricity was significantly lower in ImaPre compared to VocPre and ImaImp in the left inferior frontal gyrus (L IFG) indicating a reduced potential for integration of this network. CC was significantly the lowest in VocImp compared to any other condition in three networks: L STG, L AI, and L mFG. These networks thus show decreased segregation in VocImp suggesting diminishing communication with other connected networks.
Vocalize versus imagine conditions
Figure 4 show patterns of strong and weak connectivity contrasts related to imaging and vocalizing. Figure 6 shows results for the contrast Voc − Ima = (VocPre + VocImp) − (ImaPre + ImaImp) with significant differences for individual connectivity values. Effects on graph metrics were not found as they probably faded after joining sample groups. A diagram of the stronger connectivity contrasts is presented on the right for ease of interpretation. The DMN shows a dual behavior depending on its dorsal (dDMN) or ventral (vDMN) components. For the Voc condition, the dDMN shows weaker connectivity with itself and with a LAN network compared to the Ima condition. However, the vDMN shows stronger connectivity with visual networks, but weaker connectivity to auditory networks in the Voc condition. The AUD domain has stronger connectivity overall in the Ima condition. There was no effect found in the ECN or SEN domains indicating that.
Prelearned versus improvised conditions
Figure 7 summarizes the observations as ECN and AUD domains show stronger connectivity to other functional domains of the brain for the Pre condition. On the other hand, ECN is less connected during improvisation, but AUD establishes a stronger connection with areas in the HighVIS domain.
This work studied how the musician’s brain reconfigures its connectivity depending on the degree of creativity required during jazz music performance. We estimated static functional network connectivity from fMRI scans when scanned jazz musicians were vocalizing, imagining, improvising, or performing prelearned memorized scores. Data was analyzed with an unsupervised data-driven method to separate statistically independent brain networks and estimate their functional connectivity. A previous study conducted a similar analysis but focused on a small set of regions of interest33. The current analysis spans the whole brain, allowing us to observe widespread and richer effects on brain connectivity than our previous report. To our knowledge, this is the first analysis of whole brain connectivity during vocalized and imagined real-time production of creative output. Specifically, previous brain imaging studies with jazz musicians included only pianists2,28. The current paradigm allowed us to compare connectivity among vocally improvising musicians, providing a way to control for specific motor effects otherwise affected by the physical constraints of musical instrument manipulation.
The most important outcome in the Voc-Ima contrast is the absence of functional connectivity difference observed in ECN and SEN domains illustrated in Fig. 6. This observation suggests that connectivity of these brain networks during musical execution19,24,49,52 is indistinguishable whether musicians internalize or externalize their performances. Regularly, the ECN processes sensorial and internal information to coordinate behavior16. However, there is evidence that ECN is also elicited to accomplish mental planning, lacking of evident external behavior, which involves the imagined evaluation of a finite set of steps towards achieving a goal53. We can interpret these results to pinpoint one of the important purposes of ECN recruitment as aiming for the proficient planning and processing of musical related information. The difference between vocalized and imagined conditions was more evident when looking at the increased functional connectivity within the dDMN for the Ima condition, see Fig. 6. This observation is consistent with a previous study reporting increased DMN activation and connectivity during imagined tasks compared to a press button task53. In the current musical experiment, only specific dDMN areas were activated during the imagine condition located within the frontal pole which have been identified to process self-referential information and incorporate personally relevant stimuli as ‘mine’, i.e. self association of objects54. Imagined music performances could have been influenced by a more self-referenced personal experience that does not require external expression.
Connectivity differences between prelearned and improvised conditions may align with a previously suggested state of hypofrontality18,21. According to this view, frontal control areas are attenuated to allow bottom-up processes to drive behavior during improvisation. Figure 7 shows how our results align with a weaker connectivity of prefrontal areas (assigned to the ECN domain) during improvisation and stronger connectivity for the prelearned condition. In traditional creativity tasks (e.g., divergent thinking), ideas may be generated in an initial step by an unsupervised bottom-up process involving the DMN. In a second step, these ideas are then presumably evaluated according to applicability to the current task by a top-down control network driven by the ECN6. However, through training, creative experts may be able to maximize applicable ideas in the initial bottom-up stage, leading to a state in which evaluation by ECN is less necessary and thus attenuated17,55. This state may be particularly important during musical improvisation, where the generation occurs in real-time.
On the other hand, it is well known that performance of prelearned material is constantly evaluated to see if the actual output aligns with the encoded memory3,56. Here, we identified increased connectivity in the prelearned condition between ECN and DMN areas indicating higher cognitive control (see Fig. 7). In addition, ECN is more connected with visual areas, possibly because prelearned material was presented visually using traditional musical notation and the comparison between actual auditory output and the prelearned model may have involved this visual representation57. Finally, increased bilateral connectivity between auditory areas may involve increased evaluation processes during prelearned driven by higher level auditory cortices.
A notable effect is the reduced segregation linked to temporal, insula and frontal areas that seems to separate VocImp from the other conditions illustrated in Fig. 5. At one end Fig. 6 illustrates that connectivity within the DMN might be suppressed during the vocalize condition, avoiding interference with external goal-directed behavior seeking a proficient vocal performance27. At the other end in Fig. 7, improvisation reduced ECN connectivity with other networks. Notable is the reduced ECN – DMN connectivity for a free flow of musical novelty by allowing freer functioning of self-referential-default-mode areas of the brain21. The joint influence of both vocalizing and improvising points to a reduced number of connections which can explain the decrement in segregation observed in the VocImp against other tasks. In our previous analysis of this dataset, we found increased node activation using a traditional contrasts but less functional connectivity among six predefined areas during improvisation compared to prelearned performance33. Compared to VocImp, there is a trend of overall increased connectivity for the ImaPre task (see the Supplementary Figure provided). This hyperconnectivity in ImaPre is the result of combining two trends of stronger overall connectivity conditions. The prelearned had a large number of higher connectivity values than improvised (Fig. 7) and the imagine condition follow a similar overall increment of connectivity compared to vocalize. This trend played a role in the significantly lower eccentricity found in ImaPre as displayed in Fig. 5.
The pattern in which connectivity between ECN and DMN is attenuated may reflect a state of decreased top-down evaluation suggesting this state may be optimal during improvisation18,58. This state has been compared to the flow state in which the subject is completely immersed in an inherently motivating activity and evaluation processes are attenuated23. This state is dependent upon expertise in the task specific area allowing for continuous successful achievement59. As the flow state can be applied to many different activities, a domain general neural signature of this cognitive state has proved elusive. Yet, it has been suggested that the cognitive underpinnings of flow represent an optimal state for a specific activity60. Though no subjective measures of flow were collected from the current participants, several aspects of the task align with the potential for eliciting flow which is commonly reported by skilled improvisers61. All the participants were expert jazz improvisers. Even though none were vocalists, participants acknowledge they could perform the vocalization task without difficulty. Even though voice quality is not comparable to the standard of a trained scat vocalist, the instrumentalists could vocalize the prelearned melodies so that pitch and rhythm are easily identifiable. Expert jazz instrumentalists indeed often practice scat singing34. Furthermore, the harmonic context over which the improvisation was performed, the 12-measusure blues progression, is a very common tonal constraint that participants were familiar with. Yet, the task was likely immersive as the participants typically implied the harmonic structure in their single line improvisations (as is common practice in tonal jazz improvisation) without hearing an actual accompaniment. This is a typical goal of vocal practice for jazz instrumentalists and may therefore be highly motivating. Experts engaged in related motivating and immersive behaviors are very likely to experience flow60.
The major inherent limitation of the current paradigm compared to previous similar investigations2 concerns the lack of ability to analyze the improvised output. Due to technical errors, only audio recordings of 13 of the participants were captured. However, only trials in which the overall length of the improvisations aligned with the tempo given at the beginning of each trial were included in the analysis. Future research using the current vocalization task should capture high quality audio allowing for analysis of output. Furthermore, we did not ask participants to rate vividness after auditory imagine trials. This rating plus ratings of perceived flow should be included in future studies. Another important direction for future acquisition techniques will be to measure the effect of in-scanner motion during vocalization looking for ways to reduce movement variance. Gender bias toward male musicians was also a limitation. The unfortunate gender gap among expert jazz musicians is well documented62. Instances of female expert jazz instrumentalists to participate did not occur within the recruitment time frame. Another limitation of the cohort is the fact that instrumentalists were not expert vocal improvisers which might play a role in improvisation proficiency. However, the unusual use of vocalization for improvisation can be seen as an extra layer of creativity as musical pattern generation is less constrained by physical instrument limitations.
Outcomes in this study can be summarized as follows. First, executing prelearned music elicits higher functional connectivity than improvisation. Second, here we show for the first time that this attenuation of executive control during improvisation appears to be independent of modality (performed or imagined). Future research could adapt the imagining contrast to other domains in which actual performance of more or less creative activities is not possible within the confound of the MRI scanner (e.g. dance). Functional disconnection during improvisation has been linked to a state of mind that allows more freedom of information to flow with minimal cognitive control21. We found reduced integration during the VocImp task. Our results align with previous research that also found neural signatures implying improvisation is guided by bottom-up processes with less cognitive control. Importantly, our vocalization paradigm allowed for the inclusion of expert jazz musicians with many different instrument specializations implying the results may be generalizable to all jazz musicians. Future research could adapt our verbalization and imagination paradigm to other domains in which creation occurs under real-time constraints potentially identifying domain general neural signatures.
Amabile, T. Creativity in Context (Westview Press, 1996).
Beaty, R. E. The neuroscience of musical improvisation. Neurosci. Biobehav. Rev. 51, 108–117. https://doi.org/10.1016/j.neubiorev.2015.01.004 (2015).
Pressing, J. in John A. Sloboda (Hg.): Generative processes in music, Oxford 129–178 (1988).
Norgaard, M. How Jazz musicians improvise. Music Percept. 31, 271–287. https://doi.org/10.1525/mp.2014.31.3.271 (2014).
Henry, L. et al. Dig That lick: exploring patterns in Jazz with computational methods contributions for Jazzforschung/Jazz Research, Vol. 50. (2020).
Beaty, R. E., Benedek, M., Silvia, P. J. & Schacter, D. L. Creative cognition and brain network dynamics. Trends Cogn. Sci. 20, 87–95. https://doi.org/10.1016/j.tics.2015.10.004 (2016).
Andrews-Hanna, J. R., Smallwood, J. & Spreng, R. N. The default network and self-generated thought: component processes, dynamic control, and clinical relevance. Ann. N Y Acad. Sci. 1316, 29–52. https://doi.org/10.1111/nyas.12360 (2014).
Raichle, M. E. The brain’s default mode network. Annu. Rev. Neurosci. 38, 433–447. https://doi.org/10.1146/annurev-neuro-071013-014030 (2015).
Bowman, C. R. & Zeithamova, D. Abstract memory representations in the ventromedial prefrontal cortex and hippocampus support concept generalization. J. Neurosci. 38, 2605–2614. https://doi.org/10.1523/JNEUROSCI.2811-17.2018 (2018).
Spalding, K. N. et al. Ventromedial prefrontal cortex is necessary for normal associative inference and memory integration. J. Neurosci. 38, 3767–3775. https://doi.org/10.1523/JNEUROSCI.2501-17.2018 (2018).
Leech, R. & Sharp, D. J. The role of the posterior cingulate cortex in cognition and disease. Brain 137, 12–32. https://doi.org/10.1093/brain/awt162 (2014).
Bird, C. M., Keidel, J. L., Ing, L. P., Horner, A. J. & Burgess, N. Consolidation of complex events via reinstatement in posterior cingulate cortex. J. Neurosci. 35, 14426–14434. https://doi.org/10.1523/JNEUROSCI.1774-15.2015 (2015).
Dietrich, A. & Haider, H. A neurocognitive framework for human creative thought. Front. Psychol. 7, 2078. https://doi.org/10.3389/fpsyg.2016.02078 (2016).
Seeley, W. W. et al. Dissociable intrinsic connectivity networks for salience processing and executive control. J. Neurosci. 27, 2349–2356. https://doi.org/10.1523/JNEUROSCI.5587-06.2007 (2007).
Corbetta, M. & Shulman, G. L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201–215. https://doi.org/10.1038/nrn755 (2002).
Miller, E. K. & Cohen, J. D. An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167–202. https://doi.org/10.1146/annurev.neuro.24.1.167 (2001).
Pinho, A. L., de Manzano, O., Fransson, P., Eriksson, H. & Ullen, F. Connecting to create: expertise in musical improvisation is associated with increased functional connectivity between premotor and prefrontal areas. J. Neurosci. 34, 6156–6163. https://doi.org/10.1523/JNEUROSCI.4769-13.2014 (2014).
Limb, C. J. & Braun, A. R. Neural substrates of spontaneous musical performance: an FMRI study of jazz improvisation. PLoS ONE 3, e1679. https://doi.org/10.1371/journal.pone.0001679 (2008).
Berkowitz, A. The Improvising Mind: Cognition and Creativity in the Musical Moment. (Oxford University Press, 2010).
Sudnow, D. & Dreyfus, H. L. Ways of the Hand: A Rewritten Account. (The MIT Press, 2001).
Dietrich, A. The cognitive neuroscience of creativity. Psychon. Bull. Rev. 11, 1011–1026. https://doi.org/10.3758/bf03196731 (2004).
Harris, D. J., Vine, S. J. & Wilson, M. R. Is flow really effortless? The complex role of effortful attention. Sport Exerc. Perform. Psychol. 6, 103–114. https://doi.org/10.1037/spy0000083 (2017).
Csikszentmihalyi, M. Flow: The Psychology of Optimal Experience. Vol. 1990 (Harper & Row New York, 1990).
Liu, S. et al. Neural correlates of lyrical improvisation: an FMRI study of freestyle rap. Sci. Rep. 2, 834. https://doi.org/10.1038/srep00834 (2012).
Chialvo, D. R. et al. Neural substrates of interactive musical improvisation: an fMRI study of ‘Trading Fours’ in Jazz. PLoS ONE 9, e88665. https://doi.org/10.1371/journal.pone.0088665 (2014).
Sutherland, M. T., McHugh, M. J., Pariyadath, V. & Stein, E. A. Resting state functional connectivity in addiction: lessons learned and a road ahead. Neuroimage 62, 2281–2295. https://doi.org/10.1016/j.neuroimage.2012.01.117 (2012).
Sonuga-Barke, E. J. & Castellanos, F. X. Spontaneous attentional fluctuations in impaired states and pathological conditions: a neurobiological hypothesis. Neurosci. Biobehav. Rev. 31, 977–986. https://doi.org/10.1016/j.neubiorev.2007.02.005 (2007).
Loui, P. Rapid and flexible creativity in musical improvisation: review and a model. Ann. N Y Acad. Sci. https://doi.org/10.1111/nyas.13628 (2018).
Zatorre, R. J. & Zarate, J. M. The Human Auditory Cortex. Vol. 43 (2012).
Halwani, G. F., Loui, P., Ruber, T. & Schlaug, G. Effects of practice and experience on the arcuate fasciculus: comparing singers, instrumentalists, and non-musicians. Front. Psychol. 2, 156. https://doi.org/10.3389/fpsyg.2011.00156 (2011).
Arkin, C., Przysinda, E., Pfeifer, C. W., Zeng, T. & Loui, P. Gray matter correlates of creativity in musical improvisation. Front. Hum. Neurosci. 13, 169. https://doi.org/10.3389/fnhum.2019.00169 (2019).
Belden, A. et al. Improvising at rest: differentiating jazz and classical music training with resting state functional connectivity. Neuroimage 207, 116384. https://doi.org/10.1016/j.neuroimage.2019.116384 (2020).
Dhakal, K., Norgaard, M., Adhikari, B. M., Yun, K. S. & Dhamala, M. Higher node activity with less functional connectivity during musical improvisation. Brain Connect 9, 296–309. https://doi.org/10.1089/brain.2017.0566 (2019).
Berliner, P. Thinking in Jazz: The Infinite Art of Improvisation. (University of Chicago Press, 1994).
Adhikari, B. M. et al. The brain network underpinning novel melody creation. Brain Connect 6, 772–785. https://doi.org/10.1089/brain.2016.0453 (2016).
Friston, K. J. et al. Analysis of fMRI time-series revisited. Neuroimage 2, 45–53. https://doi.org/10.1006/nimg.1995.1007 (1995).
Himberg, J., Hyvärinen, A. & Esposito, F. Validating the independent components of neuroimaging time series via clustering and visualization. Neuroimage 22, 1214–1222 (2004).
Shirer, W., Ryali, S., Rykhlevskaia, E., Menon, V. & Greicius, M. Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb. Cortex 22, 158–165 (2012).
Power, J. D. et al. Methods to detect, characterize, and remove motion artifact in resting state fMRI. Neuroimage 84, 320–341 (2014).
Newman, M. E. Modularity and community structure in networks. Proc. Natl. Acad. Sci. U S A 103, 8577–8582. https://doi.org/10.1073/pnas.0601602103 (2006).
Watts, D. J. & Strogatz, S. H. Collective dynamics of “small-world” networks. Nature 393, 440–442. https://doi.org/10.1038/30918 (1998).
Newman, M. E. J. The structure and function of complex networks. SIAM Rev. 45, 167–256. https://doi.org/10.1137/s003614450342480 (2003).
Newman, M. E. Fast algorithm for detecting community structure in networks. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 69, 066133. https://doi.org/10.1103/PhysRevE.69.066133 (2004).
Bullmore, E. & Sporns, O. Complex brain networks: graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10, 186–198. https://doi.org/10.1038/nrn2575 (2009).
Rubinov, M. & Sporns, O. Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52, 1059–1069. https://doi.org/10.1016/j.neuroimage.2009.10.003 (2010).
Wang, J., Lu, M., Lu, L. & Belardo, F. Spectral properties of the eccentricity matrix of graphs. Discret. Appl. Math. 279, 168–177. https://doi.org/10.1016/j.dam.2019.10.015 (2020).
Fornito, A., Zalesky, A. & Breakspear, M. Graph analysis of the human connectome: promise, progress, and pitfalls. Neuroimage 80, 426–444. https://doi.org/10.1016/j.neuroimage.2013.04.087 (2013).
Humphries, M. D. & Gurney, K. Network “small-world-ness”: a quantitative method for determining canonical network equivalence. PLoS ONE 3, e0002051. https://doi.org/10.1371/journal.pone.0002051 (2008).
Berkowitz, A. L. & Ansari, D. Generation of novel motor sequences: the neural correlates of musical improvisation. Neuroimage 41, 535–543. https://doi.org/10.1016/j.neuroimage.2008.02.028 (2008).
Allen, E. A. et al. A baseline for the multivariate comparison of resting-state networks. Front. Syst. Neurosci. 5, 2. https://doi.org/10.3389/fnsys.2011.00002 (2011).
Lilliefors, H. W. On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J. Am. Stat. Assoc. 62, 399. https://doi.org/10.1080/01621459.1967.10482916 (1967).
Beaty, R. E., Seli, P. & Schacter, D. L. Network neuroscience of creative cognition: mapping cognitive mechanisms and individual differences in the creative brain. Curr. Opin. Behav. Sci. 27, 22–30. https://doi.org/10.1016/j.cobeha.2018.08.013 (2019).
Gerlach, K. D., Spreng, R. N., Madore, K. P. & Schacter, D. L. Future planning: default network activity couples with frontoparietal control network and reward-processing regions during process and outcome simulations. Soc. Cogn. Affect Neurosci. 9, 1942–1951. https://doi.org/10.1093/scan/nsu001 (2014).
Kim, K. & Johnson, M. K. Extended self: spontaneous activation of medial prefrontal cortex by objects that are “mine”. Soc. Cogn. Affect Neurosci. 9, 1006–1012. https://doi.org/10.1093/scan/nst082 (2014).
Rosen, D. S. et al. Anodal tDCS to right dorsolateral prefrontal cortex facilitates performance for novice Jazz improvisers but hinders experts. Front. Hum. Neurosci. 10, 579. https://doi.org/10.3389/fnhum.2016.00579 (2016).
Ruiz, M. H., Jabusch, H. C. & Altenmuller, E. Detecting wrong notes in advance: neuronal correlates of error monitoring in pianists. Cereb Cortex 19, 2625–2639. https://doi.org/10.1093/cercor/bhp021 (2009).
Rahman, S. S., Christensen, K., Jensen, H. J., Vuust, P. & Bhattacharya, J. Neural markers for musical creativity in Jazz improvisation and classical interpretation. bioRxiv. https://doi.org/10.1101/2021.02.12.427648 (2021).
Pinho, A. L., Ullen, F., Castelo-Branco, M., Fransson, P. & de Manzano, O. Addressing a paradox: dual strategies for creative performance in introspective and extrospective networks. Cereb Cortex 26, 3052–3063. https://doi.org/10.1093/cercor/bhv130 (2016).
de Manzano, O., Theorell, T., Harmat, L. & Ullen, F. The psychophysiology of flow during piano playing. Emotion 10, 301–311. https://doi.org/10.1037/a0018432 (2010).
de Manzano, Ö. Flow in Performance and Creative Cognition – An Optimal State of Task-Based Adaptation. In A. Abraham (Ed.), The Cambridge Handbook of the Imagination (Cambridge Handbooks in Psychology, pp. 796-810). Cambridge: Cambridge University Press. https://doi.org/10.1017/9781108580298.047 (2020).
Biasutti, M. & Frezza, L. Dimensions of music improvisation. Creat. Res. J. 21, 232–242. https://doi.org/10.1080/10400410902861240 (2009).
Van, V. Women in Jazz music: a hundred years of gender disparity in Jazz study and performance (1920–2020). Jazz Educ. Res. Pract. 2, 211. https://doi.org/10.2979/jazzeducrese.2.1.16 (2021).
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Vergara, V.M., Norgaard, M., Miller, R. et al. Functional network connectivity during Jazz improvisation. Sci Rep 11, 19036 (2021). https://doi.org/10.1038/s41598-021-98332-x