Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Theta-gamma coupling binds visual perceptual features in an associative memory task

Abstract

It is an integral function of the human brain to sample novel information from the environment and to integrate them into existing representations. Recent evidence suggests a specific role for the theta rhythm (4–8 Hz) in mnemonic processes and the coupling between the theta and the gamma rhythm (40–120 Hz) in ordering and binding perceptual features during encoding. Furthermore, decreases in the alpha rhythm (8–12 Hz) are assumed to gate perceptual information processes in semantic networks. In the present study, we used an associative memory task (object-color combinations) with pictures versus words as stimuli (high versus low visual information) to separate associative memory from visual perceptual processes during memory formation. We found increased theta power for later remembered versus later forgotten items (independent of the color judgement) and an increase in phase-amplitude coupling between frontal theta and fronto-temporal gamma oscillations, specific for the formation of picture-color associations. Furthermore, parietal alpha suppression and gamma power were higher for pictures compared to words. These findings support the idea of a theta-gamma code in binding visual perceptual features during encoding. Furthermore, alpha suppression likely reflects perceptual gating processes in semantic networks and is insensitive to mnemonic and associative binding processes. Gamma oscillations may promote visual perceptual information in visual cortical networks, which is integrated into existing representations by prefrontal control processes, working at a theta pace.

Introduction

To retain a coherent internal representation of the outer world, the wake human brain constantly samples and integrates information from the environment1,2. The integration of novel information relies on the formation of new associations between perceptual information, to form a coherent spatio-temporal representation of the environment3. This way, mnemonic processes are inextricably linked to perceptual processes4, the activation of semantic neuronal networks and the integration of novel sensory information. Specifically, Cowan conceptualizes perceptual processes as the activation of existing neuronal representations (the long-term memory storage), which may then be bound into memories (forming new associations in cortical semantic networks).

On a neuronal time scale, the activity within and across nerve cell populations is coordinated and integrated by the rhythmic synchronization of neuronal activity5,6,7 and it is assumed that neuronal rhythms are key mechanisms, which facilitate perceptual processes8 and enable the formation of new memories9. To observe memory formation processes in the human brain, in subsequent memory paradigms, the neuronal activity during encoding is contrasted between later remembered and later forgotten items10. Previous electro- and magnetoencephalography (EEG and MEG) studies have established that the formation of novel memory traces is closely associated with neuronal oscillatory activity in the theta (3–8 Hz), alpha (8–12 Hz), and gamma (40–120 Hz) frequency in the human brain11,12,13. Specifically, successful encoding in memory tasks using visual stimuli was marked by increases in theta and gamma power and a decrease in alpha power11,13.

Although visual perceptual and mnemonic mechanisms are inextricably linked4, oscillatory dynamics at different frequency ranges are assumed to index distinct functional mechanisms during memory formation. Theta oscillations facilitate associative binding14, play a functional role in integrating of novel perceptual information into lasting memory traces15,16, and increase with the intentional encoding of visual perceptual features17. Gamma oscillations in the visual cortex reflect the promotion of perceptual signals along the visual hierarchy18, and the sustained activation of recent perceptual inputs in working memory19,20. Decreases in alpha activity are assumed to facilitate visual cortical processes during memory formation11,21,22. Specifically, the alpha rhythm was decreased for the memory formation in semantic encoding tasks17,22 and was insensitive to the intentional encoding of perceptual features17. Alpha oscillations are assumed to inhibit neuronal activity in task-irrelevant regions, while routing perceptual processes to task-relevant regions23. Thus, reduced alpha oscillation may reflect the activation of semantic cortical networks24 and thereby form a functional architecture on which binding mechanisms operate23.

Recently, a specific role for mnemonic processing in the human brain has been ascribed to theta-gamma coupling processes. The frontal theta rhythm is posited to reflect an executive mnemonic mechanism that acts on perceptual information, reflected in gamma activity11,25. This is, theta-gamma coupling reflects the maintenance, ordering and binding of perceptual information within neuronal networks, forming a theta-gamma neuronal code26. This is substantiated by theta-gamma phase-amplitude coupling (PAC) pattern in the human neocortex27 and an increase in theta-gamma PAC in neocortical and medio-temporal networks accompanying successful episodic encoding11,28,29 and working memory processes19. A recent study using visual brain stimulation at an individual theta rhythm (versus an individual alpha rhythm) provides first functional evidence for the theta-gamma neuronal code in memory formation processes16. The theta-gamma code is assumed to support long-term potentiation processes in the hippocampus30, the core system of human associative memory formation3. However, despite a clear theoretical dissociation between the oscillatory dynamics that underpin memory encoding31, mnemonic and visual perceptual processes have not been separated experimentally, thus far.

In the present encephalographic (EEG) study, we aimed to dissociate the neuronal oscillatory activity for associative binding and visual perceptual processes during memory formation. To pinpoint associative memory processes, we used a subsequent memory design with an associative encoding and retrieval task. Furthermore, to scrutinize perceptual processes in the visual modality, we used picture and word stimuli (i.e., high and low visual information). Our analysis focused on oscillatory dynamics at individual theta, alpha and gamma frequencies, as well as theta-gamma PAC dynamics, and alpha-gamma PAC as a control analysis. We hypothesized that theta power and theta-gamma coupling reflects the formation of associative memories (i.e., a subsequent memory effect), while alpha suppression and gamma oscillations as such would primarily reflect visual perceptual processes (i.e., being pronounced for pictures versus words).

Methods

Subjects

The final sample consisted of 26 subjects (18 female, Mage = 20.0 years, SDage = 2.0 years). Two additional participants were not included in the analysis due to incomplete data assessments (n = 2). The experimental procedure was conducted in accordance with the World Medical Association’s Declaration of Helsinki (59th WMA general assembly, Seoul, 2008) and informed written consent was obtained from each participant. According to the regulations on freedom of research in the German Constitution (§ 5 (3)), and the German University Law (§ 22) this study did not require a separate vote by a local Institutional Review Board. All data will be made available on reasonable request.

Stimuli and Procedure

The pictorial stimuli were 400 pictures of objects (e.g. plants, animals, clothes, tools), taken from a standard picture library (Hemera Photo Objects; the exemplary stimuli shown in Fig. 1 were taken by the first author). Pictures were gray-scaled and presented at a visual angle of 6.2 × 6.2°. The words were 400 German nouns labeling familiar objects (with a maximum of 7 letters and 3 syllables).

Figure 1
figure1

The experimental procedure and the stimuli used for the associative memory task. During encoding, subjects had to from associations between pictures (high visual information) or words (low visual information) and the background color (yellow or green). During retrieval, subjects were asked to recognize objects and to recall the associated color, among distractor items. Stimulus presentation was identical for encoding and retrieval: each trial started with a blank screen (s), followed by a fixation point (variable duration of 0.5–1.0 s), and the presentation of a target stimulus (s). The trial terminated with a question mark that remained until a response was given.

The experimental procedure is depicted in Fig. 1. During encoding, participants were confronted with 300 pictures and 300 words, superimposed on a yellow or a green square. The associative memory task was to form object-color associations. Subjects were told the example of “a flower on green grass” as a potential association for the word or the picture of a flower presented on a green background. We avoided any overlaps between the objects presented as words and pictures (i.e., if a dog was presented as a picture, ‘dog’ was not used as a word). During retrieval, the pictures or words of the objects from encoding were intermixed with 50 new object stimuli of the respective category and presented on a gray background. For each picture, participants had to indicate, whether they retrieved the picture with the associated color (old, green or old, yellow), retrieved the picture without a color (old, no color) or did not see this picture before (new).

The stimulus presentation was identical during encoding and retrieval: each trial started with a blank screen (1 s), followed by a fixation point (variable duration of 0.5–1.0 s), and the presentation of a target stimulus (2 s). The trial terminated with a question mark, which remained on the screen until a response was given. Response keys were pressed with different fingers of the right hand. The procedure was demonstrated in 10 training trials prior to each phase of the actual experiment. We used a blocked design, presenting half of the pictorial stimuli (150, A), and half of the words (150, B), before presenting the other half of both categories (A, B). The order of the stimulus category presented first (pictures or words) was counterbalanced across participants resulting in an ABAB or BABA block logic. Object-color allocations (yellow or green) were randomized for each participant.

The present paper is a companion paper of a sleep study32. Thus, the memory for half of the stimuli was tests before, the other half after a three hour interval (i.e., after a sleep or wake interval of the sleep study). However, all stimuli were encoded at the same time, representing the data analyzed here.

EEG Recording and Analyses

The EEG was recorded from 128 active electrodes using a BioSemi Active-Two amplifier system (BioSemi, Amsterdam) at a sampling rate of 512 Hz in a shielded room. A horizontal and vertical EOG was applied to monitor eye movements and blinks. Two additional electrodes (CMS: Common Mode Sense and DRL: Driven Right Leg; cf. www.biosemi.com/faq/cms&drl.htm) served as reference and ground.

Prior to the analyses, continuous EEG data was high-pass filtered at 0.5 Hz and eye-blinks and muscle artifacts were detected using an independent component procedure and removed after visual inspection33. EEG data was then segmented into epochs from −1000 ms to 3000 ms with regard to the stimulus onset. Further artifacts and noisy trials were removed by the means of statistical correction of artifacts in dense array studies (SCADS34), like in former studies11,35. At least 18 trials remained for each condition of each participant and thus all remaining participants were included in the final analyses. Furthermore, we applied a correction of saccade-related transient potentials36, used in several previous publications25,32,36 to remove miniature eye-movement artifacts37. Due to artifact correction procedures approximately 10% of the original trials were removed. Throughout further analysis, an average reference was used. To obtain the spectral power over time, the trial data was convoluted using Morlet’s wavelets with seven cycles38 at a resolution of 0.5 Hz.

Theta, alpha and gamma spectral power

To account for the variability in frequency bands across individuals21, we identified the peak theta, alpha and gamma frequencies, individually for each subject, based on the mean spectral activity across all encoding conditions11,25,32. This resulted in (Mean ± SD): 3.8 Hz ± 0.8 Hz theta frequencies, 9.8 Hz ± 2.2 Hz alpha frequencies and 57.3 Hz ± 10.2 Hz gamma frequencies. Event-related spectral changes at individual peak frequencies were then calculated as the relative signal change of the post stimulus spectral activity, relative to a −500 to −100 ms pre-stimulus baseline, in percent. For all topographical analyses, the relative signal change values were averaged over the time of stimulus presentation (500 to 2000 ms), excluding early evoked responses11,13,25 (0 to 500 ms), for all comparisons.

First, to analyze the overall spectral changes for theta, alpha and gamma frequencies in the encoding phase, the relative signal change values were tested against zero, using a cluster mass permutation t-test (two-sided, dependent samples)39. Second, to test the differences in theta, alpha and gamma activity between encoding conditions and stimulus type, we entered the relative signal change values of all trials into a repeated measures ANOVA with the factors 3 Response (SF, subsequently forgotten; SR, subsequently remembered with correct, or without color judgement), 2 Stimulus (picture, word), 9 Cluster (i.e., a 3 caudality × 3 laterality clustering; see Fig. 2). This strategy was chosen as a conservative method to include the oscillatory activity across the whole scalp. Huynh-Feldt corrected p-values are reported for all main effects and interactions. All effects not mentioned in the result section were non-significant, at the level of p > 0.10.

Figure 2
figure2

Electrode configuration and the clusters used for the statistical analyses. Electrodes were grouped along two dimensions, divided into 3 laterality (left, medial, right) times 3 caudality (frontal, central, posterior) clusters.

Theta-gamma phase-amplitude coupling

Phase-amplitude coupling (PAC) between the phase of both low frequencies, theta and alpha, and the gamma amplitude, were calculated using the modulation index40 (MI). Specifically, the individual theta and alpha oscillatory activity were filtered +/−1 Hz around the individual peak frequency, across fronto-central electrode clusters for theta and at parietal electrode clusters for alpha. Specifically, we choose fronto-central electrodes for theta and parietal electrodes for alpha because these are the regions where these rhythms are most pronounced11,25 and their phase can thus be most reliably determined. The gamma signal was filtered between 50–80 Hz, a frequency range adapted from previous studies11,16,25, at each of the 128 electrodes. The MI was then calculated between the theta phase of fronto-central electrodes11,25 and the gamma amplitude, separately for each electrode, for the 500–2000 ms time window. To avoid any bias due to different trial numbers, the trial number of each condition were matched to the lowest number of trials within the test conditions (SR [color], SR [no color], SF), for each participant.

We then calculated a three factorial repeated measures ANOVA equal to the one used in spectral power analysis (3 Response × 2 Stimulus × 9 Cluster). Because theta-gamma coupling during memory formation has formerly been found to be a local effect11,19, we furthermore conducted a cluster permutation t-test (two-sided, dependent samples; Maris and Oostenveld, 2007). This is, we tested for significant electrode clusters in all SME contrasts of interest (SME [color] and SME [no color] for pictures and words) against randomly occurring clusters in all contrasts of interest, when conditions were shuffled. Specifically, the cluster calculation sums up all t-values of neighboring electrodes with a p-value < 0.05. To obtain a valid distribution for the calculation of significance 10000 Monte Carlo iterations with randomly assigned conditions, were calculated for each contrast. For the final statistics, the distributions of all SME contrasts were combined into one single distribution, to estimate the significance of the summed cluster t-values (combined cluster permutation test; cf. Köster et al., 2017). Noteworthy, by combining the permutation distributions of all SME differences, the significance test takes into account the overall differences in neuronal activity across all conditions.

Results

Behavioral Results

Response rates for old and new items are displayed in Table 1. We used d’ to quantify participants item memory (based on hits and false alarms, independent of the color judgement) and their associative memory performance (based on correct color judgements as hits and incorrect color judgements false alarms), separately for pictures and words32. Note that both measures reflect either only item memory or only item-color associations and are independent.

Table 1 Response rates in percent.

Overall, we found higher item memory performance for pictures (d’ = 1.70, SD = 0.55), compared to words (d’ = 1.23, SD = 0.45), t(25) = 4.23, p < 0.001, due to higher false alarm rates for word stimuli, see Table 1. There were no differences in associative memory performance between words (d’ = 0.98, SD = 0.44) and pictures (d’ = 0.88, SD = 0.45), t(25) = −1.49, p = 0.149.

EEG Results

Spectral power

The spectral changes across participants are displayed in Fig. 3. To test significant increases and decreases in the individual theta, alpha and gamma rhythm, we used a cluster permutation test against zero across all electrodes. All significant increases and decreases are displayed in Fig. 4. Subsequently, we used ANOVAs to test for global differences in theta, alpha, and gamma power across all 9 clusters, see Fig. 4, lower panels. For theta, we found a main effect Response, F(2, 50) = 7.67, p < 0.001, η² = 0.24, with higher theta power for remembered and known stimuli, compared to forgotten stimuli, see Fig. 4A. Furthermore, theta power was marginally higher for pictures compared to words, F(1, 25) = 3.23, p = 0.084, η² = 0.11, for the main effect of the Stimulus type and there was a marginal Stimulus x Response interaction, F(2, 50) = 2.94, p = 0.062, η² = 0.11. Specifically, the theta rhythm peaked at frontal electrodes, pronounced for remembered stimuli and for pictures. This was reflected in a main effect Cluster F(8, 200) = 5.70, p < 0.001, η² = 0.19, as well as a Cluster × Stimulus, F(8, 200) = 5.92, p < 0.001, η² = 0.19, and a Cluster × Response interaction, F(16, 400) = 1.91, p = 0.029, η² = 0.07. A subsidiary ANOVA at frontal clusters revealed a main effect for Response, F(2, 50) = 9.65, p < 0.001, η² = 0.28, and Stimulus, F(1, 25) = 7.57, p = 0.011, η² = 0.23.

Figure 3
figure3

Time-frequency plots illustrate the relative signal changes (RSC) upon stimulus onset across all subjects and encoding conditions included in the analyses (linear y-axis, indicating Hz). RSC were averaged across frontal and posterior electrodes for low frequencies and across posterior electrodes for high frequencies.

Figure 4
figure4

Topographical maps of the encoding activity, in relative signal changes (RSC). Figures indicate the RSCs for subsequently remembered item-color associations (SR, with color), items later retrieved without (SK) and subsequently forgotten items (SF). Topographies show the averaged power for the whole duration of the stimulus presentation (500 ms to 2000 ms) at individual theta, alpha and gamma frequencies. Black dots indicate the electrodes of statistically significant clusters (p < 0.05), tested against zero. Bars illustrate the RSCs across all clusters. The main effects of stimulus type and the post hoc t-tests between encoding conditions are displayed, *p = 0.055, *p < 0.05, **p < 0.01, ***p < 0.001.

In the alpha rhythm we found a stronger decrease in alpha power for pictures compared to words, F(1, 25) = 8.95, p = 0.006, η² = 0.26, main effect Stimulus. Alpha suppression was highest at posterior recording sites for the processing of pictorial stimuli, see Fig. 4B. This is reflected in a main effect Cluster, F(8, 200) = 79.40, p < 0.001, η² = 0.27, and a Cluster × Stimulus Interaction, F(8, 200) = 7.74, p < 0.001, η² = 0.24, and a subsidiary ANOVA at posterior clusters, main effect Stimulus, F(1, 25) = 17.61, p < 0.001, η² = 0.41. There was no difference between subsequent memory conditions, main effect Response, F(2, 50) = 0.34, p = 0.714, η² = 0.01.

For the gamma rhythm, we found pronounced posterior gamma activity over posterior recording sites and reduced gamma activity at temporal electrodes, see Fig. 4C, main effect Cluster: F(8, 200) = 13.92, p < 0.001, η² = 0.35. We found higher gamma activity for pictures compared to words, F(1, 25) = 9.09, p = 0.006, η² = 0.27, but no difference in gamma activity between remembered and forgotten stimuli, F(2, 50) = 2.12, p = 0.145, η² = 0.08. The stimulus effect was somewhat pronounced at posterior electrode clusters, confirmed by a marginal Cluster × Stimulus Interaction, F(8, 200) = 1.93, p = 0.071, η² = 0.07, and subsidiary ANOVA at posterior electrodes, main effect Stimulus: F(1, 25) = 15.09, p < 0.001, η² = 0.38. Posterior electrodes also revealed a trend for a Response effect, F(1, 25) = 3.11, p = 0.061, η² = 0.11.

Given that half of the stimuli were tested immediately and some were tested after a delay, we checked if there were any differences in spectral activity between these stimuli by adding the factor Retention Interval (immediate or delayed) as an additional factor in the ANOVAs. This did not reveal any main or interaction effects for stimuli tested immediately or after about 3 h, all p > 0.08, for 24 main effects and interaction across all 3 ANOVAs.

Theta-gamma phase-amplitude coupling

In a next step we used the MI to quantify phase-amplitude coupling between the fronto-central theta and posterior alpha phase and the gamma amplitude across all scalp electrodes, see Fig. 5A.

Figure 5
figure5

Subsequent memory effects (SMEs) in theta-gamma phase-amplitude coupling (PAC) for items remembered with or without color. (A) The cartoon head illustrates theta-gamma PAC, as assessed by the modulation index (MI). Theta-gamma PAC was assessed between individual theta phase across the mid-frontal and -central clusters with the 50–80 Hz gamma amplitude at each electrode. (B) Black dots indicate the electrodes of statistically significant clusters (p = 0.009), with higher theta-gamma PAC for pictures remembered with color. No theta-gamma PAC was found for the SME of pictures remembered without color, or the SMEs for remembered words.

In a first step, we entered the MI values of the 9 clusters from the power analyses into a Response × Stimulus × Cluster ANOVA (see above), we found a trend for a main effect Response, F(2,50) = 3.089, p = 0.054, η² = 0.11 and a Cluster × Stimulus interaction, F(4.263, 106.578) = 3.854, p = 0.008, η² = 0.13. Furthermore, for alpha-gamma PAC, there was a trend for a Stimulus effect, F(1, 25) = 3.493, p = 0.073, η² = 0.12. Given our specific hypothesis on theta-gamma PAC in associative memory processes and previous findings, that theta-gamma coupling effects were found in sparse electrode or voxel clusters11,19,28 (and may thus not be well characterized by an omnibus ANOVA), we further tested SME effects in a cluster based permutation test. Therefore, in a second step, we entered theta-gamma coupling into cluster permutation tests, testing the main SME contrasts namely comparing remembered stimuli with and without color against forgotten items, for pictures and words separately.

The cluster permutation test revealed a higher theta-gamma PAC for remembered associations (pictures with color) compared to forgotten pictures (p = 0.009) see Fig. 5B. No difference was found between pictures remembered without color, or memory performance for words, when comparing remembered words (with or without color) against forgotten words (all p > 0.12). Furthermore, no clusters were found for the same comparisons on alpha-gamma PAC (all p > 0.13), not displayed. Find the cluster statistics for the highest clusters of each SME contrast in Table 2.

Table 2 PAC clusters permutation statistics.

Critically, differences in cross-frequency coupling between conditions could be biased by power changes of the phase-modulating frequency. Since theta power was higher in the associative memory condition, estimations of theta phase might be improved in contrast to forgotten items. Consequently, the MI measure could be biased. To rule out this possibility, we applied the same control analysis as a previous study (Friese et al.11): Single-trial data of each participant were sorted regardless of condition by mean theta power averaged across the selected electrodes. We divided the sorted data into quartiles such that the first quartile (Q1) contained 25% of all trials with lowest theta power, and the forth quartile (Q4) contained 25% of all trials with highest theta power. For each quartile, we derived the MIs between the theta power averaged across fronto-central electrodes and the gamma amplitude at individual posterior electrodes, before averaging the MI values across all electrodes of posterior clusters. Naturally, we found an increase in the mean theta power, F(1.062, 26.552) = 41.79, p < 0.001, η² = 0.63. In contrast, MIs did not differ across quartiles, F(3, 75) = 1.465, p = 0.23, η² = 0.06. Hence, it is unlikely that our finding of increased cross-frequency coupling for remembered picture color associations versus the forgotten condition is due to theta power differences between the conditions.

Discussion

To our best knowledge, this is the first study to dissociate associative binding from visual processes in a subsequent memory task. Theta oscillations increased for subsequently remembered pictures and words, with and without the associated color. In the theta band, this effect was pronounced at frontal electrodes. Critically, theta-gamma PAC was increased between frontal and fronto-temporal electrodes selectively for picture-color associations, and no theta-gamma PAC was found for pictures remembered without color or for words (remembered with or without color). Furthermore, no SMEs were found in alpha-gamma PAC. Alpha, and gamma oscillations were sensitive to visual perceptual processes, with higher alpha suppression and increased gamma power for pictures compared to words. Differences between pictures and words in alpha and gamma oscillations were pronounced over posterior recording sites. Overall, these findings support our main hypotheses; First, the pivotal role of the frontal theta and theta-gamma PAC in binding visual perceptual features, and, second, that alpha and gamma oscillations reflect the gating and promotion of visual perceptual processes along the visual processing stream.

Noteworthy, in the present study we used more conservative analysis strategies than previously11,13,25. This is, we based the analyses on all electrodes, included the whole time window of the stimulus presentation, excluding the evoked response, and focused the analyses on specific individual frequencies. Furthermore, 26 participants were included in the analysis and, considering the complexity of the design, we had high trial numbers in each condition.

The present study provides further evidence for increased theta power during successful encoding. This is in line with several former studies using similar study designs11,13,17,22,25 (although recent studies with more variable designs and not based on individual frequencies also found lower theta oscillations to be associated with successful encoding41,42,43). The theta rhythm is proposed to mark mnemonic control processes1,11. Specifically the theta rhythm plays a pivotal role in ordering and binding perceptual information, reflected in a theta-gamma neuronal code26, with first evidence for a sequencing function in the human brain28,44. Using visual brain stimulation at an individual theta pace, recent evidence supports a functional role of the theta-rhythm and theta-gamma coupling processes in the formation of novel memories16. Theta activity is strongly associated with memory processes in the prefrontal cortex13,45 and the medio-temporal lobe46,47, two structures which closely interact in long-term memory processes48. Proposedly, theta-gamma PAC may provide an optimal temporal code for long-term potentiation processes in the medial temporal lobe30, the core system for episodic memories49, to establish a coherent representation of time and space3. Noteworthy, we found theta-gamma PAC pattern specifically between frontal and fronto-temporal electrodes in the present study, which may result from an interaction between frontal and medio-temporal networks. The present results replicated previous findings on gamma oscillations, coupled to the frontal11 or entrained16 theta rhythm during encoding. In addition, we could pinpoint that theta-gamma PAC is specific for the formation of visual perceptual feature binding in an associative memory task, which we did not find for non-associative memories or the encoding of words. Thus, theta-gamma PAC may reflect the binding of visual perceptual elements into coherent memories.

Alpha suppression is a marker of attention processes50 and plays a critical role in gating perceptual information in visual cortical networks23,24. Alpha oscillations may serve perceptual and mnemonic processes by the promotion of visual perceptual information along the visual hierarchy, reflected in the gamma band, with best evidence from cell recordings in the macaque visual cortex18,51. Noteworthy, in the present study we found a sharp distinction in alpha suppression and gamma oscillations between pictorial and written object presentations. In particular, alpha oscillations were not sensitive to the subsequent memory condition. These findings add to recent evidence that the alpha rhythm is rather insensitive with regard to the encoding condition16 and that event-related alpha suppression during mnemonic processing is rather associated with semantic and attentional processes accompanying the encoding of visual stimuli22,52. Thus, speculatively, subsequent memory effects in alpha suppression found in former studies11,13,22 may be due to a activation of existing semantic networks in the visual processing stream, which facilitates later retrieval. Noteworthy, by differentiating pictures versus words, we manipulate the complexity of visual perceptual features, processed in the visual modality. However, we do not presume that word processing requires less ‘perception’ or underlies different computational principles. We rather assume pictures provide richer features to be bound and are thus nicely traceable with the scalp-recorded EEG, in contrast to the concepts activated by words, and which may also explain the better remembrance of pictures, compared to words.

Regarding the pivotal role of theta-gamma PAC in associative memory formation, we assume that the theta-gamma code solves two critical computational problems, by mapping real time events to a faster, neuronal time scale. First, the neatly timed rhythmic activation within and across cell assemblies is a precondition for long term potentiation processes in the MTL30, implementing the Hebbian principle that cells which “fire together, wire together”53. This is, tetanic inputs at the pre and post synapsis are a prerequisite for LTP processes, and thus the formation of novel associations in MTL networks9. Furthermore, the theta-gamma code allows neuronal processes to speed up and advance ahead of time to emulate behavioral outcomes, such as place cells, which are activated before a specific location is actually passed54.

To conclude, the present findings are in support of a primary role of the theta-gamma code in human associative memory and support the view that theta and alpha oscillations play distinct roles in memory formation. This is, alpha may gate neuronal processes in semantic cortical networks underlying implicit and explicit processes24, while the theta rhythms reflects the explicit mental elaboration of perceptual elements, the computational mechanism for associative feature binding3. More generally, the theta-gamma neuronal code may implement a mnemonic sampling loop6, integrating novel perceptual elements bit by bit into existing representations to guide current behavior in the light of the present context and goals.

References

  1. 1.

    Buzsáki, G. The hippocampo-neocortical dialogue. Cereb. Cortex 6, 81–92 (1996).

    Article  Google Scholar 

  2. 2.

    Kandel, E. R., Schwartz, J. H. & Jessell, T. M. Principles of Neural Science. McGraw-Hill, https://doi.org/10.1036/0838577016 (2013).

  3. 3.

    Eichenbaum, H. Hippocampus: Cognitive processes and neural representations that underlie declarative memory. Neuron 44, 109–120 (2004).

    CAS  Article  Google Scholar 

  4. 4.

    Cowan, N. Evolving Conceptions of Memory Storage, Selective Attention, and their Mutual Constraints Within the Human Information-Processing System. Psychol. Bull. 104, 163–191 (1988).

    CAS  Article  Google Scholar 

  5. 5.

    Engel, A. K., Fries, P. & Singer, W. Dynamic predictions: Oscillations and synchrony in top–down processing. Nat. Rev. Neurosci. 2, 704–716 (2001).

    CAS  Article  Google Scholar 

  6. 6.

    Fries, P. Rhythms for Cognition: Communication through Coherence. Neuron 88, 220–235 (2015).

    CAS  Article  Google Scholar 

  7. 7.

    Varela, F., Lachaux, J., Rodriguez, E. & Martinerie, J. The brainweb: phase synchronization and large-scale integration. Nat. Rev. Neurosci. 2, 229–39 (2001).

    CAS  Article  Google Scholar 

  8. 8.

    VanRullen, R. Perceptual Cycles. Trends in Cognitive Sciences 20, 723–735 (2016).

    Article  Google Scholar 

  9. 9.

    Fell, J. & Axmacher, N. The role of phase synchronization in memory processes. Nat. Rev. Neurosci. 12, 105–118 (2011).

    CAS  Article  Google Scholar 

  10. 10.

    Paller, K. A. & Wagner, A. D. Observing the transformation of experience into memory. Trends in Cognitive Sciences 6, 93–102 (2002).

    Article  Google Scholar 

  11. 11.

    Friese, U. et al. Successful memory encoding is associated with increased cross-frequency coupling between frontal theta and posterior gamma oscillations in human scalp-recorded EEG. Neuroimage 66, 642–647 (2013).

    Article  Google Scholar 

  12. 12.

    Klimesch, W. EEG alpha and theta oscillations reflect cognitive and memory performance: A review and analysis. Brain Res. Rev. 29, 169–195 (1999).

    CAS  Article  Google Scholar 

  13. 13.

    Osipova, D. et al. Theta and Gamma Oscillations Predict Encoding and Retrieval of Declarative Memory. J. Neurosci. 26, 7523–7531 (2006).

    CAS  Article  Google Scholar 

  14. 14.

    Hanslmayr, S., Gross, J., Klimesch, W. & Shapiro, K. L. The role of alpha oscillations in temporal attention. Brain Res. Rev. 67, 331–343 (2011).

    Article  Google Scholar 

  15. 15.

    Clouter, A., Shapiro, K. L. & Hanslmayr, S. Theta Phase Synchronization Is the Glue that Binds Human Associative Memory. Current Biology 27, 3143–3148.e6 (2017).

    CAS  Article  Google Scholar 

  16. 16.

    Köster, M., Martens, U. & Gruber, T. Memory entrainment by visually evoked theta-gamma coupling. biorxiv. org, https://doi.org/10.1101/191189 (2017).

  17. 17.

    Köster, M., Haese, A. & Czernochowski, D. Neuronal oscillations reveal the processes underlying intentional compared to incidental learning in children and young adults. PLoS One 12 (2017).

  18. 18.

    Bosman, C. A. et al. Attentional Stimulus Selection through Selective Synchronization between Monkey Visual Areas. Neuron 75, 875–888 (2012).

    CAS  Article  Google Scholar 

  19. 19.

    Daume, J., Gruber, T., Engel, A. K. & Friese, U. Phase-Amplitude Coupling and Long-Range Phase Synchronization Reveal Frontotemporal Interactions during Visual Working Memory. J. Neurosci. 37, 313–322 (2017).

    CAS  Article  Google Scholar 

  20. 20.

    Kaiser, J., Ripper, B., Birbaumer, N. & Lutzenberger, W. Dynamics of gamma-band activity in human magnetoencephalogram during auditory pattern working memory. Neuroimage 20, 816–827 (2003).

    Article  Google Scholar 

  21. 21.

    Klimesch, W., Doppelmayr, M., Pachinger, T. & Ripper, B. Brain oscillations and human memory: EEG correlates in the upper alpha and theta band. Neurosci. Lett. 238, 9–12 (1997).

    CAS  Article  Google Scholar 

  22. 22.

    Hanslmayr, S., Spitzer, B. & Bäuml, K. H. Brain oscillations dissociate between semantic and nonsemantic encoding of episodic memories. Cereb. Cortex 19, 1631–1640 (2009).

    Article  Google Scholar 

  23. 23.

    Jensen, O. & Mazaheri, A. Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition. Front. Hum. Neurosci. 4, 1–8 (2010).

    Article  Google Scholar 

  24. 24.

    Klimesch, W. Alpha-band oscillations, attention, and controlled access to stored information. Trends Cogn. Sci. 16, 606–617 (2012).

    Article  Google Scholar 

  25. 25.

    Köster, M., Friese, U., Schöne, B., Trujillo-Barreto, N. & Gruber, T. Theta-gamma coupling during episodic retrieval in the human EEG. Brain Res. 1577, 57–68 (2014).

    Article  Google Scholar 

  26. 26.

    Lisman, J. E. & Jensen, O. The Theta-Gamma Neural Code. Neuron 77, 1002–1016 (2013).

    CAS  Article  Google Scholar 

  27. 27.

    Canolty, R. T. et al. High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex. Science (80-.). 313, 1626–1628 (2006).

    ADS  CAS  Article  Google Scholar 

  28. 28.

    Heusser, A. C., Poeppel, D., Ezzyat, Y. & Davachi, L. Episodic sequence memory is supported by a theta–gamma phase code. Nat. Neurosci. 19, 1374–1380 (2016).

    CAS  Article  Google Scholar 

  29. 29.

    Staudigl, T. & Hanslmayr, S. Theta oscillations at encoding mediate the context-dependent nature of human episodic memory. Curr. Biol. 23, 1101–1106 (2013).

    CAS  Article  Google Scholar 

  30. 30.

    Pavlides, C., Greenstein, Y. J., Grudman, M. & Winson, J. Long-term potentiation in the dentate gyrus is induced preferentially on the positive phase of θ-rhythm. Brain Res. 439, 383–387 (1988).

    CAS  Article  Google Scholar 

  31. 31.

    Hanslmayr, S., Staresina, B. P. & Bowman, H. Oscillations and Episodic Memory: Addressing the Synchronization/Desynchronization Conundrum. Trends Neurosci. 39, 16–25 (2016).

    CAS  Article  Google Scholar 

  32. 32.

    Köster, M., Finger, H., Kater, M.-J., Schenk, C. & Gruber, T. Neuronal Oscillations Indicate Sleep-dependent Changes in the Cortical Memory Trace. J. Cogn. Neurosci. 29, 698–707 (2017).

    Article  Google Scholar 

  33. 33.

    Chaumon, M., Bishop, D. V. M. & Busch, N. A. A practical guide to the selection of independent components of the electroencephalogram for artifact correction. J. Neurosci. Methods 250, 47–63 (2015).

    Article  Google Scholar 

  34. 34.

    Junghöfer, M., Elbert, T., Tucker, D. O. N. M. & Rockstroh, B. Statistical control of artifacts in dense array EEG 0 MEG studies. Wiley Online Libr. 523–532 (2000).

  35. 35.

    Gruber, T., Tsivilis, D., Giabbiconi, C.-M. & Müller, M. M. Induced electroencephalogram oscillations during source memory: familiarity is reflected in the gamma Band, recollection in the theta Band. J. Cogn. Neurosci. 20, 1043–1053 (2008).

    Article  Google Scholar 

  36. 36.

    Hassler, U., Barreto, N. & Gruber, T. Induced gamma band responses in human EEG after the control of miniature saccadic artifacts. Neuroimage (2011).

  37. 37.

    Yuval-Greenberg, S., Tomer, O., Keren, A. S., Nelken, I. & Deouell, L. Y. Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades. Neuron 58, 429–441 (2008).

    CAS  Article  Google Scholar 

  38. 38.

    Tallon-Baudry, C. & Bertrand, O. Oscillatory gamma activity in humans and its role in object representation. Trends Cogn. Sci. 3, 151–162 (1999).

    CAS  Article  Google Scholar 

  39. 39.

    Maris, E. & Oostenveld, R. Nonparametric statistical testing of EEG- and MEG-data. J. Neurosci. Methods 164, 177–190 (2007).

    Article  Google Scholar 

  40. 40.

    Tort, A. B. L., Komorowski, R., Eichenbaum, H. & Kopell, N. Measuring phase-amplitude coupling between neuronal oscillations of different frequencies. J. Neurophysiol. 104, 1195–210 (2010).

    Article  Google Scholar 

  41. 41.

    Griffiths, B., Mazaheri, A., Debener, S. & Hanslmayr, S. Brain oscillations track the formation of episodic memories in the real world. Neuroimage 143, 256–266 (2016).

    Article  Google Scholar 

  42. 42.

    Greenberg, J. A., Burke, J. F., Haque, R., Kahana, M. J. & Zaghloul, K. A. Decreases in theta and increases in high frequency activity underlie associative memory encoding. Neuroimage 114, 257–263 (2015).

    Article  Google Scholar 

  43. 43.

    Burke, J. F. et al. Synchronous and asynchronous theta and gamma activity during episodic memory formation. J. Neurosci. 33, 292–304 (2013).

    CAS  Article  Google Scholar 

  44. 44.

    Bahramisharif, A., Jensen, O., Jacobs, J. & Lisman, J. Serial representation of items during working memory maintenance at letter-selective cortical sites. bioRxiv (2017).

  45. 45.

    Sederberg, P. B., Kahana, M. J., Howard, M. W., Donner, E. J. & Madsen, J. R. Theta and gamma oscillations during encoding predict subsequent recall. J. Neurosci. 23, 10809–10814 (2003).

    CAS  Article  Google Scholar 

  46. 46.

    Fell, J. et al. Human memory formation is accompanied by rhinal-hippocampal coupling and decoupling. Nat. Neurosci. 4, 1259–1264 (2001).

    MathSciNet  CAS  Article  Google Scholar 

  47. 47.

    Rutishauser, U., Ross, I. B., Mamelak, A. N. & Schuman, E. M. Human memory strength is predicted by theta-frequency phase-locking of single neurons. Nature 464, 903–907 (2010).

    ADS  CAS  Article  Google Scholar 

  48. 48.

    Simons, J. S. & Spiers, H. J. Prefrontal and medial temporal lobe interactions in long-term memory. Nat. Rev. Neurosci. 4, 637–648 (2003).

    CAS  Article  Google Scholar 

  49. 49.

    Squire, L. R. & Zola-morgan, S. The Medial Temporal Lobe Memory System. Science (80-.). 253, 1380–1386 (1991).

    ADS  CAS  Article  Google Scholar 

  50. 50.

    Berger, H. Über das Elektrenkephalogramm des Menschen: Achte Mitteilung. Arch. Psychiatr. Nervenkr. 101, 452–469 (1934).

    Article  Google Scholar 

  51. 51.

    Haegens, S., Nacher, V., Luna, R., Romo, R. & Jensen, O. α-Oscillations in the monkey sensorimotor network influence discrimination performance by rhythmical inhibition of neuronal spiking. Proc. Natl. Acad. Sci. 108, 19377–19382 (2011).

    ADS  CAS  Article  Google Scholar 

  52. 52.

    Minarik, T., Berger, B. & Sauseng, P. The involvement of alpha oscillations in voluntary attention directed towards encoding episodic memories. Neuroimage 166, 307–316 (2018).

    Article  Google Scholar 

  53. 53.

    Hebb, D. O. The Organization of Behavior; A Neuropsychological Theory. (New York: Wiely, 1949), https://doi.org/10.2307/1418888.

  54. 54.

    O’Keefe, J., Recce, M. L., O’Keefe, J. & Recce, M. L. Phase relationship between hippocampal place units and the hippocampal theta rhythm. Hippocampus 3, 317–330 (1993).

    Article  Google Scholar 

Download references

Acknowledgements

We acknowledge support by Deutsche Forschungsgemeinschaft (DFG) and Open Access Publishing Fund of Osnabrück University for covering the article processing charge.

Author information

Affiliations

Authors

Contributions

M.K. conceived the study. M.K., M.K. and T.G. designed the study. M.K. and M.K. assessed the data. M.K., H.F. and S.G. analyzed the data. M.K. wrote the manuscript. All authors revised the manuscript.

Corresponding author

Correspondence to Moritz Köster.

Ethics declarations

Competing Interests

The authors declare no competing interests.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Köster, M., Finger, H., Graetz, S. et al. Theta-gamma coupling binds visual perceptual features in an associative memory task. Sci Rep 8, 17688 (2018). https://doi.org/10.1038/s41598-018-35812-7

Download citation

Keywords

  • Theta Gamma
  • Phase-amplitude Coupling (PAC)
  • Theta Power
  • Visual Perceptual Processing
  • Gamma Oscillations

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing