Main

Working memory (WM), the ability to maintain and manipulate a limited amount of information in mind for a brief period of time6, is a crucial component of cognition that is often compromised in disease. WM maintenance is an active process that retains information that is no longer available in the external world. A mechanism that is thought to support WM is persistent neural activity7,8,9,10. In humans, memoranda-specific persistent activity has been observed in the human medial temporal lobe (MTL)11,12, an area of the brain that becomes essential for WM when distractors are present or memory load is high13. It is thought that cognitive control is required to support the maintenance of WM content under these circumstances1,2. Models of WM assign the role of control to the frontal lobes3,4,14, but little is known about how storage and control mechanisms interact.

A ubiquitous macroscopic electrophysiological phenomenon is TG-PAC15,16,17,18,19,20,21. Although its functional role remains poorly understood, a major hypothesis is that PAC enables the integration of local sensory information processing with brain-wide cognitive control22,23. Within this framework, local increases in power in the gamma-frequency range (30–140 Hz)24,25,26,27 reflect local processing, whereas long-range interareal interactions in the theta range (3–7 Hz) mediate cognitive control28,29,30. TG-PAC could therefore serve as a tool to integrate these two processes in local circuitries16,31,32. However, to date, it remains unclear how these theories translate to single-neuron activity and how PAC exerts control over WM maintenance processes. Here we test the hypothesis that neurons whose activity is modulated by both theta phase and gamma amplitude are engaged in interareal interactions between the frontal and temporal lobes, thereby exerting PAC-mediated cognitive control over WM storage. We examined whether top-down control directly modulated the cells that carry information about the memoranda currently held in WM or whether, alternatively, control is exerted indirectly through a different group of cells.

We recorded single-cell and local field potential (LFP) activity from the medial frontal cortex and MTL while patients who had undergone neurosurgery performed a WM task (36 patients, 44 sessions; Supplementary Table 5) with pictures as stimuli. All of the pictures belonged to one of five visual categories. In each trial, the patients maintained either one (load 1) or three (load 3) consecutively presented pictures in their WM for 2.5–2.8 s (Fig. 1a). The patients were then asked whether a probe stimulus shown was identical to one of the item(s) they were holding in WM. Mean accuracy was 93.66 ± 7.04% (mean ± s.d.; 78.34 ± 20.09% of all errors were false negatives) and the participants responded slower (1.46 s versus 1.33 s; t43 = 6.42, P < 0.001) and less accurately (91.60% versus 95.71%; t43 = −4.45, P < 0.001) in load 3 trials compared with load 1 trials (Fig. 1d).

Fig. 1: Task, recording sites and behaviour.
figure 1

a, An example trial. Each trial consisted of either one (load 1) and three (load 3) consecutively presented pictures, each presented for 2 s (separated by a variable blank screen of up to 200 ms as indicated by a small dot). After a variable maintenance period with an average duration of 2.7 s, a probe picture was presented. The task was to decide whether the probe picture has been part of the pictures shown during encoding in this trial (the correct answer was ‘No’ in the example shown). For copyright reasons, the pictures shown are similar but not identical to those used in the study. b, The recording locations. Each coloured dot represents the location of a microwire bundle across all 44 sessions shown on a standardized MNI152 brain template (left) and in a 3D model using the Brainnetome Atlas (right). The slices (https://osf.io/r2hvk/) were obtained under a Creative Commons licence CC BY 4.0. c, The proportions of neurons recorded in each brain area. d, The behaviour of the participants. Patients made fewer errors (P = 0.0001) and responded faster (P = 0.0001) in load 1 compared with load 3 trials. Statistical analysis was performed using two-sided permutation-based t-tests with 10,000 permutations. Each line connects the two dots belonging to the same session. n = 44 sessions. The RT was measured relative to the probe stimulus onset. Data are mean ± s.e.m. ***P < 0.001.

Hippocampal PAC is modulated by WM load

We recorded from 1,454 single neurons (Fig. 1b,c) and from 1,922 microwire channels with LFP (Extended Data Fig. 1f,g) across the hippocampus, amygdala, pre-supplementary motor area (pre-SMA), dorsal anterior cingulate cortex (dACC) and ventromedial prefrontal cortex (vmPFC). To determine whether PAC was present in the LFP during the WM maintenance period, we estimated PAC as a function of low-frequency (2–14 Hz) phase and high-frequency (30–150 Hz) power. Across all of the recorded channels (Fig. 2a; average plots per brain area are shown in Extended Data Fig. 2a), PAC was strongest between the phase in the theta range (3–7 Hz) and the amplitude in two different gamma-frequency bands—a lower (30–55 Hz) and a higher gamma range (70–140 Hz). For each channel, we then separately averaged the normalized modulation indices in the theta to low-gamma and the theta to high-gamma combinations and assessed which of the channels exhibited significant PAC across both load conditions in the given frequency combination (averaged z score > 1.64; P < 0.05; right sided). For theta to high-gamma PAC, 137 out of 586 hippocampal channels showed significant PAC across all correct trials from both load conditions (Fig. 2b). For these 137 channels, we then compared the PAC estimates between the two load conditions. This comparison revealed significantly weaker theta–high-gamma PAC in load 3 compared with load 1 trials (t136 = −4.26, P < 0.001; Fig. 2c (left); false-discovery rate (FDR) corrected for the five brain regions of interest33; Fig. 2d shows PAC for a single example channel in the hippocampus; Fig. 2e shows the average PAC across all significant PAC channels in the hippocampus).

Fig. 2: TG-PAC.
figure 2

a, Average normalized modulation indices for all phase–amplitude pairs. n = 1,917 channels. b, The proportion of channels with significant theta–high-gamma PAC in each area, determined by comparisons to trial-shuffled surrogates (both loads). The horizontal lines indicate the 99th percentile of the surrogate null distribution per area (P = 0.005 for hippocampus (hippo.), amygdala (amy.) and vmPFC; right-sided permutation test, no adjustment for multiple comparisons). c, log-normalized modulation indices were averaged within the theta–high-gamma band in each load and compared between the loads in each significant PAC channel in each region. Only in the hippocampus, theta–high-gamma PAC differed as a function of load, with PAC higher in load 1 versus load 3 trials (left: n = 137 channels, P = 0.0005; amygdala (middle): n = 130, P = 0.38; vmPFC (right): n = 40, P = 0.87; two-sided permutation-based t-tests; FDR corrected for all five brain areas). z-scored values were shifted into a positive range by an offset of 1 and log-transformed for illustrative purposes only. All statistics are based on non-transformed z values. d, Example gamma amplitude distribution over theta phase as well as comodulograms with raw modulation indices in each load for a representative hippocampal channel. Note the wider distribution of gamma amplitude over theta phase in load 3 trials, which leads to lower levels of PAC (further analysis is provided in Extended Data Fig. 3a). Normalized MI values were as follows for the two examples shown: load 1, z = 16.52; load 3, z = 7.92. e, Average normalized modulation indices for significant hippocampal PAC channels. n = 137. f, TG-PAC was significantly negatively correlated with RTs in the hippocampus (n = 137, P = 6 × 10−5, mixed-effects GLM), but not in the amygdala (n = 130, P = 0.48) or the vmPFC (n = 40, P = 0.24). GLM results are shown in Supplementary Table 2. Each dot represents a significant PAC channel. For c,f, data are mean ± s.e.m. *P < 0.05; NS, not significant.

Two other brain areas also exhibited substantial proportions of channels with significant PAC: the amygdala and the vmPFC (Fig. 2b). However, in contrast to the hippocampus, theta–high-gamma PAC did not differ significantly between the two load conditions in neither of these two areas (Fig. 2c; t129 = 1.43, P = 0.38, Bayes factor (BF)01 = 1.40; and t39 = 0.16, P = 0.87, BF01 = 5.84, respectively). In the other two frontal areas that we examined (pre-SMA and dACC), only a small proportion of channels had significant theta–high-gamma PAC (Fig. 2b) and PAC in these channels did not differ significantly between the two loads (pre-SMA: t4 = −0.16, P = 0.87; dACC: t13 = −0.82, P = 0.73). These observations were qualitatively comparable when averaging channels within each patient (Extended Data Fig. 2b). For PAC involving the low gamma band (30–55 Hz), there were no significant differences between the load conditions in any of the regions (Extended Data Fig. 2c and Supplementary Table 1). Next, we asked whether PAC is associated with reaction times (RTs), with the idea that faster RTs indicate success of control. In the hippocampus, faster RTs were associated with stronger single-trial estimates of TG-PAC (Methods and Supplementary Table 2; Fig. 2f shows univariate correlation coefficients for illustration; all statistics and conclusions are based on the generalized linear model (GLM) results). By contrast, there were no significant correlations between PAC and RT in the amygdala and vmPFC (Fig. 2f and Supplementary Table 2).

Lastly, we tested whether the differences in hippocampal PAC between loads could be explained by changes in power, theta waveform shape, cross-frequency phase–phase coupling, preferred phase or PAC peak frequency but did not find evidence for any of those factors (Extended Data Fig. 3). These findings suggest that PAC is related to ongoing WM processes during the maintenance period in the hippocampus, but not in the amygdala or frontal lobe.

Category cells support WM maintenance

We next investigated whether cells remained persistently active during WM maintenance and, if so, whether their activity was related to PAC. We first selected for category neurons, which are cells of which the firing rate (FR) was related to the visual category of the stimuli shown during encoding (Methods). We identified such cells at numbers higher than expected by chance within the hippocampus (89 neurons (24.72%)), amygdala (181 neurons (36.49%)) and vmPFC (37 neurons (17.96%)) but not within the pre-SMA and dACC (Extended Data Fig. 4a; an example hippocampal neuron is shown in Fig. 3a). During the maintenance period, the FRs of the identified category neurons remained elevated during the maintenance period compared with the baseline across all of the correct trials in the MTL, but not in the vmPFC (Fig. 3b shows the hippocampus and amygdala combined for simplicity; statistics per area are shown in Extended Data Fig. 4b). Furthermore, the FRs of category cells were significantly higher in trials in which a stimulus of the preferred category of a cell was held in WM relative to when patients held stimuli in mind that belonged to the non-preferred categories of a cell in the MTL, but not the vmPFC (t269 = 2.93, P = 0.001; Fig. 3b; see Extended Data Fig. 4b for vmPFC). Category neurons in the MTL but not the frontal lobe therefore exhibited stimulus-specific persistent activity (statistics per area are shown in Extended Data Fig. 4b). For this reason, we focus on MTL category neurons for the remainder of the paper.

Fig. 3: FRs and SFC of category neurons in MTL.
figure 3

a, Example hippocampal category neuron. The preferred category of this neuron was ‘animals’. Pic., picture. b, Category neurons (n = 270) remained active (preferred (pref.) versus baseline (bsl), P = 0.0001; non-preferred (non-pref.), P = 0.0001) and retained their selectivity during the maintenance period, with FRs higher for preferred compared with non-preferred categories (P = 0.001). FRs are shown as the percentage change compared with the baseline (−0.9 to −0.3 s before picture 1 onset). c, FRs of category neurons were higher in load 1 compared with load 3 trials with their preferred category held in WM (n = 270, P = 0.004) during the maintenance period. d, Category neurons fired more in correct compared with incorrect trials (n = 246, P = 0.02). e, SFC between spikes and LFPs from the same area. The slice (https://osf.io/r2hvk/) was obtained under a Creative Commons licence CC BY 4.0. f, Paired with PAC channels, hippocampal category neurons were more strongly phase-locked to local gamma LFPs with the preferred category held in WM (n = 151 combinations; P = 0.004). Differences were not significant in the amygdala (n = 423) or non-PAC channels (Extended Data Fig. 5e). Statistical analysis was performed using two-sided cluster-based permutation t-tests. g, Gamma (70–140 Hz) SFC for hippocampal category neurons was stronger for preferred versus non-preferred trials in both load conditions (main effect preference, F1,150 = 16.23, P = 0.0001; load 1, P = 0.003; load 3, P = 0.004). No main effect of load (P = 0.25) or interaction (P = 0.33) was found. Each dot is a neuron–LFP channel pair (n = 151). h, TG-PAC was positively correlated with the FR of category neurons in the hippocampus (n = 151, P = 0.017, mixed-effects GLM), but not in the amygdala (n = 423, P = 0.45). The GLM results are shown in Supplementary Table 3. For bd,g, statistical analysis was performed using two-sided permutation-based t-tests (bd, lower brackets in g) and F-tests (top bracket in g). For ad,fh, data are mean ± s.e.m. (coloured areas in a,f); **P < 0.01.

The activity of category neurons in the MTL was modulated by load, with FRs higher in load 1 than in load 3 in preferred trials (t269 = 2.65, P = 0.004; Fig. 3c), but not in non-preferred trials (t269 = −1.46, P = 0.14; Extended Data Fig. 5a) during the maintenance period. Moreover, FRs were higher in correct as compared to incorrect trials across both load conditions (t245 = 2.43, P = 0.02; Fig. 3d; 24 neurons were excluded from this comparison due to insufficient data in the incorrect condition; patient-level statistics are shown in Extended Data Fig. 5b). There was no significant difference in the FRs between fast and slow RT trials (median split; computed per load condition and then averaged across loads for the preferred category and correct trials only; hippocampus, t88 = 0.73, P = 0.47; amygdala, t180 = 1.38, P = 0.18). Together, these data demonstrate the relevance of category cells to WM maintenance.

We next examined how spike timing of category neurons in the MTL relates to the phase of LFPs by examining their spike-field coherence (SFC; Methods) during the maintenance period in channels with significant PAC (Fig. 3e). In the hippocampus, high-gamma-band SFC was significantly stronger in preferred trials than in non-preferred trials for neuron-to-channel combinations that involved significant PAC channels (cluster P = 0.004; Fig. 3f). This difference in gamma-band SFC was present in both load 1 and load 3 (Fig. 3g; preferred versus non-preferred trials in load 1 (t150 = 3.14, P = 0.003) and load 3 (t150 = 2.88, P = 0.004)). Computing the same statistic for theta-band SFC did not reveal any significant effects (Extended Data Fig. 5c), confirming specificity to gamma. Notably, this gamma cluster spanned approximately the same frequencies at which theta–high-gamma PAC was present (Extended Data Fig. 5f,g shows comparisons including all channels and patient-level results). We did not find similar effects for the theta band (Fig. 3f), non-PAC channels (Extended Data Fig. 5e) or the amygdala (Fig. 3f and Extended Data Fig. 5e,f). Finally, SFC was different between preferred and non-preferred trials only for spikes that occurred during high (t150 = 3.06, P = 0.002) but not low high-gamma band power in the hippocampus (t150 = 0.26, P = 0.85; Extended Data Fig. 5d). Thus, specifically in periods in which gamma amplitude was high, spikes of category neurons were more strongly synchronized to the phase of gamma-band LFP.

We next determined whether spiking activity of category cells during the WM maintenance period correlated with PAC trial-by-trial (Methods). In the hippocampus, PAC was weakly but significantly positively correlated with the FR of category neurons (Supplementary Table 3; Fig. 3h shows correlation coefficients for illustration only; all conclusions are based on the GLM results). In the amygdala, there were no significant correlations between single-trial TG-PAC and FR of category neurons (Fig. 3h and Supplementary Table 3). Together, these results show that persistently active hippocampal category-selective neurons were more synchronized with gamma LFPs when their preferred category was held in WM. This effect was specific to channels that showed significant TG-PAC during the maintenance period. Also, FRs of hippocampal category neurons were correlated with single-trial estimates of PAC.

Category neurons are not PAC neurons

Although the above results indicate a relationship between category neurons and PAC within the hippocampus, they alone do not definitively demonstrate that the spiking activity of category neurons was sensitive to the nonlinear interaction between theta-phase and gamma amplitude as would be expected from PAC. Thus, we next selected for MTL neurons whose activity was modulated by PAC and determined whether they significantly overlapped with the persistently active category neurons. We defined PAC neurons as neurons whose FR was a function of the interaction between theta-phase and gamma amplitude (Methods; an example is shown in Fig. 4). In the hippocampus, 79 (37.29%) out of 212 available neurons (P < 0.005; 200 permutations (Methods); pre-processing steps removed broadband LFPs for some of the neurons and those were therefore not part of this analysis) qualified as PAC neurons. In the amygdala, 163 (45.53%) out of 358 neurons (P < 0.005) qualified as PAC neurons.

Fig. 4: PAC neuron selection and local activity.
figure 4

a, The binning used for PAC neuron selection for an example hippocampal neuron. Theta phase, binned into ten groups, and gamma amplitude (amp.), median split into low and high, were used to predict the spike counts of each neuron from the MTL during the delay. The spike count was higher during high-gamma amplitudes (gamma main effect) and differed in their theta phase distribution between high and low gamma amplitudes (interaction effect), resulting in selecting this neuron as a PAC neuron. b, The proportions of neurons qualifying as PAC neurons. Cat., category. c,d, FRs of PAC neurons were positively correlated with single-trial estimates of TG-PAC in the hippocampus (c; n = 79, P = 0.028, mixed-effects GLM), but not in the amygdala (d; n = 163, P = 0.98; GLM results are shown in Supplementary Table 4). e,f, FRs of PAC neurons during the maintenance period differed between correct and incorrect trials in the hippocampus (e; n = 63; correct versus baseline, P = 0.01; incorrect, P = 0.33; correct − incorrect, P = 0.0001; 16 neurons were excluded due to insufficient data in the incorrect condition), but not in the amygdala (f; n = 156; correct, P = 0.0001; incorrect, P = 0.0001; correct − incorrect, P = 0.45; 7 were neurons excluded due to insufficient data in the incorrect condition). FRs are shown as the percentage change compared with the baseline (−0.9 to −0.3 s). g,h, FRs did not differ between loads (hippocampus (g): n = 79; load 1, P = 0.03; load 3, P = 0.01; load 3 − load 1, P = 0.20; amygdala (h): n = 163; load 1, P = 0.0001; load 3, P = 0.0001; load 3 − load 1, P = 0.80). For gj, statistical analysis was performed using two-sided permutation-based t-tests. For ej, data are mean ± s.e.m.

We next examined whether the selected PAC neurons were also category neurons. In the hippocampus, 28 (35.44%) out of the 79 PAC neurons were both PAC neurons as well as category neurons. In the amygdala, this was the case for 68 (41.72%) out of the 163 PAC neurons (Fig. 4b). The proportion of category neurons among PAC neurons was not significantly higher than expected by independent subpopulations in any of the two regions (both P > 0.05; Methods). To further corroborate this finding, we trained a linear decoder to differentiate between the five different picture categories based on the FRs extracted during picture presentation (encoding). As expected, the decoder was able to differentiate between the picture categories when it was trained on FRs from the category neurons (hippocampus, 72.77%, P = 0.001; amygdala, 88.71%, P = 0.001; Extended Data Fig. 7a). However, the decoder could not differentiate between the categories when it was trained on FRs from PAC neurons that were not also category neurons in both MTL areas (hippocampus, 26.06%, P = 0.16; amygdala, 25.86%, P = 0.15; chance level = 20%). In summary, the probabilities of a neuron being a PAC or a category neuron were independent and the activity of PAC neurons did not differ between the category of the presented stimuli.

Properties of PAC neurons

We next investigated whether PAC neuron activity was related to WM maintenance in ways other than persistent activity. We identified three such relationships for PAC neurons in the hippocampus. First, FRs of PAC neurons were positively correlated with estimates of single-trial PAC (Methods and Supplementary Table 4; Fig. 4c,d shows univariate correlation coefficients for illustration). Second, their FR was elevated throughout the maintenance period compared with the baseline (t78 = 2.43, P = 0.01). Third, FRs varied as a function of accuracy (correct versus incorrect trials (t62 = 3.82, P < 0.001; Fig. 4e; 16 neurons were excluded from this comparison due to insufficient data in the incorrect condition), and were elevated as compared to the baseline in correct trials (t62 = 2.67, P = 0.01) but not in incorrect trials (t62 = −0.98, P = 0.33). FRs were not significantly different between the two load conditions (load 3 − load 1, t78 = 1.38, P = 0.20), but FRs were elevated compared with the baseline in each condition considered separately (load 1, t78 = 2.14, P = 0.03; load 3, t78 = 2.45, P = 0.01; Fig. 4g; similar results concerning theta and gamma SFC are shown in Extended Data Fig. 7b). PAC neurons did not show a load-dependent shift in preferred theta phase (Extended Data Fig. 7d), or significant FR differences between fast and slow RT trials (t78 = −0.07, P = 0.94). By contrast, in the amygdala, FRs of PAC neurons were not significantly correlated with single-trial estimates of TG-PAC (Fig. 4d and Supplementary Table 4). PAC neurons in the amygdala also showed higher FRs during the maintenance period compared with the baseline (t162 = 6.40, P < 0.001), but there were no significant differences between correct and incorrect WM trials (t156 = −0.77, P = 0.45; Fig. 4f), loads (load 3 − load 1, t162 = 0.26, P = 0.80; Fig. 4h; SFC and phase shift results in the amygdala are shown in Extended Data Fig. 7c,d) or fast and slow RT trials (t162 = 1.87, P = 0.07). Thus, hippocampal PAC neurons, despite not being tuned to WM content, were engaged in WM maintenance because their FRs were elevated during WM maintenance and differed as a function of behavioural accuracy.

PAC neurons phase lock to the frontal cortex

Given the properties of PAC neurons shown above, we hypothesized that PAC neurons might be involved in cognitive control of WM. We therefore next examined whether the activity of PAC neurons is related to frontal activity34. To do so, we computed cross-regional SFC between spiking activity of PAC neurons in the MTL and the LFPs recorded in the pre-SMA, dACC and vmPFC (Fig. 5a). If PAC neuron activity is related to frontal cognitive control, we expected cross-regional SFC in the theta range to be stronger in load 3 than in load 1 trials. The data support this hypothesis—SFC was significantly stronger in load 3 compared with load 1 between spiking activity of PAC neurons in the hippocampus and theta-band LFPs recorded in the vmPFC (Fig. 5b and Methods; cluster P < 0.001). We did not observe significant differences for other frequency bands, nor for the other two frontal brain areas (see Extended Data Fig. 8a–h for narrow versus broad-spiking neurons, patient-level statistics, load comparisons for within-vmPFC and cross-regional SFC between vmPFC LFPs and hippocampal spiking, as well as comparisons of non-specific global changes). Repeating the same analysis for category neurons did not reveal significant differences in SFC strength (Fig. 5c and Extended Data Fig. 8c). Furthermore, the difference in SFC strength between the two load conditions for random subsets of hippocampal neurons (the same number of connections as for PAC neurons) was smaller for all tested 10,000 combinations compared with that for hippocampal PAC neurons (P = 0.0001; Fig. 5e). Lastly, PAC neurons from the amygdala did not show significant cross-regional SFC differences in any of the tested frequencies (Fig. 5d) or regions. We further hypothesized that, if theta-band cross-regional SFC indeed reflects levels of cognitive control, it should be stronger for faster RTs. This was the case—theta SFC was stronger for fast compared with slow RTs for PAC neurons from the hippocampus (t166 = 2.10, P = 0.03; Fig. 5f), but not from the amygdala (t705 = 1.40, P = 0.16). Thus, we conclude that the theta-band phase locking of PAC neurons in the hippocampus to the vmPFC is related to cognitive control.

Fig. 5: Remote connectivity of PAC neurons in the MTL to frontal theta LFPs.
figure 5

a, Long-range SFC between MTL spiking activity and LFPs recorded from all three frontal regions. The slices (https://osf.io/r2hvk/) were obtained under a Creative Commons licence CC BY 4.0. b, Spikes of hippocampal PAC neurons were more strongly synchronized with theta-band LFPs recorded in the vmPFC during the maintenance period during load 3 compared with load 1 trials (n = 175 connections; cluster P = 0.0001). This was not the case for the pre-SMA and dACC (Extended Data Fig. 8). c,d, Category neurons from the hippocampus (c; n = 215) or PAC neurons from the amygdala (d; n = 767) did not show significant SFC differences between loads relative to the vmPFC LFP. For bd, statistical analysis was performed using two-sided cluster-based permutation t-tests with a Bonferroni-corrected alpha-level for two MTL areas, three frontal areas and two cell populations. e, Hippocampal PAC cells (n = 175, cyan line) yielded the strongest long-range theta SFC difference between load 3 and load 1 trials among 10,000 random selections of hippocampus–vmPFC connections (P = 0.0001, right-sided permutation test). t values correspond to comparisons between load 3 and load 1 trials for an average of SFC values in the significant theta range (2.5–4.3 Hz). For bd, data are mean (centre line) ± s.e.m. (coloured areas). f, The remote theta-band SFC between spiking activity of PAC neurons and LFPs recorded in the vmPFC was significantly stronger for fast compared with slow RT trials (P = 0.03, two-sided permutation-based t-test). Each dot is a neuron-channel connection (n = 167; 8 connections were excluded due to inefficient spike count in at least one of the conditions). Data are mean ± s.e.m. A, amygdala; H, hippocampus.

Information-enhancing noise correlations

Cells that by themselves carry no information in their FR can influence the representation of a variable at the population level if their activity is correlated with other cells35,36. We hypothesized that PAC neurons might have this role during WM maintenance. In both the hippocampus (162 pairs; t161 = 5.26; P < 0.001) and the amygdala (892 pairs; t891 = 15.51; P < 0.001), pairs of category neurons and PAC neurons had on average positive co-fluctuations of spike counts (Fig. 6a (left); see Extended Data Fig. 9a for amygdala). As a control, we shuffled trials within conditions to remove noise correlations while leaving all other properties of the signal intact, including common category-related input, interspike-interval distributions, FR distributions and temporal relations to task events (Methods). The correlation coefficients across all PAC and category neuron pairs were significantly greater than the same correlations computed after shuffling trials this way (see Fig. 6a (right) for hippocampal pairs; noise correlations computed across trials are shown in Extended Data Fig. 9b–d). This was also true for correlations among pairs of category neurons and PAC neurons that were not also category neurons (Extended Data Fig. 9e,f).

Fig. 6: Noise correlations of PAC neurons in the hippocampus.
figure 6

a, The mean correlation for all category–PAC neuron pairs was positive (n = 162, P = 0.0001) (left). Right, the mean correlation was larger than the null distribution of mean correlations without noise correlations (P = 0.001, right-sided permutation test). b, The decoding accuracy for category from FR in the maintenance period with intact or removed noise correlations for an example session. The white dots signify accuracy, and the coloured dots indicate the identity for each neuron. Indiv., individual. c, Adding single PAC neurons to the ensemble with intact noise correlations increased the decoding accuracy (n = 21; intact, P = 0.0007; removed, P = 0.91; intact − removed, P = 0.003). d, Removing PAC neurons reduced decodability with intact noise correlations only (n = 22 sessions; intact, P = 0.004; removed, P = 0.20). Removing non-PAC neurons decreased decoding for intact (P = 0.010) and removed (P = 0.0001) correlations. e, The decoding difference with and without noise correlations was lower only when PAC neurons were removed (n = 22 sessions; PAC, P = 0.0007; non-PAC, P = 0.10). f, The signal–noise axis for simulated tuned (neuron 1) and untuned (neuron 2) neurons. The signal–noise axis angle is reduced without noise correlations. g, The signal–noise angle in the data was reduced after removing noise correlations (n = 32 sessions, P = 0.009). h, The variance along the signal axis was reduced when noise correlations were intact only when PAC neurons were present (n = 19 sessions, P = 0.014; main effect ensemble: P = 0.0013; permutation-based F-test). i, Correlations of PAC–category pairs (n = 162) were stronger in fast (P = 0.0001) compared with slow (P = 0.06; median split; fast − slow, P = 0.028; preferred category trials only) RT trials. This effect was significant in load 3 (P = 0.009) but not in load 1 (P = 0.34) trials. j, The PAC–category pair correlation difference between fast and slow RT trials was larger than for random non-PAC–category pairs (P = 0.016, right-sided permutation test). For a,ce,gi, statistical analysis was performed using two-sided permutation-based t-tests. Data are mean ± s.e.m.

We next examined whether PAC neurons contributed to the decodability of image category during WM maintenance at the population level. We iteratively added neurons to the population through greedy selection of the neuron that adds most decodability above and beyond that provided by the already included neurons (Methods; see Fig. 6b for an example from a single session for neurons up to peak decodability). In the hippocampus, adding single PAC neurons to the optimized decoding ensemble significantly enhanced category decoding when noise correlations were intact (t20 = 3.16, P < 0.001) but not when they were removed (t20 = −0.12, P = 0.91, BF01 = 4.37; intact versus removed, t20 = 3.33, P = 0.003; Fig. 6c). This suggests that specifically the noise correlations of PAC neurons enhanced the decodability of category information, not their category-related FRs per se.

We next compared the maximal decoding performance for intact and removed noise correlations before and after all PAC neurons were removed from the ensembles. PAC neurons enhanced the decodability of category, but only when noise correlations were intact (t21 = 2.94; P = 0.004; FDR corrected for all comparisons; Fig. 6d). Removing PAC neurons from the ensemble after noise correlations were removed did not significantly change the decoding performance (t21 = 1.36, P = 0.20; Fig. 6d (red)). The decoding performance dropped to a similar extent when only removing PAC neurons that were not also category neurons (Extended Data Fig. 9g). Together, this pattern of results suggests that the decrease in decoding performance was not caused by removing PAC neurons that also carried category information. Rather, dropping neurons that were modulated by PAC from the ensemble led to a reduction in decoding accuracy. In accordance with these results, the maximal differences between intact and removed noise correlations were larger when PAC neurons were part of the ensembles as compared to being removed (t21 = 3.59, P < 0.001; Fig. 6e).

To assess the specificity of those results, we repeated the above analysis after removing randomly chosen neurons that were not PAC neurons from the ensembles (Fig. 6d (without non-PAC); averaged over 500 random selections; the same number as for PAC neurons in each session). This revealed that removing non-PAC neurons in the ensembles without noise correlations led to further decreases of decoding performance (t21 = 3.89; P < 0.001), thereby indicating that non-PAC neurons contributed information to the population that did not depend on noise correlations. Accordingly, we did not find a significant difference when comparing the maximal decoding difference between intact and removed noise correlations for ensembles for which we removed randomly selected non-PAC neurons (t21 = −1.77, P = 0.10; Fig. 6e). In contrast to in the hippocampus, in the amygdala, PAC neurons contributed to category decodability not only when noise correlations were intact but also when noise correlations were removed; Extended Data Fig. 9j,k).

We quantified geometric features of the data manifold to determine why noise correlations enhanced decodability of WM content. We quantified the angle between the two vectors that describe the signal and the noise axis in the n-dimensional space formed by the n simultaneously recorded neurons in a given session. Whether noise correlations are information limiting or enhancing depends on this angle37. As noise correlations are information enhancing in our case, we hypothesized that the angle between the signal and the noise axes should (1) be relatively large to begin with; and (2) increase when noise correlations are present compared with when they are absent (Fig. 6f). This was the case—when noise correlations were intact, the signal–noise axis angle was around 69° (out of maximally 90°). After removing noise correlations, this angle became significantly smaller, as hypothesized (t31 = 2.77, P = 0.009; Fig. 6g).

We examined the variance of the signal projected onto the signal axis38 in populations with and without PAC neurons present to examine whether noise correlations are related to PAC. Removing PAC neurons from the ensembles significantly increased the s.d. of the projection values (main effect for ensemble, F1,18 = 12.55, P = 0.0013; Fig. 6h). Moreover, the s.d. of the projected values was larger when noise correlations were removed (main effect for noise correlations, F1,18 = 7.24, P = 0.014). This was only the case if PAC neurons were part of the ensembles (t18 = −2.66, P = 0.014), and there was no significant difference between intact and removed noise correlations when PAC neurons were removed (t18 = −1.69, P = 0.11). These findings suggest that specifically the noise correlations introduced by PAC neurons affected the geometry of the population code.

If noise correlations are beneficial to WM, they should be stronger in correct fast RT trials as compared to correct slow RT trials, specifically when category neurons’ preferred categories were maintained in WM. In the hippocampus, noise correlations were significantly stronger for fast compared with slow RT trials (t161 = 2.15, P = 0.028; Fig. 6i (left); patient-level results are shown in Extended Data Fig. 9h) for pairs of PAC–category cells in trials in which the preferred stimulus of the category cell in the pair was maintained in WM (Methods). Noise correlations were on average significantly positive only in fast trials (t161 = 4.10, P < 0.001) but not in slow trials (t161 = 1.94, P = 0.06). For non-preferred trials, we did not observe a significant difference between fast and slow RT trials (Extended Data Fig. 9h). Separating trials into the two load conditions, we observed a significant difference only between fast and slow trials in load 3 (t161 = 2.60, P = 0.009; Fig. 6i (right)), but not in load 1 (t161 = 0.96, P = 0.34; Fig. 6i (middle)). In the amygdala, comparing fast to slow RT trials in preferred trials did not reveal a significant difference (Extended Data Fig. 9l). Lastly, we examined whether the effect of noise correlations on RTs in the hippocampus was specific to PAC-to-category neuron pairs or a common feature across the entire population of simultaneously recorded neurons. PAC-to-category neuron pairs showed a significantly stronger effect compared with most randomly selected cell pairs (P = 0.016; Fig. 6j), showing that noise correlations between category and PAC neurons within the hippocampus contributed to enhanced WM fidelity.

Discussion

Although TG-PAC is ubiquitous at the electroencephalogram and LFP level, it has remained unclear how PAC is reflected at the single-neuron level. We find that TG-PAC has a direct relationship to the spiking activity of individual neurons. However, while by definition PAC neurons were related to local gamma activity, they were not directly involved in the processing of the memoranda held in WM per se. Rather, their activity was coordinated with frontal theta, with stronger phase locking for higher WM load and faster RTs. This finding indicates that PAC neurons have a role in cognitive control.

Long-range theta phase locking between frontal and temporal/occipital areas has been suggested to reflect frontal cognitive control exerted over task-relevant brain processes29,30,39. In WM maintenance, frontotemporal interactions are crucial, especially when involving the hippocampus31,32,40,41,42,43. Theta-based prefrontal coordination of posterior WM content-specific processes could ensure efficient information processing at phases that are optimal for network-wide communication within the memoranda-processing population of neurons30,44. According to this model, higher levels of cognitive control are indicated by stronger phase locking between regions to facilitate faster and more efficient readout of WM content. Our results support this model and provide evidence for a specific mechanism to implement it. SFC between hippocampal PAC neurons and vmPFC theta was stronger in periods in which more cognitive control was required. Cross-regional hippocampus–vmPFC SFC was enhanced for fast compared with slow RT trials, suggesting that a more efficient interaction between distant areas might lead to a behaviourally beneficial read-out of WM content with stronger levels of control.

The goal of successful cognitive control is to increase the fidelity of the retained memories. Here we show that one way PAC neurons contributed to achieving this goal is by introducing noise correlations that enhance information content at the population level. Noise correlations are a population phenomenon and are therefore not expected to occur only between specific subpopulations of neurons. However, our results show that the noise correlations of PAC neurons with other neurons predicted behaviour better than pairs not involving PAC neurons. Although the numerical strength of the pairwise noise correlations between single pairs of neurons was low (as expected45), noise correlations of this magnitude can have large effects at the population level46,47. Noise correlations are typically thought to be information limiting48,49, but theoretical work shows that this is not always the case35,50,51,52. Rather, in our case, noise correlations of PAC neurons shaped the geometry of stimulus category information such that decodability of WM content improved. That is, noise correlations were information enhancing. These decodability enhancements were abolished when noise correlations among neurons were removed. By contrast, although non-PAC neurons also improved decoding accuracy, these improvements were not due to noise correlations because decoding improvement did not change when noise correlations were removed. Geometrically, the effect of PAC neurons was to increase the angle between the signal and the noise axis, which improved the read-out of encoded WM content and enhanced the fidelity of WM memoranda representations.

Taken together, our results are in agreement with a multicomponent view of WM1,2, whereby frontal control processes regulate and manage maintenance of WM content in storage-related areas such as the hippocampus3,4,5,14. This interplay between the control and processing of WM content was revealed by jointly analysing the activity of both PAC and category neurons. PAC neurons are a single-cell correlate of the widespread macro-scale phenomena of TG-PAC. They mediate interareal interactions that have a role in cognitive control and shape WM fidelity through noise correlations with information-carrying, persistently active category neurons, with stronger interactions in trials with successful control. PAC-mediated interareal interactions might serve as a general mechanism for top-down control to influence bottom-up processes, a hypothesis that we confirm here for WM, but that remains to be tested for other high-level cognitive functions involving top-down control from frontal regions such as attention53, decision making54,55, speech comprehension56 and long-term memory retrieval34.

Methods

Patients

A total of 36 patients (44 sessions; 21 female individuals; 15 male individuals; age: 40.47 ± 13.76 years; Supplementary Table 5; no statistical methods were used to predetermine sample sizes) participated in the study. All of the patients had Behnke–Fried hybrid electrodes (AdTech) implanted for intracranial seizure monitoring and evaluation for surgical treatment of drug-resistant epilepsy. Their participation was voluntary, and all of the patients gave their informed consent. This study was part of an NIH Brain consortium between three institutions (Cedars-Sinai Medical Center, Toronto Western Hospital and Johns Hopkins Hospital) and was approved by the Institutional Review Board of the institution at which the patient was enrolled. A pre-operative magnetic resonance imaging (MRI) image together with MRI or computed tomography post-operative images were used to localize the electrodes using Freesurfer as previously described34. Electrode positions are plotted on the CITI168 Atlas Brain57 in MNI152 coordinates for the sole purpose of visualization (Fig. 1b). The 3D plot was generated using FieldTrip (v.20200409) and the Brainnetome Atlas58. Coordinates appearing in white matter or outside of the target area is due to usage of a template brain. Electrodes that were localized outside of the target area in native space were excluded from analysis (8 out of a total of 265 recording sites). Data used in this study are available in the DANDI archive59.

Task

The task consists of 140 trials and 280 novel pictures. Each trial started with a fixation cross presented for 0.9 to 1.2 s (Fig. 1a). Depending on the load condition, the fixation cross was followed by either one (load 1; 70 trials) or three (load 3; 70 trials) consecutively presented pictures, each remaining on the screen for 2 s. In load 3 trials, pictures were separated by a blank screen randomly shown for 17 to 200 ms. Picture presentation was followed by a 2.55 to 2.85 s long maintenance period in which only the word “HOLD” was presented on the screen. The maintenance period was terminated by the presentation of a probe picture, which was either one of the pictures shown earlier in the trial (match) or a picture already presented in one of the previous trials (non-match; see below). The task was to indicate whether the probe picture matched on of the pictures shown earlier in the same trial or not. The probe picture was shown until the patients provided their response through a button press. The response mapping switched after half the trials, which was communicated to patients during a short half-time break. Responses were provided using a Cedrus response pad (RB-844; Cedrus). All of the pictures were novel (that is, the patient had never seen this particular image) and were drawn from five different visual categories: faces, animals, cars (or tools depending on the version), fruits and landscapes. Images (width × height: 10.5 × 7 visual degrees) were presented in the centre of the screen and never more than twice (that is, when serving as the probe picture). Pictures were only repeated when presented as the probe stimulus. To make sure that also the non-match probe pictures were never completely new to patients (as were the matching probe pictures), which could have been used as a strategy to solve the task without using WM, we always used a picture that the patients had seen already in one of the earlier trials, randomly drawn from one of the categories not used during encoding. If a patient participated in more than one session, we used a completely new set of pictures in each session to ensure that all pictures were novel in all of the sessions. The overall longer duration of load 3 as compared to load 1 trials ensured increased cognitive control demands in trials with higher load. The maintenance period was the same length regardless of load, and all analysis of neural activity during the maintenance period was performed within this time window (0–2.5 s after the maintenance period onset). Note that, in load 3 trials, the three encoded items were from three different categories, assuring that the participants always had to maintain pictures from three different categories. Thus, when comparing trials between load 1 and 3 for preferred trials, each load condition always contained exactly one item from the preferred category.

Spike sorting

Each hybrid depth electrode contained eight microwires from which we recorded the broadband LFP signal between 0.1 and 8,000 Hz at a sampling rate of 32 kHz (ATLAS system, Neuralynx; Cedars-Sinai Medical Center and Toronto Western Hospital) or 30 kHz (Blackrock Neurotech; Johns Hopkins Hospital) depending on the institution. All recordings were locally referenced within each recording site by using either one of the eight available micro channels or a dedicated reference channel with lower impedance provided in the bundle, especially when all channels contained recordings of neuronal spiking. To detect and sort spikes from putative single neurons in each wire, we used the semiautomated template-matching algorithm OSort (v.4.1)60. Spikes were detected after band-pass filtering the raw signal in the 300–3,000 Hz band (single-cell quality metrics are shown in Extended Data Fig. 1). All analysis in this paper (including the LFP) is based on signals recorded from micro wires. We isolated 360 neurons in the hippocampus, 496 in the amygdala, 204 in the pre-SMA, 188 in the dACC and 206 in the vmPFC. Of the LFP channels, 586 channels were in the hippocampus, 421 in the amygdala, 283 in the pre-SMA, 325 in the dACC and 307 in the vmPFC.

LFP preprocessing

Before analysing the LFPs, we removed spike waveforms (action potentials) and excluded trials with interictal discharges and high-amplitude noise. First, to avoid leakage of spiking activity into lower frequency ranges61,62, we removed the waveforms of detected spikes from the raw signal by linear interpolating the raw data from −1 to 2 ms around each spike onset in the raw recording before downsampling. As the same spike can, in rare instances, be recorded on more than one wire, we not only interpolated the data for the wire on which the neuron was detected but also for all other wires in the same wire bundle. We then low-pass filtered the raw signal using a zero phase-lag filter at 175 Hz and downsampled to 400 Hz. Line noise was then removed between 59.5 and 60.5 Hz as well as between 119.5 and 120.5 Hz using zero phase-lag band-stop filters. Extended Data Fig. 1f,g shows the raw LFP as well as the log–log power spectrum for an example channel from the hippocampus. The slope of log–log power spectra did not differ significantly between load 1 and load 3 trials in hippocampal channels (n = 586 channels; mean slope −1.7526 ± 0.3902 versus −1.7517 ± 0.3928, t585 = −0.86, P = 0.39).

Artefact and inter-ictal discharge detection was performed on a per trial and wire basis using a semiautomated algorithm together with subsequent visual inspection of the data. To detect high-amplitude noise events as well as inter-ictal discharges, we z-scored the amplitude in each channel across all trials. To avoid artefactual amplitude biasing, we first capped the data at 6 s.d. from the mean and re-performed the z-scoring on the capped data63,64. If a single time sample in each trial and wire exceeded a threshold of 4 s.d., the trial was removed from the analysis for that wire. Jumps in the signal were detected by z-scoring the difference between every fourth sample of the capped signal. Trials in which any jump exceeded a z-score of 10 s.d. were removed. The result of this cleaning process was visually inspected in every recording and any remaining artefactual trials were removed manually. If a wire or brain region showed excessive noise or epileptic activity, it was entirely removed from the analysis. On average, 20.4 ± 13.9 trials (14.6% of the data) were removed per wire.

PAC

We measured the strength of PAC for a wide set of frequency combinations in all of the recorded micro channels (except those excluded, see above) using the modulation index (MI) as introduced previously65. As the cleaning process described above produced a different set of available trials for each channel, we first randomly subsampled from all correct trials in each channel such that the number of trials were the same for both load 1 and load 3. We then extracted the LFP starting at −500 until 3,000 ms following the maintenance period onset in each selected trial. We then filtered (using pop_eegfiltnew.m from EEGLAB, v.2019.1)66 each trial separately within the respective frequency bands of interest (see below for more details). We then extracted the instantaneous phase from the lower-frequency signal and the amplitude from the higher-frequency signal using the Hilbert transform. Lastly, we cut each trial to the final time window of interest of 0–2,500 ms relative to maintenance period onset. This last step ensures that filter artefacts that arise at the edges of the signal are removed. All analysis of neural activity during the maintenance period was performed in this 2.5-s-long time window that started at the onset of the maintenance period. The length of the analysis window was the same in both load conditions. Next, we concatenated the phase and the amplitude signal across trials and computed the MI as described previously65 (18 phase bins). We computed MIs separately for load 1 and load 3 trials. All subsampled trials from both load conditions were used to select for significant PAC channels in an unbiased fashion (see below). Example code to reproduce parts of the results in this study in published at Zenodo67.

To standardize the MI in each channel, frequency and condition, we computed 200 surrogate MIs by randomly combining the phase and amplitude signals from different trials (trial-shuffling), again separately for load 1, load 3 and for all trials. We fit a normal distribution to these surrogate data (normfit.m) to obtain the mean and s.d. of each distribution. These values were then used to z-transform the raw MI values. Standardizing MI values eliminates potential systematic differences that might arise due to load-related power or phase differences, which could drive observed differences in PAC. Moreover, low frequencies are more vulnerable to non-specific correlations to high-frequency power due to non-stationarities in the LFP signal caused by factors such phase resets. Comparing raw modulation indices to trial-shuffled surrogates within the same condition will reduce PAC that is caused by such non-specific interactions (discussed in detail previously68). In addition to providing a measure of significance, normalizing the MI values therefore allows for comparisons across conditions, frequencies and channels69. A channel was indicated as having significant PAC present if the normalized MI computed across all subsampled trials (both loads) exceeded a z-score of 1.64 (P < 0.05, right-sided).

We repeated the above procedure for all frequency combinations. The phase signals were extracted for centre frequencies between 2 and 14 Hz in steps of 2 Hz (2 Hz fixed bandwidth). The amplitude signals were extracted for frequencies between 30 and 150 Hz in steps of 5 Hz. The bandwidth of the amplitude signals was variable and depended on the centre frequency of the low-frequency signal. It was chosen such that it constituted twice the centre frequency of the phase signal (for example, if combined with an 8 Hz centre frequency for the phase signal, the bandwidth of the amplitude signal was chosen to be 16 Hz). This procedure ensures that the side peaks that arise if the amplitude signal is modulated by a lower-frequency phase signal are included68.

To determine the influence of theta waveform shape on PAC, we tested for differences in theta waveform peak-to-trough as well as rise-to-decay asymmetries between the two load conditions, which could potentially cause differences in TG-PAC70,71. To extract and characterize each theta cycle during the delay period in all significant hippocampal PAC channels, we used the bycycle toolbox72 in Python. We averaged estimates for peak-to-trough as well as rise-to-decay asymmetries across cycles during the maintenance period from the same trials used for our PAC analysis within each load and tested the estimates between the conditions. Results of this analysis are presented in Extended Data Fig. 3c.

Moreover, we determined the number of significant PAC channels that showed theta–high-gamma nesting using the method described previously69. To do so, in each PAC channel we determined the theta phase bin for which gamma amplitude was maximal, that is, the preferred theta phase of gamma amplitude. In the band-pass-filtered and phase-binned theta (3–7 Hz) signal, we then determined all instances during the delay periods of all of the correct trials in which this phase bin occurred, and extracted the precise timepoint at which the concurrent instantaneous gamma amplitude (70–140 Hz) was maximal within each bin. To obtain the average waveform, we selected a window of 500 ms centred on each timepoint in the raw (unfiltered) LFP recording and averaged the signals across all windows in each channel. Example average waveforms from two channels are shown in Extended Data Fig. 3e. In accordance with ref. 69, we characterized a waveform as being nested if at least three local maxima fell within a window of 45 ms (that is, 3 cycles at 70 Hz) around the preferred phase. Results are presented in Extended Data Fig. 3e.

Relationship between single-trial PAC and FR or RT

We calculated single-trial estimates of TG-PAC for all significant PAC channels of both MTL regions and the vmPFC. We used mixed-effect GLMs to assess whether RT is related to PAC in a trial-by-trial manner (using only correct trials). We included load as a confounder and modelled random intercepts for each significant PAC channel nested into patientID. To examine whether there was a correlation between FR of category neurons (see below) and single-trial estimates of PAC, we used a mixed-effects GLM with load as a confounder and modelled random intercepts for each neuron to significant PAC channel combination. Only correct trials were used.

Category cell selection

We selected for neurons of which the response after stimulus onset during encoding differed systematically between the picture categories of the stimuli shown. To do so, for each trial, we counted the number of spikes a neuron fired in a window between 200 to 1,000 ms after stimulus onset (all encoding periods and the probe period). We then grouped spike counts based on the category of the picture shown in that trial. For each neuron, we computed a 1 × 5 permutation-based analysis of variance (ANOVA) with visual category as the grouping variable, followed by a post hoc one-sided permutation-based t-test between the category with maximum spike count and all other categories. We classified a given neuron as a category neuron if both tests were significant (P < 0.05, 2,000 permutations (see below)). We refer to the category with the maximum FR as the preferred category of a cell. To test whether the observed number of category cells was significantly larger than that expected by chance in each area, we repeated the above selection for 500 times after shuffling the category labels for each stimulus across all picture presentations. If the observed number of category cells in the unshuffled data was higher than the 99th percentile (P < 0.01) of the resulting shuffled distribution (which, across all five brain areas, corresponds to a Bonferroni-corrected alpha level of 0.05), we considered the number of category cells observed in a given area as significant. Note that category cells are selected only using spiking activity from the encoding period, leaving the FRs during the maintenance period independent for later analyses.

SFC

To measure how strongly the spiking activity of a neuron followed the phase of an LFP in a certain frequency, we computed the SFC. We measured SFC as the mean vector length (MVL) across spike-phases for all neuron-to-channel combinations available within a bundle or across regions (within the same hemisphere) in correct trials73. To estimate the instantaneous phase from LFPs in different frequency ranges in each trial, we applied continuous wavelet transforms using 40 complex Morlet wavelets74 spanning from 2 to 150 Hz in logarithmic steps. The number of cycles for each wavelet changed as a function of frequency from 3 to 10 cycles, also in 40 logarithmic steps75. This ensured a higher temporal precision for longer wavelets at low frequencies and higher frequency precision for faster wavelets at high frequencies as compared to using a constant number of cycles across all frequencies76. Extended Data Figure 1 shows the temporal and spectral characteristics across all wavelets used in this analysis. To assess the quality of our wavelet transform, we tested how well we were able to reconstruct the original signal after applying the wavelets to our data. To reconstruct the signal, we extracted the real-valued (bandpass-filtered) signal after applying each wavelet to the data and then summed up these signals across all frequencies. This resulted in a signal that closely followed the original recording in each trial (an example trial is shown in Extended Data Fig. 1j). We assessed how well the reconstructed signal predicted the original signal by computing R2 values extracted from linear models using the reconstructed signal as predictors and the original signal as response variables in each trial and channel. As the quality of the reconstruction could change as a function of frequency or time, we performed this analysis for several time and frequency bins. First, we band-pass filtered both signals within the spectral bandwidth of each wavelet and then applied the linear model in sliding windows of 500 ms with a step size of 25 ms. The results of this analysis are presented in Extended Data Fig. 1.

For our SFC analysis, we first extracted data between −500 and 3,000 ms around the maintenance period onset from all clean trials in each channel and then computed a complex Morlet wavelet convolution to extract the instantaneous phase of the LFP as described above. The trials were then cut to the final time window of interest of 0 to 2,500 ms after the maintenance period onset to remove filter artefacts at the edges of each trial. To further avoid a bias of the MVL based on differences in spike count, we subsampled spikes such that an equal number of spikes was available in each condition. We included neurons that had at least 50 spikes available in each condition (we used a minimum of ten spikes for the preferred versus non-preferred analysis in category neurons due to a potentially low spike count in the non-preferred condition77). Next, we extracted the phase in the LFP closest to the timestamp of each spike, averaged across all spike-phases in polar space, and computed the MVL for each of the 40 frequencies. We repeated this subsampling 500 times and averaged the resulting MVLs across all repetitions within conditions. To avoid potential bias of load within the preferred versus non-preferred (category neurons; Fig. 3) or fast versus slow RT SFC comparison (cross-regional analysis; Fig. 5), we computed the SFC estimates within each load condition and then averaged across the loads.

The resulting MVL in each neuron-to-channel combination was further normalized using a surrogate distribution, which was computed after adding random noise to the timestamps of all spikes within a condition 500 times. Potential biases of the MVL based on systematic differences between the conditions (such as power differences between conditions within a given frequency band) were thereby reduced. Like for the measure of PAC (see above), we fit a normal distribution to the surrogate data and used the mean and the s.d. of that distribution to z-score the raw MVL within each condition.

To compare SFC between preferred and non-preferred trials, we computed SFC for all category neuron-to-channel combinations within the same region in frequencies between 2 and 150 Hz during the maintenance period and compared trials in which preferred or non-preferred stimuli were correctly maintained. We used cluster-based permutation statistics to identify ranges of frequencies with significant differences (Fig. 3f). To determine whether the observed gamma SFC difference between preferred and non-preferred trials was dependent on gamma amplitude, we tested whether gamma SFC (averaged across 70–140 Hz) for category neurons in the hippocampus differed between preferred and non-preferred trials for high and low gamma amplitudes separately (median split).

Whether theta or gamma-band SFC was related to the preference of the cell and/or load was tested by averaging SFC within the theta (3–7 Hz) or gamma band (70–140 Hz) and computing a 2 × 2 permutation-based ANOVA with the factors load and preference for all category neuron to PAC channel combinations in the hippocampus.

To examine whether cross-regional SFC differed between the two load conditions, we computed SFC for all neuron-to-channel combinations between the respective areas in each load condition. We then used cluster-based permutation statistics to identify ranges of frequencies with significant differences (Fig. 5b; alpha level Bonferroni-corrected for all tests across two MTL areas, three frontal areas and two cell populations). To further determine a relationship to RT (Fig. 5f), we performed a median split of RTs for all correct trials within each load condition and compared cross-regional SFC between hippocampal PAC neurons and the vmPFC, averaged within and the significant theta range, between fast and slow RTs (averaged across both load conditions).

Selection of PAC neurons

We selected for neurons whose FR was correlated with both theta phase and gamma amplitude during the maintenance period of the task. For all neuron-to-channel combinations within a bundle of microwires, we extracted the data from correct trials between −500 and 3,000 ms relative to the maintenance period onset and estimated the phase of theta signals by filtering between 3 and 7 Hz and computing a Hilbert transform in each trial. Gamma amplitude was determined by computing wavelet convolutions for frequencies between 70 and 140 Hz in frequency steps of 5 Hz (each wavelet using 7 cycles). Trials were cut to 0 to 2,500 ms after maintenance period onset to remove edge artefacts, and were then concatenated. The extracted amplitudes in each gamma frequency were z-scored across all trials and averaged across all frequencies. Computing wavelet convolutions in 5 Hz steps and z-scoring the data before averaging avoided biasing power estimates to lower frequencies due to the power law. Next, for each neuron–channel pair, we performed a median split of gamma amplitudes and binned all amplitudes into low and high gamma, respectively. In each of the two gamma groups, we further binned the corresponding theta phases into 10 groups (36° bins), resulting in a total of 20 bins (Fig. 4a). In each of those bins, we then counted the number of spikes that occurred in each theta–gamma bin.

We fit three Poisson GLMs for each neuron-to-channel combination. In model 1, spike count (SC) was a function of theta phase (10 levels), gamma amplitude (2 levels), and the interaction between theta phase and gamma amplitude. We included theta separately as cosine and sine due to the circularity of phase values78, which enabled us to treat theta phase as a linear variable. Model 2 included the theta phase and gamma amplitude as main effects but not the interaction term. Model 3 included a main effect for theta phase and an interaction term but no main effect for gamma amplitude:

$$\text{Model 1:}\,{\rm{SC}} \sim 1+{{\rm{Theta}}}_{\cos }+{{\rm{Theta}}}_{\sin }+{\rm{Gamma}}+\left({{\rm{Theta}}}_{\cos }+{{\rm{Theta}}}_{\sin }\right)\times {\rm{Gamma}}$$
$$\text{Model 2:}\,{\rm{SC}} \sim 1+{{\rm{Theta}}}_{\cos }+{{\rm{Theta}}}_{\sin }+{\rm{Gamma}}$$
$${\rm{Model\; 3:}}\,{\rm{SC}} \sim 1+{{\rm{Theta}}}_{\cos }+{{\rm{Theta}}}_{\sin }+\left({{\rm{Theta}}}_{\cos }+{{\rm{Theta}}}_{\sin }\right)\times {\rm{Gamma}}$$

We next compared pairs of models using a likelihood-ratio test between model 1 and the two other models (using compare.m). A neuron qualified as a PAC neuron if model 1 explained variance in spike counts significantly better than both of the other two models (P < 0.01, FDR corrected for all possible channel combinations). The rationale behind each model comparison was as follows. First, we were specifically interested in neurons that followed the interaction of theta phase and gamma amplitude, that is, PAC, and not just theta phase or gamma amplitude alone. Selecting neurons for which model 1, including the interaction term, explained spike count variance of a given neuron significantly better than model 2, lacking the interaction term, ensured extracting those neurons. Second, we also compared model 1 to model 3, lacking the gamma term, for the following reason. Assume that a given neuron–channel combination has an LFP with strong PAC at the field potential level, that is, strong interactions between theta phase and gamma amplitude, and a neuron of which the FR is not related to neither theta phase nor gamma amplitude. Nevertheless, this situation would result in a significant interaction term in model 1 because the spikes that fall into the low and high gamma amplitude groups will have different theta phases (due to PAC). This is only the case if the underlying PAC in the LFP is very strong (an illustration and further discussion is provided in Extended Data Fig. 6). However, in this scenario, the gamma amplitude term (or the theta phase term) would not be significant. Comparing model 1 to model 2 and model 3 therefore ensures that cells were selected only at PAC neurons in which the interaction term explained variance above and beyond the main effects and interactions alone.

As we did not observe strong PAC nor persistently active category neurons in frontal regions, we restricted this analysis to channels from the MTL regions and performed it separately in each load condition. If spike count variance was significantly better explained by model 1 than the two other models in either of the load conditions for at least one neuron-to-channel combination, we included this neuron as a PAC neuron. If a neuron was selected in more than one neuron-to-channel combination, we selected the combination with the highest R2 in the full model (model 1). This combined channel was later used for within-region SFC as well as FR correlation analyses. Lastly, to determine whether the number of selected PAC neurons per area was significantly higher than chance, we repeated the entire selection process 200 times after pairing spikes and LFPs from different, randomly selected trials, therefore destroying their relationship with theta phase and gamma amplitude. The P values indicate the proportion of repetitions that resulted in a higher number of selected neurons using the shuffled data than the original number of PAC neurons determined using the unshuffled data.

Properties of PAC neurons

We used mixed-effects GLMs with load as a confounder and modelling a random intercept for each PAC neuron-to-channel combination nested into patientID (using only correct trials and the LFP channel selected for each neuron; see above) to examine the relationship between FR of PAC neurons and single-trial estimates of PAC. Note that trial-by-trial correlations are independent from the selection procedure as PAC neurons were selected on the basis of trial-averaged theta–gamma interactions, irrespective of their trial-by-trial variance.

Noise correlations and population category decoding

We investigated the effect of noise correlations among groups of simultaneously recorded neurons on population decoding accuracies for the image category currently held in mind and on WM behaviour during the maintenance period. To estimate noise correlations among pairs of category and PAC neurons, for each neuron, we counted spikes in bins of 200 ms that slid across the maintenance period (0–2.5 s after the last picture offset) in steps of 25 ms. We then computed the correlation coefficient across all 101 time bins in each single trial for each pair of neurons and averaged across all considered trials within each condition. We used only correct trials for this analysis, and paired only neurons that were recorded in the same session and within the same brain region. Pairs of neurons recorded on the same channel were not considered as a precaution against spurious correlations caused by spike sorting inaccuracies. To assess the significance of noise correlations among pairs of neurons, we shuffled trial labels within conditions, that is, within the preferred and non-preferred category as well as within each load, 1,000 times in each pair and recomputed the average correlation coefficient across all pairs. The original average correlation coefficient was then compared against the distribution of all average correlation coefficients obtained from the 1,000 trial shuffles (Fig. 6a (right)).

To investigate the contribution of PAC neurons to the population category decoding accuracy when noise correlations among neurons were intact or removed, we used an approach introduced previously36 (Fig. 6b). To measure how much a single neuron affects the decoding accuracy of an ensemble of neurons, this approach finds optimized neuron ensembles that have maximal decoding accuracy by adding each single neuron to the ensemble in a stepwise manner. Each neuron’s contribution to the ensemble can thereby be determined. In more detail, using a linear decoder, first the decoding performance for each single neuron in each region is determined from all correct trials. The neuron with the best decoding performance is then paired with each remaining neuron to determine which pair yields the best decoding accuracy. This most informative pair of neurons is then again combined with each remaining neuron to determine the most informative triplet of neurons, and so on. These steps were repeated until all neurons were part of the decoding ensemble.

As we were most interested in decoding picture category from FRs in the maintenance period, we used trials from load 1 only. This is because the maintenance period in load 3 trials contains intermixed information about the three different categories maintained in WM. We trained a linear support vector machine (SVM) decoder (fitcecoc.m; one-versus-one) on 80% of trials and tested it on the remaining 20% using z-scored FRs. To ensure an equal amount of data for all five categories, we subsampled trials to match the lowest number of trials available in each stimulus category. Noise correlations among neurons were left intact by using the same trials for each neuron or removed by shuffling trials per neuron within each category. Shuffling trials within each category ensured that the original category label remained correct but correlations among neurons were removed. Any decoding benefit that is purely based on category-selective firing activity is therefore not affected (Fig. 6b (red)). Note that, if PAC neurons enhanced the decodability by ‘residual coding’ of category information, they should have done so also when noise correlations were removed through shuffling. We repeated each decoding analysis 500 times and averaged the results to generalize across trial selections.

To test the influence of PAC neurons as well as their noise correlations on decoding performances, we first tested contributions between intact and removed noise correlations for PAC neurons that were added to the ensemble before maximal decoding performance was reached in each session and area36. This approach therefore tested the effect that single PAC neurons had on information encoding within a neural population (Fig. 6c). To determine a functional specificity of PAC neurons as a group, we further compared the maximal decoding performance before and after all PAC neurons were removed from the neuronal ensemble in each session. We did this for all sessions that had at least one PAC neuron, and at least two neurons left after removing all PAC neurons. We then compared this effect with removing the same number of non-PAC neurons from the ensembles (averaged across 500 iterations of random selections).

We quantified the effect of noise correlations on the geometry of the population response. The effect that noise correlations have on the encoded information in a population of neurons depends on the angle between the signal and the noise axis37. To illustrate how the angle between the noise and the signal axes changes with noise correlations, we first simulated neural responses for a population of neurons that were partially tuned to two different categories (see Fig. 6f for a simulation of two neurons for which one was tuned and the other was untuned to category). Firing rates for each neuron were drawn from a normal distribution with variable variance. We simulated 200 trials for each category. For tuned neurons, a variable offset was added to the mean of one of the categories. To add noise correlations to the population of neurons, in each trial, we added a random number drawn from a normal distribution to the FRs of all neurons. To compare our simulation to a condition with removed noise correlations, we shuffled trials within each category to destroy noise correlations within conditions but leave signal correlations among neurons intact. We then determined the signal axis by training a linear SVM classifier on the FRs from all neurons and extracting the hyperplane (decision boundary) obtained from the model. The signal axis is defined as a vector orthogonal to that plane. The noise axis was determined by extracting the first principal component of the data across both categories.

We then quantified and compare the angle between the signal and the noise axis in the recorded data (Fig. 6g). For each recording session, we extracted the signal and the noise axis for the neuronal ensemble at which the difference in category decoding was maximal between removed and intact noise correlations. For this analysis, we included all sessions that had at least two hippocampal neurons available. To obtain the direction of the signal axis, we extracted the hyperplane from each of the ten trained binary SVM classifiers (trained on 80% of the data; one-versus-one decoding, see above) and derived a vector orthogonal to that plane using a QR decomposition. The noise axis was determined by extracting the first principal component of the data across categories. The resulting angle between the two vectors was determined and then averaged across all 10 binary learners and all 500 decoding repetitions, resulting in one angle per session separately for intact and removed noise correlations.

To further determine the functional specificity of PAC neurons, we projected the population responses onto the signal axes and determined the variance of the projection values before and after PAC neurons were removed from the ensembles at which the difference between intact and removed noise correlations was maximal (Fig. 6h). This analysis was performed for all sessions that had at least one hippocampal PAC neuron, and at least two neurons left after removing all PAC neurons from those ensembles. The rationale of the analysis was based on the idea that the variance of the projected values should be small when the angle between the noise and signal axis is large and vice versa38. For each binary classifier, we projected the population responses for each category onto the signal axis and determined their s.d. We then averaged the obtained variances across both categories, all 10 binary classifiers and all 500 iterations, and tested the variances between intact and removed noise correlations before and after all PAC neurons were removed from the ensembles.

To compare noise correlations between fast and slow RT trials, we examined all possible PAC–category cell pairs in a given session (Fig. 6i). We analysed the trials in which the preferred or non-preferred categories of the category cell were held in WM separately. Fast and slow RT trials were defined by median split, computed separately in each load condition, and then averaged to avoid a bias of load in RTs. To assess the specificity of the fast versus slow RT trial difference to PAC neurons, we randomly paired category neurons with any other non-PAC neuron and compared noise correlations between fast and slow RT trials (for n = 162 randomly selected pairs; same n as for PAC-to-category neuron pairs).

The significance of population decoding (Extended Data Fig. 7a) was assessed by comparing the original decoding accuracy to a distribution of 1,000 decoding accuracies after randomly shuffling category labels.

Statistics

Throughout this Article, we use (cluster-based) nonparametric permutation tests (statcond.m as implemented in EEGLab, using option ‘perm’, or ft_freqstatistics.m in FieldTrip), that is, tests that do not make assumptions about the underlying distributions, or mixed-effects GLMs (fitglme.m in MATLAB) to assess statistical differences between conditions. In these tests, random permutations of condition labels were performed to estimate an underlying null distribution, which was then used to assess the statistical significance of the effect. The paired permutation t-tests that we performed are equivalent to computing pair-wise condition differences and testing the differences against zero. All permutations statistics used 10,000 permutations, and t-tests were tested two-sided unless stated otherwise. The corresponding t and F estimates, which are computed based on a normal distribution, are provided as a reference only. Bayes factors were computed using the BayesFactor package79. BF01 indicates the evidence of H0 (null hypothesis; no evidence between conditions) over H1. A value of 1 indicates equal evidence for H0 and H1, and values larger than 1 indicate more evidence for H0 over H1 and vice versa. SFC estimates tested across several frequencies were corrected for multiple comparisons using cluster-based permutation statistics as implemented in FieldTrip80 with 10,000 permutations and an alpha level of 0.025 for each one-sided cluster, which was also Bonferroni corrected for the number of tests involved. Depending on whether we used z-scored FRs or spike counts, we used mixed-effects GLMs based on a normal or Poisson distribution, respectively. Finally, error bars shown in figures show the s.e.m. unless otherwise stated.

Reporting summary

Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.