Abstract
Multisensory integration is necessary for the animal to survive in the real world. While conventional methods have been extensively used to investigate the multisensory integration process in various brain areas, its long-range interactions remain less explored. In this study, our goal was to investigate interactions between visual and somatosensory networks on a whole-brain scale using 15.2-T BOLD fMRI. We compared unimodal to bimodal BOLD fMRI responses and dissected potential cross-modal pathways with silencing of primary visual cortex (V1) by optogenetic stimulation of local GABAergic neurons. Our data showed that the influence of visual stimulus on whisker activity is higher than the influence of whisker stimulus on visual activity. Optogenetic silencing of V1 revealed that visual information is conveyed to whisker processing via both V1 and non-V1 pathways. The first-order ventral posteromedial thalamic nucleus (VPM) was functionally affected by non-V1 sources, while the higher-order posterior medial thalamic nucleus (POm) was predominantly modulated by V1 but not non-V1 inputs. The primary somatosensory barrel field (S1BF) was influenced by both V1 and non-V1 inputs. These observations provide valuable insights for into the integration of whisker and visual sensory information.
Similar content being viewed by others
Introduction
The integration of diverse sensory inputs is crucial for animals to enhance survival opportunities by enriching behavioral outcomes in the real world. In particular, mice acquire information on their surrounding environment relying on whisker sensation in combination with other sensory modalities, such as vision. The convergence of information across the senses takes place at various brain regions along the sensory tracts, which are established by multiple conventional electrophysiological recordings and optical imaging studies1,2,3,4,5,6,7,8,9,10,11. Previous studies have reported that not only the posterior parietal association (PTLp)8 and the superior colliculus (SC)5,11,12, but also the primary somatosensory barrel field (S1BF)7,9 and ventral posteromedial thalamic nucleus (VPM)1,3 exhibit enhanced responses to bimodal stimulation compared to unimodal whisker stimulation.
Tracing studies have shown reciprocal but asymmetric anatomical connections between visual and somatosensory cortices, where the primary visual cortex (V1) has a stronger anterograde connection to the S1BF7, suggesting the involvement of V1 may exert influence on the whisker-sensory information processing such as provide guidance information for tactile sensing or navigation by whisker. In addition, electrophysiological studies reported that stimulation of V1 recruits neural activity in the VPM, the first-order thalamus in whisker-sensory pathways1. The transmission of visual inputs to whisker-related areas is likely relayed by V1. Other possible pathways could be the multimodal subcortical nuclei, such as the SC and the lateral posterior thalamic nucleus (LP). Anatomical tracing studies have revealed extensive somatosensory cortical projections from the SC5,13,14, which relay more than eighty percent of visual inputs in colliculo-cortical visual pathway15,16. The LP is a higher order visual thalamic structure, which has been established as a hub-like center extensively implicated in a broad range of function across various sensory modalities17. Overall, the convergence of visual inputs in whisker-related areas involves two main nodes: V1 and subcortical areas.
To investigate long-range interactions between visual and somatosensory processing, we performed blood oxygenation level-dependent (BOLD) fMRI of mice at 15.2 T. Initially, we compared BOLD fMRI responses to unimodal whisker and visual stimulation with bimodal whisker-visual stimulation. Bimodal stimulation enhanced BOLD fMRI responses in whisker cortices and subcortical regions compared to whisker-only stimulation, and multisensory visual-related regions compared to visual-only stimulation. Additionally, BOLD fMRI responses to whisker stimulus were observed in different thalamic regions located in subcortical areas including anterior pretectal nucleus (APN), midbrain reticular nucleus (MRN), substantia nigra (SNr), zona incerta (ZI), parafascicular nucleus (PF), and mediodorsal thalamic nucleus (MD). To investigate the contribution of V1 vs. subcortical related pathways to whisker processing, we performed fMRI of sensory stimulation with silencing of V1 by optogenetic activation of inhibitory neurons18,19. We found that VPM predominantly receives the signals from subcortical visual areas, while the posterior medial complex thalamic nucleus (POm) is mostly modulated by V1 but not subcortical signals. Somatosensory cortices such as the S1BF and the secondary somatosensory area (S2) are modulated by both.
Results
Unimodal versus bimodal sensory stimulation: whisker, visual versus whisker-visual stimulation
Whole-brain BOLD fMRI of lightly anesthetized mice was obtained at an ultrahigh field of 15.2 T for enhancing functional sensitivity20. As a reference for bimodal stimulation, we initially acquired fMRI data responding to single sensory whisker (defined as to W) and visual stimulation (defined as to V) in ketamine/xylazine anesthetized mice. Subsequently, we computed group-averaged BOLD fMRI maps using the general linear model (GLM) analysis, and averaged beta values within each region of interest (ROI) for individual mice (Fig. 1).
BOLD fMRI maps of whisker and visual stimulation (Fig. 1a) agree well with observations from previous mouse fMRI studies15,21,22. The right whisker pad stimulation evoked robust and localized responses in whisker-related areas, including somatosensory thalamus VPM/POm, S1BF, S2 and motor areas (primary and secondary motor cortex, M1 and M2) (Figs. 1a,c)22,23,24. Widespread BOLD responses were also observed in visual-related areas, with particularly significant activity in the SC, LP, higher-order visual cortex (V2), and PTLp (Figs. 1a,c) as expected due to their multimodal integration role. Specifically, the SC is functionally involved in multisensory integration of sensorimotor and visual systems4,11,12,22; the LP is known as part of extrageniculate visual pathway that shares reciprocal connection with multiple sensory areas10,17,25,26, and the PTLp is well-established as a mouse visuotactile area8. While the activation of other visual areas may be attributed to responses originating from the SC and LP.
Monocular stimulation of the right eye elicited robust BOLD responses across contralateral visual pathway-related areas, the dorsal lateral geniculate thalamic nucleus (LGd), SC, and LP, and in visual cortices consisting of V1 and V2 (Figs. 1a,c)15,21. Additionally, pronounced responses in somatosensory networks were observed including the sensory thalamus (VPM and POm) as well as the sensory cortices (S1BF and M2 as illustrated in Fig. 1a,c).
Overall, unimodal sensory stimulation activates the main pathway related to its specific function (e.g., somatosensory-related areas responding to whisker stimulation, visual-related areas responding to visual stimulation), and extends broadly to other functional sites. In this context, the PTLp responds to both stimulations equally (Fig. 1c).
To investigate cross-modal integration, fMRI was also obtained during the simultaneous application of whisker pad and visual stimuli (WV) (Fig. 2a). BOLD responses of the bimodal stimulus (WV) were compared to mean BOLD responses of the most effective single-modal stimulus (W or V)27,28,29,30 (Fig. 2b). In comparison to the whisker stimulus (W), bimodal stimulation yielded (WV) significantly higher BOLD responses across most whisker somatosensory related areas (one-way repeated ANOVA, p < 0.05) (Fig. 2b). Similarly, the bimodal stimulation induced higher responses in higher-order visual regions, including the SC, LP, and higher association cortex PTLp compared to visual stimulation (V) (Fig. 2b).
In addition to expected BOLD responses in specific regions, bimodal stimulation induced widespread activities in subcortical regions such as APN, MRN, SNr, ZI, PF and MD (Fig. 2c). The APN, ZI and PF were activated not only by whisker stimulus but also by visual stimulus, while the MRN, SNr and MD mostly responded to whisker stimulation (Supplementary Fig. 1 for time courses). The SNr and MD receive somatosensory inputs via the striatum or prefrontal cortex from the S1BF for further sensory processing31,32. We observed significant increases in APN, MRN, ZI and PF activities under the bimodal stimulation compared to whisker-only stimulation (Fig. 2d), indicating the involvement of these subcortical regions in multimodal integration.
The enhancement of bimodal stimulation could be different types of effects, such as sub-additive (bimodal < sum of unimodals), additive (bimodal = sum of unimodals), super-additive (bimodal > sum of unimodals), or inhibitory (bimodal < most effective unimodal)30. Although fMRI measures hemodynamic responses derived from a population of heterogenerous excitatory and inhibitory neurons33,34, we analyzed our bimodal BOLD fMRI data similar to neural data analyses30. Mean BOLD responses of whisker-related areas under bimodal stimulation [WV] were compared to the summation of unimodal stimulation responses [W] + [V] (Fig. 3 and Supplementary Fig. 2 for [WV]—([W] + [V])). The results suggest that the enhancement of activation in whisker-related regions by bimodal stimulation can be described by an additive model, where the response to bimodal stimulation [WV] equals the sum of unimodal stimulation responses [W] + [V]. However, in V1, V2 and PTLp bimodal responses appear to be sub-additive, indicating response depression30.
In general, bimodal stimulation had distinct effects on different sensory activities, with visual inputs appearing to enhance whisker areal activity by bimodal whisker-visual integration. Meanwhile, whisker inputs only affected multisensory-related area activity in visual-related areas. Thus, whisker-visual integration in the somatosensory regions was further investigated.
Visual-whisker potential pathways investigated by fMRI with V1 silencing
Visual-to-somatosensory enhancement in somatosensory whisker areas could arise from V1 and V1 downstream pathways involving higher-order visual cortex6,8. To investigate these potential V1-downstream circuits to somatosensory regions, we employed optogenetic silencing of excitatory neurons in V1. Activating ChR2-expressing inhibitory neurons in V1 suppresses cortical excitatory recurrent circuits and its outputs to downstream pathways18,19,35,36. Inactivating V1 with 20-s optogenetic stimulation of inhibition neurons resulted in negative BOLD changes at the ipsilateral V1, networked cortical visual regions (V2, PTLp) and subcortical visual sites (LGd, SC, LP) (Fig. 4a). Notably, a significant reduction was also observed in somatosensory-related thalamus VPM and POm, while only a slight change occurred in somatosensory cortices. It should be noted that due to image artifacts caused by susceptibility effects by residual blood clots or trapped air bubbles at motor areas, images in these regions exhibited significant distortions in some animals (see Supplementary Fig. 3) and were not included in further data analysis.
Optogenetic fMRI (ofMRI) of V1 silencing shows resting-state functional effective connectivity (EC) originated from V1, which may reflect structural connections. Thus, structural connectivity (SC) was constructed from Allen mouse data obtained with anterograde viral tracers that were focally injected into V1 (https://connectivity.brain-map.org/) (Fig. 4b). In general, ofMRI maps were topologically aligned with axonal projection density maps. To enable a quantitative comparison, fMRI responses and tracer counting were normalized by those in V137 and presented as heatmaps in a log scale (Fig. 4c). The functional EC and axonal projection density were positively correlated with each other (Spearman coefficient ρ = 0.867, p = 0.0025). Notably, V1 is functionally and structurally connected to S1BF and weakly to VPM. However, the functional connection between V1 and POm exists without the monosynaptic anatomical connection, possibly due to the presence of polysynaptic connections37,38,39,40 involving other areas connected with V1 (see Supplementary Fig. 4).
Dissection of visual-whisker pathways by sensory fMRI with V1 silencing
The total enhancement of whisker-related areal responses by bimodal stimulation (ΔVt = WV – W) can be attributed by both V1 and non-V1 pathways. To dissect these two contributions, we compared fMRI responses to whisker-visual bimodal stimulation with V1 silencing (WVO) and whisker-only stimulation with V1 silencing (WO). Since V1 silencing by itself induces negative fMRI signal changes in the stimulation site and in downstream regions (Fig. 4), the common suppression of resting-state connectivity should be removed by the difference between WVO and WO19, leaving only the non-V1 contribution of visual inputs, ΔnV1 = WVO – WO (Fig. 5a,c).
All fMRI responses in individual subjects were normalized to the BOLD response of whisker-only stimulation in S1BF to minimize inter-subject variations (Fig. 5b). The BOLD response from the visual inputs in VPM was predominantly originated from the non-V1 contribution (ΔnV1), as silencing of V1 did not significantly reduce the visual enhancement in the VPM. In contrast, the total visual enhancement in POm was reduced by > 75% due to V1 silencing (mean relative ΔVt = 0.43 versus ΔnV1 = 0.12); hence, the POm was mostly modulated by the V1 contribution. The whisker cortices (S1BF and S2) received inputs from both ΔVt and ΔnV1 (ΔVt = 0.33 versus ΔnV1 = 0.13 in S1BF; ΔVt = 0.27 versus ΔnV1 = 0.11 in S2) (Fig. 5b,c). Similarly, the APN and PF were partially reduced by V1 silencing, while the MRN and ZI were strongly inhibited by V1 silencing, indicating V1-driven inputs (Fig. 5b,c).
The flow of information from visual inputs to VPM appears to occur only through sparse axonal projections from specific visual cortical areas, V1 and the anterolateral visual area (VISal) (refer to Supplementary Fig. 4). However, the silencing of V1 does not have a significant impact on the visual enhancement of VPM during bimodal stimulation (ΔnV1 ~ ΔVt), suggesting that visual-related subcortical areas are the primary network for enhancing visual activity in VPM through unidentified intermediary regions. The information flow from V1 to POm (Fig. 5) must be conveyed via polysynaptic connections, as direct anatomical connections between V1 and POm are minimal (Fig. 4). Based on anatomical connections, possible candidates are SC, LP, and subregions in V2 including VISal and anteromedial visual area (VISam) (see Supplementary Fig. 4).
To further investigate possible intermediate visual areas related to POm connections (V1 → downstream subcortical areas/V2 → POm), the non-V1 contribution to visual areas was determined by the difference between WVO and WO (ΔnV1), while the V1 contribution was estimated by visual-only (V; see Fig. 1) minus ΔnV1 (Fig. 6). Firstly, LGd and PTLp received feedback and feedforward signals from V1 (V minus ΔnV1) and the non-V1 component (ΔnV1), respectively (Figs. 5c and 6 and for ΔnV1 map), but there are no direct anatomical connections from LGd and PTLp to POm/VPM (Supplementary Fig. 4). Thus, LGd and PTLp are unlikely to be involved in visual enhancement in POm/VPM. Secondly, SC also received both V1 and non-V1 contributions, while V2 was predominantly interacted with V1 (Fig. 6). Hence, these areas could serve as intermediate spots from V1 to POm through their axonal projection to POm (V1 → SC/V2 → POm) (see Supplementary Fig. 4).
Discussion
In our high spatial resolution whole-brain mouse fMRI at 15.2 T, broad BOLD responses to different sensory stimulation were observed. Unimodal sensory stimulation not only activated the main pathway related to its specific function but also elicited responses that extended broadly to other sensory areas. The combination of whisker and visual stimulation revealed that whisker activity is strengthened by additional inputs from retina, while whisker stimulation only affects multisensory regions among visual-related areas. Employing V1 optogenetic inhibition can assist in delineating cross-modal pathways from visual inputs to whisker areas.
The presence of whisker-visual bimodal stimulation produced enhancements in BOLD responses of all whisker-related areas, suggesting that visual inputs assist the whisker network, a prominent sense in rodents used for navigating and exploring the environment41,42,43,44. Similar enhancements have been observed in several electrophysiology studies1,3,9. The enhancement of VPM activity might occur either directly through the VPM – V1 axonal connection or indirectly through the intralaminar thalamus1,3. In our data, VPM is dominantly affected by non-V1 signals, while POm is robustly modulated by V1 silencing. The exact pathway of non-V1 signals to VPM is unknown, which can be further investigated by circuit-specific silencing. Since fMRI activity in PF due to visual input was not significantly reduced by V1 silencing (Fig. 5), the visual input may be relayed to the parafascicular intralaminar nuclei through the SC45, then reaching VPM by a direct connection from PF to VPM3. On the other hand, the enhancement of POm activity by V1 might occur through SC5 and/or V246. Since the ZI activity projects to POm during whisker activation32, the V1 effect may modulate POm response through SC/V2 → ZI → POm. To identify intermediate sites in the connection from V1 to POm, it is crucial to optogenetically silence V1-downstream circuits such as SC, V2, or ZI. The ZI also projects to MRN47, which is modulated by V1 inputs. The APN has been described as part of the visual pretectal complex as well as is involved in somatosensory modulation by recurrent projections from POm and SC22,48,49. These connections could lead to the non-V1 and V1 enhancement in APN during bimodal stimulation compared to unimodal stimulation.
The augmentation of the S1BF response might come from axonal cortico-cortical connection between S1BF and V17,9,50,51 or from visual inputs to VPM and POm5. Subsequently, S2 could be affected by cortico-cortical connections with S1BF. Unlike rodents9,30,51,52,53,54,55, primates and humans exhibit a sparse direct connection between the somatosensory cortex and visual cortex56,57,58,59. Thus, the translatability of our findings may be limited. Nonetheless, our observations provide valuable insights for future studies focused on investigating the sources of visual integration in the whisker somatosensory network and exploring the roles of visual inputs in abnormal whisker-related behavior60.
There are several limitations in this study. Firstly, there was a distortion in the anterior brain image in the mouse motor areas (M1 and M2) due to susceptibility artifacts around the surgical area. This resulted in incomplete coverage of the somatosensory network in optogenetic fMRI. Secondly, multimodal integration may vary under different stimulus conditions. We used simple flashing light and electrical pad stimulations at a fixed strength. Exploring various stimulation strengths and/or different sites for stimulation (e.g., retinotopy, forepaw) could offer additional insights into multimodal integration. Additionally, a naturalistic paradigm, such as moving grating and air puff, is needed for further investigations. Thirdly, to validate our fMRI findings, it is necessary to conduct electrophysiological recordings studies. Electrophysiological recordings can offer additional insights that cannot be fully elucidated by BOLD fMRI, such as higher spatial and temporal multimodal integration. Fourthly, the integration of multiple senses becomes more complex under awake and behaving conditions. Since our studies were performed under anesthesia, further studies under awake conditions would be critical to understand multisensory integration.
In conclusion, we have successfully mapped visual and whisker networks and their interaction on a whole brain scale. Our findings indicate that both V1 and non-V1 pathways contribute to whisker somatosensory activity. The combination of sensory stimulation and focal silencing provides a viable fMRI approach for dissecting the functional contribution of specific brain areas or pathways.
Methods
Animal
In total, twenty male mice (23–32 g; 8–13 weeks old) were used in two different studies under ketamine-xylazine anesthesia61: (1) ten wildtype mice for visual and whisker stimulation BOLD fMRI (C57BL/6; Orient Bio, Seongnam, Korea), and (2) ten transgenic mice with ChR2 in inhibitory neurons (VGAT-ChR2-EYFP) for fMRI with cortical inactivation. The VGAT-ChR2-EYFP mice (B6.Cg-Tg(Slc32a1-COP4*H134R/EYFP)8Gfng/J) were bred in-house from breeding pairs obtained from Jackson Laboratory (Bar Harbor, ME, USA). Animals were housed in cages under controlled temperature and humidity conditions and a 12-h dark–light cycle with food and water provided ad libitum. All experiments were performed with approval by the Institutional Animal Care and Use Committee (IACUC) of Sungkyunkwan University following standards for humane animal care from the Animal Welfare Act and the National Institutes of Health Guide for the Care and Use of Laboratory Animals and ARRIVE guidelines 2.0 (Animal Research: Reporting in Vivo Experiments)62.
The fiber-optic cannulas (Thorlabs, Newton, New Jersey, USA) were implanted63 in transgenic mice > 2 weeks before fMRI experiments. The optical fiber cannula (200 µm inner core diameter, NA = 0.22) was implanted into the left V1 (AP:—3.64 mm, ML: + 2.3 mm relative to bregma and DV: + 0.2 mm relative to the surface).
For stereotactic surgical and BOLD fMRI, mice were initially anesthetized with 4% isoflurane in 20% O2/80% air mixture then given an induction dose with a mixture of ketamine (Yuhan, Korea) and xylazine (Rompun®, Bayer, Korea) (100/10 mg/kg for initial IP, and 25/1.25 mg/kg intermittent IP injections every 30–45 min) under self-breathing through a nose cone that provided a continuous supply of oxygen and air (1:4 ratio) at a rate of 1 L/min (SAR-1000, CWE, Ardmore, USA or TOPO, Kent Scientific Corporation, Torrington, CT, USA) to maintain an oxygen saturation level > 90%20,61,63,64. To minimize whisker movements during fMRI studies, all whiskers were neatly trimmed before the animal was inserted into the magnet. Temperature was monitored with a rectal probe and maintained at ± 37 °C via warm-water circulation pad. Respiration and heart rate were monitored with a pressure detector placed on the ventral surface and pulse oximeter (SA Instruments, Inc., Stony Brook, NY, USA) placed on the tail, respectively. Physiological information was monitored using a data acquisition system (Acknowledge, Biopac Systems, Inc., Goleta, CA, USA).
Sensory stimulation
For visual stimulation to right eye, optic fibers with 0.5-mm diameter were placed 2 cm distally from right eye of the animal and connected to a cold white LED driver (DC200, Thorlabs, Newton, New Jersey, USA). The illuminance of the LED light was measured to be around 10 lx at the fiber tip. The LED driver was controlled by a pulse generator (Master 9; World Precision Instruments, Sarasota, FL, USA). Stimulation parameters for visual stimuli were at a frequency of 5 Hz, pulse width of 10 ms15. For whisker stimulation, we opted for electric stimulation instead of a mechanical stimulator due to its ease of implementation within a small-bore size magnet. Whisker pad electric stimulation has consistently induced fMRI and neural responses in whisker-related somatosensory areas (e.g., VPM, S1, S2)22,23,24,65, making it a suitable choice for whisker stimulation. For right whisker-pad electrical stimulation, a three-pin electrode pad was placed on the mouse’s right whisker-pad. Stimulation parameters for whisker stimuli were at a frequency of 4 Hz, pulse width of 0.5 ms, and current intensity of 0.6 mA22. Ten C57BL/6 mice were used for right eye stimulus only (V), right whisker stimulation only (W), and bimodal stimulation with combination of right whisker and right eye stimulus simultaneously (WV).
Optogenetic silencing of V1
The experimental procedure for optogenetic fMRI (ofMRI) was previously described in detail63,66. Light was delivered to the left V1 through a fiber-optic cable (length: 7 m, Doric Lenses Inc, Quebec, Canada) coupled to a 473-nm diode-pumped solid-state laser (Changchun New Industries Optoelectronics Tech. Co., Ltd, Changchun, China). The constant output power was calibrated to be 3 mW at the tip of the optic fiber, as measured by a power meter (PM100D, Thorlabs, USA). The optical stimulation was then given at 20 Hz/10 ms parameter to silence excitatory pyramidal neurons through optogenetic activation of interneurons of VGAT-ChR2 mice19,40. To block undesired activation of the visual pathway by light leakage, the connection between the fiber optic cable and the implanted cannula was covered carefully. Ten VGAT-ChR2 mice were used to perform optogenetic fMRI for cortical silencing18,19,40. Four different stimulation data were obtained: V1 optogenetic silencing (O), right whisker stimuli with and without left V1 inhibition (W, WO), and right whisker + right eye + left V1 inhibition (WVO).
fMRI experiments at 15.2 T
All MRI experiments were performed on a 15.2-T MRI scanner with an actively shielded 6-cm diameter gradient operating with a maximum strength of 100 G/cm and a rise time of 110 µs (Bruker BioSpec MRI, Billerica, MA, USA). A 15-mm ID customized surface coil for radiofrequency (RF) transmission/reception was centered on the imaging slices covering the whole brain, and the animal was positioned to make the brain close to the isocenter of the magnet.
Magnetic field homogeneity was shimmed globally using the field map method. Eighteen contiguous 0.5-mm thick coronal slices T1-weighted anatomical images were acquired using a fast-low angle shot (FLASH) sequence with field of view (FOV) = 15.6 × 7.8 mm2, matrix size = 256 × 128, in-plane resolution = 0.061 × 0.061 mm2, repetition time (TR) = 384 ms, echo time (TE) = 3.34 ms, and number of averages (NA) = 4. Before starting the fMRI experiments with an EPI sequence, local field homogeneity was optimized in the ellipsoidal volume covering the sensory areas using the Bruker MAPSHIM shimming protocol (ParaVision 6, Bruker BioSpec, Billerica, MA, USA). All fMRI data were acquired using single-shot gradient-echo EPI with eighteen contiguous slices without gaps in the coronal plane, FOV = 15.6 × 7.8 mm2, acquisition matrix = 106 × 53, in-plane resolution = 0.147 × 0.147 mm2, slice thickness = 0.5 mm, TR/TE = 1000/11 ms, flip angle = 50°, NA = 1, sampling bandwidth = 300 kHz, and 15 dummy scans. Each fMRI trial consisted of a 40-s pre-stimulus, 20-s stimulus, 60-s inter-stimulus, 20-s stimulus, and 60-s post-stimulus. 8–10 fMRI trials were obtained for each stimulus condition on each animal. Image acquisition and stimulus application were synchronized.
Functional imaging data analyses
All data analyses were performed with the Analysis of Functional NeuroImages package67, the FMRIB Software Library68, Advanced Normalization Tools69, and Matlab® codes (MathWorks, Natick, MA, USA). All quantitative values are represented as the mean ± standard error of the mean (SEM). The statistical significance of the results was assessed according to a p < 0.05 criterion.
Each functional image volume underwent preprocessing steps, including slice timing correction and motion correction by realignment to the first volume. Subsequently, the preprocessed data within the same session were averaged, and linear detrending was applied to mitigate signal drift. Time course normalization was performed by using the average of the baseline volumes before spatial normalization to a general brain template. The spatial normalization was conducted using the following procedure. Firstly, multislice functional EPI images were co-registered to the anatomical T1-weighted images from the same subject. Secondly, the T1-weighted images of all subjects were normalized and averaged by applying linear and nonlinear transformations to generate a mouse brain template. Thirdly, all EPI images co-registered in the first step were normalized to the mouse brain template (50 × 50 × 50 µm3) using the co-registration parameters obtained in the second step.
The Allen Mouse Brain Atlas was also registered to the brain template. In that common brain space, spatial smoothing was applied using a Gaussian kernel with a 147-µm full-width at half maximum (FWHM of 1 pixel). Animal-wise functional maps were made by a GLM analysis using a stimulation paradigm convolved with a double-gamma variate hemodynamic response function (HRF). The beta value was obtained from the GLM analysis, which represents the estimated effect size. After that the group activation maps were generated using a one-sample t-test and considering the significance of the false discovery rate (FDR) corrected to p < 0.01, then overlaid on the brain template. Statistical values were reported in the figure.
Quantitative BOLD ROI analyses
Regions of interests (ROIs) were defined based on the Allen Mouse Brain Atlas (Allen Institute for Brain Science, http://mouse.brain-map.org/)13. All the ROIs considered as related to the visual pathways and somatosensory networks were selected based on the brain atlas: LGd dorsal lateral geniculate thalamic nucleus, SC superior colliculus, LP lateral posterior thalamic nucleus, V1 primary visual cortex, V2 higher-order visual cortex, PTLp posterior parietal association areas, VPM ventral posteromedial thalamic nucleus, POm posterior medial thalamic nucleus, S1BF primary somatosensory barrel field, S2 secondary somatosensory area, M1 primary motor area, M2 secondary motor area, anterior pretectal nucleus (APN), midbrain reticular nucleus (MRN), substantia nigra (SNr), zona incerta (ZI), parafascicular nucleus (PF), and mediodorsal thalamic nucleus (MD).
Two ROI analyses were performed. (1) The averaged beta value within each ROI was calculated from individual animal beta maps obtained from the GLM analysis of unimodal sensory stimulation. (2) BOLD time courses of ROIs were extracted from the fMRI data without spatial smoothing applied for each mouse. The BOLD fMRI responses of the two stimulus blocks were averaged in each animal. Then mean percent signal changes were calculated excluding the initial 3–6 s of data after stimulus onset to avoid the initial transition period.
Structural connectivity analyses
For the structural connectivity data, experiment #100141598, 112827164, 146078721, 266585624, 307321674 (for V1 injection), 146077302, 116903968, 120437703, 100,148,503, and 286301303 were obtained from the Allen Mouse Connectivity Atlas (https://connectivity.brain-map.org) and presented as projection density (PD). PD was calculated as the projection density in each ROI divided by the density of the source (e.g., V1) (Fig. 4 and Supplementary Fig. 4)37. To compare the structure connectivity with the effectivity connectivity (EC) of V1 silencing, beta values from the GLM analysis were averaged among all voxels within each ROI in each animal. EC was computed as a sum of voxel-by-voxel responses (beta values) in each ROI divided by a sum of voxel-by-voxel responses of the V1 (Fig. 4)37. Both PD and EC were presented on a log scale. Spearman's rank correlation analysis was performed between PD and EC37. The presence of EC was determined by a statistical test (one-sample t-test against zero; p < 0.05), and effective connectivity was not obtained from motor areas due to susceptibility artifacts. Projection volumes < 0.01 µm3 (voxel volume) were removed.
Data availability
The unprocessed functional and anatomical data are available from the corresponding author upon request. They will be provided in NIFTI format. The preprocessing scripts can also be shared upon request.
References
Allen, A. E., Procyk, C. A., Brown, T. M. & Lucas, R. J. Convergence of visual and whisker responses in the primary somatosensory thalamus (ventral posterior medial region) of the mouse. J. Physiol. 595, 865–881. https://doi.org/10.1113/JP272791 (2017).
Allen, A. E., Procyk, C. A., Howarth, M., Walmsley, L. & Brown, T. M. Visual input to the mouse lateral posterior and posterior thalamic nuclei: Photoreceptive origins and retinotopic order. J. Physiol. 594, 1911–1929. https://doi.org/10.1113/Jp271707 (2016).
Bieler, M., Xu, X., Marquardt, A. & Hanganu-Opatz, I. L. Multisensory integration in rodent tactile but not visual thalamus. Sci. Rep. 8, 15684. https://doi.org/10.1038/s41598-018-33815-y (2018).
Castro-Alamancos, M. A. & Favero, M. Whisker-related afferents in superior colliculus. J. Neurophysiol. 115, 2265–2279. https://doi.org/10.1152/jn.00028.2016 (2016).
Gharaei, S., Honnuraiah, S., Arabzadeh, E. & Stuart, G. J. Superior colliculus modulates cortical coding of somatosensory information. Nat. Commun. 11, 1693. https://doi.org/10.1038/s41467-020-15443-1 (2020).
Lippert, M. T., Takagaki, K., Kayser, C. & Ohl, F. W. Asymmetric multisensory interactions of visual and somatosensory responses in a region of the rat parietal cortex. Plos One 8, e63631. https://doi.org/10.1371/journal.pone.0063631 (2013).
Masse, I. O., Ross, S., Bronchti, G. & Boire, D. Asymmetric direct reciprocal connections between primary visual and somatosensory cortices of the mouse. Cereb. Cortex 27, 4361–4378. https://doi.org/10.1093/cercor/bhw239 (2017).
Olcese, U., Lurilli, G. & Medini, P. Cellular and synaptic architecture of multisensory integration in the mouse neocortex. Neuron 79, 579–593. https://doi.org/10.1016/j.neuron.2013.06.010 (2013).
Sieben, K., Roder, B. & Hanganu-Opatz, I. L. Oscillatory entrainment of primary somatosensory cortex encodes visual control of tactile processing. J. Neurosci. 33, 5736–5749. https://doi.org/10.1523/JNEUROSCI.4432-12.2013 (2013).
Sit, K. K. & Goard, M. J. Distributed and retinotopically asymmetric processing of coherent motion in mouse visual cortex. Nat. Commun. 11, 3565. https://doi.org/10.1038/s41467-020-17283-5 (2020).
Triplett, J. W., Phan, A., Yamada, J. & Feldheim, D. A. Alignment of multimodal sensory input in the superior colliculus through a gradient-matching mechanism. J. Neurosci. 32, 5264–5271. https://doi.org/10.1523/Jneurosci.0240-12.2012 (2012).
Gharaei, S., Arabzadeh, E. & Solomon, S. G. Integration of visual and whisker signals in rat superior colliculus. Sci. Rep. https://doi.org/10.1038/s41598-018-34661-8 (2018).
Lein, E. S. et al. Genome-wide atlas of gene expression in the adult mouse brain. Nature 445, 168–176. https://doi.org/10.1038/nature05453 (2007).
Oh, S. W. et al. A mesoscale connectome of the mouse brain. Nature 508, 207–214. https://doi.org/10.1038/nature13186 (2014).
Dinh, T. N. A., Jung, W. B., Shim, H. J. & Kim, S. G. Characteristics of fMRI responses to visual stimulation in anesthetized vs. awake mice. Neuroimage 226, 117542. https://doi.org/10.1016/j.neuroimage.2020.117542 (2021).
Seabrook, T. A., Burbridge, T. J., Crair, M. C. & Huberman, A. D. Architecture, function, and assembly of the mouse visual system. Annu. Rev. Neurosci. 40, 499–538. https://doi.org/10.1146/annurev-neuro-071714-033842 (2017).
Leow, Y. N. et al. Brain-wide mapping of inputs to the mouse lateral posterior (LP/Pulvinar) thalamus-anterior cingulate cortex network. J. Comp. Neurol. 530, 1992–2013. https://doi.org/10.1002/cne.25317 (2022).
Lee, J. Y. et al. Role of anterior cingulate cortex inputs to periaqueductal gray for pain avoidance. Curr. Biol. 32, 2834. https://doi.org/10.1016/j.cub.2022.04.090 (2022).
Jung, W. B., Jiang, H. Y., Lee, S. & Kim, S. G. Dissection of brain-wide resting-state and functional somatosensory circuits by fMRI with optogenetic silencing. Proc. Natl. Acad. Sci. https://doi.org/10.1073/pnas.2113313119 (2022).
Jung, W. B., Shim, H. J. & Kim, S. G. Mouse BOLD fMRI at ultrahigh field detects somatosensory networks including thalamic nuclei. Neuroimage 195, 203–214. https://doi.org/10.1016/j.neuroimage.2019.03.063 (2019).
Niranjan, A., Christie, I. N., Solomon, S. G., Wells, J. A. & Lythgoe, M. F. fMRI mapping of the visual system in the mouse brain with interleaved snapshot GE-EPI. Neuroimage 139, 337–345. https://doi.org/10.1016/j.neuroimage.2016.06.015 (2016).
You, T., Im, G. H. & Kim, S. G. Characterization of brain-wide somatosensory BOLD fMRI in mice under dexmedetomidine/isoflurane and ketamine/xylazine. Sci. Rep. https://doi.org/10.1038/s41598-021-92582-5 (2021).
Mowery, T. M., Harrold, J. B. & Alloway, K. D. Repeated whisker stimulation evokes invariant neuronal responses in the dorsolateral striatum of anesthetized rats: A potential correlate of sensorimotor habits. J. Neurophysiol. 105, 2225–2238. https://doi.org/10.1152/jn.01018.2010 (2011).
Chakrabarti, S., Zhang, M. L. & Alloway, K. D. MI neuronal responses to peripheral whisker stimulation: Relationship to neuronal activity in SI barrels and septa. J. Neurophysiol. 100, 50–63. https://doi.org/10.1152/jn.90327.2008 (2008).
Bennett, C. et al. Higher-order thalamic circuits channel parallel streams of visual information in mice. Neuron 102, 477-492 e475. https://doi.org/10.1016/j.neuron.2019.02.010 (2019).
Marshel, J. H., Garrett, M. E., Nauhaus, I. & Callaway, E. M. Functional specialization of seven mouse visual cortical areas. Neuron 72, 1040–1054. https://doi.org/10.1016/j.neuron.2011.12.004 (2011).
Avillac, M., Ben Hamed, S. & Duhamel, J. R. Multisensory integration in the ventral intraparietal area of the macaque monkey. J. Neurosci. 27, 1922–1932. https://doi.org/10.1523/JNEUROSCI.2646-06.2007 (2007).
Kayser, C., Petkov, C. I. & Logothetis, N. K. Visual modulation of neurons in auditory cortex. Cereb. Cortex 18, 1560–1574. https://doi.org/10.1093/cercor/bhm187 (2008).
Sarko, D. K., Ghose, D. & Wallace, M. T. Convergent approaches toward the study of multisensory perception. Front. Syst. Neurosci. 7, 81. https://doi.org/10.3389/fnsys.2013.00081 (2013).
Stevenson, R. A. et al. Identifying and quantifying multisensory integration: A tutorial review. Brain. Topogr. 27, 707–730. https://doi.org/10.1007/s10548-014-0365-7 (2014).
Mitchell, A. S. & Chakraborty, S. What does the mediodorsal thalamus do?. Front. Syst. Neurosci. 7, 37 (2013).
Staiger, J. F. & Petersen, C. C. H. Neuronal circuits in barrel cortex for whisker sensory perception. Physiol. Rev. 101, 353–415. https://doi.org/10.1152/physrev.00019.2019 (2021).
Logothetis, N. K. What we can do and what we cannot do with fMRI. Nature 453, 869–878. https://doi.org/10.1038/nature06976 (2008).
Kim, S. G. & Ogawa, S. Biophysical and physiological origins of blood oxygenation level-dependent fMRI signals. J. Cerebr. Blood Flow Metab. 32, 1188–1206. https://doi.org/10.1038/jcbfm.2012.23 (2012).
Guo, Z. C. V. et al. Flow of cortical activity underlying a tactile decision in mice. Neuron 81, 179–194. https://doi.org/10.1016/j.neuron.2013.10.020 (2014).
Lien, A. D. & Scanziani, M. Tuned thalamic excitation is amplified by visual cortical circuits. Nat. Neurosci. 16, 1315-U1207. https://doi.org/10.1038/nn.3488 (2013).
Kim, S. et al. Whole-brain mapping of effective connectivity by fMRI with cortex-wide patterned optogenetics. Neuron 111, 1732-1747 e1736. https://doi.org/10.1016/j.neuron.2023.03.002 (2023).
Grandjean, J., Zerbi, V., Balsters, J. H., Wenderoth, N. & Rudin, M. Structural basis of large-scale functional connectivity in the mouse. J. Neurosci. 37, 8092–8101. https://doi.org/10.1523/JNEUROSCI.0438-17.2017 (2017).
Liang, H. & Wang, H. Structure-Function Network Mapping and Its Assessment via Persistent Homology. PLoS Comput. Biol. 13, e1005325. https://doi.org/10.1371/journal.pcbi.1005325 (2017).
Moon, H. S. et al. Contribution of Excitatory and Inhibitory Neuronal Activity to BOLD fMRI. Cereb. Cortex 31, 4053–4067. https://doi.org/10.1093/cercor/bhab068 (2021).
Grant, R. A. & Goss, V. G. A. What can whiskers tell us about mammalian evolution, behaviour, and ecology?. Mamm. Rev. 52, 148–163. https://doi.org/10.1111/mam.12253 (2022).
Voigts, J., Sakmann, B. & Celikel, T. Unsupervised whisker tracking in unrestrained behaving animals. J. Neurophysiol. 100, 504–515. https://doi.org/10.1152/jn.00012.2008 (2008).
O’Connor, D. H. et al. Vibrissa-based object localization in head-fixed mice. J. Neurosci. 30, 1947–1967. https://doi.org/10.1523/JNEUROSCI.3762-09.2010 (2010).
Matteucci, G. et al. Cortical sensory processing across motivational states during goal-directed behavior. Neuron 110, 4176-4193.e4110. https://doi.org/10.1016/j.neuron.2022.09.032 (2022).
Fisher, S. D. & Reynolds, J. N. The intralaminar thalamus-an expressway linking visual stimuli to circuits determining agency and action selection. Front. Behav. Neurosci. 8, 115. https://doi.org/10.3389/fnbeh.2014.00115 (2014).
Noseda, R. et al. A neural mechanism for exacerbation of headache by light. Nat. Neurosci. 13, 239–245. https://doi.org/10.1038/nn.2475 (2010).
Chou, X. L. et al. Inhibitory gain modulation of defense behaviors by zona incerta. Nat. Commun. 9, 1151. https://doi.org/10.1038/s41467-018-03581-6 (2018).
Terenzi, M. G., Zagon, A. & Roberts, M. H. Efferent connections from the anterior pretectal nucleus to the diencephalon and mesencephalon in the rat. Brain. Res. 701, 183–191. https://doi.org/10.1016/0006-8993(95)01001-8 (1995).
Giber, K. et al. Heterogeneous output pathways link the anterior pretectal nucleus with the zona incerta and the thalamus in rat. J Comp. Neurol. 506, 122–140. https://doi.org/10.1002/cne.21545 (2008).
Bieler, M. et al. Rate and temporal coding convey multisensory information in primary sensory cortices. Eneuro https://doi.org/10.1523/ENEURO.0037-17.2017 (2017).
Henschke, J. U., Noesselt, T., Scheich, H. & Budinger, E. Possible anatomical pathways for short-latency multisensory integration processes in primary sensory cortices. Brain Struc. Func. 220, 955–977. https://doi.org/10.1007/s00429-013-0694-4 (2015).
Charbonneau, V., Laramée, M. E., Boucher, V., Bronchti, G. & Boire, D. Cortical and subcortical projections to primary visual cortex in anophthalmic, enucleated and sighted mice. Eur. J. Neurosci. 36, 2949–2963. https://doi.org/10.1111/j.1460-9568.2012.08215.x (2012).
Wang, Q. X., Sporns, O. & Burkhalter, A. Network analysis of corticocortical connections reveals ventral and dorsal processing streams in mouse visual cortex. J. Neurosci. 32, 4386–4399. https://doi.org/10.1523/Jneurosci.6063-11.2012 (2012).
Stehberg, J., Deng, P. T. & Frostig, R. D. Unimodal primary sensory cortices are directly connected by long-range horizontal projections in the rat sensory cortex. Front. Neuroanat. https://doi.org/10.3389/fnana.2014.00093 (2014).
Zingg, B. et al. Neural networks of the mouse neocortex. Cell 156, 1096–1111. https://doi.org/10.1016/j.cell.2014.02.023 (2014).
Falchier, A., Clavagnier, S., Barone, P. & Kennedy, H. Anatomical evidence of Multimodal integration in primate striate cortex. J. Neurosci. 22, 5749–5759 (2002).
Rockland, K. S. & Ojima, H. Multisensory convergence in calcarine visual areas in macaque monkey. Int. J. Psychophysiol. 50, 19–26. https://doi.org/10.1016/S0167-8760(03)00121-1 (2003).
Clavagnier, S., Falchier, A. & Kennedy, H. Long-distance feedback projections to area V1: Implications for multisensory integration, spatial awareness, and visual consciousness. Cogn. Affect. Behav. Neurosci. 4, 117–126. https://doi.org/10.3758/Cabn.4.2.117 (2004).
Cappe, C., Rouiller, E. M. & Barone, P. Multisensory anatomical pathways. Hear. Res. 258, 28–36. https://doi.org/10.1016/j.heares.2009.04.017 (2009).
Tsytsarev, V. et al. Layers 3 and 4 neurons of the bilateral whisker-barrel cortex. Neuroscience 494, 140–151. https://doi.org/10.1016/j.neuroscience.2022.05.018 (2022).
Shim, H. J. et al. Mouse fMRI under ketamine and xylazine anesthesia: Robust contralateral somatosensory cortex activation in response to forepaw stimulation. Neuroimage 177, 30–44. https://doi.org/10.1016/j.neuroimage.2018.04.062 (2018).
du Sert, N. P. et al. Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0. Plos Biol. 18, e3000411. https://doi.org/10.1371/journal.pbio.3000411 (2020).
Shim, H.-J. et al. Protocol for mouse optogenetic fMRI at ultrahigh magnetic fields. STAR Protoc. 3, 101846 (2022).
Shim, H. J., Lee, J. & Kim, S. G. BOLD fMRI and hemodynamic responses to somatosensory stimulation in anesthetized mice: Spontaneous breathing vs. mechanical ventilation. NMR Biomed. https://doi.org/10.1002/nbm.4311 (2020).
Yu, X. et al. Thalamocortical inputs show post-critical-period plasticity. Neuron 74, 731–742. https://doi.org/10.1016/j.neuron.2012.04.024 (2012).
Jung, W. B., Im, G. H., Jiang, H. Y. & Kim, S. G. Early fMRI responses to somatosensory and optogenetic stimulation reflect neural information flow. Proc. Natl. Acad. Sci. https://doi.org/10.1073/pnas.2023265118 (2021).
Cox, R. W. AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Comp. Biomed. Res. 29, 162–173. https://doi.org/10.1006/cbmr.1996.0014 (1996).
Smith, S. M. et al. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 23, S208–S219. https://doi.org/10.1016/j.neuroimage.2004.07.051 (2004).
Avants, B. B. et al. A reproducible evaluation of ANTs similarity metric performance in brain image registration. Neuroimage 54, 2033–2044. https://doi.org/10.1016/j.neuroimage.2010.09.025 (2011).
Acknowledgements
This project was funded by the Institute for Basic Science in Korea (IBS-R015-D1). We would like to thank Professor Hey-Kyoung Lee of John Hopkins University for helpful scientific discussions, Dr. Geun Ho Im for assisting fMRI experiments and maintaining the 15.2 T MR instrument and associated equipment.
Author information
Authors and Affiliations
Contributions
T.N.A.D and S.G.K conceived and planned the experiments; T.N.A.D performed the animal preparation and the experiments; T.N.A.D and H.S.M analyzed the data; and T.N.A.D. and S.G.K. wrote the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Dinh, T.N.A., Moon, H.S. & Kim, SG. Separation of bimodal fMRI responses in mouse somatosensory areas into V1 and non-V1 contributions. Sci Rep 14, 6302 (2024). https://doi.org/10.1038/s41598-024-56305-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-56305-w
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.