Abstract
Although early sensory cortex is organized along dimensions encoded by receptor organs, little is known about the organization of higher areas in which different modalities are integrated. We investigated multisensory integration in human superior temporal sulcus using recent advances in parallel imaging to perform functional magnetic resonance imaging (fMRI) at very high resolution. These studies suggest a functional architecture in which information from different modalities is brought into close proximity via a patchy distribution of inputs, followed by integration in the intervening cortex.
This is a preview of subscription content, access via your institution
Relevant articles
Open Access articles citing this article.
-
A modality-independent proto-organization of human multisensory areas
Nature Human Behaviour Open Access 16 January 2023
-
Functional localization of audiovisual speech using near infrared spectroscopy
Brain Topography Open Access 12 July 2022
-
Audiovisual structural connectivity in musicians and non-musicians: a cortical thickness and diffusion tensor imaging study
Scientific Reports Open Access 22 February 2021
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Rent or buy this article
Prices vary by article type
from$1.95
to$39.95
Prices may be subject to local taxes which are calculated during checkout


References
Beauchamp, M.S., Lee, K.E., Argall, B.D. & Martin, A. Neuron 41, 809–823 (2004).
Calvert, G.A. Cereb. Cortex 11, 1110–1123 (2001).
Van Atteveldt, N., Formisano, E., Goebel, R. & Blomert, L. Neuron 43, 271–282 (2004).
Wright, T.M., Pelphrey, K.A., Allison, T., McKeown, M.J. & McCarthy, G. Cereb. Cortex 13, 1034–1043 (2003).
Hikosaka, K., Iwai, E., Saito, H. & Tanaka, K. J. Neurophysiol. 60, 1615–1637 (1988).
Benevento, L.A., Fallon, J., Davis, B.J. & Rezak, M. Exp. Neurol. 57, 849–872 (1977).
Seltzer, B. & Pandya, D.N. J. Comp. Neurol. 343, 445–463 (1994).
Seltzer, B. et al. J. Comp. Neurol. 370, 173–190 (1996).
Bodurka, J. et al. Magn. Reson. Med. 51, 165–171 (2004).
De Zwart, J.A. et al. Magn. Reson. Med. 51, 22–26 (2004).
Cheng, K., Waggoner, R.A. & Tanaka, K. Neuron 32, 359–374 (2001).
Goodyear, B.G. & Menon, R.S. Hum. Brain Mapp. 14, 210–217 (2001).
Beauchamp, M.S., Lee, K.E., Haxby, J.V. & Martin, A. Neuron 34, 149–159 (2002).
Logothetis, N.K., Pauls, J., Augath, M., Trinath, T. & Oeltermann, A. Nature 412, 150–157 (2001).
Wallace, M.T., Ramachandran, R. & Stein, B.E. Proc. Natl. Acad. Sci. USA 101, 2167–2172 (2004).
Acknowledgements
We thank C. Senior for providing the face stimuli and R.W. Cox and Z.S. Saad for their continued development of AFNI and SUMA.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Supplementary information
Supplementary Video 1
Example of tool video used as visual stimulus (V) in main experiment. (MPG 330 kb)
Supplementary Video 2
Example of tool recording used as auditory stimulus (A) in main experiment. (MPG 216 kb)
Supplementary Video 3
Example of simultaneous video and recording used as auditory-visual stimulus (AV) in main experiment. (MPG 557 kb)
Supplementary Video 4
Example of face video used as visual stimulus (V) in control experiment. (MPG 1395 kb)
Supplementary Video 5
Example of voice recording used as auditory stimulus (A) in control experiment. (MPG 210 kb)
Supplementary Video 6
Example of simultaneous face video and voice recording used as auditory-visual stimulus (AV) in control experiment. (MPG 1395 kb)
Rights and permissions
About this article
Cite this article
Beauchamp, M., Argall, B., Bodurka, J. et al. Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci 7, 1190–1192 (2004). https://doi.org/10.1038/nn1333
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nn1333
This article is cited by
-
A modality-independent proto-organization of human multisensory areas
Nature Human Behaviour (2023)
-
Alterations of Audiovisual Integration in Alzheimer’s Disease
Neuroscience Bulletin (2023)
-
Functional localization of audiovisual speech using near infrared spectroscopy
Brain Topography (2022)
-
Audiovisual structural connectivity in musicians and non-musicians: a cortical thickness and diffusion tensor imaging study
Scientific Reports (2021)
-
Optic flow selectivity in the macaque parieto-occipital sulcus
Brain Structure and Function (2021)