Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Letter
  • Published:

Functional anatomy of a common semantic system for words and pictures

Abstract

THE relationship between the semantic processing of words and of pictures is a matter of debate among cognitive scientists1,2. We studied the functional anatomy of such processing by using positron-emission tomography (PET). We contrasted activity during two semantic tasks (probing knowledge of associations between concepts, and knowledge of the visual attributes of these concepts) and a baseline task (discrimination of physical stimulus size), performed either with words or with pictures. Modality-specific activations unrelated to semantic processing occurred in the left inferior parietal lobule for words, and the right middle occipital gyrus for pictures. A semantic network common to both words and pictures extended from the left superior occipital gyrus through the middle and inferior temporal cortex to the inferior frontal gyrus. A picture-specific activation related to semantic tasks occurred in the left posterior inferior temporal sulcus, and word-specific activations related to semantic tasks were localized to the left superior temporal sulcus, left anterior middle temporal gyrus, and left inferior frontal sulcus. Thus semantic tasks activate a distributed semantic processing system shared by both words and pictures, with a few specific areas differentially active for either words or pictures.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Similar content being viewed by others

References

  1. Caplan, D. Language: Structure, Processing and Disorders 63–104 (MIT Press, Cambridge, MA, 1992).

    Google Scholar 

  2. Shallice, T. In The Cognitive Neuropsychology of Language (eds Coltheart, M. Sartori, G. & Job, R.) 111–127 (Lawrence Erlbaum, Hove, 1987).

    Google Scholar 

  3. Farah, M. Visual Agnosia: Disorders of Object Recognition and What They Tell Us About Normal Vision (MIT Press, Cambridge, MA, 1990).

    Google Scholar 

  4. Gomori, A. & Hawryluk, G. Neurology 34, 947–950 (1984).

    Article  CAS  Google Scholar 

  5. Albert, M., Soffer, D., Silverberg, R. & Reches, A. Neurology 29, 870–879 (1979).

    Google Scholar 

  6. Mack, J. & Bollen, F. Neuropsychologia 15, 345–348 (1977).

    Article  CAS  Google Scholar 

  7. Bub, D., Black, S., Hampson, E. & Kertesz, A. Cogn. Neuropsychol. 5, 27–66 (1988).

    Article  Google Scholar 

  8. Beauvois, M. Phil. Trans. R. Soc. Lond. B 298, 35–47 (1982).

    Article  ADS  CAS  Google Scholar 

  9. Warrington, E. & McCarthy, R. Neuropsychologia 32, 1465–1473 (1994).

    Article  CAS  Google Scholar 

  10. Warrington, E. & Shallice, T. Brain 107, 829–853 (1984).

    Article  Google Scholar 

  11. McCarthy, R. & Warrington, E. Nature 334, 428–430 (1988).

    Article  ADS  CAS  Google Scholar 

  12. Glaser, W. Cognition 42, 61–105 (1992).

    Article  CAS  Google Scholar 

  13. Caramazza, A., Hillis, A., Rapp, B. & Romani, C. Cogn. Neuropsychol. 7, 161–189 (1990).

    Article  Google Scholar 

  14. Butterworth, B., Howard, D. & McLoughlin, P. Neuropsychologia 22, 409–426 (1984).

    Article  CAS  Google Scholar 

  15. Howard, D. & Patterson, K. Pyramids and Palm Trees: a Test of Semantic Access from Pictures and Words. (Thames Valley, Bury St Edmunds, 1992).

    Google Scholar 

  16. te Linde, J. J. Exp. Psychol. Learn. Mem. Cogn. 8, 584–598 (1982).

    Article  CAS  Google Scholar 

  17. Martin, A., Wiggs, C., Ungerleider, L. & Haxby, J. Nature 379, 649–652 (1996).

    Article  ADS  CAS  Google Scholar 

  18. Demonet, J.-F. et al. Brain 115, 1753–1768 (1992).

    Article  Google Scholar 

  19. Price, C., Moore, C. & Frackowiak, R. S. J. Neuroimage 3, 40–52 (1996).

    Article  CAS  Google Scholar 

  20. Martin, A., Haxby, J., Lalonde, F., Wiggs, C. & Ungerleider, L. Science 270, 102–105 (1995).

    Article  ADS  CAS  Google Scholar 

  21. Price, C., Wise, R. & Frackowiak, R. S. J. Cereb. Cort. 6, 62–70 (1996).

    Article  CAS  Google Scholar 

  22. Damasio, H., Grabowski, T., Tranel, D., Hichwa, R. & Damasio, A. Nature 380, 499–505 (1996).

    Article  ADS  CAS  Google Scholar 

  23. Petersen, S., Fox, P., Snyder, A. & Raichle, M. Nature 331, 585–589 (1988).

    Article  ADS  CAS  Google Scholar 

  24. Riddoch, J. & Humphreys, G. Cogn. Neuropsychol. 4, 131–185 (1987).

    Article  Google Scholar 

  25. Coltheart, V., Patterson, K. & Leahy, J. Q. J. Exp. Psychol. 47A, 917–955 (1994).

    Google Scholar 

  26. Mishkin, M., Ungerleider, L. & Macko, K. Trends Neurosci. 6, 414–417 (1983).

    Article  Google Scholar 

  27. Wilson, F., Scalaidhe, S. O. & Goldman-Rakic, P. Science 260, 1955–1958 (1993).

    Article  ADS  CAS  Google Scholar 

  28. Snodgrass, J. & Vanderwart, M. J. Exp. Psychol. Hum. Learn. Mem. 6, 174–215 (1980).

    Article  CAS  Google Scholar 

  29. Friston, K. et al. Hum. Brain Mapp. 2, 189–210 (1995).

    Article  Google Scholar 

  30. Friston, K. et al. Hum. Brain Mapp. 2, 165–189 (1995).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vandenberghe, R., Price, C., Wise, R. et al. Functional anatomy of a common semantic system for words and pictures. Nature 383, 254–256 (1996). https://doi.org/10.1038/383254a0

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1038/383254a0

This article is cited by

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing