Article | Published:

Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words

Nature Neuroscience volume 5, pages 371375 (2002) | Download Citation

Subjects

Abstract

In 'colored-hearing' synesthesia, individuals report color experiences when they hear spoken words. If the synesthetic color experience resembles that of normal color perception, one would predict activation of parts of the visual system specialized for such perception, namely the human 'color center', referred to as either V4 or V8. Using functional magnetic resonance imaging (fMRI), we here locate the region activated by speech in synesthetes to area V4/V8 in the left hemisphere, and demonstrate overlap with V4/V8 activation in normal controls in response to color. No activity was detected in areas V1 or V2, suggesting that activity in primary visual cortex is not necessary for such experience. Control subjects showed no activity in V4/V8 when imagining colors in response to spoken words, despite overtraining on word–color associations similar to those spontaneously reported by synesthetes.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    , & Hearing words and seeing colours: an experimental investigation of a case of synaesthesia. Perception 16, 761–767 (1987).

  2. 2.

    et al. The physiology of coloured-hearing: a PET activation study of colour–word synaesthesia. Brain 118, 661–676 (1995).

  3. 3.

    et al. The colour centre in the cerebral cortex of man. Nature 340, 386–389 (1989).

  4. 4.

    et al. A direct demonstration of functional specialisation in human visual cortex. J. Neurosci. 11, 641–649 (1991).

  5. 5.

    , , , & Retinopy and color sensitivity in human visual cortical area V8. Nature Neurosci. 1, 235–241 (1998).

  6. 6.

    et al. Conscious visual perception without V1. Brain 116,1293–1302 (1993).

  7. 7.

    , & Going beyond the information given: the relation of illusory visual motion to brain activity. Proc. R. Soc. Lond. B 252, 215–222 (1993).

  8. 8.

    & Are we aware of neural activity in primary visual cortex? Nature 373,121–123 (1995).

  9. 9.

    et al. The functional anatomy of imagining and perceiving colour. NeuroReport 9, 1019–1023 (1998).

  10. 10.

    & The architecture of the colour centre in the human visual brain: new results and a review. Eur. J. Neurosci. 12, 172–193 (2000).

  11. 11.

    Synaesthesia: Classical and Contemporary Readings (ed. Baron-Cohen, S. & Harrison, J. E.) 148–172 (Blackwell, Oxford, 1997).

  12. 12.

    & Three cortical stages of colour processing in the human brain. Brain 121, 1669–1685 (1998).

  13. 13.

    et al. The functional anatomy of the McCollough contingent colour after-effect. NeuroReport 10, 195–199 (1999).

  14. 14.

    & Cross-modal transfer of information between the tactile and the visual representations in the human brain: a positron emission tomographic study. J. Neurosci. 18, 1072–1084 (1998).

  15. 15.

    et al. Functional mapping of brain areas implicated in auditory–verbal memory function. Brain 116, 1–20 (1993).

  16. 16.

    et al. Remembering the past: two facets of episodic memory explored with positron emission tomography. Am. J. Psychiat. 152, 1576–1585 (1995).

  17. 17.

    et al. Brain systems for encoding and retrieval of auditory–verbal memory: an in vivo study in humans. Brain 118, 401–416 (1995).

  18. 18.

    & Activation of left posterior cingulate gyrus by the auditory presentation of threat-related words: an fMRI study. Psychiatry Res. 75, 1–14 (1997).

  19. 19.

    Synaesthesia: Classical and Contemporary Readings (eds. Baron-Cohen, S. & Harrison, J. E.) 17–39 (Blackwell, Oxford, 1997).

  20. 20.

    , , & Coloured speech perception: is synaesthesia what happens when modularity breaks down? Perception 22, 419–426 (1993).

  21. 21.

    & Psychophysical investigations into the neural basis of synaesthesia. Proc. R. Soc. Lond., B 268, 979–983 (2001).

  22. 22.

    et al. The anatomy of conscious vision: an fMRI study of visual hallucinations. Nature Neurosci. 11, 738–742 (1998).

  23. 23.

    & Mechanisms of synesthesia: cognitive and physiological constraints. Trends Cogn. Sci. 5, 36–41 (2001).

  24. 24.

    et al. Visual motion aftereffect in human cortical area MT revealed by functional magnetic resonance imaging. Nature 375, 139–141 (1995).

  25. 25.

    & Interocular rivalry revealed in the human cortical blind-spot representation. Nature 411, 195–199 (2001).

  26. 26.

    , & in Synaesthesia: Classical and Contemporary Readings (ed. Baron-Cohen, S. & Harrison, J. E.) 173–181 (Blackwell, Oxford, 1997).

  27. 27.

    & The Visual Brain in Action (Oxford Univ. Press, Oxford, 1995).

  28. 28.

    , & Transient projections from the fronto-parietal and temporal cortex to areas 17, 18 and 19 in the kitten. Exp. Brain Res. 57, 208–212 (1984).

  29. 29.

    & in Synaesthesia: Classical and Contemporary Readings (eds. Baron-Cohen, S. & Harrison, J. E.) 182–207 (Blackwell, Oxford, 1997).

  30. 30.

    , , , & Synaesthesia: prevalence and familiality. Perception 25, 1073–1079 (1996).

  31. 31.

    in Neuronal Bases and Psychological Aspects of Consciousness (eds. Taddeo-Ferretto, C. & Musio, C.) 8, 450–457 (World Scientific, Singapore,1999).

  32. 32.

    & National Adult Reading Test (NART): Test Manual 2nd ed. (NFER-Nelson, Windsor, 1991).

  33. 33.

    et al. Neural pathways involved in the processing of concrete and abstract words. Hum. Brain Mapp. 7, 225–233 (1999).

  34. 34.

    & Frequency Analysis of English Vocabulary and Grammar Based on the LOB Corpus (Oxford Univ. Press, Oxford, 1982).

  35. 35.

    , , & Brain magnetic resonance imaging with contrast dependent on blood oxygenation. Proc. Nat. Acad. Sci. USA 8, 9868–9872 (1990).

  36. 36.

    et al. Methods for diagnosis and treatment of stimulus-correlated motion in generic brain activation studies using fMRI. Hum. Brain Mapp. 7, 38–48 (1999).

  37. 37.

    et al. Colored noise and computational inference in neurophysiological (fMRI) time series analysis: resampling methods in time and wavelet domains. Hum. Brain Mapp. 12, 61–78 (2001).

  38. 38.

    Randomisation Tests 3rd ed. (Dekker, New York, 1995).

  39. 39.

    & Co-planar Stereotactic Atlas of the Human Brain. (Thieme, Stuttgart, 1988).

  40. 40.

    et al. Generic brain activation mapping in fMRI: a nonparametric approach. Mag. Res. Imaging 15, 763–770 (1997).

  41. 41.

    et al. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI)—use of a cluster size threshold. Mag. Res. Med. 33, 636–647 (1995).

Download references

Acknowledgements

This work was supported by the McDonnell–Pew Foundation and a Consciousness Studies Award from the University of Arizona. We thank John Harrison and Sue Chopping for assistance with various aspects of the research. J.A.G. is currently a fellow at the Center for Advanced Study in the Behavioral Sciences, Stanford University, with financial support from the John D. and Catherine T. Macarthur Foundation, Grant no.32005-0.

Author information

Affiliations

  1. Department of Psychology, Goldsmiths College, London SE14 6NW, UK

    • J. A. Nunn
  2. Neuroimaging, Institute of Psychiatry, London SE5 8AF, UK

    • J. A. Nunn
    • , L. J. Gregory
    •  & S. C. R. Williams
  3. Brain Image Analysis Unit Institute of Psychiatry, London SE5 8AF, UK

    • M. Brammer
  4. Department of Psychology, Institute of Psychiatry, London SE5 8AF, UK

    • D. M. Parslow
    • , R. G. Morris
    •  & J. A. Gray
  5. Applied Vision Research Centre, The City University, Northampton Square, London EC1V OHB, UK

    • M. J. Morgan
  6. Department of Psychiatry, University of Cambridge, Addenbrooke's Hospital, Cambridge, CB2 2QQ, UK

    • E. T. Bullmore
    •  & S. Baron-Cohen
  7. Department of Experimental Psychology, University of Cambridge, Cambridge, CB2 3EB, UK

    • S. Baron-Cohen
  8. Gastrointestinal Sciences, University of Manchester, Manchester, M13 9PL

    • L. J. Gregory

Authors

  1. Search for J. A. Nunn in:

  2. Search for L. J. Gregory in:

  3. Search for M. Brammer in:

  4. Search for S. C. R. Williams in:

  5. Search for D. M. Parslow in:

  6. Search for M. J. Morgan in:

  7. Search for R. G. Morris in:

  8. Search for E. T. Bullmore in:

  9. Search for S. Baron-Cohen in:

  10. Search for J. A. Gray in:

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to J. A. Nunn.

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/nn818