Key Points
-
Synaesthesia is a rare phenomenon in which a sensory stimulus in one modality can trigger sensory experience in other modalities. For example, hearing a word (the 'inducer') might cause a synaesthete to see a particular colour (the 'concurrent'). Although there are many forms of synaesthesia involving different combinations of sensory inducer and concurrent, the most common consists of specific colours being elicited by written or spoken digits, letters or words.
-
Although early explanations for synaesthesia suggested that the associations between inducer and concurrent were learned, more recent data showing that synaesthesia is automatic and involuntary have led researchers to propose that it might arise from anomalous connectivity between brain areas, perhaps as a result of the failure of pruning during the development of the nervous system. Alternative explanations invoke abnormal sprouting of connections, or disinhibition of feedback within existing pathways.
-
Functional imaging studies have shown that visual synaesthetic experiences involve activation of extrastriate visual cortices, but not early visual areas, and that this activation seems to occur later than activation associated with the sensory modality of the inducer. Future imaging studies will need to be carefully designed to eliminate possible confounds and to provide further information on the neural bases of synaesthesia.
-
Objective measures of synaesthesia have shown that it is consistent over time, involuntary and automatic: for example, synaesthetes show interference when asked to name the colour in which a letter or digit is printed if that colour is incongruent with the synaesthetic colour induced by the character. Studies of priming by synaesthetic inducers seem to show that the inducing stimulus must be processed to conscious levels by the visual system in order for the synaesthetic effect to occur. However, other evidence relating to the stage of perceptual processing at which synaesthesia occurs indicates that synaesthetic colours arise before the inducer is identified.
-
A neurocognitive model of colour–graphemic synaesthesia is presented, based on the assumption that there are multiple routes for processing symbolic form and colour in the brain. According to the model, the experience of colour in synaesthesia might arise at different levels in the processing hierarchy. This model could provide a framework for further investigations of the neurocognitive bases of synaesthesia.
Abstract
An enduring question in cognitive neuroscience is how the physical properties of the world are represented in the brain to yield conscious perception. In most people, a particular physical stimulus gives rise to a unitary, unimodal perceptual experience. So, light energy leads to the sensation of seeing, whereas sound waves produce the experience of hearing. However, for individuals with the rare phenomenon of synaesthesia, specific physical stimuli consistently induce more than one perceptual experience. For example, hearing particular sounds might induce vivid experiences of colour, taste or odour, as might the sight of visual symbols, such as letters or digits. Here we review the latest findings on synaesthesia, and consider its possible genetic, neural and cognitive bases. We also propose a neurocognitive framework for understanding such anomalous perceptual experiences.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$189.00 per year
only $15.75 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Cytowic, R. E. Synesthesia: a Union of the Senses (Springer, New York, 1989).
Baron-Cohen, S., Wyke, M. A. & Binnie, C. Hearing words and seeing colours: an experimental investigation of a case of synaesthesia. Perception 16, 761–767 (1987).Many papers have documented the consistency of synaesthetic experiences over time. This paper was the first to provide comparative data from a non-synaesthetic control on a 'test of consistency', which has become something of a gold standard in the field. The study also examined the effect of orthography and phonology of inducing words on synaesthetic colours.
Dixon, M. J., Smilek, D., Cudahy, C. & Merikle, P. M. Five plus two equals yellow. Nature 406, 365 (2000).An elegant demonstration of synaesthetic Stroop interference arising from the mere concept of a number, rather than from afferent processing of its visual or auditory form.
Grossenbacher, P. G. & Lovelace, C. T. Mechanisms of synesthesia: cognitive and physiological constraints. Trends Cogn. Sci. 5, 36–41 (2001).An overview of recent research on synaesthesia, with particular emphasis on a specific neurobiological explanation for synaesthesia (the 'disinhibited feedback' theory).
Cytowic, R. E. Synesthesia and mapping of subjective sensory dimensions. Neurology 39, 849–850 (1989).
Grossenbacher, P. G. in Synaesthesia: Classic and Contemporary Readings (eds Baron-Cohen, S. & Harrison, J. E.) 148–172 (Blackwell, Massachusetts, 1997).
Galton, F. Visualised numerals. Nature 21, 252–256 (1880).
Seron, X., Pesenti, M. & Noel, M. P. Images of numbers, or 'When 98 is upper left and 6 sky blue'. Cognition 44, 159–196 (1992).
Collier, G. L. Affective synesthesia: extracting emotion space from simple perceptual stimuli. Motiv. Emot. 20, 1–32 (1996).
Cutsforth, T. D. The role of emotion in a synaesthetic subject. Am. J. Psychol. 36, 527–543 (1925).
Cytowic, R. E. The Man who Tasted Shapes (Putnam, New York, 1993).A detailed and lucid description of one of the classic cases of synaesthesia. Provides a fascinating overview of the heterogeneous manifestations of synaesthesia, and offers thought-provoking speculations on its cognitive and neurobiological significance.
Baron-Cohen, S. & Harrison, J. E. (eds) Synaesthesia: Classic and Contemporary Readings (Blackwell, Massachusetts, 1997).This edited volume contains several historical and contemporary papers on synaesthesia. It covers numerous topics, including genetic and developmental aspects, brain imaging, cognition, consciousness and theories of synaesthesia.
Cytowic, R. E. Synesthesia: phenomenology and neuropsychology. Psyche 2 [online] (cited 02 Oct. 01) 〈http://psyche.cs.monash.edu.au/v2/psyche-2-10-cytowic.html〉 (1996).
Mattingley, J. B., Rich, A. N., Yelland, G. & Bradshaw, J. L. Unconscious priming eliminates automatic binding of colour and alphanumeric form in synaesthesia. Nature 410, 580–582 (2001).The first study to show consistent synaesthetic Stroop effects in a group of colour–graphemic synaesthetes. This study also used masked priming to reveal the level of inducer processing required for synaesthetic colours to arise. In the absence of conscious perception of the inducer, Stroop interference was eliminated.
Paulesu, E. et al. The physiology of coloured hearing: a PET activation study of colour–word synaesthesia. Brain 118, 661–676 (1995).A pioneering functional brain-imaging study of synaesthesia. A group of colour–phonemic synaesthetes showed significant activity in various extrastriate visual areas as they listened to words that elicited synaesthetic colour experiences.
Smilek, D., Dixon, M. J., Cudahy, C. & Merikle, P. M. Synaesthetic photisms influence visual perception. J. Cogn. Neurosci. 13, 930–936 (2001).
Baron-Cohen, S., Burt, L., Smith-Laittan, F., Harrison, J. & Bolton, P. Synaesthesia: prevalence and familiality. Perception 25, 1073–1079 (1996).The only published study to provide a reliable estimate of the prevalence of synaesthesia in the adult population (1 in 2,000), and the first to report details of possible patterns of inheritance.
Riggs, L. A. & Karwoski, T. Synaesthesia. Br. J. Psychol. 25, 29–41 (1934).
Galton, F. Inquiries into Human Faculty and its Development (Macmillan, London, 1883).
Bailey, M. E. S. & Johnson, K. J. in Synaesthesia: Classic and Contemporary Readings (eds Baron-Cohen, S. & Harrison, J. E.) 182–207 (Blackwell, Massachusetts, 1997).
Marks, L. E. in Varieties of Anomalous Experience: Examining the Scientific Evidence (eds Cardena, E., Lynn, S. J. & Krippner, S. C.) 121–149 (American Psychological Association, Washington, 2000).
Porac, C. & Coren, S. Lateral Preferences and Human Behavior (Springer, New York, 1981).
Jacobs, L., Karpik, A., Bozian, D. & Gothgen, S. Auditory–visual synesthesia. Arch. Neurol. 38, 211–216 (1981).
Rang, H. P., Dale, M. M. & Ritter, J. M. Pharmacology (Churchill Livingstone, Edinburgh, 1999).
Myers, C. S. Two cases of synaesthesia. Br. J. Psychol. 7, 112–117 (1914).
Howells, T. H. The experimental development of color–tone synesthesia. J. Exp. Psychol. 34, 87–103 (1944).
Kelly, E. L. An experimental attempt to produce artificial chromaesthesia by the technique of the conditioned response. J. Exp. Psychol. 17, 315–341 (1934).
Rizzo, M. & Eslinger, P. J. Colored hearing synesthesia: an investigation of neural factors. Neurology 39, 781–784 (1989).
Luria, A. R. The Mind of a Mnemonist (Jonathan Cape, London, 1969).
Marks, L. E. On colored–hearing synesthesia: cross-modal translations of sensory dimensions. Psychol. Bull. 82, 303–331 (1975).
Marks, L. E. The Unity of the Senses: Interrelations Among the Modalities (Academic, New York, 1978).
Martino, G. & Marks, L. E. Perceptual and linguistic interactions in speeded classification: tests of the semantic coding hypothesis. Perception 28, 903–923 (1999).
Marks, L. E. On cross-modal similarity: auditory–visual interactions in speeded discrimination. J. Exp. Psychol. Hum. Percept. Perform. 13, 384–394 (1987).
Karwoski, T. F., Odbert, H. S. & Osgood, C. E. Studies in synesthetic thinking. II. The role of form in visual responses to music. J. Gen. Psychol. 26, 199–222 (1942).
Baron-Cohen, S., Harrison, J., Goldstein, L. H. & Wyke, M. Coloured speech perception: is synaesthesia what happens when modularity breaks down? Perception 22, 419–426 (1993).
Kennedy, H., Batardiere, A., Dehay, C. & Barone, P. in Synaesthesia: Classic and Contemporary Readings (eds Baron-Cohen, S. & Harrison, J. E.) 243–256 (Blackwell, Massachusetts, 1997).
Maurer, D. in Synaesthesia: Classic and Contemporary Readings (eds Baron-Cohen, S. & Harrison, J. E.) 224–242 (Blackwell, Massachusetts, 1997).
Lewkowicz, D. J. & Turkewitz, G. Cross-modal equivalence in early infancy: auditory–visual intensity matching. Dev. Psychol. 16, 597–607 (1980).
Bullier, J. Feedback connections and conscious vision. Trends Cogn. Sci. 5, 369–370 (2001).
Aleman, A., Rutten, G. M., Sitskoorn, M. M., Dautzenberg, G. & Ramsey, N. F. Activation of striate cortex in the absence of visual stimulation: an fMRI study of synesthesia. Neuroreport 12, 2827–2830 (2001).
Howard, R. J. et al. The functional anatomy of imagining and perceiving colour. Neuroreport 9, 1019–1023 (1998).
Schiltz, K., Trocha, K., Wieringa, B. M., Johannes, S. & Munte, T. F. Neurophysiological aspects of synesthetic experience. J. Neuropsychiatry Clin. Neurosci. 11, 58–65 (1999).
Stroop, J. R. Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643–662 (1935).
MacLeod, C. M. Half a century of research on the Stroop effect: an integrative review. Psychol. Bull. 109, 163–203 (1991).
Mills, C. B., Boteler, E. H. & Oliver, G. K. Digit synaesthesia: a case study using a Stroop-type test. Cogn. Neuropsychol. 16, 181–191 (1999).
Odgaard, E. C., Flowers, J. H. & Bradman, H. L. An investigation of the cognitive and perceptual dynamics of a colour–digit synaesthete. Perception 28, 651–664 (1999).
Wollen, K. A. & Ruggiero, F. T. Colored-letter synesthesia. J. Ment. Imag. 7, 83–86 (1983).
Tipper, S. P. & Cranston, M. Selective attention and priming; inhibitory and facililatory effects of ignored primes. Q. J. Exp. Psychol. 37A, 591–611 (1985).
Ramachandran, V. S. & Hubbard, E. S. Psychophysical investigations into the neural basis of synaesthesia. Proc. R. Soc. Lond. B 268, 979–983 (2001).
Mattingley, J. B., Rich, A. N., Yelland, G. & Bradshaw, J. L. Investigations of automatic binding of colour and form in synaesthesia. Brain Cogn. (in the press).
Navon, D. Forest before trees: the precedence of global features in visual perception. Cogn. Psychol. 9, 353–383 (1977).
Rubin, E. Visuell Wahrgenommene Figuren (Glydenalske Boghandel, Kobenhaven, 1921).
Treisman, A. & Gelade, G. A feature-integration theory of attention. Cogn. Psychol. 12, 97–136 (1980).
Wolfe, J. M. in Attention (ed. Pashler, H.) 13–73 (Psychology, Hove, 1998).
Coltheart, M., Rastle, K., Perry, C. & Langdon, R. DRC: a dual route cascaded model of visual word recognition and reading aloud. Psychol. Rev. 108, 204–256 (2001).
Rumelhart, D. E. & McClelland, J. L. An interactive activation model of context effects in letter perception: part 2. The contextual enhancement effect and some tests and extensions of the model. Psychol. Rev. 89, 60–94 (1982).
McClelland, J. L. & Rumelhart, D. E. An interactive activation model of context effects in letter perception: part 1. An account of basic findings. Psychol. Rev. 88, 375–407 (1981).
Davidoff, J. Cognition through Color (MIT Press, Cambridge, Massachusetts, 1991).
Bartolomeo, P. et al. Multiple-domain dissociation between impaired visual perception and preserved visual imagery in a patient with bilateral extrastriate lesions. Neuropsychologia 36, 239–249 (1998).
Bartolomeo, P., Bachoud-Levi, A. & Denes, G. Preserved imagery for colours in a patient with cerebral achromatopsia. Cortex 33, 369–378 (1977).
Shuren, B. J., Brott, T. G., Schefft, B. K. & Houston, W. Preserved color imagery in an achromatopsic. Neuropsychologia 34, 485–489 (1996).
Miceli, G. et al. The dissociation of color from form and function knowledge. Nature Neurosci. 4, 662–667 (2001).
Ginsberg, L. A case of synaesthesia. Am. J. Psychol. 34, 582–589 (1923).
Coriat, I. H. A case of synesthesia. J. Abnorm. Psychol. 8, 38–43 (1913).
Pierce, A. H. Gustatory audition: a hitherto undescribed variety of synaesthesia. Am. J. Psychol. 18, 341–352 (1907).
Gazzaniga, M. S. (ed.) The New Cognitive Neurosciences (MIT Press, Cambridge, Massachusetts, 2000).
Fodor, J. A. The Modularity of Mind (MIT Press/Bradford Books, Cambridge, Massachusetts, 1983).
Shallice, T. From Neuropsychology to Mental Structure (Cambridge Univ. Press, Cambridge, 1988).
Coltheart, M. Modularity and cognition. Trends Cogn. Sci. 3, 115–120 (1999).
Shor, R. E. Symbol processing speed differences and symbol interference effects in a variety of concept domains. J. Gen. Psychol. 85, 187–205 (1971).
Flowers, J. H., Warner, J. L. & Polansky, M. C. Response and encoding factors in 'ignoring' irrelevant information. Mem. Cogn. 7, 86–94 (1979).
Carter, C. S. et al. Parsing executive processes: strategic vs. evaluative functions of the anterior cingulate cortex. Proc. Natl Acad. Sci. USA 97, 1944–1948 (2000).
Acknowledgements
We thank J. L. Bradshaw, M. Howard, M. O'Boyle and M. A. Williams for their helpful comments on the manuscript. A.N.R. is supported by an Australian Postgraduate Award. J.B.M. is supported by grants from the Australian Research Council, the National Health and Medical Research Council and Unilever (UK).
Author information
Authors and Affiliations
Corresponding author
Related links
Glossary
- ISHIHARA COLOUR PLATES
-
A series of plates used for the diagnosis of colour blindness. They are designed so that individuals with normal colour vision can see shapes or characters, but colour-blind people cannot.
- FEEDFORWARD INFORMATION FLOW
-
Information processing that proceeds in a single direction from sensory input, through perceptual analysis, to motor output, without involving feedback information flowing backwards from 'higher' centres to 'lower' centres.
- FEEDBACK INFORMATION FLOW
-
The flow of information from 'higher' to 'lower' centres.
- AREA MT/V5
-
A region of visual association cortex in the middle temporal extrastriate area that is important for the analysis of visual motion.
- PRIMARY VISUAL CORTEX
-
The cortical area that is the main recipient of visual information from the retinae (by way of the lateral geniculate nucleus); also known as V1 or striate cortex.
- AREA V4
-
A region of the posterior fusiform gyrus that has been implicated in colour perception.
- EVENT-RELATED POTENTIALS
-
Electrical potentials generated in the brain as a consequence of synchronized activation of neuronal networks by external stimuli. These evoked potentials are recorded at the scalp and consist of precisely timed sequences of waves or 'components'.
- NEGATIVE PRIMING
-
The increased time taken to respond to a target item that was an ignored distractor in a preceding trial. The effect is thought to occur because inhibition associated with the ignored distractor carries over to processing of the target.
- POP OUT
-
In displays composed of identical distractor stimuli (for example, red 'X's), a stimulus with a unique feature (for example, a blue 'X') can be detected rapidly and effortlessly, with little or no increase in reaction time as the number of distractor stimuli increases.
- TRANSCRANIAL MAGNETIC STIMULATION
-
A technique used to induce a transient interruption of normal activity in a relatively restricted area of the brain. It is based on the generation of a strong magnetic field near the area of interest, which, if changed rapidly enough, will induce an electric field sufficient to stimulate neurons.
Rights and permissions
About this article
Cite this article
Rich, A., Mattingley, J. Anomalous perception in synaesthesia: A cognitive neuroscience perspective. Nat Rev Neurosci 3, 43–52 (2002). https://doi.org/10.1038/nrn702
Issue Date:
DOI: https://doi.org/10.1038/nrn702
This article is cited by
-
Do Synesthetic Colors Grab Attention in Visual Search?
Review of Philosophy and Psychology (2016)
-
Geminate consonant grapheme-colour synaesthesia (ideaesthesia)
BMC Neurology (2015)
-
Neither touch nor vision: sensory substitution as artificial synaesthesia?
Biology & Philosophy (2013)
-
Is it for real? Evaluating authenticity of musical pitch-space synesthesia
Cognitive Processing (2012)
-
Molecular mapping of quantitative trait loci for domestication traits and β-glucan content in a wheat recombinant inbred line population
Euphytica (2011)