Abstract
Visually guided grasping movements require a rapid transformation of visual representations into object-specific motor programs. Here we report that graspable objects may facilitate these visuomotor transformations by automatically grabbing visual spatial attention. Human subjects viewed two task-irrelevant objects—one was a 'tool', the other a 'non-tool'—while waiting for a target to be presented in one of the two object locations. Using event-related potentials (ERPs), we found that spatial attention was systematically drawn to tools in the right and lower visual fields, the hemifields that are dominant for visuomotor processing. Using event-related fMRI, we confirmed that tools grabbed spatial attention only when they also activated dorsal regions of premotor and prefrontal cortices, regions associated with visually guided actions and their planning. Although it is widely accepted that visual sensory gain aids perception, our results suggest that it may also have consequences for object-directed actions.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Craighero, L., Fadiga, L., Umilta, C.A. & Rizzolatti, G. Evidence for visuomotor priming effect. Neuroreport 8, 347–349 (1996).
Jeannerod, M., Arbib, M.A., Rizzolatti, G. & Sakata, H. Grasping objects: the cortical mechanisms of visuomotor transformation. Trends Neurosci. 18, 314–320 (1995).
Tucker, M. & Ellis, R. On the relations between seen objects and components of potential actions. J. Exp. Psychol. Hum. Percept. Perform. 24, 830–846 (1998).
Chao, L.L. & Martin, A. Representation of manipulable man-made objects in the dorsal stream. Neuroimage 12, 478–484 (2000).
Grafton, S.T., Fadiga, L., Arbib, M.A. & Rizzolatti, G. Premotor cortex activation during observation and naming of familiar tools. Neuroimage 6, 231–236 (1997).
Martin, A., Haxby, J.V., Lalonde, F.M., Wiggs, C.L. & Ungerleider, L.G. Discrete cortical regions associated with knowledge of color and knowledge of action. Science 270, 102–105 (1995).
Martin, A., Wiggs, C.L., Ungerleider, L.G., & Haxby, J.V. Neural correlates of category-specific knowledge. Nature 379, 649–652 (1996).
Bonfiglioli, C., Duncan, J., Rorden, C. & Kennett, S. Action and perception: evidence against converging selection processes. Vis. Cognit. 9, 458–476 (2002).
Craighero, L., Fadiga, L., Rizzolatti, G. & Umiltà, C. Action for perception: a motor-visual attentional effect. J. Exp. Psychol. Hum. Percept. Perform. 25, 1673–1692 (1999).
Desimone, R. & Duncan, J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193–222 (1995).
Duncan, J., Humphreys, G. & Ward, R. Competitive brain activity in visual attention. Curr. Opin. Neurobiol. 7, 255–261 (1997).
Snodgrass, J.G. & Vanderwart, M. A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity and visual complexity. J. Exp. Psychol. Hum. Learn. Mem. 6, 174–215 (1980).
Ward, R. Interaction between perception and action systems: a model for selective action. in Attention, Space and Action: Studies in Cognitive Neuroscience (eds. Humphreys, G.W., Duncan, J. and Treisman, A.) 311–332 (Oxford Univ. Press, New York, 1999).
Van Voorhis, S. & Hillyard, S.A. Visual evoked potentials and selective attention to points in space. Percept. Psychophys. 23, 146–160 (1977).
Hillyard, S.A., Vogel, E.K. & Luck, S.J. Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. in Attention, Space and Action: Studies in Cognitive Neuroscience (eds. Humphreys, G.W., Duncan, J. and Treisman, A.) 311–332 (Oxford Univ. Press, New York, 1999).
Handy, T.C. & Mangun, G.R. Attention and spatial selection: electrophysiological evidence for modulation by perceptual load. Percept. Psychophys. 62, 175–186 (2000).
Mangun, G.R. & Hillyard, S.A. Spatial gradients of visual attention: behavioral and electrophysiological evidence. Electroencephal. Clin. Neurophysiol. 70, 417–428 (1988).
Haaland, K.Y. & Harrington, D.L. Hemispheric asymmetry of movement. Curr. Opin. Neurobiol. 6, 796–800 (1996).
Rushworth, M.F.S., Krams, M. & Passingham, R.E. The attentional role of the left parietal cortex: the distinct lateralization and localization of motor attention in the human brain. J. Cogn. Neurosci. 13, 698–710 (2001).
Boles, D.B. An experimental comparison of stimulus type, display type and input variable contributions to visual field asymmetry. Brain Cogn. 24, 184–197 (1994).
Danckert, J. & Goodale, M.A. Superior performance for visually guided pointing in the lower visual field. Exp. Brain Res. 137, 303–308 (2001).
Kenemans, J.L., Baas, J.M.P., Mangun, G.R., Lijffijt, M. & Verbaten, M.N. On the processing of spatial frequencies as revealed by evoked-potential source modeling. Clin. Neurophysiol. 111, 1113–1123 (2000).
Zani, A. & Proverbio, A.M. Attention modulation of short latency ERPs by selective attention to conjunction of spatial frequency and location. J. Psychophysiol. 11, 21–32 (1997).
Picard, N. & Strick, P.L. Imaging premotor areas. Curr. Opin. Neurobiol. 11, 663–672 (2001).
Marconi, B. et al. Eye-hand coordination during reaching. I. Anatomical relationships between parietal and frontal cortex. Cereb. Cortex 11, 513–527 (2001).
Battaglia-Mayer, A. et al. Eye-hand coordination during reaching. II. An analysis of the relationships between visuomanual signals in parietal cortex and parieto-frontal association projections. Cereb. Cortex 11, 528–544 (2001).
Corbetta, M. & Shulman, G.L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201–215 (2002).
Hopfinger, J.B., Buonocore, M.H. & Mangun, G.R. The neural mechanisms of top-down attentional control. Nat. Neurosci. 3, 284–291 (2000).
Luck, S.J. et al. Effects of spatial cuing on luminance detectability: psychophysical and electrophysiological evidence for early selection. J. Exp. Psychol. Hum. Percept. Perform. 20, 887–904 (1994).
Hopfinger, J.B. & Mangun, G.R. Reflexive attention modulates processing of visual stimuli in human extrastriate cortex. Psychol. Sci. 9, 441–446 (1998).
Handy, T.C., Soltani, M. & Mangun, G.R. Perceptual load and visuocortical processing: ERP evidence of sensory-level selection. Psychol. Sci. 12, 213–218 (2001).
Ivry, R.B. & Robertson, L.C. The Two Sides of Perception (MIT Press, Cambridge, Massachusetts, 1998).
Posner, M.I. Orienting of attention. Q. J. Exp. Psychol. 32, 3–25 (1980).
Handy, T.C., Green, V., Klein, R. & Mangun, G.R. Combined expectancies: ERPs reveal the early benefits of spatial attention that are obscured by reaction time measures. J. Exp. Psychol. Hum. Percept. Perform. 27, 303–317 (2001).
Rushworth, M.F.S., Ellison, A. & Walsh, V. Complementary localization and lateralization of orienting and motor attention. Nat. Neurosci. 4, 656–661 (2001).
Hodges, J.R., Spatt, J. & Patterson, K. “What” and “how”: evidence for the dissociation of object knowledge and mechanical problem-solving skills in the human brain. Proc. Natl. Acad. Sci. USA 96, 9444–9448 (1999).
Humphreys, G.W. & Riddoch, M.J. Knowing what you need but not what you want: affordances and action-defined templates in neglect. Behav. Neurol. 13, 75–87 (2001).
Riddoch, M.J., Humphreys, G.W., Edwards, S., Baker, T. & Willson, K. Seeing the action: neuropsychological evidence for action-based effects on object selection. Nat. Neurosci. 6, 82–89 (2003).
Humphreys, G.W. & Riddoch, M.J. Detection by action: neuropsychological evidence for action-defined templates in search. Nat. Neurosci. 4, 84–88 (2001).
Milner, A.D. & Goodale, M.A. The Visual Brain in Action (Oxford Univ. Press, New York, 1995).
Colby, C.L. Action-oriented spatial reference frames in cortex. Neuron 20, 15–24 (1998).
Marotta, J.J. & Goodale, M.A. The role of familiar size in the control of grasping. J. Cogn. Neurosci. 13, 8–17 (2001).
Murata, A., Gallese, V., Luppino, G., Kaseda, M. & Sakata, H. Selectivity for the shape, size and orientation of objects for grasping in neurons of monkey parietal area AIP. J. Neurophysiol. 83, 2580–2601 (2000).
Batista, A.P. & Andersen, R.A. The parietal reach region codes the next planned movement in a sequential reach task. J. Neurophysiol. 85, 539–544 (2001).
Carey, D.P. Eye-hand coordination: eye to hand or hand to eye? Curr. Biol. 10, 416–419 (2000).
Graziano, M.S.A. Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proc. Natl. Acad. Sci. USA 96, 10418–10421 (1999).
Friston, K.J. et al. Spatial registration and normalization of images. Hum. Brain Mapp. 2 165–189 (1995).
Friston, K.J., Holmes, A.P., Worsley, K.J., Poline, J.-P., Frith, C.D. & Frackowiak, R.S.J. statistical parametric maps in functional imaging: a general linear approach. Human Brain Mapp. 2, 189–210 (1995b).
Friston, K.J., Williams, S., Howard, R., Frackowiak, R.S. & Turner, R. Movement-related effects in fMRI time-series. Magn. Reson. Med. 35, 346–355 (1996).
Talairach, J. & Tournoux, P. Co-planar Stereotaxic Atlas of the Human Brain (Thieme, New York, 1988).
Acknowledgements
This study was supported by funding from the National Institute of Health and Dartmouth College. We thank D. Turk, W. Kelley, E. R. Matheney and S. Mann for technical assistance.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
About this article
Cite this article
Handy, T., Grafton, S., Shroff, N. et al. Graspable objects grab attention when the potential for action is recognized. Nat Neurosci 6, 421–427 (2003). https://doi.org/10.1038/nn1031
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nn1031
This article is cited by
-
Effect of peri-hand space among users of a familiar tool: more attention enhancement in space near palm than dorsal side of hand
Current Psychology (2024)
-
Temporal differences and commonalities between hand and tool neural processing
Scientific Reports (2023)
-
Body Form Modulates the Prediction of Human and Artificial Behaviour from Gaze Observation
International Journal of Social Robotics (2023)
-
The visual encoding of graspable unfamiliar objects
Psychological Research (2023)
-
Trick the body trick the mind: avatar representation affects the perception of available action possibilities in virtual reality
Virtual Reality (2022)