The context-contingent nature of cross-modal activations of the visual cortex

Pawel J Matusz; Chrysa Retsa; Micah M Murray

doi:10.1016/j.neuroimage.2015.11.016

The context-contingent nature of cross-modal activations of the visual cortex

Neuroimage. 2016 Jan 15:125:996-1004. doi: 10.1016/j.neuroimage.2015.11.016. Epub 2015 Nov 10.

Authors

Pawel J Matusz¹, Chrysa Retsa², Micah M Murray³

Affiliations

¹ The Laboratory for Investigative Neurophysiology (The LINE), Neuropsychology and Neurorehabilitation Service and Department of Radiology, University Hospital Center and University of Lausanne, 1011 Lausanne, Switzerland; Attention, Brain, and Cognitive Development Group, Department of Experimental Psychology, University of Oxford, UK; University of Social Sciences and Humanities, Faculty in Wroclaw, Wroclaw, Poland. Electronic address: pawel.matusz@chuv.ch.
² The Laboratory for Investigative Neurophysiology (The LINE), Neuropsychology and Neurorehabilitation Service and Department of Radiology, University Hospital Center and University of Lausanne, 1011 Lausanne, Switzerland.
³ The Laboratory for Investigative Neurophysiology (The LINE), Neuropsychology and Neurorehabilitation Service and Department of Radiology, University Hospital Center and University of Lausanne, 1011 Lausanne, Switzerland; EEG Brain Mapping Core, Center for Biomedical Imaging (CIBM) of Lausanne and Geneva, 1011 Lausanne, Switzerland; Department of Ophthalmology, University of Lausanne, Jules-Gonin Eye Hospital, Lausanne, Switzerland.

PMID: 26564531
DOI: 10.1016/j.neuroimage.2015.11.016

Abstract

Real-world environments are nearly always multisensory in nature. Processing in such situations confers perceptual advantages, but its automaticity remains poorly understood. Automaticity has been invoked to explain the activation of visual cortices by laterally-presented sounds. This has been observed even when the sounds were task-irrelevant and spatially uninformative about subsequent targets. An auditory-evoked contralateral occipital positivity (ACOP) at ~250ms post-sound onset has been postulated as the event-related potential (ERP) correlate of this cross-modal effect. However, the spatial dimension of the stimuli was nevertheless relevant in virtually all prior studies where the ACOP was observed. By manipulating the implicit predictability of the location of lateralised sounds in a passive auditory paradigm, we tested the automaticity of cross-modal activations of visual cortices. 128-channel ERP data from healthy participants were analysed within an electrical neuroimaging framework. The timing, topography, and localisation resembled previous characterisations of the ACOP. However, the cross-modal activations of visual cortices by sounds were critically dependent on whether the sound location was (un)predictable. Our results are the first direct evidence that this particular cross-modal process is not (fully) automatic; instead, it is context-contingent. More generally, the present findings provide novel insights into the importance of context-related factors in controlling information processing across the senses, and call for a revision of current models of automaticity in cognitive sciences.

Keywords: Attention; Context; Control; Crossmodal; ERP; Multisensory; Visual.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Acoustic Stimulation
Adult
Attention / physiology*
Auditory Perception / physiology*
Electroencephalography
Evoked Potentials / physiology*
Female
Humans
Male
Visual Cortex / physiology*
Visual Perception / physiology*
Young Adult