Journal article
Auditory-visual processing represented in the human superior temporal gyrus
Neuroscience, Vol.145(1), pp.162-184
03/02/2007
DOI: 10.1016/j.neuroscience.2006.11.036
PMID: 17241747
Abstract
In natural face-to-face communication, speech perception utilizes both auditory and visual information. We described previously an acoustically responsive area on the posterior lateral surface of the superior temporal gyrus (field PLST) that is distinguishable on physiological grounds from other auditory fields located within the superior temporal plane. Considering the empirical findings in humans and non-human primates of cortical locations responsive to heard sounds and/or seen sound-sources, we reasoned that area PLST would also contain neural signals reflecting audiovisual speech interactions. To test this hypothesis, event related potentials (ERPs) were recorded from area PLST using chronically implanted multi-contact subdural surface-recording electrodes in patient–subjects undergoing diagnosis and treatment of medically intractable epilepsy, and cortical ERP maps were acquired during five contrasting auditory, visual and bimodal speech conditions. Stimulus conditions included consonant–vowel (CV) syllable sounds alone, silent seen speech or CV sounds paired with a female face articulating matched or mismatched syllables. Data were analyzed using a MANOVA framework, with the results from planned comparisons used to construct cortical significance maps. Our findings indicate that evoked responses recorded from area PLST to auditory speech stimuli are influenced significantly by the addition of visual images of the moving lower face and lips, either articulating the audible syllable or carrying out a meaningless (gurning) motion. The area of cortex exhibiting this audiovisual influence was demonstrably greater in the speech-dominant hemisphere.
Details
- Title: Subtitle
- Auditory-visual processing represented in the human superior temporal gyrus
- Creators
- R.A Reale - Department of Neurosurgery, University of Iowa, Iowa City, IA 52242, USAG.A Calvert - University Laboratory of Physiology, University of Oxford, Oxford, UKT Thesen - University Laboratory of Physiology, University of Oxford, Oxford, UKR.L Jenison - Department of Psychology, University of Wisconsin, 1202 West Johnson Street, Madison, WI 53706, USAH Kawasaki - Department of Neurosurgery, University of Iowa, Iowa City, IA 52242, USAH Oya - Department of Neurosurgery, University of Iowa, Iowa City, IA 52242, USAM.A Howard - Department of Neurosurgery, University of Iowa, Iowa City, IA 52242, USAJ.F Brugge - Department of Neurosurgery, University of Iowa, Iowa City, IA 52242, USA
- Resource Type
- Journal article
- Publication Details
- Neuroscience, Vol.145(1), pp.162-184
- Publisher
- Elsevier Ltd
- DOI
- 10.1016/j.neuroscience.2006.11.036
- PMID
- 17241747
- ISSN
- 0306-4522
- eISSN
- 1873-7544
- Language
- English
- Date published
- 03/02/2007
- Academic Unit
- Neurology; Iowa Neuroscience Institute; Neurosurgery; Otolaryngology
- Record Identifier
- 9984020504202771
Metrics
32 Record Views