Can you hear me yet? An intracranial investigation of speech and non-speech audiovisual interactions in human cortex

Ariane E Rhone; Kirill V Nourski; Hiroyuki Oya; Hiroto Kawasaki; Matthew A Howard III; Bob McMurray

doi:10.1080/23273798.2015.1101145

Back

Can you hear me yet? An intracranial investigation of speech and non-speech audiovisual interactions in human cortex

Journal article

Peer reviewed

Can you hear me yet? An intracranial investigation of speech and non-speech audiovisual interactions in human cortex

Ariane E Rhone, Kirill V Nourski, Hiroyuki Oya, Hiroto Kawasaki, Matthew A Howard III and Bob McMurray

Language, cognition and neuroscience, Vol.31(2), pp.284-302

02/07/2016

DOI: 10.1080/23273798.2015.1101145

PMCID: PMC4865257

PMID: 27182530

Files and links (1)

url

https://www.ncbi.nlm.nih.gov/pmc/articles/4865257View

Open Access

Abstract

In everyday conversation, viewing a talker's face can provide information about the timing and content of an upcoming speech signal, resulting in improved intelligibility. Using electrocorticography, we tested whether human auditory cortex in Heschl's gyrus (HG) and on superior temporal gyrus (STG) and motor cortex on precentral gyrus (PreC) were responsive to visual/gestural information prior to the onset of sound and whether early stages of auditory processing were sensitive to the visual content (speech syllable versus non-speech motion). Event-related band power (ERBP) in the high gamma band was content-specific prior to acoustic onset on STG and PreC, and ERBP in the beta band differed in all three areas. Following sound onset, we found no evidence for content-specificity in HG, evidence for visual specificity in PreC, and specificity for both modalities in STG. These results support models of audiovisual processing in which sensory information is integrated in non-primary cortical areas.

multisensory

cross-modal

auditory cortex

speech

Electrocorticography

Details

Title: Subtitle: Can you hear me yet? An intracranial investigation of speech and non-speech audiovisual interactions in human cortex
Creators: Ariane E Rhone - Department of Neurosurgery, The University of Iowa
Kirill V Nourski - Department of Neurosurgery, The University of Iowa
Hiroyuki Oya - Department of Neurosurgery, The University of Iowa
Hiroto Kawasaki - Department of Neurosurgery, The University of Iowa
Matthew A Howard III - Department of Neurosurgery, The University of Iowa
Bob McMurray - Department of Linguistics, The University of Iowa
Resource Type: Journal article
Publication Details: Language, cognition and neuroscience, Vol.31(2), pp.284-302
DOI: 10.1080/23273798.2015.1101145
PMID: 27182530
PMCID: PMC4865257
NLM abbreviation: Lang Cogn Neurosci
ISSN: 2327-3798
eISSN: 2327-3801
Publisher: Routledge
Grant note: DC008089,DC04290,UL1RR024979 / National Institutes of Health (10.13039/100000002)
Language: English
Date published: 02/07/2016
Academic Unit: Neurology; Communication Sciences and Disorders; Linguistics; Psychological and Brain Sciences; Iowa Neuroscience Institute; Neurosurgery; Otolaryngology
Record Identifier: 9984020637802771

Metrics

31 Record Views

16 Times Cited - Web of Science