Neural networks supporting audiovisual integration for speech: A large-scale lesion study

Gregory Hickok; Corianne Rogalsky; William Matchin; Alexandra Basilakos; Julia Cai; Sara Pillay; Michelle Ferrill; Soren Mickelsen; Steven W. Anderson; Tracy Love; Jeffrey Binder; Julius Fridriksson

doi:10.1016/j.cortex.2018.03.030

Back

Neural networks supporting audiovisual integration for speech: A large-scale lesion study

Journal article

Open access

Peer reviewed

Neural networks supporting audiovisual integration for speech: A large-scale lesion study

Gregory Hickok, Corianne Rogalsky, William Matchin, Alexandra Basilakos, Julia Cai, Sara Pillay, Michelle Ferrill, Soren Mickelsen, Steven W. Anderson, Tracy Love, …

Cortex, Vol.103, pp.360-371

06/01/2018

DOI: 10.1016/j.cortex.2018.03.030

PMCID: PMC6223621

PMID: 29705718

Files and links (1)

url

https://www.ncbi.nlm.nih.gov/pmc/articles/6223621View

Open Access

Abstract

Auditory and visual speech information are often strongly integrated resulting in perceptual enhancements for audiovisual (AV) speech over audio alone and sometimes yielding compelling illusory fusion percepts when AV cues are mismatched, the McGurk-MacDonald effect. Previous research has identified three candidate regions thought to be critical for AV speech integration: the posterior superior temporal sulcus (STS), early auditory cortex, and the posterior inferior frontal gyrus. We assess the causal involvement of these regions (and others) in the first large-scale (N = 100) lesion-based study of AV speech integration. Two primary findings emerged. First, behavioral performance and lesion maps for AV enhancement and illusory fusion measures indicate that classic metrics of AV speech integration are not necessarily measuring the same process. Second, lesions involving superior temporal auditory, lateral occipital visual, and multisensory zones in the STS are the most disruptive to AV speech integration. Further, when AV speech integration fails, the nature of the failure-auditory vs visual capture-can be predicted from the location of the lesions. These findings show that AV speech processing is supported by unimodal auditory and visual cortices as well as multimodal regions such as the STS at their boundary. Motor related frontal regions do not appear to play a role in AV speech integration. (C) 2018 Elsevier Ltd. All rights reserved.

Behavioral Sciences

Life Sciences & Biomedicine

Neurosciences

Neurosciences & Neurology

Psychology

Psychology, Experimental

Science & Technology

Social Sciences

Details

Title: Subtitle: Neural networks supporting audiovisual integration for speech: A large-scale lesion study
Creators: Gregory Hickok - University of California, Irvine
Corianne Rogalsky - Arizona State University
William Matchin - University of California System
Alexandra Basilakos - University of South Carolina
Julia Cai - Arizona State University
Sara Pillay - Medical College of Wisconsin
Michelle Ferrill - San Diego State University
Soren Mickelsen - Arizona State University
Steven W. Anderson - University of Iowa
Tracy Love - San Diego State University
Jeffrey Binder - Medical College of Wisconsin
Julius Fridriksson - University of South Carolina
Resource Type: Journal article
Publication Details: Cortex, Vol.103, pp.360-371
DOI: 10.1016/j.cortex.2018.03.030
PMID: 29705718
PMCID: PMC6223621
NLM abbreviation: Cortex
ISSN: 0010-9452
eISSN: 1973-8102
Publisher: Elsevier
Number of pages: 12
Grant note: DC009659 / NIH; United States Department of Health & Human Services; National Institutes of Health (NIH) - USA T32DC014435 / NATIONAL INSTITUTE ON DEAFNESS AND OTHER COMMUNICATION DISORDERS; United States Department of Health & Human Services; National Institutes of Health (NIH) - USA; NIH National Institute on Deafness & Other Communication Disorders (NIDCD)
Language: English
Date published: 06/01/2018
Academic Unit: Neurology
Record Identifier: 9984303020502771

Metrics

9 Record Views

31 Times Cited - Web of Science