Journal article
Intact speech-gesture integration in narrative recall by adults with moderate-severe traumatic brain injury
Neuropsychologia, Vol.189, pp.108665-108665
10/10/2023
DOI: 10.1016/j.neuropsychologia.2023.108665
PMCID: PMC10592037
PMID: 37619936
Abstract
Purpose: Real-world communication is situated in rich multimodal contexts, containing speech and gesture. Speakers often convey unique information in gesture that is not present in the speech signal (e.g., saying “He searched for a new recipe” while making a typing gesture). We examine the narrative retellings of participants with and without moderate-severe traumatic brain injury across three timepoints over two online Zoom sessions to investigate whether people with TBI can integrate information from co-occurring speech and gesture and if information from gesture persists across delays. Methods: 60 participants with TBI and 60 non-injured peers watched videos of a narrator telling four short stories. On key details, the narrator produced complementary gestures that conveyed unique information. Participants retold the stories at three timepoints: immediately after, 20-min later, and one-week later. We examined the words participants used when retelling these key details, coding them as a Speech Match (e.g., “He searched for a new recipe”), a Gesture Match (e.g., “He searched for a new recipe online), or Other (“He looked for a new recipe”). We also examined whether participants produced representative gestures themselves when retelling these details. Results: Despite recalling fewer story details, participants with TBI were as likely as non-injured peers to report information from gesture in their narrative retellings. All participants were more likely to report information from gesture and produce representative gestures themselves one-week later compared to immediately after hearing the story. Conclusion: We demonstrated that speech-gesture integration is intact after TBI in narrative retellings. This finding has exciting implications for the utility of gesture to support comprehension and memory after TBI and expands our understanding of naturalistic multimodal language processing in this population.
Details
- Title: Subtitle
- Intact speech-gesture integration in narrative recall by adults with moderate-severe traumatic brain injury
- Creators
- Sharice Clough - Vanderbilt University Medical CenterVictoria Grace Padilla - Vanderbilt University Medical CenterSarah Brown-Schmidt - Vanderbilt UniversityMelissa C. Duff - Vanderbilt University Medical Center
- Resource Type
- Journal article
- Publication Details
- Neuropsychologia, Vol.189, pp.108665-108665
- DOI
- 10.1016/j.neuropsychologia.2023.108665
- PMID
- 37619936
- PMCID
- PMC10592037
- NLM abbreviation
- Neuropsychologia
- ISSN
- 0028-3932
- eISSN
- 1873-3514
- Grant note
- UL1TR002243 / National Center for Advancing Translational Sciences (100006108) F31 DC020388 / National Institute on Deafness and Other Communication Disorders (100000055) National Center for Advancing Translational Sciences (http://data.elsevier.com/vocabulary/SciValFunders/100006108) R01 NIH DC017926 / National Center for Advancing Translational Sciences (http://data.elsevier.com/vocabulary/SciValFunders/100006108) F31 DC020388; UL1TR002243 / National Institute on Deafness and Other Communication Disorders (http://data.elsevier.com/vocabulary/SciValFunders/100000055) National Institute on Deafness and Other Communication Disorders (http://data.elsevier.com/vocabulary/SciValFunders/100000055)
- Language
- English
- Date published
- 10/10/2023
- Academic Unit
- Communication Sciences and Disorders
- Record Identifier
- 9985113183602771
Metrics
2 Record Views