Logo image
Long-lasting gradient activation of referents during spoken language processing
Journal article   Open access   Peer reviewed

Long-lasting gradient activation of referents during spoken language processing

J. Benjamin Falandays, Sarah Brown-Schmidt and Joseph C. Toscano
Journal of memory and language, Vol.112, p.104088
06/2020
DOI: 10.1016/j.jml.2020.104088
url
https://doi.org/10.1016/j.jml.2020.104088View
Published (Version of record) Open Access

Abstract

•Listeners integrate sub-categorical acoustic information with discourse information.•This information drives gradient referential activation.•Gradient effects persist over 35 syllables (~8 s) of intervening speech.•These effects appear in both online fixations and latencies to fixate the target.•Results suggest gradient uncertainty is maintained at high levels of representation. During speech processing, listeners must map a fundamentally continuous acoustic signal onto discrete symbols, such as words. A current debate concerns the time-course over which sub-phonemic (i.e., gradient) acoustic information continues to influence symbolic (i.e., linguistic) interpretation, which can provide evidence regarding the level of representation at which gradient information is maintained. In a visual-world paradigm experiment, participants indicated whether a spoken sentence matched a display while eye-gaze was monitored. Participants heard an acoustically ambiguous stimulus (a pronoun referring to either a male or female referent in the display), which was not disambiguated until later in the discourse. The acoustic properties of the pronouns and length of the ambiguous period were varied while responses and eye-movements to the discourse-relevant items were recorded, providing a measure of whether gradient referential uncertainty is maintained over time. Fixation patterns during the ambiguous period and latencies to fixate the target at the end of the trial varied linearly with the acoustics of the earlier pronoun, indicating that gradient information can be maintained over intervening periods of 35 syllables. These results provide strong evidence that gradient uncertainty is maintained at the level of referent representations.
Eye tracking Maintenance of uncertainty Referential activation

Details

Metrics

Logo image