Journal article
The pictures who shall not be named: Empirical support for benefits of preview in the Visual World Paradigm
Journal of memory and language, Vol.121, 104279
12/2021
DOI: 10.1016/j.jml.2021.104279
PMCID: PMC8315347
PMID: 34326570
Abstract
•Lexical competition arises in the VWP even when no stimulus preview occurs.•Stimulus preview does not cause phonological preactivation in typical contexts.•Visual stimulus preview increases sensitivity to phonological competition in the VWP.•The VWP relies on a complex interaction of linguistic and non-linguistic processes.•Observed fixation patterns are dependent on the structure of the VWP trial.
A common critique of the Visual World Paradigm (VWP) in psycholinguistic studies is that what is designed as a measure of language processes is meaningfully altered by the visual context of the task. This is crucial, particularly in studies of spoken word recognition, where the displayed images are usually seen as just a part of the measure and are not of fundamental interest. Many variants of the VWP allow participants to sample the visual scene before a trial begins. However, this could bias their interpretations of the later speech or even lead to abnormal processing strategies (e.g., comparing the input to only preactivated working memory representations). Prior work has focused only on whether preview duration changes fixation patterns. However, preview could affect a number of processes, such as visual search, that would not challenge the interpretation of the VWP. The present study uses a series of targeted manipulations of the preview period to ask if preview alters looking behavior during a trial, and why. Results show that evidence of incremental processing and phonological competition seen in the VWP are not dependent on preview, and are not enhanced by manipulations that directly encourage phonological prenaming. Moreover, some forms of preview can eliminate nuisance variance deriving from object recognition and visual search demands in order to produce a more sensitive measure of linguistic processing. These results deepen our understanding of how the visual scene interacts with language processing to drive fixations patterns in the VWP, and reinforce the value of the VWP as a tool for measuring real-time language processing. Stimuli, data and analysis scripts are available at https://osf.io/b7q65/.
Details
- Title: Subtitle
- The pictures who shall not be named: Empirical support for benefits of preview in the Visual World Paradigm
- Creators
- Keith S Apfelbaum - Dept. of Psychological and Brain Sciences, University of Iowa, United StatesJamie Klein-Packard - Dept. of Psychological and Brain Sciences, University of Iowa, United StatesBob McMurray - Dept. of Psychological and Brain Sciences, University of Iowa, United States
- Resource Type
- Journal article
- Publication Details
- Journal of memory and language, Vol.121, 104279
- DOI
- 10.1016/j.jml.2021.104279
- PMID
- 34326570
- PMCID
- PMC8315347
- NLM abbreviation
- J Mem Lang
- ISSN
- 0749-596X
- eISSN
- 1096-0821
- Publisher
- Elsevier Inc
- Grant note
- DOI: 10.13039/100000002, name: National Institutes of Health, award: DC008089
- Language
- English
- Date published
- 12/2021
- Academic Unit
- Communication Sciences and Disorders; Linguistics; Psychological and Brain Sciences; Iowa Neuroscience Institute; Otolaryngology
- Record Identifier
- 9984105799102771
Metrics
16 Record Views