Analyzing Complete Generalizability Theory Designs Using Structural Equation Models

Walter P. Vispoel; Hyeri Hong; Hyeryung Lee; Terrence D. Jorgensen

doi:10.1080/08957347.2023.2274573

Back

Analyzing Complete Generalizability Theory Designs Using Structural Equation Models

Journal article

Peer reviewed

Analyzing Complete Generalizability Theory Designs Using Structural Equation Models

Walter P. Vispoel, Hyeri Hong, Hyeryung Lee and Terrence D. Jorgensen

Applied measurement in education, Vol.36(4), pp.372-393

12/08/2023

DOI: 10.1080/08957347.2023.2274573

Files and links (1)

url

https://handle.uba.uva.nl/personal/pure/en/publications/analyzing-complete-generalizability-theory-designs-using-structural-equation-models(b7eb3bd3-937d-48e8-bfd6-9656420e7b12).htmlView

Open Access

Abstract

We illustrate how to analyze complete generalizability theory (GT) designs using structural equation modeling software (lavaan in R), compare results to those obtained from numerous ANOVA-based packages, and apply those results in practical ways using data obtained from a large sample of respondents, who completed the Self-Perception Profile for College Students (Neemann & Harter, 2012) on two occasions. Results revealed that estimates of variance components, generalizability coefficients, dependability coefficients, and proportions of measurement error derived from lavaan were essentially equivalent to those produced by the GT packages GENOVA and gtheory in R and variance component programs in SPSS, SAS, and R. Within the article and extended online Supplemental Material, we illustrate how indices obtained from these resources can be used for either norm- and criterion-referencing purposes and for estimating effects of changes made to measurement procedures. We further describe ways to use structural equation models for applications of GT beyond what conventional ANOVA-based packages would typically permit.

Psychology

Social Sciences

Education & Educational Research

Psychology, Educational

Psychology, Mathematical

Details

Title: Subtitle: Analyzing Complete Generalizability Theory Designs Using Structural Equation Models
Creators: Walter P. Vispoel - University of Iowa
Hyeri Hong - California State University, Fresno
Hyeryung Lee - University of Iowa
Terrence D. Jorgensen - University of Amsterdam
Resource Type: Journal article
Publication Details: Applied measurement in education, Vol.36(4), pp.372-393
DOI: 10.1080/08957347.2023.2274573
ISSN: 0895-7347
eISSN: 1532-4818
Publisher: Taylor & Francis
Number of pages: 22
Grant note: Iowa Measurement Research Foundation
Language: English
Date published: 12/08/2023
Academic Unit: Psychological and Quantitative Foundations
Record Identifier: 9984532181802771

Metrics

33 Record Views

6 Times Cited - Web of Science

See more details