Practical Applications of Generalizability Theory for Designing, Evaluating, and Improving Psychological Assessments

Walter P Vispoel; Carrie A Morris; Murat Kilinc

doi:10.1080/00223891.2017.1296455

Back

Practical Applications of Generalizability Theory for Designing, Evaluating, and Improving Psychological Assessments

Journal article

Peer reviewed

Practical Applications of Generalizability Theory for Designing, Evaluating, and Improving Psychological Assessments

Walter P Vispoel, Carrie A Morris and Murat Kilinc

Journal of personality assessment, Vol.100(1), pp.53-67

01/2018

DOI: 10.1080/00223891.2017.1296455

PMID: 28418721

View Online

Abstract

In this article, we illustrate how generalizability theory (G-theory) can extend traditional assessment methods for designing, improving, and evaluating results from both objectively and subjectively scored measures of individual differences. Our illustrations include quantification of multiple sources of measurement error, derivation of unique indexes of consistency for norm- and criterion-referenced interpretations of scores, estimation of score consistency when changing a measurement procedure, and disattenuation of correlation coefficients for measurement error. We also expand G-theory analyses beyond the item level to include parcels and split measures and highlight linkages among G-theory, classical test theory, and structural equation modeling. Computer code and sample data are provided in online supplements to help readers apply the demonstrated techniques to their own assessments.

Models, Psychological

Reproducibility of Results

Personality Assessment - standards

Humans

Psychological Tests - standards

Details

Title: Subtitle: Practical Applications of Generalizability Theory for Designing, Evaluating, and Improving Psychological Assessments
Creators: Walter P Vispoel - a Department of Psychological and Quantitative Foundations, College of Education , University of Iowa
Carrie A Morris - a Department of Psychological and Quantitative Foundations, College of Education , University of Iowa
Murat Kilinc - a Department of Psychological and Quantitative Foundations, College of Education , University of Iowa
Resource Type: Journal article
Publication Details: Journal of personality assessment, Vol.100(1), pp.53-67
Publisher: England
DOI: 10.1080/00223891.2017.1296455
PMID: 28418721
ISSN: 1532-7752
eISSN: 1532-7752
Language: English
Date published: 01/2018
Academic Unit: Psychological and Quantitative Foundations
Record Identifier: 9983993486402771

Metrics

28 Record Views

27 Times Cited - Web of Science