Pretest Item Calibration in Computerized Multistage Adaptive Testing

Rabia Karatoprak Ersen; Won-Chan Lee

doi:10.1111/jedm.12361

Back

Pretest Item Calibration in Computerized Multistage Adaptive Testing

Journal article

Open access

Peer reviewed

Pretest Item Calibration in Computerized Multistage Adaptive Testing

Rabia Karatoprak Ersen and Won-Chan Lee

Journal of educational measurement, Vol.60(3), pp.379-401

Autumn 2023

DOI: 10.1111/jedm.12361

Files and links (1)

url

https://doi.org/10.1111/jedm.12361View

Published (Version of record) Open Access

Abstract

The purpose of this study was to compare calibration and linking methods for placing pretest item parameter estimates on the item pool scale in a 1-3 computerized multistage adaptive testing design in terms of item parameter recovery. Two models were used: embedded-section, in which pretest items were administered within a separate module, and embedded-items, in which pretest items were distributed across operational modules. The calibration methods were separate calibration with linking (SC) and fixed calibration (FC) with three parallel approaches under each (FC-1 and SC-1; FC-2 and SC-2; and FC-3 and SC-3). The FC-1 and SC-1 used only operational items in the routing module to link pretest items. The FC-2 and SC-2 also used only operational items in the routing module for linking, but in addition, the operational items in second stage modules were freely estimated. The FC-3 and SC-3 used operational items in all modules to link pretest items. The third calibration approach (i.e., FC-3 and SC-3) yielded the best results. For all three approaches, SC outperformed FC in all study conditions which were module length, sample size and examinee distributions.

Psychology

Social Sciences

Psychology, Applied

Psychology, Educational

Psychology, Mathematical

Details

Title: Subtitle: Pretest Item Calibration in Computerized Multistage Adaptive Testing
Creators: Rabia Karatoprak Ersen - Kastamonu University
Won-Chan Lee - Univ Iowa, Educ Measurement & Stat, 210E Lindquist Ctr, Iowa City, IA 52242 USA
Resource Type: Journal article
Publication Details: Journal of educational measurement, Vol.60(3), pp.379-401
Publisher: Wiley
DOI: 10.1111/jedm.12361
ISSN: 0022-0655
eISSN: 1745-3984
Number of pages: 23
Language: English
Electronic publication date: 03/10/2023
Date published season: Autumn 2023
Date published: 2023
Academic Unit: Psychological and Quantitative Foundations
Record Identifier: 9984384360302771

Metrics

8 Record Views