Journal article
The stochastically curtailed generalized likelihood ratio: A new termination criterion for variable-length computerized classification tests
Behavior research methods, Vol.47(2), pp.549-561
06/01/2015
DOI: 10.3758/s13428-014-0490-y
PMID: 24907003
Abstract
Computerized classification tests (CCTs) are used to classify examinees into categories in the context of professional certification testing. The term "variable-length" refers to CCTs that terminate (i.e., cease administering items to the examinee) when a classification can be made with a prespecified level of certainty. The sequential probability ratio test (SPRT) is a common criterion for terminating variable-length CCTs, but recent research has proposed more efficient methods. Specifically, the stochastically curtailed SPRT (SCSPRT) and the generalized likelihood ratio criterion (GLR) have been shown to classify examinees with accuracy similar to the SPRT while using fewer items. This article shows that the GLR criterion itself may be stochastically curtailed, resulting in a new termination criterion, the stochastically curtailed GLR (SCGLR). All four criteria-the SPRT, SCSPRT, GLR, and the new SCGLR-were compared using a simulation study. In this study, we examined the criteria in testing conditions that varied several CCT design features, including item bank characteristics, pass/fail threshold, and examinee ability distribution. In each condition, the termination criteria were evaluated according to their accuracy (proportion of examinees classified correctly), efficiency (test length), and loss (a single statistic combing both accuracy and efficiency). The simulation results showed that the SCGLR can yield increased efficiency without sacrificing accuracy, relative to the SPRT, SCSPRT, and GLR in a wide variety of CCT designs.
Details
- Title: Subtitle
- The stochastically curtailed generalized likelihood ratio: A new termination criterion for variable-length computerized classification tests
- Creators
- Alan R Huebner - University of Notre DameAnthony D Fina - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Behavior research methods, Vol.47(2), pp.549-561
- DOI
- 10.3758/s13428-014-0490-y
- PMID
- 24907003
- ISSN
- 1543-4494
- eISSN
- 1554-3528
- Language
- English
- Date published
- 06/01/2015
- Academic Unit
- School of Social Work; Iowa Testing Programs; Psychological and Quantitative Foundations
- Record Identifier
- 9984627253602771
Metrics
3 Record Views