Journal article
An Investigation of the Power of the Likelihood Ratio Goodness-of-Fit Statistic in Detecting Differential Item Functioning
Journal of educational measurement, Vol.36(4), pp.277-300
12/1999
DOI: 10.1111/j.1745-3984.1999.tb00558.x
Abstract
The purpose of this study was to investigate the power and Type I error rate of the likelihood ratio goodness-of-fit (LR) statistic in detecting differential item functioning (DIF) under Samejima's (1969, 1972) graded response model. A multiple-replication Monte Carlo study was utilized in which DIF was modeled in simulated data sets which were then calibrated with MULTILOG (Thissen, 1991) using hierarchically nested item response models. In addition, the power and Type I error rate of the Mantel (1963) approach for detecting DIF in ordered response categories were investigated using the same simulated data, for comparative purposes. The power of both the Mantel and LR procedures was affected by sample size, as expected. The LR procedure lacked the power to consistently detect DIF when it existed in reference/focal groups with sample sizes as small as 500/500. The Mantel procedure maintained control of its Type I error rate and was more powerful than the LR procedure when the comparison group ability distributions were identical and there was a constant DIF pattern. On the other hand, the Mantel procedure lost control of its Type I error rate, whereas the LR procedure did not, when the comparison groups differed in mean ability; and the LR procedure demonstrated a profound power advantage over the Mantel procedure under conditions of balanced DIF in which the comparison group ability distributions were identical. The choice and subsequent use of any procedure requires a thorough understanding of the power and Type I error rates of the procedure under varying conditions of DIF pattern, comparison group ability distributions - or as a surrogate, observed score distributions - and item characteristics.
Details
- Title: Subtitle
- An Investigation of the Power of the Likelihood Ratio Goodness-of-Fit Statistic in Detecting Differential Item Functioning
- Creators
- Robert D. Ankenmann - University of IowaElizabeth A. Witt - Assessment Systems CorporationStephen B. Dunbar - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Journal of educational measurement, Vol.36(4), pp.277-300
- Publisher
- Blackwell Publishing Ltd
- DOI
- 10.1111/j.1745-3984.1999.tb00558.x
- ISSN
- 0022-0655
- eISSN
- 1745-3984
- Number of pages
- 24
- Language
- English
- Date published
- 12/1999
- Academic Unit
- Psychological and Quantitative Foundations
- Record Identifier
- 9984371261402771
Metrics
5 Record Views