Journal article
A comparison of denominator degrees of freedom methods for multiple observer ROC analysis
Statistics in medicine, Vol.26(3), pp.596-619
02/10/2007
DOI: 10.1002/sim.2532
PMCID: PMC1769324
PMID: 16538699
Abstract
There are several methods available for analysing multireader ROC studies that generalize results to both the reader and case populations. Two of these methods--the Dorfman-Berbaum-Metz (DBM) method and the Obuchowki-Rockette (OR) method--appear to be quite different in their original formulations. However, recently it has been shown that the DBM and OR procedures yield the same test statistic when based on the same accuracy measure and covariance estimation method, but inferences can vary depending on which denominator degrees of freedom (ddf) method, DBM or OR, is used. I show in simulations that there are problems with both ddf methods: OR is ultraconservative with significance levels considerably below the nominal level, and DBM can result in extremely wide confidence intervals because the ddf can be close to zero. I propose a new ddf method that overcomes both of these problems and can be used with either the OR or DBM procedure.
Details
- Title: Subtitle
- A comparison of denominator degrees of freedom methods for multiple observer ROC analysis
- Creators
- Stephen L Hillis - Center for Research in the Implementation of Innovative Strategies in Practice, Iowa City VA Medical Center, Iowa City, IA 52246-2208, USA. steve-hillis@uiowa.edu
- Resource Type
- Journal article
- Publication Details
- Statistics in medicine, Vol.26(3), pp.596-619
- DOI
- 10.1002/sim.2532
- PMID
- 16538699
- PMCID
- PMC1769324
- NLM abbreviation
- Stat Med
- ISSN
- 0277-6715
- eISSN
- 1097-0258
- Publisher
- Wiley; England
- Grant note
- R01EB000863 / NIBIB NIH HHS R01 EB000863 / NIBIB NIH HHS
- Language
- English
- Date published
- 02/10/2007
- Academic Unit
- Radiology; Biostatistics
- Record Identifier
- 9984051992702771
Metrics
36 Record Views