Journal article
A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data
Statistics in medicine, Vol.24(10), pp.1579-1607
05/30/2005
DOI: 10.1002/sim.2024
PMID: 15685718
Abstract
There are several different statistical methods for analysing multireader ROC studies, with the Dorfman-Berbaum-Metz (DBM) method being the most frequently used. Another method is the corrected F method proposed by Obuchowski and Rockette (OR). The DBM and OR procedures at first appear quite different: DBM is a three-way ANOVA analysis of pseudovalues while OR is a two-way ANOVA analysis of accuracy estimates with correlated errors. We show that the original DBM and OR F statistics for testing the null hypothesis of equal treatments have the same form and will typically have similar values; however, differences in the denominator degrees of freedom will result in differences in p-values even when the F statistics are identical. We show how the methods can be generalized to include variations in the accuracy measure, covariance method, and degrees of freedom. Identical results are obtained when the methods agree with respect to all three of these procedure parameters; hence for a particular choice of procedure parameters the choice of method appears to depend mainly on software preference and availability. The methods are compared using data from a factorial study with two modalities, five readers, and 114 patients.
Details
- Title: Subtitle
- A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data
- Creators
- Stephen L Hillis - Center for Research in the Implementation of Innovative Strategies in Practice, Iowa City VA Medical Center, Iowa City, IA, USA. steve-hillis@uiowa.eduNancy A ObuchowskiKevin M SchartzKevin S Berbaum
- Resource Type
- Journal article
- Publication Details
- Statistics in medicine, Vol.24(10), pp.1579-1607
- Publisher
- England
- DOI
- 10.1002/sim.2024
- PMID
- 15685718
- ISSN
- 0277-6715
- eISSN
- 1097-0258
- Grant note
- R01EB000863 / NIBIB NIH HHS
- Language
- English
- Date published
- 05/30/2005
- Academic Unit
- Radiology; Biostatistics
- Record Identifier
- 9984051506602771
Metrics
26 Record Views