Journal article
Generalized Roe and Metz receiver operating characteristic model: analytic link between simulated decision scores and empirical AUC variances and covariances
Journal of medical imaging (Bellingham, Wash.), Vol.1(3), pp.031006-031006
Special Section on Pioneers in Medical Imaging: Honoring the Memory of Robert F. Wagner
10/2014
DOI: 10.1117/1.JMI.1.3.031006
PMCID: PMC4478859
PMID: 26158048
Abstract
Modeling and simulation are often used to understand and investigate random quantities and estimators. In 1997, Roe and Metz introduced a simulation model to validate analysis methods for the popular endpoint in reader studies to evaluate medical imaging devices, the reader-averaged area under the receiver operating characteristic (ROC) curve. Here, we generalize the notation of the model to allow more flexibility in recognition that variances of ROC ratings depend on modality and truth state. We also derive and validate equations for computing population variances and covariances for reader-averaged empirical AUC estimates under the generalized model. The equations are one-dimensional integrals that can be calculated using standard numerical integration techniques. This work provides the theoretical foundation and validation for a Java application called iRoeMetz that can simulate multireader multicase ROC studies and numerically calculate the corresponding variances and covariances of the empirical AUC. The iRoeMetz application and source code can be found at the “iMRMC” project on the google code project hosting site. These results and the application can be used by investigators to investigate ROC endpoints, validate analysis methods, and plan future studies.
Details
- Title: Subtitle
- Generalized Roe and Metz receiver operating characteristic model: analytic link between simulated decision scores and empirical AUC variances and covariances
- Creators
- Brandon D Gallas - , Division of Imaging and Applied Mathematics, Bldg. 62, Rm 3124, 10903 New Hampshire Avenue, Silver Spring, Maryland 20993-0002Stephen L Hillis - , Departments of Radiology and Biostatistics, 3170 Medical Laboratories, 200 Hawkins Drive, Iowa City, Iowa 52242-1077
- Resource Type
- Journal article
- Publication Details
- Journal of medical imaging (Bellingham, Wash.), Vol.1(3), pp.031006-031006
- Publisher
- Society of Photo-Optical Instrumentation Engineers
- Series
- Special Section on Pioneers in Medical Imaging: Honoring the Memory of Robert F. Wagner
- DOI
- 10.1117/1.JMI.1.3.031006
- PMID
- 26158048
- PMCID
- PMC4478859
- ISSN
- 2329-4302
- eISSN
- 2329-4310
- Grant note
- R01EB013667 / National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health
- Language
- English
- Date published
- 10/2014
- Academic Unit
- Radiology; Biostatistics
- Record Identifier
- 9984051508002771
Metrics
13 Record Views