Journal article
Relationship between Roe and Metz simulation model for multireader diagnostic data and Obuchowski‐Rockette model parameters
Statistics in medicine, Vol.37(13), pp.2067-2093
06/15/2018
DOI: 10.1002/sim.7616
PMCID: PMC5980727
PMID: 29609206
Abstract
For the typical diagnostic radiology study design, each case (ie, patient) undergoes several diagnostic tests (or modalities) and the resulting images are interpreted by several readers. Often, each reader is asked to assign a confidence‐of‐disease rating to each case for each test, and the diagnostic tests are compared with respect to reader‐performance outcomes that are functions of the reader receiver operating characteristic (ROC) curves, such as the area under the ROC curve. These reader‐performance outcomes are frequently analyzed using the Obuchowski and Rockette method, which allows conclusions to generalize to both the reader and case populations. The simulation model proposed by Roe and Metz (RM) in 1997 emulates confidence‐of‐disease data collected from such studies and has been an important tool for empirically evaluating various reader‐performance analysis methods. However, because the RM model parameters are expressed in terms of a continuous decision variable rather than in terms of reader‐performance outcomes, it has not been possible to evaluate the realism of the RM model. I derive the relationships between the RM and Obuchowski‐Rockette model parameters for the empirical area under the ROC curve reader‐performance outcome. These relationships make it possible to evaluate the realism of the RM parameter models and to assess the performance of Obuchowski‐Rockette parameter estimates. An example illustrates the application of the relationships for assessing the performance of a proposed upper one‐sided confidence bound for the Obuchowski‐Rockette test‐by‐reader variance component, which is useful for sample size estimation.
Details
- Title: Subtitle
- Relationship between Roe and Metz simulation model for multireader diagnostic data and Obuchowski‐Rockette model parameters
- Creators
- Stephen L Hillis - The University of Iowa
- Resource Type
- Journal article
- Publication Details
- Statistics in medicine, Vol.37(13), pp.2067-2093
- DOI
- 10.1002/sim.7616
- PMID
- 29609206
- PMCID
- PMC5980727
- NLM abbreviation
- Stat Med
- ISSN
- 0277-6715
- eISSN
- 1097-0258
- Number of pages
- 27
- Grant note
- National Institute of Biomedical Imaging and Bioengineering (NIBIB) of the National Institutes of Health (R01EB013667; R01EB019967)
- Language
- English
- Date published
- 06/15/2018
- Academic Unit
- Radiology; Biostatistics
- Record Identifier
- 9984051514402771
Metrics
15 Record Views