Conference proceeding
Identical-test Roe and Metz simulation model for validating multi-reader methods of analysis for comparing different radiologic imaging modalities
Medical Imaging 2022: Image Perception, Observer Performance, and Technology Assessment, Vol.12035, pp.120350E-120350E-10
Proceedings of SPIE
01/01/2022
DOI: 10.1117/12.2612691
PMCID: PMC9497942
PMID: 36159879
Abstract
The most frequently used model for simulating multireader multicase (MRMC) data that emulate confidence-ofdisease ratings from diagnostic imaging studies has been the Roe and Metz model, proposed by Roe and Metz in 1997 and later generalized by Hillis (2012), Abbey et al (2013) and Gallas and Hillis (2014). All of these models generate continuous confidence-of-disease ratings based on an underlying binormal model for each reader, with the separation between the normal and abnormal rating distributions varying across readers. Numerous studies have used these models for evaluating MRMC analysis and sample size methods. The models suggested in these papers for assessing type I error have been "null" models, where the expected AUC across readers is the same for each test. However, for the null models that have been suggested, there are other differences that would not exist if the two tests were identical. None of the papers cited above discuss how to formulate a null model that is also an \identical-test" model, where the two tests are identical in all respects. The purpose of this paper is to show how to formulate an identical-test model and to discuss the importance of this model. Using the identical-test model, I show through simulations the importance of the Obuchowski-Rockette model constraints to avoid a negative variance estimate, a result which had not previously been empirically demonstrated.
Details
- Title: Subtitle
- Identical-test Roe and Metz simulation model for validating multi-reader methods of analysis for comparing different radiologic imaging modalities
- Creators
- Stephen L. Hillis - University of Iowa
- Contributors
- C R Mello-Thoms (Editor)S Taylor-Phillips (Editor)
- Resource Type
- Conference proceeding
- Publication Details
- Medical Imaging 2022: Image Perception, Observer Performance, and Technology Assessment, Vol.12035, pp.120350E-120350E-10
- Series
- Proceedings of SPIE
- DOI
- 10.1117/12.2612691
- PMID
- 36159879
- PMCID
- PMC9497942
- NLM abbreviation
- Proc SPIE Int Soc Opt Eng
- ISSN
- 0277-786X
- eISSN
- 1996-756X
- Publisher
- Spie-Int Soc Optical Engineering
- Number of pages
- 10
- Grant note
- R01EB025174 / National Institute of Biomedical Imaging and Bioengineering (NIBIB) of the National Institutes of Health; United States Department of Health & Human Services; National Institutes of Health (NIH) - USA; NIH National Institute of Biomedical Imaging & Bioengineering (NIBIB)
- Language
- English
- Date published
- 01/01/2022
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology; Biostatistics
- Record Identifier
- 9984318706202771
Metrics
18 Record Views