Journal article
Multi-reader multi-case analysis of variance software for diagnostic performance comparison of imaging modalities
Proceedings of SPIE, the international society for optical engineering, Vol.11316, pp.113160K-113160K-8
02/2020
DOI: 10.1117/12.2549075
PMCID: PMC7190386
PMID: 32351258
Abstract
A common study design for comparing the diagnostic performance of imaging modalities is to obtain modality-specific ratings from multiple readers of multiple cases whose true statuses are known. Typically, there is overlap between the modalities, readers, and/or cases for which special analytical methods are needed to perform statistical comparisons. We describe our new R software package MRMCaov, which is designed for multi-reader multi-case comparisons of two or more imaging modalities. The software allows for the comparison of reader performance metrics, such as area under the receiver operating characteristic curve (ROC AUC), with analysis of variance methods originally proposed by Obuchowski and Rockette (1995) and later unified and improved by Hillis and colleagues (2005, 2007, 2008, 2018). MRMCaov is an open-source package with an integrated command-line interface for performing multi-reader multi-case statistical analysis, plotting, and presenting results. Features of the package include (1) ROC curves estimated parametrically or non-parametrically; (2) reader-specific ROC curves and performance metrics; (3) user-definable performance metrics; (4) modality-specific estimates of mean performance along with confidence intervals and p-values for statistical comparisons; (5) support for factorial, nested, or partially paired study designs; (6) inference for random readers and cases, random readers and fixed cases, or fixed readers and random cases; (7) DeLong, jackknife, or unbiased covariance estimation; and (8) compatibility with Microsoft Windows, Mac OS, and Linux.
Details
- Title: Subtitle
- Multi-reader multi-case analysis of variance software for diagnostic performance comparison of imaging modalities
- Creators
- Brian J Smith - Department of Biostatistics, University of Iowa, Iowa City, USA Departments of Radiology and Biostatistics, University of Iowa, Iowa City, USAStephen L Hillis - Department of Biostatistics, University of Iowa, Iowa City, USA Departments of Radiology and Biostatistics, University of Iowa, Iowa City, USA
- Resource Type
- Journal article
- Publication Details
- Proceedings of SPIE, the international society for optical engineering, Vol.11316, pp.113160K-113160K-8
- DOI
- 10.1117/12.2549075
- PMID
- 32351258
- PMCID
- PMC7190386
- NLM abbreviation
- Proc SPIE Int Soc Opt Eng
- ISSN
- 0277-786X
- eISSN
- 1996-756X
- Language
- English
- Date published
- 02/2020
- Academic Unit
- Radiology; Biostatistics; Holden Comprehensive Cancer Center
- Record Identifier
- 9984213374202771
Metrics
10 Record Views