Benefits of Independent Double Reading in Digital Mammography: A Theoretical Evaluation of All Possible Pairing Methodologies

Patrick C Brennan; Aarthi Ganesan; Miguel P Eckstein; Ernest Usang Ekpo; Kriscia Tapia; Claudia Mello-Thoms; Sarah Lewis; Mordechai Z Juni

doi:10.1016/j.acra.2018.06.017

Back

Benefits of Independent Double Reading in Digital Mammography: A Theoretical Evaluation of All Possible Pairing Methodologies

Journal article

Peer reviewed

Benefits of Independent Double Reading in Digital Mammography: A Theoretical Evaluation of All Possible Pairing Methodologies

Patrick C Brennan, Aarthi Ganesan, Miguel P Eckstein, Ernest Usang Ekpo, Kriscia Tapia, Claudia Mello-Thoms, Sarah Lewis and Mordechai Z Juni

Academic radiology, Vol.26(6), pp.717-723

06/2019

DOI: 10.1016/j.acra.2018.06.017

PMCID: PMC7184882

PMID: 30064917

Files and links (1)

url

https://www.ncbi.nlm.nih.gov/pmc/articles/7184882View

Open Access

Abstract

To establish the efficacy of pairing readers randomly and evaluate the merits of developing optimal pairing methodologies. Sensitivity, specificity, and proportion correct were computed for three different case sets that were independently read by 16 radiologists. Performance of radiologists as single readers was compared to expected double reading performance. We theoretically evaluated all possible pairing methodologies. Bootstrap resampling methods were used for statistical analyses. Significant improvements in expected performance for double versus single reading (ie, delta performance) were shown for all performance measures and case-sets (p ≤ .003), with overall delta performance across all theoretically possible pairing schemes (n = 10,395) ranging between .05 and .08. Delta performance for the 20 best pairing schemes was significant (p < .001) and ranged between .07 and .10. Delta performance for 20 random pairing schemes was also significant (p ≤ .003) and ranged between .05 and .08. Delta performance for the 20 worst pairing schemes ranged between .03 and .06, reaching significance in delta proportion correct (p ≤ .021) for all three case-sets and in delta specificity for two case-sets (p ≤ .033) but not for a third case-set (p = .131), and not reaching significance in delta sensitivity for any of the three case-sets (.098 ≥ p ≥ .067). Significant benefits accrue from double reading, and while random reader pairing achieves most double reading benefits, a strategic pairing approach may maximize the benefits of double reading.

Radiographic Image Interpretation, Computer-Assisted - methods

Humans

Middle Aged

Sensitivity and Specificity

Breast - diagnostic imaging

Radiologists

Female

Breast Neoplasms - diagnostic imaging

Mammography - methods

Observer Variation

Details

Title: Subtitle: Benefits of Independent Double Reading in Digital Mammography: A Theoretical Evaluation of All Possible Pairing Methodologies
Creators: Patrick C Brennan - Medical Image Optimisation and Perception Group (MIOPeG), Medical Imaging and Radiation Sciences, Faculty Research Group, Faculty of Health Sciences, the University of Sydney, Cumberland Campus, 75 East St, Lidcombe, NSW 2141, Australia
Aarthi Ganesan - Medical Image Optimisation and Perception Group (MIOPeG), Medical Imaging and Radiation Sciences, Faculty Research Group, Faculty of Health Sciences, the University of Sydney, Cumberland Campus, 75 East St, Lidcombe, NSW 2141, Australia
Miguel P Eckstein - Department of Psychological & Brain Sciences, University of California, Santa Barbara, CA 93106; Institute for Collaborative Biotechnologies, University of California, Santa Barbara, CA 93106
Ernest Usang Ekpo - Medical Image Optimisation and Perception Group (MIOPeG), Medical Imaging and Radiation Sciences, Faculty Research Group, Faculty of Health Sciences, the University of Sydney, Cumberland Campus, 75 East St, Lidcombe, NSW 2141, Australia. Electronic address: ernest.ekpo@sydney.edu.au
Kriscia Tapia - Medical Image Optimisation and Perception Group (MIOPeG), Medical Imaging and Radiation Sciences, Faculty Research Group, Faculty of Health Sciences, the University of Sydney, Cumberland Campus, 75 East St, Lidcombe, NSW 2141, Australia
Claudia Mello-Thoms - Medical Image Optimisation and Perception Group (MIOPeG), Medical Imaging and Radiation Sciences, Faculty Research Group, Faculty of Health Sciences, the University of Sydney, Cumberland Campus, 75 East St, Lidcombe, NSW 2141, Australia
Sarah Lewis - Medical Image Optimisation and Perception Group (MIOPeG), Medical Imaging and Radiation Sciences, Faculty Research Group, Faculty of Health Sciences, the University of Sydney, Cumberland Campus, 75 East St, Lidcombe, NSW 2141, Australia
Mordechai Z Juni - Department of Psychological & Brain Sciences, University of California, Santa Barbara, CA 93106
Resource Type: Journal article
Publication Details: Academic radiology, Vol.26(6), pp.717-723
DOI: 10.1016/j.acra.2018.06.017
PMID: 30064917
PMCID: PMC7184882
NLM abbreviation: Acad Radiol
ISSN: 1076-6332
eISSN: 1878-4046
Publisher: United States
Grant note: R01 EB026427 / NIBIB NIH HHS R01 EB018958 / NIBIB NIH HHS
Language: English
Date published: 06/2019
Academic Unit: Roy J. Carver Department of Biomedical Engineering; Radiology
Record Identifier: 9984051572402771

Metrics

22 Record Views

26 Times Cited - Web of Science

See more details