Conference proceeding
Inverse dependence of search and classification performances in lesion localization tasks
Proceedings of SPIE, Vol.8318(1), pp.83180H-83180H-12
Medical Imaging 2012: Image Perception, Observer Performance, and Technology Assessment
02/20/2012
DOI: 10.1117/12.911820
Abstract
Search involves detecting the locations of potential lesions. Classification involves determining if a detected region is a
true lesion. The most commonly used measure of observer performance, namely the area A under the ROC curve, is
affected by both search and classification performances. The aim was to demonstrate a method for separating these
contributions and apply it to several clinical datasets. Search performance S was defined as the square root of 2 times the
perpendicular distance of the end-point of the search-model predicted ROC from the chance diagonal. Classification
performance C was defined as the separation of the unit-variance binormal distributions for signal and noise sites.
Eleven (11) datasets were fitted by the search model and search, classification and trapezoidal A were computed for each
modality and reader combination. Kendall-tau correlations were calculated between the resulting S, C and A pairs.
Kendall correlation (S vs. C) was smaller than zero for all datasets, and the average Kendall correlation was significantly
smaller than 0 (average = -0.401, P = 8.3 x 10
). Also, Kendall correlation (A vs. S) was larger than zero for 9 out of 11
datasets and the average Kendall correlation was significantly larger than 0 (average = 0.295, P = 2.9 x 10
). On the
other hand average Kendall correlation (A vs. C) was not significantly different from zero (average = 0.102, P = 0.25).
The results suggest that radiologists may learn to compensate for poor search performance with better classification
performance. This study also indicates that efforts at improving net performance, which currently focus almost
exclusively on improving classification performance, may be more successful if aimed at improving search performance.
Details
- Title: Subtitle
- Inverse dependence of search and classification performances in lesion localization tasks
- Creators
- D. P Chakraborty - University of PittsburghHong-Jun Yoon - University of PittsburghClaudia Mello-Thoms - University of Pittsburgh
- Resource Type
- Conference proceeding
- Publication Details
- Proceedings of SPIE, Vol.8318(1), pp.83180H-83180H-12
- Conference
- Medical Imaging 2012: Image Perception, Observer Performance, and Technology Assessment
- DOI
- 10.1117/12.911820
- ISSN
- 0277-786X
- Language
- English
- Date published
- 02/20/2012
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology
- Record Identifier
- 9984318711502771
Metrics
7 Record Views