Journal article
Kernel-weighted contribution: a method of visual attribution for 3D deep learning segmentation in medical imaging
Journal of medical imaging (Bellingham, Wash.), Vol.10(5), 054001
09/07/2023
DOI: 10.1117/1.JMI.10.5.054001
PMCID: PMC10482593
PMID: 37692092
Abstract
Purpose
Explaining deep learning model decisions, especially those for medical image segmentation, is a critical step toward the understanding and validation that will enable these powerful tools to see more widespread adoption in healthcare. We introduce kernel-weighted contribution, a visual explanation method for three-dimensional medical image segmentation models that produces accurate and interpretable explanations. Unlike previous attribution methods, kernel-weighted contribution is explicitly designed for medical image segmentation models and assesses feature importance using the relative contribution of each considered activation map to the predicted segmentation.
Approach
We evaluate our method on a synthetic dataset that provides complete knowledge over input features and a comprehensive explanation quality metric using this ground truth. Our method and three other prevalent attribution methods were applied to five different model layer combinations to explain segmentation predictions for 100 test samples and compared using this metric.
Results
Kernel-weighted contribution produced superior explanations of obtained image segmentations when applied to both encoder and decoder sections of a trained model as compared to other layer combinations (p < 0.0005). In between-method comparisons, kernel-weighted contribution produced superior explanations compared with other methods using the same model layers in four of five experiments (p < 0.0005) and showed equivalently superior performance to GradCAM++ when only using non-transpose convolution layers of the model decoder (p = 0.008).
Conclusion
The reported method produced explanations of superior quality uniquely suited to fully utilize the specific architectural considerations present in image and especially medical image segmentation models. Both the synthetic dataset and implementation of our method are available to the research community.
Details
- Title: Subtitle
- Kernel-weighted contribution: a method of visual attribution for 3D deep learning segmentation in medical imaging
- Creators
- Sean Mullan - University of IowaMilan Sonka - University of Iowa
- Resource Type
- Journal article
- Publication Details
- Journal of medical imaging (Bellingham, Wash.), Vol.10(5), 054001
- DOI
- 10.1117/1.JMI.10.5.054001
- PMID
- 37692092
- PMCID
- PMC10482593
- NLM abbreviation
- J Med Imaging (Bellingham)
- ISSN
- 2329-4302
- eISSN
- 2329-4310
- Publisher
- SPIE-Intl Soc Optical Eng
- Language
- English
- Date published
- 09/07/2023
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Electrical and Computer Engineering; Radiation Oncology; Fraternal Order of Eagles Diabetes Research Center; Injury Prevention Research Center; Computer Science; Ophthalmology and Visual Sciences
- Record Identifier
- 9984465559302771
Metrics
40 Record Views