Journal article
Can a Machine Learn from Radiologists’ Visual Search Behaviour and Their Interpretation of Mammograms—a Deep-Learning Study
Journal of digital imaging, Vol.32(5), pp.746-760
10/15/2019
DOI: 10.1007/s10278-018-00174-z
PMCID: PMC6737161
PMID: 31410677
Abstract
Visual search behaviour and the interpretation of mammograms have been studied for errors in breast cancer detection. We aim to ascertain whether machine-learning models can learn about radiologists’ attentional level and the interpretation of mammograms. We seek to determine whether these models are practical and feasible for use in training and teaching programmes. Eight radiologists of varying experience levels in reading mammograms reviewed 120 two-view digital mammography cases (59 cancers). Their search behaviour and decisions were captured using a head-mounted eye-tracking device and software allowing them to record their decisions. This information from radiologists was used to build an ensembled machine-learning model using top-down hierarchical deep convolution neural network. Separately, a model to determine type of missed cancer (search, perception or decision-making) was also built. Analysis and comparison of variants of these models using different convolution networks with and without transfer learning were also performed. Our ensembled deep-learning network architecture can be trained to learn about radiologists’ attentional level and decisions. High accuracy (95%,
p
value ≅ 0 [better than dumb/random model]) and high agreement between true and predicted values (kappa = 0.83) in such modelling can be achieved. Transfer learning techniques improve by < 10% with the performance of this model. We also show that spatial convolution neural networks are insufficient in determining the type of missed cancers. Ensembled hierarchical deep convolution machine-learning models are plausible in modelling radiologists’ attentional level and their interpretation of mammograms. However, deep convolution networks fail to characterise the type of false-negative decisions.
Details
- Title: Subtitle
- Can a Machine Learn from Radiologists’ Visual Search Behaviour and Their Interpretation of Mammograms—a Deep-Learning Study
- Creators
- Suneeta Mall - University of SydneyPatrick C. Brennan - University of SydneyClaudia Mello-Thoms - University of Sydney
- Resource Type
- Journal article
- Publication Details
- Journal of digital imaging, Vol.32(5), pp.746-760
- Publisher
- Springer International Publishing
- DOI
- 10.1007/s10278-018-00174-z
- PMID
- 31410677
- PMCID
- PMC6737161
- ISSN
- 0897-1889
- eISSN
- 1618-727X
- Language
- English
- Date published
- 10/15/2019
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology
- Record Identifier
- 9984318686802771
Metrics
11 Record Views