Journal article
Can eye-tracking metrics be used to better pair radiologists in a mammogram reading task?
Medical physics (Lancaster), Vol.45(11), pp.4844-4856
11/2018
DOI: 10.1002/mp.13161
PMID: 30168153
Abstract
To propose a framework for optimal pairing of radiologists when reading mammograms based on their search patterns.
Four experienced and four less-experienced radiologists were asked to assess 120 cases (59 with cancers) while their eye positions were tracked. Fourteen eye-tracking metrics were extracted to quantify the differences among radiologists' visual search pattern. For each radiologist and metric, less-experienced radiologists and expert readers were ranked based on the level of similarities in gaze patterns (from the most different to the most similar). Less-experienced readers and experts were also ranked based on the values of area under the receiver operating characteristic curve (AUC) after pairing (the best possible way of ranking). Using the Kendall's tau distance, rankings based on different metrics were compared with the best possible ranking. Using paired Wilcoxon signed-rank test, the AUC values when pairing in the best way were compared with pairing based on different metrics. Finally, we investigated the robustness of pairing strategies against the small sample size.
For ranking the experienced radiologists, results from eight metrics were as good as the best possible ranking. For the less-experienced ones, only one metric resulted in a ranking comparable to the best possible way of ranking. The AUC values of pairings based on these metrics did not differ significantly from the best pairing scenario. Compared to the pairings based on the cognitive metrics, the ranking based on AUC values varied more greatly with the sample size, suggesting that it is less robust against the small sample size compared to the cognitive metrics.
Different pairings may have different effects on performance; some are detrimental while some improve the performance of the pair. Using the suggested cognitive metrics, we can optimize the pairings even with a small dataset.
Details
- Title: Subtitle
- Can eye-tracking metrics be used to better pair radiologists in a mammogram reading task?
- Creators
- Ziba Gandomkar - Discipline of Medical Imaging and Radiation Sciences, Image Optimisation and Perception Group (MIOPeG), The University of Sydney, Sydney, NSW, AustraliaKevin Tay - Medical Imaging Department, Prince of Wales Hospital, Randwick, NSW, AustraliaPatrick C Brennan - Discipline of Medical Imaging and Radiation Sciences, Image Optimisation and Perception Group (MIOPeG), The University of Sydney, Sydney, NSW, AustraliaEmma Kozuch - University of Notre Dame, Notre Dame, Indiana, 46556, USAClaudia Mello-Thoms - Department of Radiology, The University of Iowa, Iowa City, IA, 52242, USA
- Resource Type
- Journal article
- Publication Details
- Medical physics (Lancaster), Vol.45(11), pp.4844-4856
- Publisher
- United States
- DOI
- 10.1002/mp.13161
- PMID
- 30168153
- ISSN
- 0094-2405
- eISSN
- 2473-4209
- Language
- English
- Date published
- 11/2018
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology
- Record Identifier
- 9984051596902771
Metrics
31 Record Views