Book chapter
Longitudinal Anatomical Attention Maps for Recognizing Diagnostic Errors from Radiologists’ Eye Movements
Medical Image Computing and Computer Assisted Intervention – MICCAI 2025, pp.315-325
Lecture Notes in Computer Science, v. 15966, Springer Nature Switzerland
2025
DOI: 10.1007/978-3-032-04981-0_30
Abstract
With the rise in respiratory diseases, the workload on radiologists is increasing, leading to a higher risk of diagnostic errors. One approach to improve diagnostic processes is to reduce the frequency of cognitive and perceptual errors made by humans. This study aims to predict radiologists’ diagnostic errors while interpreting chest X-rays using eye-tracking technology. We propose a novel method that combines human attention, derived from the locations of gaze fixation points, with attention from transformer neural networks. The resulting attention maps are combined with the segmentation of anatomical structures, including the lungs, clavicles, hila, heart, mediastinum, and esophagus, which restricts the analysis for regions potentially relevant for thoracic disease diagnosis. Attention maps are computed for each gaze fixation point, creating a longitudinal path representing the X-ray reading process. Finally, we applied Gated Recurrent Units (GRUs) to learn from the longitudinal attention maps and statistical gaze features to predict potential X-ray diagnostic errors. The proposed methodology was validated on 4, 000 chest X-ray readings performed by four radiologists. The model achieved an error detection accuracy of 0.79, measured as the area under the receiver operating characteristic (ROC) curve. The code is available at https://github.com/annshorn/TEGRU.
Details
- Title: Subtitle
- Longitudinal Anatomical Attention Maps for Recognizing Diagnostic Errors from Radiologists’ Eye Movements
- Creators
- Anna AnikinaDiliara IbragimovaTamerlan MustafaevClaudia Mello-ThomsBulat Ibragimov
- Contributors
- James C. Gee (Editor)Daniel C. Alexander (Editor)Jaesung Hong (Editor)Juan Eugenio Iglesias (Editor)Carole H. Sudre (Editor)Archana Venkataraman (Editor)Polina Golland (Editor)Jong Hyo Kim (Editor)Jinah Park (Editor)
- Resource Type
- Book chapter
- Publication Details
- Medical Image Computing and Computer Assisted Intervention – MICCAI 2025, pp.315-325
- Series
- Lecture Notes in Computer Science; v. 15966
- DOI
- 10.1007/978-3-032-04981-0_30
- eISSN
- 1611-3349
- ISSN
- 0302-9743
- Publisher
- Springer Nature Switzerland; Cham
- Language
- English
- Date published
- 2025
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology
- Record Identifier
- 9984964234002771
Metrics
1 Record Views