Book chapter
Prediction of Radiological Diagnostic Errors from Eye Tracking Data Using Graph Neural Networks and Gaze-Guided Transformers
Graphs in Biomedical Image Analysis, pp.33-42
Lecture Notes in Computer Science, v. 15182, Springer Nature Switzerland
2025
DOI: 10.1007/978-3-031-83243-7_4
Abstract
The accuracy of radiological diagnostics is crucial for providing effective medical treatment, ensuring that patients receive timely and appropriate care. Despite the efforts of numerous medical studies to identify radiological errors, this has a negligible effect, and the percentage of annual errors does not decrease. To a large extent, this is explained by the constancy of human perceptual abilities. This study investigates the idea of analyzing longitudinal gaze paths of radiologists and finding consistent patterns associated with diagnostic errors. Three information sources are synergistically studied, namely target medical image, gaze fixation points, and accumulated gaze maps. Methodologically, a transformer was trained on the target image using the gaze map as the attention input. A graph neural network was developed to find the patterns in gaze fixation regions on the image and fixation statistical features. The adjacency of the graph was based on the spatial and temporal differences between fixations. The resulting framework was trained on 3949 chest radiograph readings performed by four radiologists, who on average made some decision errors in 20% of readings. The framework predicted the errors with 0.69 accuracy and 0.74 ROC AUC, which compares favorably to alternative approaches.
Details
- Title: Subtitle
- Prediction of Radiological Diagnostic Errors from Eye Tracking Data Using Graph Neural Networks and Gaze-Guided Transformers
- Creators
- Anna AnikinaReza Karimzadeh - University of CopenhagenDiliara IbragimovaTamerlan MustafaevClaudia Mello-ThomsBulat Ibragimov
- Contributors
- Seyed-Ahmad Ahmadi (Editor)Anees Kazi (Editor)
- Resource Type
- Book chapter
- Publication Details
- Graphs in Biomedical Image Analysis, pp.33-42
- Publisher
- Springer Nature Switzerland; Cham
- Series
- Lecture Notes in Computer Science; v. 15182
- DOI
- 10.1007/978-3-031-83243-7_4
- eISSN
- 1611-3349
- ISSN
- 0302-9743
- Language
- English
- Date published
- 2025
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology
- Record Identifier
- 9984795476602771
Metrics
1 Record Views