Book chapter
Predicting Radiologist Expertise from 3D Gaze Patterns During CT Interpretation
Medical Image Computing and Computer Assisted Intervention – MICCAI 2026, pp.429-439
Lecture Notes in Computer Science, v. 16896, Springer Nature Switzerland
2026
DOI: 10.1007/978-3-032-38260-3_41
Abstract
Accurate interpretation of volumetric CT requires efficient navigation of 3D image volumes and attention to diagnostically relevant regions. While eye-tracking has been widely studied in 2D medical imaging, its use for expertise assessment in CT settings remains limited. We propose a gaze-informed transformer framework for expertise classification in thoracic CT. Using a DINOv2 backbone, radiologist fixation patterns are integrated into volumetric feature learning through (1) a learnable log-space bias in self-attention and (2) gaze-weighted pooling of patch embeddings. We trained and evaluated our approach on 182 CT reading sessions from five radiologists with varying levels of experience. On a held-out test set, the model achieves an ROC-AUC of 0.91 and F1 score of 0.86, outperforming adapted methods. These findings suggest that incorporating visual search behavior into transformers may support objective, process-based expertise assessment in radiology. Code is available via https://github.com/leiluk1/GazeToSkill.
Details
- Title: Subtitle
- Predicting Radiologist Expertise from 3D Gaze Patterns During CT Interpretation
- Creators
- Leila Khaertdinova - University of CopenhagenAnna Anikina - University of CopenhagenClaudia Mello-Thoms - University of IowaBulat Ibragimov - University of Copenhagen
- Contributors
- Guang Yang (Editor)Ehsan Adeli (Editor)Marleen de Bruijne (Editor)Bartłomiej W. Papież (Editor)Stefanie Speidel (Editor)Pallavi Tiwari (Editor)Guoyan Zheng (Editor)Mohammad Yaqub (Editor)Qi Dou (Editor)Islem Rekik (Editor)
- Resource Type
- Book chapter
- Publication Details
- Medical Image Computing and Computer Assisted Intervention – MICCAI 2026, pp.429-439
- Series
- Lecture Notes in Computer Science; v. 16896
- DOI
- 10.1007/978-3-032-38260-3_41
- eISSN
- 1611-3349
- ISSN
- 0302-9743
- Publisher
- Springer Nature Switzerland; Cham
- Language
- English
- Date published
- 2026
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology
- Record Identifier
- 9985236418602771
Metrics
1 Record Views