Book chapter
Self-supervised Test-Time Adaptation for Medical Image Segmentation
Machine Learning in Clinical Neuroimaging, pp.32-41
Lecture Notes in Computer Science, Springer Nature Switzerland
10/06/2022
DOI: 10.1007/978-3-031-17899-3_4
Abstract
The performance of convolutional neural networks (CNNs) often drop when they encounter a domain shift. Recently, unsupervised domain adaptation (UDA) and domain generalization (DG) techniques have been proposed to solve this problem. However, access to source domain data is required for UDA and DG approaches, which may not always be available in practice due to data privacy. In this paper, we propose a novel test-time adaptation framework for volumetric medical image segmentation without any source domain data for adaptation and target domain data for offline training. Specifically, our proposed framework only needs pre-trained CNNs in the source domain, and the target image itself. Our method aligns the target image on both image and latent feature levels to source domain during the test-time. There are three parts in our proposed framework: (1) multi-task segmentation network (Seg), (2) autoencorders (AEs) and (3) translation network (T). Seg and AEs are pre-trained with source domain data. At test-time, the weights of these pre-trained CNNs (decoders of Seg and AEs) are fixed, and T is trained to align the target image to source domain at image-level by the autoencoders which optimize the similarity between input and reconstructed output. The encoder of Seg is also updated to increase the domain generalizability of the model towards the source domain at the feature level with self-supervised tasks. We evaluate our method on healthy controls, adult Huntington’s disease (HD) patients and pediatric Aicardi Goutières Syndrome (AGS) patients, with different scanners and MRI protocols. The results indicate that our proposed method improves the performance of CNNs in the presence of domain shift at test-time.
Details
- Title: Subtitle
- Self-supervised Test-Time Adaptation for Medical Image Segmentation
- Creators
- Hao LiHan LiuDewei HuJiacheng WangHans JohnsonOmar SherbiniFrancesco GavazziRussell D’AielloAdeline VanderverJeffrey LongJane PaulsenIpek Oguz
- Resource Type
- Book chapter
- Publication Details
- Machine Learning in Clinical Neuroimaging, pp.32-41
- Publisher
- Springer Nature Switzerland; Cham
- Series
- Lecture Notes in Computer Science
- DOI
- 10.1007/978-3-031-17899-3_4
- eISSN
- 1611-3349
- ISSN
- 0302-9743
- Language
- English
- Date published
- 10/06/2022
- Academic Unit
- Psychological and Brain Sciences; Psychiatry; The Iowa Institute for Biomedical Imaging; Electrical and Computer Engineering; Roy J. Carver Department of Biomedical Engineering; The Iowa Initiative for Artificial Intelligence; Iowa Informatics Initiative; Biostatistics
- Record Identifier
- 9984305043302771
Metrics
16 Record Views