Lung2Lung: Volumetric Style Transfer with Self-Ensembling for High-Resolution Cross-Volume Computed Tomography

Muhammad F. A Chaudhary; Sarah E Gerard; Gary E Christensen; Christopher B Cooper; Joyce D Schroeder; Eric A Hoffman; Joseph M Reinhardt

Lung2Lung: Volumetric Style Transfer with Self-Ensembling for High-Resolution Cross-Volume Computed Tomography

Preprint

Open access

Lung2Lung: Volumetric Style Transfer with Self-Ensembling for High-Resolution Cross-Volume Computed Tomography

Muhammad F. A Chaudhary, Sarah E Gerard, Gary E Christensen, Christopher B Cooper, Joyce D Schroeder, Eric A Hoffman and Joseph M Reinhardt

ArXiv.org

10/05/2022

Files and links (1)

url

https://doi.org/10.48550/arXiv.2210.02625View

Published (Version of record)This preprint has not been evaluated by subject experts through peer review. Preprints may undergo extensive changes and/or become peer-reviewed journal articles. Open Access

Abstract

Chest computed tomography (CT) at inspiration is often complemented by an expiratory CT for identifying peripheral airways disease in the form of air trapping. Additionally, co-registered inspiratory-expiratory volumes are used to derive several clinically relevant measures of local lung function. Acquiring CT at different volumes, however, increases radiation dosage, acquisition time, and may not be achievable due to various complications, limiting the utility of registration-based measures, To address this, we propose Lung2Lung - a style-based generative adversarial approach for translating CT images from end-inspiratory to end-expiratory volume. Lung2Lung addresses several limitations of the traditional generative models including slicewise discontinuities, limited size of generated volumes, and their inability to model neural style at a volumetric level. We introduce multiview perceptual similarity (MEAL) to capture neural styles in 3D. To incorporate global information into the training process and refine the output of our model, we also propose self-ensembling (SE). Lung2Lung, with MEAL and SE, is able to generate large 3D volumes of size 320 x 320 x 320 that are validated using a diverse cohort of 1500 subjects with varying disease severity. The model shows superior performance against several state-of-the-art 2D and 3D generative models with a peak-signal-to-noise ratio of 24.53 dB and structural similarity of 0.904. Clinical validation shows that the synthetic volumes can be used to reliably extract several clinical endpoints of chronic obstructive pulmonary disease.

Details

Title: Subtitle: Lung2Lung: Volumetric Style Transfer with Self-Ensembling for High-Resolution Cross-Volume Computed Tomography
Creators: Muhammad F. A Chaudhary
Sarah E Gerard
Gary E Christensen
Christopher B Cooper
Joyce D Schroeder
Eric A Hoffman
Joseph M Reinhardt
Resource Type: Preprint
Publication Details: ArXiv.org
ISSN: 2331-8422
Language: English
Date posted: 10/05/2022
Academic Unit: Holden Comprehensive Cancer Center; The Iowa Institute for Biomedical Imaging; Electrical and Computer Engineering; Roy J. Carver Department of Biomedical Engineering; Advanced Pulmonary Physiomic Imaging Laboratory; Internal Medicine; Radiology; Radiation Oncology
Record Identifier: 9984305049202771

Metrics

14 Record Views