Journal article
Neuroimaging-based classification of PTSD using data-driven computational approaches: A multisite big data study from the ENIGMA-PGC PTSD consortium
NeuroImage (Orlando, Fla.), Vol.283, 120412
12/01/2023
DOI: 10.1016/j.neuroimage.2023.120412
PMCID: PMC10842116
PMID: 37858907
Abstract
•Classifying PTSD from trauma-unexposed healthy controls (HC) using three imaging modalities performed well (∼75 % AUC), but performance suffered markedly when classifying PTSD from trauma-exposed healthy controls (TEHC) using three imaging modalities (∼60 % AUC).•Using deep learning for feature reduction (denoising variational auto-encoder; DVAE) dramatically reduced the number of features with no concomitant performance degradation.•Utilizing denoising variational autoencoder (DVAE) models improves generalizability across heterogeneous multi-site data compared with the traditional machine learning frameworks.
Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group.
We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality.
We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60 % test AUC for s-MRI, 59 % for rs-fMRI and 56 % for d-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75 % AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance.
These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable.
Details
- Title: Subtitle
- Neuroimaging-based classification of PTSD using data-driven computational approaches: A multisite big data study from the ENIGMA-PGC PTSD consortium
- Creators
- Xi Zhu - Columbia University Irving Medical CenterYoojean Kim - New York Psychoanalytic Society and InstituteOrren Ravid - New York Psychoanalytic Society and InstituteXiaofu He - Columbia University Irving Medical CenterBenjamin Suarez-Jimenez - University of RochesterSigal Zilcha-Mano - University of HaifaAmit Lazarov - Tel Aviv UniversitySeonjoo Lee - New York Psychoanalytic Society and InstituteChadi G. Abdallah - Baylor College of MedicineMichael Angstadt - University of MichiganChristopher L. Averill - Baylor College of MedicineC. Lexi Baird - Duke UniversityLee A. Baugh - University of South DakotaJennifer U. Blackford - Nebraska Medical CenterJessica Bomyea - University of California San DiegoSteven E. Bruce - University of Missouri–St. LouisRichard A. Bryant - UNSW SydneyZhihong Cao - Yixing People's HospitalKyle Choi - University of California San DiegoJosh Cisler - The University of Texas at AustinAndrew S. Cotton - University of ToledoJudith K. Daniels - University of GroningenNicholas D. Davenport - Minneapolis VA Health Care SystemRichard J. Davidson - University of Wisconsin–MadisonMichael D. DeBellis - Duke UniversityEmily L. Dennis - University of UtahMaria DensmoreTerri deRoon-Cassini - Medical College of WisconsinSeth G. Disner - Minneapolis VA Health Care SystemWissam El Hage - Université de ToursAmit Etkin - Tel Aviv UniversityNegar Fani - Emory UniversityKelene A. Fercho - Civil Aerospace Medical InstituteJacklynn Fitzgerald - Marquette UniversityGina L. Forster - University of OtagoJessie L. Frijling - Amsterdam University Medical CentersElbert Geuze - Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The NetherlandsAtilla Gonenc - McLean HospitalEvan M. Gordon - Department of Radiology, Washington University School of Medicine, St. Louis, MO, USAStaci Gruber - McLean HospitalDaniel W Grupe - University of Wisconsin–MadisonJeffrey P. Guenette - Brigham and Women's HospitalCourtney C. Haswell - Duke UniversityRyan J. Herringa - University of Wisconsin–MadisonJulia Herzog - Heidelberg UniversityDavid Bernd Hofmann - University of MünsterBobak Hosseini - University of Illinois ChicagoAnna R. Hudson - Ghent UniversityAshley A. Huggins - Duke UniversityJonathan C. Ipser - University of Cape TownNeda Jahanshad - Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USAMeilin Jia-Richards - Baylor UniversityTanja Jovanovic - Wayne State UniversityMilissa L. Kaufman - McLean HospitalMitzy Kennis - Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The NetherlandsAnthony King - University of MichiganPhilipp Kinzel - Ludwig-Maximilians-Universität MünchenSaskia B.J. Koch - Radboud University NijmegenInga K. Koerte - Ludwig-Maximilians-Universität MünchenSheri M. Koopowitz - University of Cape TownMayuresh S. Korgaonkar - Westmead Institute for Medical ResearchJohn H. Krystal - Yale UniversityRuth Lanius - University of LondonChristine L. Larson - University of Wisconsin–MilwaukeeLauren A.M. Lebois - McLean HospitalGen Li - Institute of Psychology, Chinese Academy of SciencesIsrael Liberzon - Psychiatry and Behavioral Science, Texas A&M University Health Science Center, College Station, TX, USAGuang Ming Lu - Nanjing UniversityYifeng Luo - Department of Radiology, The Affiliated Yixing Hospital of Jiangsu University, Yixing, Jiangsu, ChinaVincent A. Magnotta - University of IowaAntje Manthey - Charité - Universitätsmedizin BerlinAdi Maron-Katz - Stanford UniversityGeoffery May - VA Heart of Texas Health Care NetworkKatie McLaughlin - Harvard UniversitySven C. Mueller - Ghent UniversityLaura Nawijn - Amsterdam University Medical CentersSteven M. Nelson - University of MinnesotaRichard W.J. NeufeldJack B Nitschke - University of Wisconsin–MadisonErin M. O'Leary - University of ToledoBunmi O. Olatunji - Vanderbilt UniversityMiranda Olff - Amsterdam University Medical CentersMatthew Peverill - University of WashingtonK. Luan Phan - The Ohio State UniversityRongfeng Qi - Nanjing UniversityYann Quidé - School of Psychology, University of New South Wales, Sydney, NSW, AustraliaIvan Rektor - Masaryk UniversityKerry Ressler - McLean HospitalPavel Riha - Masaryk UniversityMarisa Ross - Northwestern UniversityIsabelle M. Rosso - McLean HospitalLauren E. Salminen - Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USAKelly Sambrook - University of WashingtonChristian Schmahl - Heidelberg UniversityMartha E. Shenton - Brigham and Women's HospitalMargaret Sheridan - University of North Carolina at Chapel HillChiahao Shih - University of ToledoMaurizio Sicorello - Heidelberg University, Heidelberg, GermanyAnika Sierk - Charité - Universitätsmedizin BerlinAlan N. Simmons - VA San Diego Healthcare SystemRaluca M. Simons - University of South DakotaJeffrey S. Simons - University of South DakotaScott R. Sponheim - Minneapolis VA Health Care SystemMurray B. Stein - University of California San DiegoDan J. Stein - University of Cape TownJennifer S. Stevens - Emory UniversityThomas Straube - University of MünsterDelin Sun - Duke UniversityJean Théberge - New York Psychoanalytic Society and InstitutePaul M. Thompson - Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USASophia I. Thomopoulos - Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USANic J.A. van der Wee - Leiden University Medical CenterSteven J.A. van der Werff - Leiden University Medical CenterTheo G.M. van Erp - University of California, IrvineSanne J.H. van Rooij - Emory UniversityMirjam van Zuiden - Amsterdam University Medical CentersTim Varkevisser - Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The NetherlandsDick J. Veltman - Amsterdam University Medical CentersRobert R.J.M. Vermeiren - Leiden University Medical CenterHenrik Walter - Charité - Universitätsmedizin BerlinLi Wang - Chinese Academy of SciencesXin Wang - University of ToledoCarissa Weis - Medical College of WisconsinSherry Winternitz - McLean HospitalHong Xie - Yixing People's HospitalYe Zhu - New York Psychoanalytic Society and InstituteMelanie Wall - Columbia University Irving Medical CenterYuval Neria - Columbia University Irving Medical CenterRajendra A. Morey - Duke University
- Resource Type
- Journal article
- Publication Details
- NeuroImage (Orlando, Fla.), Vol.283, 120412
- DOI
- 10.1016/j.neuroimage.2023.120412
- PMID
- 37858907
- PMCID
- PMC10842116
- NLM abbreviation
- Neuroimage
- ISSN
- 1053-8119
- eISSN
- 1095-9572
- Publisher
- Elsevier Inc
- Grant note
- DOI: 10.13039/501100001659, name: Deutsche Forschungsgemeinschaft, award: DA 1222/4-1; DOI: 10.13039/501100001677, name: National Institute of Health and Medical Research, award: 1073041; DOI: 10.13039/100000874, name: NARSAD, award: 27040; DOI: 10.13039/100006380, name: VA RR&D, award: IK2RX002922; DOI: 10.13039/100009670, name: National Alliance for Research on Schizophrenia and Depression; DOI: 10.13039/501100000925, name: National Health and Medical Research Council; DOI: 10.13039/100000002, name: National Institutes of Health, award: AT011267, CX001600, F31MH122047, K01MH118467, K01MH122774, MH111671, R01MH117601, R61MH127005, R61NS120249, T32GM007507, T32MH018931, U54 EB020403; DOI: 10.13039/100000025, name: National Institute of Mental Health, award: MH097784, MH119132, MH129832
- Language
- English
- Date published
- 12/01/2023
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology; Psychiatry; Iowa Neuroscience Institute
- Record Identifier
- 9984500246602771
Metrics
10 Record Views