Conference proceeding
Effect of computerized decision support on diagnostic accuracy and intra-observer variability in multi-institutional observer performance study for bladder cancer treatment response assessment in CT urography
MEDICAL IMAGING 2022: COMPUTER-AIDED DIAGNOSIS, Vol.12033, pp.120330G-120330G-7
Proceedings of SPIE
01/01/2022
DOI: 10.1117/12.2611179
Abstract
We have previously developed a computerized decision support system for bladder cancer treatment response assessment (CDSS-T) in CT urography (CTU). In this work, we conducted an observer study to evaluate the diagnostic accuracy and intra-observer variability with and without the CDSS-T system. One hundred fifty-seven pre- and post-treatment lesion pairs were identified in pre- and post-chemotherapy CTU scans of 123 patients. Forty lesion pairs had T0 stage (complete response) after chemotherapy. Multi-disciplinary observers from 4 different institutions participated in reading the lesion pairs, including 5 abdominal radiologists, 4 radiology residents, 5 oncologists, 1 urologist, and 1 medical student. Each observer provided estimates of the T0 likelihood after treatment without and then with the CDSS-T aid for each lesion. To assess the intra-observer variability, 51 cases were evaluated two times - the original and the repeated evaluation. The average area under the curve (AUC) of 16 observers for estimation of T0 disease after treatment increased from 0.73 without CDSS-T to 0.77 with CDSS-T (p = 0.003). For the evaluation with CDSS-T, the average AUC performance for different institutions was similar. The performance with CDSS-T was improved significantly and the AUC standard deviations were slightly smaller showing potential trend of more accurate and uniform performance with CDSS-T. There was no significant difference between the original and repeated evaluation. This study demonstrated that our CDSS-T system has the potential to improve treatment response assessment of physicians from different specialties and institutions, and reduce the inter- and intra-observer variabilities of the assessments.
Details
- Title: Subtitle
- Effect of computerized decision support on diagnostic accuracy and intra-observer variability in multi-institutional observer performance study for bladder cancer treatment response assessment in CT urography
- Creators
- Di Sun - University of Michigan–Ann ArborLubomir M. Hadjiiski - University of Michigan–Ann ArborRohan Garje - University of IowaYousef Zakharia - University of IowaLauren Pomerantz - Pennsylvania State UniversityMonika Joshi - Pennsylvania State UniversityAjjai Alva - University of Michigan–Ann ArborHeang-Ping Chan - Univ Michigan, Dept Radiol, 1500 E Med Ctr Dr, Ann Arbor, MI 48109 USARichard Cohan - University of Michigan–Ann ArborElaine Caoili - University of Michigan–Ann ArborKenny H. Cha - Univ Michigan, Dept Radiol, 1500 E Med Ctr Dr, Ann Arbor, MI 48109 USAGalina Kirova-Nedyalkova - Tokuda HospitalMatthew S. Davenport - University of Michigan–Ann ArborPrasad R. Shankar - University of Michigan–Ann ArborIsaac R. Francis - University of Michigan–Ann ArborKimberly Shampain - University of Michigan–Ann ArborNathaniel Meyer - University of Michigan–Ann ArborDaniel Barkmeier - University of Michigan–Ann ArborSean Woolen - University of Michigan–Ann ArborPhillip L. Palmbos - University of Michigan–Ann ArborAlon Z. Weizer - University of Michigan–Ann ArborRavi K. Samala - University of Michigan–Ann ArborChuan Zhou - University of Michigan–Ann ArborMartha Matuszak - University of Michigan–Ann Arbor
- Contributors
- K Drukker (Editor)K M Iftekharuddin (Editor)
- Resource Type
- Conference proceeding
- Publication Details
- MEDICAL IMAGING 2022: COMPUTER-AIDED DIAGNOSIS, Vol.12033, pp.120330G-120330G-7
- Publisher
- Spie-Int Soc Optical Engineering
- Series
- Proceedings of SPIE
- DOI
- 10.1117/12.2611179
- ISSN
- 0277-786X
- eISSN
- 1996-756X
- Number of pages
- 7
- Grant note
- U01CA232931 / National Institutes of Health; United States Department of Health & Human Services; National Institutes of Health (NIH) - USA
- Language
- English
- Date published
- 01/01/2022
- Academic Unit
- Hematology, Oncology, and Blood & Marrow Transplantation; Internal Medicine
- Record Identifier
- 9984544624102771
Metrics
3 Record Views