Journal article
Evaluation of Lung MDCT Nodule Annotation Across Radiologists and Methods
Academic radiology, Vol.13(10), pp.1254-1265
2006
DOI: 10.1016/j.acra.2006.07.012
PMID: 16979075
Abstract
Integral to the mission of the National Institutes of Health–sponsored Lung Imaging Database Consortium is the accurate definition of the spatial location of pulmonary nodules. Because the majority of small lung nodules are not resected, a reference standard from histopathology is generally unavailable. Thus assessing the source of variability in defining the spatial location of lung nodules by expert radiologists using different software tools as an alternative form of truth is necessary.
The relative differences in performance of six radiologists each applying three annotation methods to the task of defining the spatial extent of 23 different lung nodules were evaluated. The variability of radiologists’ spatial definitions for a nodule was measured using both volumes and probability maps (p-map). Results were analyzed using a linear mixed-effects model that included nested random effects.
Across the combination of all nodules, volume and p-map model parameters were found to be significant at
P < .05 for all methods, all radiologists, and all second-order interactions except one. The radiologist and methods variables accounted for 15% and 3.5% of the total p-map variance, respectively, and 40.4% and 31.1% of the total volume variance, respectively.
Radiologists represent the major source of variance as compared with drawing tools independent of drawing metric used. Although the random noise component is larger for the p-map analysis than for volume estimation, the p-map analysis appears to have more power to detect differences in radiologist-method combinations. The standard deviation of the volume measurement task appears to be proportional to nodule volume.
Details
- Title: Subtitle
- Evaluation of Lung MDCT Nodule Annotation Across Radiologists and Methods
- Creators
- Charles R Meyer - Department of Radiology, School of Medicine, University of Michigan, 109 Zina Pitcher Place, Ann Arbor, MI 48109-2200Timothy D Johnson - Department of Biostatistics, School of Public Health, University of Michigan, 109 Zina Pitcher Place, Ann Arbor, MI 48109-2200Geoffrey McLennan - Department of Internal Medicine, School of Medicine, University of Iowa, Iowa City, IADenise R Aberle - Department of Radiological Sciences, David Geffen School of Medicine, UCLA, Los Angeles, CAElla A Kazerooni - Department of Radiology, School of Medicine, University of Michigan, 109 Zina Pitcher Place, Ann Arbor, MI 48109-2200Heber MacMahon - Department of Radiology, University of Chicago, Chicago, IllinoisBrian F Mullan - Department of Radiology, College of Medicine, University of Iowa, Iowa City, IADavid F Yankelevitz - Department of Radiology, Weill College of Medicine, New York, NYEdwin J.R van Beek - Department of Radiology, College of Medicine, University of Iowa, Iowa City, IASamuel G Armato - Department of Radiology, University of Chicago, Chicago, IllinoisMichael F McNitt-Gray - Department of Radiological Sciences, David Geffen School of Medicine, UCLA, Los Angeles, CAAnthony P Reeves - Department of Biomedical Engineering, School of EECS, Cornell University, Ithaca, NYDavid Gur - Department of Radiology, School of Medicine, University of Pittsburgh, Pittsburgh, PennsylvaniaClaudia I Henschke - Department of Radiology, Weill College of Medicine, New York, NYEric A Hoffman - Department of Radiology, College of Medicine, University of Iowa, Iowa City, IAPeyton H Bland - Department of Radiology, School of Medicine, University of Michigan, 109 Zina Pitcher Place, Ann Arbor, MI 48109-2200Gary Laderach - Department of Radiology, School of Medicine, University of Michigan, 109 Zina Pitcher Place, Ann Arbor, MI 48109-2200Richie Pais - Department of Radiological Sciences, David Geffen School of Medicine, UCLA, Los Angeles, CADavid Qing - Department of Radiological Sciences, David Geffen School of Medicine, UCLA, Los Angeles, CAChris Piker - Department of Radiology, College of Medicine, University of Iowa, Iowa City, IAJunfeng Guo - Department of Radiology, College of Medicine, University of Iowa, Iowa City, IAAdam Starkey - Department of Radiology, University of Chicago, Chicago, IllinoisDaniel Max - Department of Radiology, Weill College of Medicine, New York, NYBarbara Y Croft - Cancer Imaging Program, National Cancer Institute, National Institutes of Health, Bethesda, MDLaurence P Clarke - Cancer Imaging Program, National Cancer Institute, National Institutes of Health, Bethesda, MD
- Resource Type
- Journal article
- Publication Details
- Academic radiology, Vol.13(10), pp.1254-1265
- DOI
- 10.1016/j.acra.2006.07.012
- PMID
- 16979075
- NLM abbreviation
- Acad Radiol
- ISSN
- 1076-6332
- eISSN
- 1878-4046
- Publisher
- Elsevier Inc
- Language
- English
- Date published
- 2006
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology; Internal Medicine
- Record Identifier
- 9984051973702771
Metrics
13 Record Views