Journal article
Certain performance values arising from mammographic test set readings correlate well with clinical audit
Journal of medical imaging and radiation oncology, Vol.59(4), pp.403-410
08/2015
DOI: 10.1111/1754-9485.12301
PMID: 25828554
Abstract
Test sets have been increasingly utilised to augment clinical audit in breast screening programmes; however, their relationship has never been satisfactorily understood. This study examined the relationship between mammographic test set performance and clinical audit data.
Clinical audit data over a 2-year period was generated for each of 20 radiologists. Sixty mammographic examinations, consisting of 40 normal and 20 cancer cases, formed the test set. Readers located any identifiable cancer, and levels of confidence were scored from 2 to 5, where a score of 3 and above is considered a recall rating. Jackknifing free response operating characteristic (JAFROC) figure-of-merit (FOM), location sensitivity and specificity were calculated for individual readers and then compared with clinical audit values using Spearman's rho.
JAFROC FOM showed significant correlations to: recall rate at a first round of screening (r = 0.51; P = 0.02); rate of small invasive cancers per 10 000 reads (r = 0.5; P = 0.02); percentage of all cancers read that were not recalled (r = -0.51; P = 0.02); and sensitivity (r = 0.51; P = 0.02). Location sensitivity demonstrated significant correlations with: rate of small invasive cancers per 10 000 reads (r = 0.46; P = 0.04); rate of DCIS (ductal carcinoma in situ) per 10 000 reads (r = 0.44; P = 0.05); detection rate of all invasive cancers and DCIS per 10 000 reads (r = 0.54; P = 0.01); percentage of all cancers read that were not recalled (r = -0.57; P = 0.009); and sensitivity (r = 0.57; P = 0.009). No other significant relationships were noted.
Performance indicators from test set demonstrate significant correlations with specific aspects of clinical performance, although caution needs to be exercised when generalising test set specificity to the clinical situation.
Details
- Title: Subtitle
- Certain performance values arising from mammographic test set readings correlate well with clinical audit
- Creators
- BaoLin Pauline Soh - Department of Diagnostic Radiology, Singapore General Hospital, SingaporeWarwick Bruce Lee - Cancer Institute NSW, Sydney, New South Wales, AustraliaClaudia Mello-Thoms - Medical Image Optimisation and Perception Group (MIOPeG), Discipline of Medical Radiation Sciences (C42), University of Sydney, Sydney, New South Wales, AustraliaKriscia Tapia - Medical Image Optimisation and Perception Group (MIOPeG), Discipline of Medical Radiation Sciences (C42), University of Sydney, Sydney, New South Wales, AustraliaJohn Ryan - Ziltron, Dublin, IrelandWai Tak Hung - Cancer Institute NSW, Sydney, New South Wales, AustraliaGraham Thompson - Cancer Institute NSW, Sydney, New South Wales, AustraliaRob Heard - Medical Image Optimisation and Perception Group (MIOPeG), Discipline of Medical Radiation Sciences (C42), University of Sydney, Sydney, New South Wales, AustraliaPatrick Brennan - Medical Image Optimisation and Perception Group (MIOPeG), Discipline of Medical Radiation Sciences (C42), University of Sydney, Sydney, New South Wales, Australia
- Resource Type
- Journal article
- Publication Details
- Journal of medical imaging and radiation oncology, Vol.59(4), pp.403-410
- Publisher
- Australia
- DOI
- 10.1111/1754-9485.12301
- PMID
- 25828554
- ISSN
- 1754-9477
- eISSN
- 1754-9485
- Grant note
- DOI: 10.13039/501100001026, name: National Breast Cancer Foundation
- Language
- English
- Date published
- 08/2015
- Academic Unit
- Roy J. Carver Department of Biomedical Engineering; Radiology
- Record Identifier
- 9984051570902771
Metrics
25 Record Views