Retrospective review of the drop in observer detection performance over time in lesion-enriched experimental studies

Sian Taylor-Phillips; Markus C Elze; Elizabeth A Krupinski; Kathryn Dennick; Alastair G Gale; Aileen Clarke; Claudia Mello-Thoms

doi:10.1007/s10278-014-9717-9

Back

Retrospective review of the drop in observer detection performance over time in lesion-enriched experimental studies

Journal article

Open access

Peer reviewed

Retrospective review of the drop in observer detection performance over time in lesion-enriched experimental studies

Sian Taylor-Phillips, Markus C Elze, Elizabeth A Krupinski, Kathryn Dennick, Alastair G Gale, Aileen Clarke and Claudia Mello-Thoms

Journal of digital imaging, Vol.28(1), pp.32-40

02/2015

DOI: 10.1007/s10278-014-9717-9

PMCID: PMC4305061

PMID: 25005866

Files and links (1)

url

https://doi.org/10.1007/s10278-014-9717-9View

Published (Version of record) Open Access

Abstract

The vigilance decrement describes a decrease in sensitivity or increase in specificity with time on task. It has been observed in a variety of repetitive visual tasks, but little is known about these patterns in radiologists. We investigated whether there is systematic variation in performance over the course of a radiology reading session. We re-analyzed data from six previous lesion-enriched radiology studies. Studies featured 8-22 participants assessing 27-100 cases (including mammograms, chest CT, chest x-ray, and bone x-ray) in a reading session. Changes in performance and speed as the reading session progressed were analyzed using mixed effects models. Time taken per case decreased 9-23% as the reading session progressed (p < 0.005 for every study). There was a sensitivity decrease or specificity increase over the course of reading 100 chest x-rays (p = 0.005), 60 bone fracture x-rays (p = 0.03), and 100 chest CT scans (p < 0.0001). This effect was not found in the shorter mammography sessions with 27 or 50 cases. We found evidence supporting the hypothesis that behavior and performance may change over the course of reading an enriched test set. Further research is required to ascertain whether this effect is present in radiological practice.

Reproducibility of Results

Tomography, X-Ray Computed - standards

Humans

Mammography - standards

Radiography - standards

Sensitivity and Specificity

Arousal

Fatigue

Radiography, Thoracic - standards

Retrospective Studies

Observer Variation

Details

Title: Subtitle: Retrospective review of the drop in observer detection performance over time in lesion-enriched experimental studies
Creators: Sian Taylor-Phillips - Warwick Medical School, University of Warwick, Coventry, CV4 7AL, UK, s.taylor-phillips@warwick.ac.uk
Markus C Elze
Elizabeth A Krupinski
Kathryn Dennick
Alastair G Gale
Aileen Clarke
Claudia Mello-Thoms
Resource Type: Journal article
Publication Details: Journal of digital imaging, Vol.28(1), pp.32-40
DOI: 10.1007/s10278-014-9717-9
PMID: 25005866
PMCID: PMC4305061
NLM abbreviation: J Digit Imaging
ISSN: 0897-1889
eISSN: 1618-727X
Publisher: United States
Grant note: WMCLAHRC-2014-1 / Department of Health PDF-2011-04-073 / Department of Health
Language: English
Date published: 02/2015
Academic Unit: Roy J. Carver Department of Biomedical Engineering; Radiology
Record Identifier: 9984051561202771

Metrics

14 Record Views

19 Times Cited - Web of Science

See more details