Development of an objective scoring system for measurement of resident performance on the human patient simulator

Barbara M Scavone; Michele T Sproviero; Robert J McCarthy; Cynthia A Wong; John T Sullivan; Viva J Siddall; Leonard D Wade

doi:10.1097/00000542-200608000-00008

Back

Development of an objective scoring system for measurement of resident performance on the human patient simulator

Journal article

Peer reviewed

Development of an objective scoring system for measurement of resident performance on the human patient simulator

Barbara M Scavone, Michele T Sproviero, Robert J McCarthy, Cynthia A Wong, John T Sullivan, Viva J Siddall and Leonard D Wade

Anesthesiology (Philadelphia), Vol.105(2), pp.260-266

08/2006

DOI: 10.1097/00000542-200608000-00008

PMID: 16871059

View Online

Abstract

The decrease in the percentage of patients having cesarean delivery during general anesthesia has led some educators to advocate the increased use of simulation-based training for this anesthetic. The authors developed a scoring system to measure resident performance of this anesthetic on the human patient simulator and subjected the system to tests of validity and reliability. A modified Delphi technique was used to achieve a consensus among several experts regarding a standardized scoring system for evaluating resident performance of general anesthesia for emergency cesarean delivery on the human patient simulator. Eight third-year and eight first-year anesthesiology residents performed the scenario and were videotaped and scored by four attending obstetric anesthesiologists. Third-year residents scored an average of 150.5 points, whereas first-year residents scored an average of 128 points (P = 0.004). The scoring instrument demonstrated high interrater reliability with an intraclass correlation coefficient of 0.97 (95% confidence interval, 0.94-0.99) compared with the average score. The developed scoring tool to measure resident performance of general anesthesia for emergency cesarean delivery on the patient simulator seems both valid and reliable in the context in which it was tested. This scoring system may prove useful for future studies such as those investigating the effect of simulator training on objective assessment of resident performance.

Anesthesia, General

Patient Simulation

Reproducibility of Results

Anesthesiology - education

Humans

Factor Analysis, Statistical

Intraoperative Care - statistics & numerical data

Preoperative Care

Pregnancy

Cesarean Section

Adult

Female

Internship and Residency - standards

Intubation, Intratracheal

Anesthesia, Obstetrical

Anesthesiology - standards

Observer Variation

Details

Title: Subtitle: Development of an objective scoring system for measurement of resident performance on the human patient simulator
Creators: Barbara M Scavone - Department of Anesthesiology, Northwestern University Feinberg School of Medicine, Chicago, Illinois 60611, USA. bscavone@nmff.org
Michele T Sproviero
Robert J McCarthy
Cynthia A Wong
John T Sullivan
Viva J Siddall
Leonard D Wade
Resource Type: Journal article
Publication Details: Anesthesiology (Philadelphia), Vol.105(2), pp.260-266
DOI: 10.1097/00000542-200608000-00008
PMID: 16871059
NLM abbreviation: Anesthesiology
ISSN: 0003-3022
eISSN: 1528-1175
Publisher: United States
Language: English
Date published: 08/2006
Academic Unit: Anesthesia
Record Identifier: 9984007180102771

Metrics

25 Record Views

69 Times Cited - Web of Science