A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performances

C D Kreiter; K Ferguson; W C Lee; R L Brennan; P Densen

doi:10.1097/00001888-199812000-00021

Back

A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performances

Journal article

Open access

Peer reviewed

A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performances

C D Kreiter, K Ferguson, W C Lee, R L Brennan and P Densen

Academic medicine, Vol.73(12), pp.1294-1298

12/1998

DOI: 10.1097/00001888-199812000-00021

PMID: 9883207

Files and links (1)

url

https://doi.org/10.1097/00001888-199812000-00021View

Published (Version of record) Open Access

Abstract

To investigate the measurement characteristics of standardized clinical evaluation forms (CEFs) used to assign grades for clerkship performance. In 1996-97, the authors reviewed 5,168 CEFs completed for 175 students in eight clerkships. Limiting their analysis to the three clerkships that produced the most CEFs, the authors conducted a generalizability study to determine the five variance components for each clerkship. A decision study then calculated the generalizability coefficients and standard errors of measurement in each clerkship for varied numbers of raters and CEF items. The generalizability study found large variance components attributable to rater and rating context. The decision study found that, when three or more raters completed CEFs for a student, the generalizability coefficient and standard error of measurement reached levels acceptable for grading. Increasing the number of items on the CEF had no significant effect. The reliability of assigning students clerkship grades based on single CEFs is unacceptably low. However, CEFs can accurately measure students' clerkship performances if completed by three or more raters.

Iowa

Reproducibility of Results

Clinical Clerkship - organization & administration

Educational Measurement - methods

Clinical Clerkship - standards

Humans

Program Evaluation - methods

Retrospective Studies

Clinical Competence - standards

Problem-Based Learning

Teaching

Details

Title: Subtitle: A generalizability study of a new standardized rating form used to evaluate students' clinical clerkship performances
Creators: C D Kreiter - Office of Consultation and Research in Medical Education, University of Iowa, Iowa City 52242-1008, USA
K Ferguson
W C Lee
R L Brennan
P Densen
Resource Type: Journal article
Publication Details: Academic medicine, Vol.73(12), pp.1294-1298
Publisher: United States
DOI: 10.1097/00001888-199812000-00021
PMID: 9883207
ISSN: 1040-2446
eISSN: 1938-808X
Language: English
Date published: 12/1998
Academic Unit: Infectious Diseases; Family and Community Medicine; General Internal Medicine; Psychological and Quantitative Foundations; Internal Medicine
Record Identifier: 9984025397202771

Metrics

21 Record Views

56 Times Cited - Web of Science