Journal article
Do Preceptors With More Rating Experience Provide More Reliable Assessments of Medical Student Performance?
Teaching and learning in medicine, Vol.24(2), pp.101-105
04/01/2012
DOI: 10.1080/10401334.2012.664497
PMID: 22490088
Abstract
Background: Although the existing psychometric literature provides guidance on the best method for acquiring a reliable clinical evaluation form (CEF)-based score, it also shows that a single CEF rating has very low reliability. Purpose: This study examines whether experience with rating students might act as a form of rater training and hence improve the quality of CEF ratings. Methods: Preceptors were divided into two groups based on rater experience. The univariate and multivariate G study designs used were simple rater (r)-nested-within-person (p) [r : p and r
○
: p
*
] models, and in the univariate analysis was applied separately to CEFs completed by high and low experienced raters. Results: The high experienced rater group yielded a substantially higher observed reliability in both the univariate and multivariate analyses. Conclusions: These results support the hypothesis that high experienced raters produce more reliable ratings of student performance and suggest methods for improving CEF ratings.
Details
- Title: Subtitle
- Do Preceptors With More Rating Experience Provide More Reliable Assessments of Medical Student Performance?
- Creators
- Kristi J Ferguson - General Internal Medicine , University of Iowa Carver College of MedicineClarence D Kreiter - Family Medicine , University of Iowa Carver College of MedicineRick D Axelson - Family Medicine , University of Iowa Carver College of Medicine
- Resource Type
- Journal article
- Publication Details
- Teaching and learning in medicine, Vol.24(2), pp.101-105
- Publisher
- Taylor & Francis Group
- DOI
- 10.1080/10401334.2012.664497
- PMID
- 22490088
- ISSN
- 1040-1334
- eISSN
- 1532-8015
- Language
- English
- Date published
- 04/01/2012
- Academic Unit
- Family and Community Medicine; General Internal Medicine; Internal Medicine
- Record Identifier
- 9984024516602771
Metrics
5 Record Views